2023-10-16T14:08:04.306 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-16T14:08:04.307 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --owner scheduled_rishabh@teuthology --name rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429048 -- /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429048/orig.config.yaml 2023-10-16T14:08:04.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T14:08:04.448 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429048 branch: rishabh-2023oct13 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7429048' kernel: flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-2023oct13 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023oct13-b2 sha1: 33be745ec4531df08cd1bb70b4c9c1f89be58078 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6006 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 sleep_before_teardown: 0 subset: 402/512 suite: fs suite_branch: rishabh-2023oct13-b2 suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 33be745ec4531df08cd1bb70b4c9c1f89be58078 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLFbm9GBm0PuOVOy7gqpNI4KVYVxUv4j23Db55DLRWpftPvEn6sIuxTsSyj7oDjY/SWP93oKV2mme1EVRwNtdrM= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMHTziqB5teh/lBoPv1jHxEa7Ze7bDZZsPZSvuFJeywXK46LMBc8xATc6PAW4Srivx2tZtkFYf9CfflFypvKsME= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-16_12:17:50 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-16T14:08:04.448 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa; will attempt to use it 2023-10-16T14:08:04.449 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks 2023-10-16T14:08:04.449 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-16T14:08:04.451 INFO:teuthology.task.internal:Checking packages... 2023-10-16T14:08:04.476 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0' 2023-10-16T14:08:04.477 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-16T14:08:04.477 INFO:teuthology.packaging:ref: None 2023-10-16T14:08:04.478 INFO:teuthology.packaging:tag: None 2023-10-16T14:08:04.478 INFO:teuthology.packaging:branch: rishabh-2023oct13 2023-10-16T14:08:04.478 INFO:teuthology.packaging:sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T14:08:04.479 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-2023oct13 2023-10-16T14:08:04.717 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6730.g4ba8a190 2023-10-16T14:08:04.718 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-16T14:08:04.724 INFO:teuthology.task.internal:no buildpackages task found 2023-10-16T14:08:04.725 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-16T14:08:04.731 INFO:teuthology.task.internal:Saving configuration 2023-10-16T14:08:04.748 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-16T14:08:04.754 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T14:08:04.781 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429048', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 14:03:07.986143', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLFbm9GBm0PuOVOy7gqpNI4KVYVxUv4j23Db55DLRWpftPvEn6sIuxTsSyj7oDjY/SWP93oKV2mme1EVRwNtdrM='} 2023-10-16T14:08:04.805 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429048', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 14:03:07.984313', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMHTziqB5teh/lBoPv1jHxEa7Ze7bDZZsPZSvuFJeywXK46LMBc8xATc6PAW4Srivx2tZtkFYf9CfflFypvKsME='} 2023-10-16T14:08:04.805 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-16T14:08:04.812 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-16T14:08:04.813 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-16T14:08:04.813 INFO:teuthology.run_tasks:Running task console_log... 2023-10-16T14:08:04.885 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6b15c81a60>, signals=[15]) 2023-10-16T14:08:04.886 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-16T14:08:04.892 INFO:teuthology.task.internal:Opening connections... 2023-10-16T14:08:04.893 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2023-10-16T14:08:04.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T14:08:04.998 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2023-10-16T14:08:04.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T14:08:05.085 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-16T14:08:05.092 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2023-10-16T14:08:05.111 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2023-10-16T14:08:05.111 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-10-16T14:08:05.169 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2023-10-16T14:08:05.169 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2023-10-16T14:08:05.169 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2023-10-16T14:08:05.170 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2023-10-16T14:08:05.170 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2023-10-16T14:08:05.170 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2023-10-16T14:08:05.170 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-16T14:08:05.171 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-10-16T14:08:05.171 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2023-10-16T14:08:05.171 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-16T14:08:05.171 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2023-10-16T14:08:05.171 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T14:08:05.172 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-16T14:08:05.172 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-16T14:08:05.173 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-10-16T14:08:05.204 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-10-16T14:08:05.221 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-10-16T14:08:05.221 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-10-16T14:08:05.278 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2023-10-16T14:08:05.278 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9" 2023-10-16T14:08:05.279 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2023-10-16T14:08:05.279 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2023-10-16T14:08:05.279 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9" 2023-10-16T14:08:05.279 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9" 2023-10-16T14:08:05.280 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-16T14:08:05.280 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-10-16T14:08:05.280 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon" 2023-10-16T14:08:05.280 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-16T14:08:05.280 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2023-10-16T14:08:05.281 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T14:08:05.281 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-16T14:08:05.281 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-16T14:08:05.281 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-10-16T14:08:05.312 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-16T14:08:05.321 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-16T14:08:05.326 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-16T14:08:05.327 DEBUG:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2023-10-16T14:08:05.330 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2023-10-16T14:08:05.346 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-16T14:08:05.352 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-16T14:08:05.352 DEBUG:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2023-10-16T14:08:05.387 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2023-10-16T14:08:05.413 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-16T14:08:05.471 INFO:teuthology.run_tasks:Running task kernel... 2023-10-16T14:08:05.488 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-16T14:08:05.489 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, timeout 300 2023-10-16T14:08:05.489 DEBUG:teuthology.orchestra.run.smithi059:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T14:08:05.490 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-16T14:08:05.505 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T14:08:05.506 DEBUG:teuthology.task.kernel:sha1 for mon.b is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T14:08:05.506 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-16T14:08:05.507 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2023-10-16T14:08:05.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T14:08:05.508 DEBUG:teuthology.task.kernel:sha1 for mon.a is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T14:08:05.508 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-16T14:08:05.509 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2023-10-16T14:08:05.563 INFO:teuthology.orchestra.run.smithi151.stdout:5.14.0-361.el9.x86_64 2023-10-16T14:08:05.563 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T14:08:05.564 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-16T14:08:05.564 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T14:08:05.568 INFO:teuthology.orchestra.run.smithi059.stdout:5.14.0-361.el9.x86_64 2023-10-16T14:08:05.568 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T14:08:05.569 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-16T14:08:05.569 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T14:08:05.786 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum upgrade -y linux-firmware 2023-10-16T14:08:05.789 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum upgrade -y linux-firmware 2023-10-16T14:08:08.467 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - AppStream 6.7 MB/s | 6.3 MB 00:00 2023-10-16T14:08:08.476 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS-9 - AppStream 5.8 MB/s | 6.3 MB 00:01 2023-10-16T14:08:10.609 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS-9 - BaseOS 1.9 MB/s | 2.0 MB 00:01 2023-10-16T14:08:10.735 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - BaseOS 1.5 MB/s | 2.0 MB 00:01 2023-10-16T14:08:11.392 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 7.9 MB 00:00 2023-10-16T14:08:13.192 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - AppStream 24 MB/s | 18 MB 00:00 2023-10-16T14:08:17.510 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - CRB 6.7 MB/s | 5.7 MB 00:00 2023-10-16T14:08:18.986 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 14 kB 00:00 2023-10-16T14:08:20.373 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 15 MB/s | 19 MB 00:01 2023-10-16T14:08:25.104 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2023-10-16T14:08:27.369 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2023-10-16T14:08:27.381 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2023-10-16T14:08:27.381 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2023-10-16T14:08:27.382 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2023-10-16T14:08:27.382 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2023-10-16T14:08:27.382 INFO:teuthology.orchestra.run.smithi059.stdout: linux-firmware noarch 20230926-140.el9 CentOS-BaseOS 326 M 2023-10-16T14:08:27.382 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:08:27.383 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2023-10-16T14:08:27.383 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2023-10-16T14:08:27.383 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 1 Package 2023-10-16T14:08:27.383 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:08:27.383 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 326 M 2023-10-16T14:08:27.384 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2023-10-16T14:08:35.130 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 333 kB/s | 7.9 MB 00:24 2023-10-16T14:08:35.913 INFO:teuthology.orchestra.run.smithi059.stdout:linux-firmware-20230926-140.el9.noarch.rpm 38 MB/s | 326 MB 00:08 2023-10-16T14:08:35.914 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2023-10-16T14:08:35.915 INFO:teuthology.orchestra.run.smithi059.stdout:Total 38 MB/s | 326 MB 00:08 2023-10-16T14:08:35.915 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2023-10-16T14:08:36.020 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2023-10-16T14:08:36.021 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2023-10-16T14:08:37.081 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 19 MB/s | 18 MB 00:00 2023-10-16T14:08:38.197 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2023-10-16T14:08:38.198 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2023-10-16T14:08:41.648 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 5.7 MB 00:01 2023-10-16T14:08:42.991 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 14 kB 00:00 2023-10-16T14:08:44.017 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2023-10-16T14:08:44.485 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-16T14:08:44.571 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-16T14:08:44.920 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 10 MB/s | 19 MB 00:01 2023-10-16T14:08:45.556 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-10-16T14:08:45.556 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-16T14:08:45.944 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-16T14:08:45.944 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:08:45.945 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2023-10-16T14:08:45.945 INFO:teuthology.orchestra.run.smithi059.stdout: linux-firmware-20230926-140.el9.noarch 2023-10-16T14:08:45.945 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:08:45.945 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2023-10-16T14:08:46.226 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.a... 2023-10-16T14:08:46.228 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T14:08:46.481 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ 2023-10-16T14:08:46.481 DEBUG:teuthology.orchestra.run.smithi059:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ --input-file=- 2023-10-16T14:08:46.484 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi059.front.sepia.ceph.com to complete... 2023-10-16T14:08:49.409 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2023-10-16T14:08:51.620 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-16T14:08:51.628 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-16T14:08:51.628 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-10-16T14:08:51.628 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-16T14:08:51.628 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2023-10-16T14:08:51.628 INFO:teuthology.orchestra.run.smithi151.stdout: linux-firmware noarch 20230926-140.el9 CentOS-BaseOS 326 M 2023-10-16T14:08:51.629 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:08:51.629 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-16T14:08:51.629 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-10-16T14:08:51.629 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 1 Package 2023-10-16T14:08:51.630 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:08:51.631 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 326 M 2023-10-16T14:08:51.631 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-16T14:08:58.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16 14:08:58 URL:https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm [320683515/320683515] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-16T14:08:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:FINISHED --2023-10-16 14:08:58-- 2023-10-16T14:08:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:Total wall clock time: 12s 2023-10-16T14:08:58.210 INFO:teuthology.orchestra.run.smithi059.stderr:Downloaded: 1 files, 306M in 11s (27.0 MB/s) 2023-10-16T14:08:58.211 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.a... 2023-10-16T14:08:58.212 DEBUG:teuthology.orchestra.run.smithi059:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-16T14:09:00.148 INFO:teuthology.orchestra.run.smithi059.stdout:Verifying... ######################################## 2023-10-16T14:09:00.206 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing... ######################################## 2023-10-16T14:09:00.290 INFO:teuthology.orchestra.run.smithi059.stdout:Updating / installing... 2023-10-16T14:09:00.742 INFO:teuthology.orchestra.run.smithi151.stdout:linux-firmware-20230926-140.el9.noarch.rpm 36 MB/s | 326 MB 00:09 2023-10-16T14:09:00.743 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-16T14:09:00.744 INFO:teuthology.orchestra.run.smithi151.stdout:Total 36 MB/s | 326 MB 00:09 2023-10-16T14:09:00.744 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-16T14:09:00.838 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-16T14:09:00.839 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-16T14:09:02.989 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-16T14:09:02.990 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-16T14:09:07.702 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-6.6.0_rc5_g47672119149b-1 ######################################## 2023-10-16T14:09:08.720 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-16T14:09:09.083 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-16T14:09:09.165 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-16T14:09:10.187 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-10-16T14:09:10.188 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-16T14:09:10.568 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-16T14:09:10.568 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:09:10.568 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2023-10-16T14:09:10.569 INFO:teuthology.orchestra.run.smithi151.stdout: linux-firmware-20230926-140.el9.noarch 2023-10-16T14:09:10.569 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:09:10.569 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-16T14:09:10.840 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.b... 2023-10-16T14:09:10.840 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-16T14:09:10.989 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ 2023-10-16T14:09:10.990 DEBUG:teuthology.orchestra.run.smithi151:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ --input-file=- 2023-10-16T14:09:10.992 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi151.front.sepia.ceph.com to complete... 2023-10-16T14:09:22.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16 14:09:22 URL:https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm [320683515/320683515] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-16T14:09:22.073 INFO:teuthology.orchestra.run.smithi151.stderr:FINISHED --2023-10-16 14:09:22-- 2023-10-16T14:09:22.073 INFO:teuthology.orchestra.run.smithi151.stderr:Total wall clock time: 11s 2023-10-16T14:09:22.074 INFO:teuthology.orchestra.run.smithi151.stderr:Downloaded: 1 files, 306M in 11s (28.6 MB/s) 2023-10-16T14:09:22.075 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.b... 2023-10-16T14:09:22.075 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-16T14:09:22.316 INFO:teuthology.orchestra.run.smithi059.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-16T14:09:23.950 INFO:teuthology.orchestra.run.smithi151.stdout:Verifying... ######################################## 2023-10-16T14:09:24.069 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing... ######################################## 2023-10-16T14:09:24.148 INFO:teuthology.orchestra.run.smithi151.stdout:Updating / installing... 2023-10-16T14:09:31.296 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-6.6.0_rc5_g47672119149b-1 ######################################## 2023-10-16T14:09:44.235 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi059.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-16T14:09:44.236 DEBUG:teuthology.orchestra.run.smithi059:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-16T14:09:44.301 INFO:teuthology.orchestra.run.smithi059.stdout:/boot/System.map-6.6.0-rc5-g47672119149b 2023-10-16T14:09:44.301 INFO:teuthology.orchestra.run.smithi059.stdout:/boot/config-6.6.0-rc5-g47672119149b 2023-10-16T14:09:44.301 INFO:teuthology.orchestra.run.smithi059.stdout:/boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-16T14:09:44.302 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b 2023-10-16T14:09:44.302 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel 2023-10-16T14:09:44.302 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch 2023-10-16T14:09:44.302 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86 2023-10-16T14:09:44.302 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto 2023-10-16T14:09:44.303 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-16T14:09:44.303 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-16T14:09:44.303 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-16T14:09:44.303 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-16T14:09:44.303 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-16T14:09:44.304 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-16T14:09:44.304 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-16T14:09:44.304 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-16T14:09:44.304 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-16T14:09:44.304 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-16T14:09:44.305 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-16T14:09:44.305 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-16T14:09:44.305 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-16T14:09:44.305 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-16T14:09:44.305 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-16T14:09:44.305 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-16T14:09:44.306 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-16T14:09:44.306 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-16T14:09:44.306 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-16T14:09:44.306 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-16T14:09:44.306 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel 2023-10-16T14:09:44.307 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu 2023-10-16T14:09:44.307 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce 2023-10-16T14:09:44.307 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-16T14:09:44.307 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm 2023-10-16T14:09:44.307 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-16T14:09:44.308 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-16T14:09:44.308 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-16T14:09:44.308 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto 2023-10-16T14:09:44.308 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-16T14:09:44.308 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-16T14:09:44.309 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-16T14:09:44.309 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx 2023-10-16T14:09:44.309 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-16T14:09:44.309 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-16T14:09:44.309 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-16T14:09:44.309 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-16T14:09:44.310 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-16T14:09:44.310 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-16T14:09:44.310 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-16T14:09:44.310 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-16T14:09:44.310 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-16T14:09:44.311 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-16T14:09:44.311 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-16T14:09:44.311 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-16T14:09:44.311 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-16T14:09:44.311 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-16T14:09:44.312 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-16T14:09:44.312 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-16T14:09:44.312 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-16T14:09:44.312 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-16T14:09:44.312 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-16T14:09:44.313 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-16T14:09:44.313 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-16T14:09:44.313 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-16T14:09:44.313 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-16T14:09:44.313 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-16T14:09:44.313 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-16T14:09:44.314 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-16T14:09:44.314 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-16T14:09:44.314 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-16T14:09:44.314 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-16T14:09:44.314 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-16T14:09:44.315 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-16T14:09:44.315 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-16T14:09:44.315 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-16T14:09:44.315 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-16T14:09:44.315 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-16T14:09:44.316 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-16T14:09:44.316 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-16T14:09:44.316 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-16T14:09:44.316 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-16T14:09:44.316 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-16T14:09:44.316 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-16T14:09:44.317 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-16T14:09:44.317 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-16T14:09:44.317 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-16T14:09:44.317 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-16T14:09:44.317 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers 2023-10-16T14:09:44.318 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi 2023-10-16T14:09:44.318 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-16T14:09:44.318 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-16T14:09:44.318 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/custom_method.ko 2023-10-16T14:09:44.318 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-16T14:09:44.319 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-16T14:09:44.319 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-16T14:09:44.319 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-16T14:09:44.319 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-16T14:09:44.319 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata 2023-10-16T14:09:44.320 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-16T14:09:44.320 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-16T14:09:44.320 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ata_generic.ko 2023-10-16T14:09:44.320 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-16T14:09:44.320 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-16T14:09:44.321 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-16T14:09:44.321 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-16T14:09:44.321 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-16T14:09:44.321 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-16T14:09:44.321 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-16T14:09:44.322 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-16T14:09:44.322 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-16T14:09:44.322 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-16T14:09:44.322 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-16T14:09:44.322 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-16T14:09:44.322 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-16T14:09:44.323 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-16T14:09:44.323 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-16T14:09:44.323 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-16T14:09:44.323 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-16T14:09:44.323 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-16T14:09:44.324 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-16T14:09:44.324 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-16T14:09:44.324 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-16T14:09:44.324 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-16T14:09:44.324 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-16T14:09:44.325 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-16T14:09:44.325 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-16T14:09:44.325 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-16T14:09:44.325 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-16T14:09:44.325 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-16T14:09:44.326 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-16T14:09:44.326 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-16T14:09:44.326 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-16T14:09:44.326 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-16T14:09:44.326 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-16T14:09:44.327 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-16T14:09:44.327 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-16T14:09:44.327 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sis.ko 2023-10-16T14:09:44.327 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-16T14:09:44.327 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-16T14:09:44.327 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-16T14:09:44.328 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-16T14:09:44.328 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-16T14:09:44.328 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-16T14:09:44.328 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-16T14:09:44.328 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-16T14:09:44.329 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-16T14:09:44.329 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-16T14:09:44.329 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-16T14:09:44.329 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-16T14:09:44.329 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-16T14:09:44.329 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-16T14:09:44.330 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-16T14:09:44.330 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-16T14:09:44.330 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-16T14:09:44.330 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay 2023-10-16T14:09:44.330 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-16T14:09:44.331 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base 2023-10-16T14:09:44.331 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap 2023-10-16T14:09:44.331 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-16T14:09:44.331 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-16T14:09:44.331 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma 2023-10-16T14:09:44.332 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-16T14:09:44.332 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block 2023-10-16T14:09:44.332 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe 2023-10-16T14:09:44.332 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-16T14:09:44.332 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/brd.ko 2023-10-16T14:09:44.333 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd 2023-10-16T14:09:44.333 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-16T14:09:44.333 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-16T14:09:44.333 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/loop.ko 2023-10-16T14:09:44.333 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx 2023-10-16T14:09:44.334 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-16T14:09:44.334 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-16T14:09:44.334 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk 2023-10-16T14:09:44.334 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-16T14:09:44.334 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-16T14:09:44.335 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-16T14:09:44.335 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/virtio_blk.ko 2023-10-16T14:09:44.335 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback 2023-10-16T14:09:44.335 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-16T14:09:44.335 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkfront.ko 2023-10-16T14:09:44.335 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram 2023-10-16T14:09:44.336 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-16T14:09:44.336 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char 2023-10-16T14:09:44.336 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-16T14:09:44.336 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random 2023-10-16T14:09:44.336 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-16T14:09:44.337 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-16T14:09:44.337 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-16T14:09:44.337 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-16T14:09:44.337 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-16T14:09:44.337 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi 2023-10-16T14:09:44.338 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-16T14:09:44.338 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-16T14:09:44.338 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-16T14:09:44.338 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-16T14:09:44.338 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-16T14:09:44.339 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-16T14:09:44.339 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-16T14:09:44.339 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave 2023-10-16T14:09:44.339 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-16T14:09:44.339 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-16T14:09:44.340 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-16T14:09:44.340 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm 2023-10-16T14:09:44.340 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm.ko 2023-10-16T14:09:44.340 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-16T14:09:44.340 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-16T14:09:44.341 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-16T14:09:44.341 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-16T14:09:44.341 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-16T14:09:44.341 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/uv_mmtimer.ko 2023-10-16T14:09:44.341 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/virtio_console.ko 2023-10-16T14:09:44.342 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq 2023-10-16T14:09:44.342 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-16T14:09:44.342 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-16T14:09:44.342 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-16T14:09:44.342 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-16T14:09:44.343 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-16T14:09:44.343 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-16T14:09:44.343 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto 2023-10-16T14:09:44.343 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp 2023-10-16T14:09:44.343 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-16T14:09:44.345 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-16T14:09:44.345 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel 2023-10-16T14:09:44.345 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat 2023-10-16T14:09:44.346 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-16T14:09:44.346 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-16T14:09:44.346 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-16T14:09:44.346 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-16T14:09:44.346 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-16T14:09:44.347 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-16T14:09:44.347 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio 2023-10-16T14:09:44.347 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-16T14:09:44.347 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca 2023-10-16T14:09:44.347 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-16T14:09:44.348 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq 2023-10-16T14:09:44.348 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-16T14:09:44.348 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma 2023-10-16T14:09:44.348 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw 2023-10-16T14:09:44.348 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-16T14:09:44.349 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat 2023-10-16T14:09:44.349 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-16T14:09:44.349 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac 2023-10-16T14:09:44.349 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-16T14:09:44.349 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-16T14:09:44.350 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-16T14:09:44.350 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-16T14:09:44.350 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-16T14:09:44.350 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-16T14:09:44.350 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-16T14:09:44.351 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-16T14:09:44.351 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-16T14:09:44.351 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-16T14:09:44.351 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-16T14:09:44.351 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-16T14:09:44.352 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-16T14:09:44.352 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware 2023-10-16T14:09:44.352 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/edd.ko 2023-10-16T14:09:44.352 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-16T14:09:44.352 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio 2023-10-16T14:09:44.352 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-16T14:09:44.353 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-16T14:09:44.353 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid 2023-10-16T14:09:44.353 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-16T14:09:44.353 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-16T14:09:44.353 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-16T14:09:44.354 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-16T14:09:44.354 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-16T14:09:44.354 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-16T14:09:44.354 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-16T14:09:44.354 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-16T14:09:44.355 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-16T14:09:44.355 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-16T14:09:44.355 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-16T14:09:44.355 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-16T14:09:44.355 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-16T14:09:44.356 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-16T14:09:44.356 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-16T14:09:44.356 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-16T14:09:44.356 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-16T14:09:44.356 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-16T14:09:44.356 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-16T14:09:44.357 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-16T14:09:44.357 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-16T14:09:44.357 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-16T14:09:44.357 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-16T14:09:44.357 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-16T14:09:44.358 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-16T14:09:44.358 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-16T14:09:44.358 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-16T14:09:44.358 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-16T14:09:44.358 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-16T14:09:44.359 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-16T14:09:44.359 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-16T14:09:44.359 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-16T14:09:44.359 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-16T14:09:44.359 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-16T14:09:44.360 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-16T14:09:44.360 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-16T14:09:44.360 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-16T14:09:44.360 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-16T14:09:44.360 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-16T14:09:44.361 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-16T14:09:44.361 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-16T14:09:44.361 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-16T14:09:44.361 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-16T14:09:44.361 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-16T14:09:44.361 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-16T14:09:44.362 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-16T14:09:44.362 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-16T14:09:44.362 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-16T14:09:44.362 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-16T14:09:44.362 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-16T14:09:44.363 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-16T14:09:44.363 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-16T14:09:44.363 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-16T14:09:44.363 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-16T14:09:44.363 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-16T14:09:44.364 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-16T14:09:44.364 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-16T14:09:44.364 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-16T14:09:44.364 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-16T14:09:44.364 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-16T14:09:44.365 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-16T14:09:44.365 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-16T14:09:44.365 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-16T14:09:44.365 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-16T14:09:44.365 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv 2023-10-16T14:09:44.365 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-16T14:09:44.366 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-16T14:09:44.366 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-16T14:09:44.366 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon 2023-10-16T14:09:44.366 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-16T14:09:44.366 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-16T14:09:44.367 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-16T14:09:44.367 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-16T14:09:44.367 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-16T14:09:44.367 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-16T14:09:44.367 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-16T14:09:44.368 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-16T14:09:44.368 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-16T14:09:44.368 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-16T14:09:44.368 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-16T14:09:44.368 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-16T14:09:44.369 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-16T14:09:44.369 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-16T14:09:44.369 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-16T14:09:44.369 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-16T14:09:44.369 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-16T14:09:44.369 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-16T14:09:44.370 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-16T14:09:44.370 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-16T14:09:44.370 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-16T14:09:44.370 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-16T14:09:44.370 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-16T14:09:44.371 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-16T14:09:44.371 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-16T14:09:44.371 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-16T14:09:44.371 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-16T14:09:44.372 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-16T14:09:44.372 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-16T14:09:44.372 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-16T14:09:44.372 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-16T14:09:44.372 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-16T14:09:44.372 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-16T14:09:44.373 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-16T14:09:44.373 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-16T14:09:44.373 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-16T14:09:44.373 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-16T14:09:44.373 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-16T14:09:44.374 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-16T14:09:44.374 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-16T14:09:44.374 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-16T14:09:44.374 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-16T14:09:44.374 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-16T14:09:44.375 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-16T14:09:44.375 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-16T14:09:44.375 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-16T14:09:44.375 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-16T14:09:44.375 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-16T14:09:44.375 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-16T14:09:44.376 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-16T14:09:44.376 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-16T14:09:44.376 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-16T14:09:44.376 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-16T14:09:44.376 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-16T14:09:44.377 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-16T14:09:44.377 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-16T14:09:44.377 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-16T14:09:44.377 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-16T14:09:44.377 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-16T14:09:44.378 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-16T14:09:44.378 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-16T14:09:44.378 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-16T14:09:44.378 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-16T14:09:44.378 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-16T14:09:44.379 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-16T14:09:44.379 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-16T14:09:44.379 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-16T14:09:44.379 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-16T14:09:44.379 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-16T14:09:44.379 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-16T14:09:44.380 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-16T14:09:44.380 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-16T14:09:44.380 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-16T14:09:44.380 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-16T14:09:44.380 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-16T14:09:44.381 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-16T14:09:44.381 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-16T14:09:44.381 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-16T14:09:44.381 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-16T14:09:44.381 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-16T14:09:44.382 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-16T14:09:44.382 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-16T14:09:44.382 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-16T14:09:44.382 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-16T14:09:44.382 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-16T14:09:44.383 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-16T14:09:44.383 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-16T14:09:44.383 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-16T14:09:44.383 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus 2023-10-16T14:09:44.383 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-16T14:09:44.384 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-16T14:09:44.384 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-16T14:09:44.384 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-16T14:09:44.384 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-16T14:09:44.384 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-16T14:09:44.384 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-16T14:09:44.385 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-16T14:09:44.385 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-16T14:09:44.385 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-16T14:09:44.385 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-16T14:09:44.385 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-16T14:09:44.386 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-16T14:09:44.386 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-16T14:09:44.386 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-16T14:09:44.386 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-16T14:09:44.386 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-16T14:09:44.387 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-16T14:09:44.387 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-16T14:09:44.387 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-16T14:09:44.387 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-16T14:09:44.387 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-16T14:09:44.388 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-16T14:09:44.388 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-16T14:09:44.388 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-16T14:09:44.388 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-16T14:09:44.389 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-16T14:09:44.389 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-16T14:09:44.389 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-16T14:09:44.389 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-16T14:09:44.390 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-16T14:09:44.390 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-16T14:09:44.390 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-16T14:09:44.390 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-16T14:09:44.390 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-16T14:09:44.391 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-16T14:09:44.391 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-16T14:09:44.391 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-16T14:09:44.391 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-16T14:09:44.391 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-16T14:09:44.392 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-16T14:09:44.392 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c 2023-10-16T14:09:44.392 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos 2023-10-16T14:09:44.392 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-16T14:09:44.392 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-16T14:09:44.392 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses 2023-10-16T14:09:44.393 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-16T14:09:44.393 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-16T14:09:44.393 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-16T14:09:44.393 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-16T14:09:44.393 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-16T14:09:44.394 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-16T14:09:44.394 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-16T14:09:44.394 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-16T14:09:44.394 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-16T14:09:44.394 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-16T14:09:44.395 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-16T14:09:44.395 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-16T14:09:44.395 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-16T14:09:44.395 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-16T14:09:44.395 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-16T14:09:44.396 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-16T14:09:44.396 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-16T14:09:44.396 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-16T14:09:44.396 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-16T14:09:44.396 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-16T14:09:44.396 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-16T14:09:44.397 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-16T14:09:44.397 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-16T14:09:44.397 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-dev.ko 2023-10-16T14:09:44.397 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-16T14:09:44.397 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-16T14:09:44.398 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-16T14:09:44.398 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-16T14:09:44.398 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband 2023-10-16T14:09:44.398 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core 2023-10-16T14:09:44.398 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-16T14:09:44.399 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-16T14:09:44.399 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-16T14:09:44.399 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-16T14:09:44.399 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-16T14:09:44.399 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-16T14:09:44.399 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-16T14:09:44.400 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw 2023-10-16T14:09:44.400 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4 2023-10-16T14:09:44.400 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-16T14:09:44.400 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4 2023-10-16T14:09:44.400 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-16T14:09:44.401 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5 2023-10-16T14:09:44.401 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-16T14:09:44.401 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca 2023-10-16T14:09:44.401 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-16T14:09:44.401 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp 2023-10-16T14:09:44.402 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib 2023-10-16T14:09:44.402 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-16T14:09:44.402 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser 2023-10-16T14:09:44.402 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-16T14:09:44.402 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert 2023-10-16T14:09:44.403 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-16T14:09:44.403 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp 2023-10-16T14:09:44.403 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-16T14:09:44.403 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt 2023-10-16T14:09:44.403 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-16T14:09:44.404 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input 2023-10-16T14:09:44.404 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport 2023-10-16T14:09:44.404 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-16T14:09:44.404 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-16T14:09:44.404 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-16T14:09:44.405 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-16T14:09:44.405 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard 2023-10-16T14:09:44.405 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-16T14:09:44.405 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse 2023-10-16T14:09:44.405 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-16T14:09:44.405 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-16T14:09:44.406 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-16T14:09:44.406 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-16T14:09:44.406 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-16T14:09:44.406 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-16T14:09:44.406 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-16T14:09:44.407 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-16T14:09:44.407 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4 2023-10-16T14:09:44.407 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-16T14:09:44.407 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio 2023-10-16T14:09:44.407 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-16T14:09:44.408 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-16T14:09:44.408 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-16T14:09:44.408 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-16T14:09:44.408 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-16T14:09:44.408 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu 2023-10-16T14:09:44.409 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd 2023-10-16T14:09:44.409 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-16T14:09:44.409 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds 2023-10-16T14:09:44.409 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-16T14:09:44.409 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-16T14:09:44.409 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-16T14:09:44.410 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-16T14:09:44.410 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger 2023-10-16T14:09:44.410 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-16T14:09:44.410 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-16T14:09:44.410 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-16T14:09:44.411 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-16T14:09:44.411 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-16T14:09:44.411 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-16T14:09:44.411 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-16T14:09:44.411 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-16T14:09:44.412 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md 2023-10-16T14:09:44.412 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache 2023-10-16T14:09:44.412 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-16T14:09:44.412 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-16T14:09:44.412 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-16T14:09:44.413 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-16T14:09:44.413 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-16T14:09:44.413 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-16T14:09:44.413 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-16T14:09:44.413 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-16T14:09:44.413 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-16T14:09:44.414 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-16T14:09:44.414 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-16T14:09:44.414 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-16T14:09:44.414 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-16T14:09:44.414 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-16T14:09:44.415 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-16T14:09:44.415 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-16T14:09:44.415 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-16T14:09:44.415 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-16T14:09:44.415 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-16T14:09:44.416 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data 2023-10-16T14:09:44.416 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-16T14:09:44.416 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-16T14:09:44.416 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-16T14:09:44.416 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-16T14:09:44.417 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-16T14:09:44.417 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message 2023-10-16T14:09:44.417 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion 2023-10-16T14:09:44.417 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-16T14:09:44.417 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-16T14:09:44.418 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-16T14:09:44.418 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-16T14:09:44.418 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-16T14:09:44.418 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-16T14:09:44.418 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-16T14:09:44.418 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd 2023-10-16T14:09:44.419 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-16T14:09:44.419 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-16T14:09:44.419 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mfd-core.ko 2023-10-16T14:09:44.419 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-16T14:09:44.419 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-16T14:09:44.420 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-16T14:09:44.420 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-16T14:09:44.420 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc 2023-10-16T14:09:44.420 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl 2023-10-16T14:09:44.420 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-16T14:09:44.421 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-16T14:09:44.421 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-16T14:09:44.421 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-16T14:09:44.421 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710 2023-10-16T14:09:44.421 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-16T14:09:44.422 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom 2023-10-16T14:09:44.422 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-16T14:09:44.422 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-16T14:09:44.422 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-16T14:09:44.422 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-16T14:09:44.423 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-16T14:09:44.423 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-16T14:09:44.423 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-16T14:09:44.423 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-16T14:09:44.423 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d 2023-10-16T14:09:44.423 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-16T14:09:44.424 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-16T14:09:44.424 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei 2023-10-16T14:09:44.424 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-16T14:09:44.424 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-16T14:09:44.424 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-16T14:09:44.425 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru 2023-10-16T14:09:44.425 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-16T14:09:44.425 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp 2023-10-16T14:09:44.425 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-16T14:09:44.425 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-16T14:09:44.426 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-16T14:09:44.426 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-16T14:09:44.426 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-16T14:09:44.426 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-16T14:09:44.426 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-16T14:09:44.427 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci 2023-10-16T14:09:44.427 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-16T14:09:44.427 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net 2023-10-16T14:09:44.427 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding 2023-10-16T14:09:44.427 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-16T14:09:44.427 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa 2023-10-16T14:09:44.428 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53 2023-10-16T14:09:44.428 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-16T14:09:44.428 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-16T14:09:44.428 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-16T14:09:44.428 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-16T14:09:44.429 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-16T14:09:44.429 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-16T14:09:44.429 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-16T14:09:44.429 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet 2023-10-16T14:09:44.429 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com 2023-10-16T14:09:44.430 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-16T14:09:44.430 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-16T14:09:44.430 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-16T14:09:44.430 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-16T14:09:44.430 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390 2023-10-16T14:09:44.431 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-16T14:09:44.431 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-16T14:09:44.431 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-16T14:09:44.431 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-16T14:09:44.431 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec 2023-10-16T14:09:44.432 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-16T14:09:44.432 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere 2023-10-16T14:09:44.432 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-16T14:09:44.432 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon 2023-10-16T14:09:44.432 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-16T14:09:44.432 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera 2023-10-16T14:09:44.433 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-16T14:09:44.433 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd 2023-10-16T14:09:44.433 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-16T14:09:44.433 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-16T14:09:44.433 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-16T14:09:44.434 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros 2023-10-16T14:09:44.434 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx 2023-10-16T14:09:44.434 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-16T14:09:44.434 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-16T14:09:44.434 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-16T14:09:44.435 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-16T14:09:44.435 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-16T14:09:44.435 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-16T14:09:44.435 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-16T14:09:44.435 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-16T14:09:44.435 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom 2023-10-16T14:09:44.436 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-16T14:09:44.436 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-16T14:09:44.436 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-16T14:09:44.436 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-16T14:09:44.436 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-16T14:09:44.437 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-16T14:09:44.437 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-16T14:09:44.437 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-16T14:09:44.437 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade 2023-10-16T14:09:44.437 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna 2023-10-16T14:09:44.438 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-16T14:09:44.438 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio 2023-10-16T14:09:44.438 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-16T14:09:44.438 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-16T14:09:44.438 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-16T14:09:44.439 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-16T14:09:44.439 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-16T14:09:44.439 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-16T14:09:44.439 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-16T14:09:44.439 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-16T14:09:44.439 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-16T14:09:44.440 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-16T14:09:44.440 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco 2023-10-16T14:09:44.440 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic 2023-10-16T14:09:44.440 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-16T14:09:44.440 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec 2023-10-16T14:09:44.441 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip 2023-10-16T14:09:44.441 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-16T14:09:44.441 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-16T14:09:44.441 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-16T14:09:44.441 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-16T14:09:44.442 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-16T14:09:44.442 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-16T14:09:44.442 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink 2023-10-16T14:09:44.442 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-16T14:09:44.442 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-16T14:09:44.443 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-16T14:09:44.443 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex 2023-10-16T14:09:44.443 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet 2023-10-16T14:09:44.443 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-16T14:09:44.443 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-16T14:09:44.444 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-16T14:09:44.444 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel 2023-10-16T14:09:44.444 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-16T14:09:44.444 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000 2023-10-16T14:09:44.444 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-16T14:09:44.444 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-16T14:09:44.445 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-16T14:09:44.445 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-16T14:09:44.445 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-16T14:09:44.445 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e 2023-10-16T14:09:44.445 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-16T14:09:44.446 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf 2023-10-16T14:09:44.446 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-16T14:09:44.446 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb 2023-10-16T14:09:44.446 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-16T14:09:44.446 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-16T14:09:44.447 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-16T14:09:44.447 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-16T14:09:44.447 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-16T14:09:44.447 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-16T14:09:44.447 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-16T14:09:44.447 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-16T14:09:44.448 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell 2023-10-16T14:09:44.448 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-16T14:09:44.448 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-16T14:09:44.448 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-16T14:09:44.448 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox 2023-10-16T14:09:44.449 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-16T14:09:44.449 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-16T14:09:44.449 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-16T14:09:44.449 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-16T14:09:44.449 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-16T14:09:44.450 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-16T14:09:44.450 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel 2023-10-16T14:09:44.450 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-16T14:09:44.450 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom 2023-10-16T14:09:44.450 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-16T14:09:44.451 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-16T14:09:44.451 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi 2023-10-16T14:09:44.451 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-16T14:09:44.451 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-16T14:09:44.451 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion 2023-10-16T14:09:44.452 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-16T14:09:44.452 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia 2023-10-16T14:09:44.452 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-16T14:09:44.452 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines 2023-10-16T14:09:44.452 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-16T14:09:44.452 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-16T14:09:44.453 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic 2023-10-16T14:09:44.453 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-16T14:09:44.453 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-16T14:09:44.453 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-16T14:09:44.453 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-16T14:09:44.454 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-16T14:09:44.454 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc 2023-10-16T14:09:44.454 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-16T14:09:44.454 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek 2023-10-16T14:09:44.454 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-16T14:09:44.455 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-16T14:09:44.455 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-16T14:09:44.455 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-16T14:09:44.455 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker 2023-10-16T14:09:44.455 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-16T14:09:44.456 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc 2023-10-16T14:09:44.456 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-16T14:09:44.456 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan 2023-10-16T14:09:44.456 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-16T14:09:44.456 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis 2023-10-16T14:09:44.456 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-16T14:09:44.457 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-16T14:09:44.457 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc 2023-10-16T14:09:44.457 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-16T14:09:44.457 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-16T14:09:44.457 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-16T14:09:44.458 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-16T14:09:44.458 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro 2023-10-16T14:09:44.458 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-16T14:09:44.458 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-16T14:09:44.458 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-16T14:09:44.459 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun 2023-10-16T14:09:44.459 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-16T14:09:44.459 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-16T14:09:44.459 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-16T14:09:44.459 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-16T14:09:44.459 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti 2023-10-16T14:09:44.460 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-16T14:09:44.460 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti 2023-10-16T14:09:44.460 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-16T14:09:44.460 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via 2023-10-16T14:09:44.460 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-16T14:09:44.461 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-16T14:09:44.461 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet 2023-10-16T14:09:44.461 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-16T14:09:44.461 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-16T14:09:44.461 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom 2023-10-16T14:09:44.462 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-16T14:09:44.462 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-16T14:09:44.462 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv 2023-10-16T14:09:44.462 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-16T14:09:44.462 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154 2023-10-16T14:09:44.463 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-16T14:09:44.463 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-16T14:09:44.463 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan 2023-10-16T14:09:44.463 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-16T14:09:44.463 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-16T14:09:44.463 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-16T14:09:44.464 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio 2023-10-16T14:09:44.464 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-16T14:09:44.464 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-16T14:09:44.464 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-16T14:09:44.464 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-16T14:09:44.465 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-16T14:09:44.465 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/net_failover.ko 2023-10-16T14:09:44.465 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-16T14:09:44.465 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-16T14:09:44.465 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs 2023-10-16T14:09:44.466 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-16T14:09:44.466 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-16T14:09:44.466 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy 2023-10-16T14:09:44.466 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-16T14:09:44.466 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-16T14:09:44.466 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-16T14:09:44.467 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-16T14:09:44.467 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-16T14:09:44.467 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-16T14:09:44.467 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-16T14:09:44.467 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-16T14:09:44.468 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/dp83640.ko 2023-10-16T14:09:44.468 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-16T14:09:44.468 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-16T14:09:44.468 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-16T14:09:44.468 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-16T14:09:44.468 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-16T14:09:44.469 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-16T14:09:44.469 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-16T14:09:44.469 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-16T14:09:44.469 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-16T14:09:44.469 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-16T14:09:44.470 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-16T14:09:44.470 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-16T14:09:44.470 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp 2023-10-16T14:09:44.470 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-16T14:09:44.470 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-16T14:09:44.470 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-16T14:09:44.471 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-16T14:09:44.471 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-16T14:09:44.471 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-16T14:09:44.471 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-16T14:09:44.471 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-16T14:09:44.472 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-16T14:09:44.472 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip 2023-10-16T14:09:44.472 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slhc.ko 2023-10-16T14:09:44.472 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-16T14:09:44.472 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-16T14:09:44.473 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-16T14:09:44.473 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team 2023-10-16T14:09:44.473 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-16T14:09:44.473 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-16T14:09:44.473 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-16T14:09:44.473 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-16T14:09:44.474 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-16T14:09:44.474 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-16T14:09:44.474 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tun.ko 2023-10-16T14:09:44.474 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-16T14:09:44.474 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/virtio_net.ko 2023-10-16T14:09:44.475 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3 2023-10-16T14:09:44.475 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-16T14:09:44.475 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan 2023-10-16T14:09:44.475 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-16T14:09:44.475 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback 2023-10-16T14:09:44.475 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-16T14:09:44.476 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netfront.ko 2023-10-16T14:09:44.476 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb 2023-10-16T14:09:44.476 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-16T14:09:44.476 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme 2023-10-16T14:09:44.476 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host 2023-10-16T14:09:44.477 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-16T14:09:44.477 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-16T14:09:44.477 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport 2023-10-16T14:09:44.477 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-16T14:09:44.477 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-16T14:09:44.477 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-16T14:09:44.478 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-16T14:09:44.478 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci 2023-10-16T14:09:44.478 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug 2023-10-16T14:09:44.478 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-16T14:09:44.478 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie 2023-10-16T14:09:44.479 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-16T14:09:44.479 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-16T14:09:44.479 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia 2023-10-16T14:09:44.479 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-16T14:09:44.479 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-16T14:09:44.480 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-16T14:09:44.480 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl 2023-10-16T14:09:44.480 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel 2023-10-16T14:09:44.480 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-16T14:09:44.480 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform 2023-10-16T14:09:44.481 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86 2023-10-16T14:09:44.481 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-16T14:09:44.481 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-16T14:09:44.481 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-16T14:09:44.481 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-16T14:09:44.482 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-16T14:09:44.482 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-16T14:09:44.482 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-16T14:09:44.482 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-16T14:09:44.482 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-16T14:09:44.482 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-16T14:09:44.483 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-16T14:09:44.483 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-16T14:09:44.483 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel 2023-10-16T14:09:44.483 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-16T14:09:44.483 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-16T14:09:44.484 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-16T14:09:44.484 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-16T14:09:44.484 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-16T14:09:44.484 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-16T14:09:44.484 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-16T14:09:44.485 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-16T14:09:44.485 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-16T14:09:44.485 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-16T14:09:44.485 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-16T14:09:44.485 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-16T14:09:44.485 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap 2023-10-16T14:09:44.486 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-16T14:09:44.486 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-16T14:09:44.486 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps 2023-10-16T14:09:44.486 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients 2023-10-16T14:09:44.486 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-16T14:09:44.487 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-16T14:09:44.487 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-16T14:09:44.487 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-16T14:09:44.487 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp 2023-10-16T14:09:44.487 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-16T14:09:44.487 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-16T14:09:44.488 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc 2023-10-16T14:09:44.488 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-16T14:09:44.488 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-16T14:09:44.488 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-16T14:09:44.488 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-16T14:09:44.489 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-16T14:09:44.489 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-16T14:09:44.489 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-16T14:09:44.489 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-16T14:09:44.489 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-16T14:09:44.489 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-16T14:09:44.490 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-16T14:09:44.490 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-16T14:09:44.490 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-16T14:09:44.490 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-16T14:09:44.490 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-16T14:09:44.491 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-16T14:09:44.491 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-16T14:09:44.491 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-16T14:09:44.491 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-16T14:09:44.491 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-16T14:09:44.492 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-16T14:09:44.492 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-16T14:09:44.492 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-16T14:09:44.492 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-16T14:09:44.492 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-16T14:09:44.492 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-16T14:09:44.493 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-16T14:09:44.493 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-16T14:09:44.493 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-16T14:09:44.493 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-16T14:09:44.493 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-16T14:09:44.494 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi 2023-10-16T14:09:44.494 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-16T14:09:44.494 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-16T14:09:44.494 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-16T14:09:44.494 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-16T14:09:44.494 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-16T14:09:44.495 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid 2023-10-16T14:09:44.495 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-16T14:09:44.495 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-16T14:09:44.495 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx 2023-10-16T14:09:44.495 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-16T14:09:44.496 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-16T14:09:44.496 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-16T14:09:44.496 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr 2023-10-16T14:09:44.496 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-16T14:09:44.496 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-16T14:09:44.496 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi 2023-10-16T14:09:44.497 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-16T14:09:44.497 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa 2023-10-16T14:09:44.497 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-16T14:09:44.497 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc 2023-10-16T14:09:44.497 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-16T14:09:44.498 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i 2023-10-16T14:09:44.498 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-16T14:09:44.498 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-16T14:09:44.498 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor 2023-10-16T14:09:44.498 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-16T14:09:44.499 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi 2023-10-16T14:09:44.499 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-16T14:09:44.499 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-16T14:09:44.499 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-16T14:09:44.499 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-16T14:09:44.499 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-16T14:09:44.500 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-16T14:09:44.500 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler 2023-10-16T14:09:44.500 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-16T14:09:44.500 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-16T14:09:44.500 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-16T14:09:44.501 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-16T14:09:44.501 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-16T14:09:44.501 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r 2023-10-16T14:09:44.501 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-16T14:09:44.501 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-16T14:09:44.502 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe 2023-10-16T14:09:44.502 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-16T14:09:44.502 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-16T14:09:44.502 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic 2023-10-16T14:09:44.502 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-16T14:09:44.502 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-16T14:09:44.503 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-16T14:09:44.503 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-16T14:09:44.503 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-16T14:09:44.503 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-16T14:09:44.503 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-16T14:09:44.504 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci 2023-10-16T14:09:44.504 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-16T14:09:44.504 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-16T14:09:44.504 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-16T14:09:44.504 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc 2023-10-16T14:09:44.504 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-16T14:09:44.505 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-16T14:09:44.505 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-16T14:09:44.505 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas 2023-10-16T14:09:44.505 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-16T14:09:44.505 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc 2023-10-16T14:09:44.506 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-16T14:09:44.506 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid 2023-10-16T14:09:44.506 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-16T14:09:44.506 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-16T14:09:44.506 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-16T14:09:44.506 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-16T14:09:44.507 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas 2023-10-16T14:09:44.507 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-16T14:09:44.507 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas 2023-10-16T14:09:44.507 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-16T14:09:44.507 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-16T14:09:44.508 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001 2023-10-16T14:09:44.508 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-16T14:09:44.508 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-16T14:09:44.508 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-16T14:09:44.508 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx 2023-10-16T14:09:44.509 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-16T14:09:44.509 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-16T14:09:44.509 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx 2023-10-16T14:09:44.509 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-16T14:09:44.509 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-16T14:09:44.509 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-16T14:09:44.510 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-16T14:09:44.510 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-16T14:09:44.510 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-16T14:09:44.510 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-16T14:09:44.510 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-16T14:09:44.511 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-16T14:09:44.511 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-16T14:09:44.511 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-16T14:09:44.511 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2 2023-10-16T14:09:44.511 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-16T14:09:44.512 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-16T14:09:44.512 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-16T14:09:44.512 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-16T14:09:44.512 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb 2023-10-16T14:09:44.512 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-16T14:09:44.512 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target 2023-10-16T14:09:44.513 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi 2023-10-16T14:09:44.513 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-16T14:09:44.513 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback 2023-10-16T14:09:44.513 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-16T14:09:44.513 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-16T14:09:44.514 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-16T14:09:44.514 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-16T14:09:44.514 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-16T14:09:44.514 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-16T14:09:44.514 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc 2023-10-16T14:09:44.514 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-16T14:09:44.515 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal 2023-10-16T14:09:44.515 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel 2023-10-16T14:09:44.515 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-16T14:09:44.515 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-16T14:09:44.515 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-16T14:09:44.516 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-16T14:09:44.516 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-16T14:09:44.516 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-16T14:09:44.516 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-16T14:09:44.516 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-16T14:09:44.516 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-16T14:09:44.517 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-16T14:09:44.517 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-16T14:09:44.517 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-16T14:09:44.517 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-16T14:09:44.517 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-16T14:09:44.518 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-16T14:09:44.518 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-16T14:09:44.518 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty 2023-10-16T14:09:44.518 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless 2023-10-16T14:09:44.518 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-16T14:09:44.519 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-16T14:09:44.519 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-16T14:09:44.519 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-16T14:09:44.519 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial 2023-10-16T14:09:44.519 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250 2023-10-16T14:09:44.519 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-16T14:09:44.520 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-16T14:09:44.520 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm 2023-10-16T14:09:44.520 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-16T14:09:44.520 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs 2023-10-16T14:09:44.520 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core 2023-10-16T14:09:44.521 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-16T14:09:44.521 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host 2023-10-16T14:09:44.521 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-16T14:09:44.521 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio 2023-10-16T14:09:44.521 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-16T14:09:44.522 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-16T14:09:44.522 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-16T14:09:44.522 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-16T14:09:44.522 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-16T14:09:44.522 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb 2023-10-16T14:09:44.523 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class 2023-10-16T14:09:44.523 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-16T14:09:44.523 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-16T14:09:44.523 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-16T14:09:44.523 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-16T14:09:44.523 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host 2023-10-16T14:09:44.524 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-16T14:09:44.524 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image 2023-10-16T14:09:44.524 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-16T14:09:44.524 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-16T14:09:44.524 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc 2023-10-16T14:09:44.525 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-16T14:09:44.525 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-16T14:09:44.525 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-16T14:09:44.525 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-16T14:09:44.525 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-16T14:09:44.525 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-16T14:09:44.526 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-16T14:09:44.526 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-16T14:09:44.526 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-16T14:09:44.526 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-16T14:09:44.526 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga 2023-10-16T14:09:44.527 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-16T14:09:44.527 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-16T14:09:44.527 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-16T14:09:44.527 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-16T14:09:44.527 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-16T14:09:44.528 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-16T14:09:44.528 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-16T14:09:44.528 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy 2023-10-16T14:09:44.528 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-16T14:09:44.528 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial 2023-10-16T14:09:44.528 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-16T14:09:44.529 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-16T14:09:44.529 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-16T14:09:44.529 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-16T14:09:44.529 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-16T14:09:44.529 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-16T14:09:44.530 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-16T14:09:44.530 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-16T14:09:44.530 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-16T14:09:44.530 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-16T14:09:44.530 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-16T14:09:44.531 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-16T14:09:44.531 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-16T14:09:44.531 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-16T14:09:44.531 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-16T14:09:44.531 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-16T14:09:44.531 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-16T14:09:44.532 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-16T14:09:44.532 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-16T14:09:44.532 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-16T14:09:44.532 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-16T14:09:44.532 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-16T14:09:44.533 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-16T14:09:44.533 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-16T14:09:44.533 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-16T14:09:44.533 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-16T14:09:44.533 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-16T14:09:44.533 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-16T14:09:44.534 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-16T14:09:44.534 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-16T14:09:44.534 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-16T14:09:44.534 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-16T14:09:44.534 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-16T14:09:44.535 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-16T14:09:44.535 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-16T14:09:44.535 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-16T14:09:44.535 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-16T14:09:44.535 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-16T14:09:44.535 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-16T14:09:44.536 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-16T14:09:44.536 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-16T14:09:44.536 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-16T14:09:44.536 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-16T14:09:44.536 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-16T14:09:44.537 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-16T14:09:44.537 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage 2023-10-16T14:09:44.537 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-16T14:09:44.537 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-16T14:09:44.537 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-16T14:09:44.537 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-16T14:09:44.538 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-16T14:09:44.538 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-16T14:09:44.538 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-16T14:09:44.538 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-16T14:09:44.538 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-16T14:09:44.539 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-16T14:09:44.539 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-16T14:09:44.539 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-16T14:09:44.539 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-16T14:09:44.539 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-16T14:09:44.540 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-16T14:09:44.540 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip 2023-10-16T14:09:44.540 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-16T14:09:44.540 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-16T14:09:44.540 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-16T14:09:44.541 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio 2023-10-16T14:09:44.541 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci 2023-10-16T14:09:44.541 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-16T14:09:44.541 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-16T14:09:44.541 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-16T14:09:44.541 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-16T14:09:44.542 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost 2023-10-16T14:09:44.542 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-16T14:09:44.542 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-16T14:09:44.542 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-16T14:09:44.542 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-16T14:09:44.543 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video 2023-10-16T14:09:44.543 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight 2023-10-16T14:09:44.543 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-16T14:09:44.543 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-16T14:09:44.543 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-16T14:09:44.544 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio 2023-10-16T14:09:44.544 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio.ko 2023-10-16T14:09:44.544 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-16T14:09:44.544 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-16T14:09:44.544 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci.ko 2023-10-16T14:09:44.544 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-16T14:09:44.545 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-16T14:09:44.545 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_ring.ko 2023-10-16T14:09:44.545 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1 2023-10-16T14:09:44.545 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters 2023-10-16T14:09:44.545 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-16T14:09:44.546 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-16T14:09:44.546 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves 2023-10-16T14:09:44.546 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-16T14:09:44.546 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-16T14:09:44.546 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-16T14:09:44.547 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-16T14:09:44.547 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-16T14:09:44.547 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-16T14:09:44.547 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-16T14:09:44.549 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-16T14:09:44.549 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-16T14:09:44.549 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-16T14:09:44.549 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-16T14:09:44.550 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-16T14:09:44.550 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog 2023-10-16T14:09:44.550 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-16T14:09:44.550 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-16T14:09:44.550 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-16T14:09:44.551 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-16T14:09:44.551 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-16T14:09:44.551 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-16T14:09:44.551 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-16T14:09:44.551 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-16T14:09:44.552 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-16T14:09:44.552 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-16T14:09:44.552 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-16T14:09:44.552 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-16T14:09:44.552 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-16T14:09:44.552 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-16T14:09:44.553 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-16T14:09:44.553 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-16T14:09:44.553 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-16T14:09:44.553 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-16T14:09:44.553 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-16T14:09:44.554 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-16T14:09:44.554 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-16T14:09:44.554 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-16T14:09:44.554 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-16T14:09:44.554 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-16T14:09:44.555 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-16T14:09:44.555 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-16T14:09:44.555 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen 2023-10-16T14:09:44.555 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-16T14:09:44.555 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-16T14:09:44.555 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-16T14:09:44.556 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-16T14:09:44.556 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback 2023-10-16T14:09:44.556 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-16T14:09:44.556 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-16T14:09:44.556 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs 2023-10-16T14:09:44.557 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-16T14:09:44.557 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs 2023-10-16T14:09:44.557 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p 2023-10-16T14:09:44.557 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-16T14:09:44.557 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs 2023-10-16T14:09:44.557 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-16T14:09:44.558 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs 2023-10-16T14:09:44.558 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-16T14:09:44.558 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-16T14:09:44.558 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs 2023-10-16T14:09:44.558 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-16T14:09:44.559 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles 2023-10-16T14:09:44.559 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-16T14:09:44.559 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph 2023-10-16T14:09:44.559 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-16T14:09:44.559 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda 2023-10-16T14:09:44.559 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-16T14:09:44.560 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs 2023-10-16T14:09:44.560 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-16T14:09:44.560 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm 2023-10-16T14:09:44.560 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-16T14:09:44.560 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs 2023-10-16T14:09:44.561 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-16T14:09:44.561 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs 2023-10-16T14:09:44.561 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-16T14:09:44.561 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat 2023-10-16T14:09:44.561 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/fat.ko 2023-10-16T14:09:44.562 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-16T14:09:44.562 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/vfat.ko 2023-10-16T14:09:44.562 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache 2023-10-16T14:09:44.562 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-16T14:09:44.562 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse 2023-10-16T14:09:44.562 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-16T14:09:44.563 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/fuse.ko 2023-10-16T14:09:44.563 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2 2023-10-16T14:09:44.563 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-16T14:09:44.563 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs 2023-10-16T14:09:44.563 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-16T14:09:44.564 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus 2023-10-16T14:09:44.564 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-16T14:09:44.564 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs 2023-10-16T14:09:44.564 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-16T14:09:44.564 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs 2023-10-16T14:09:44.565 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-16T14:09:44.565 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd 2023-10-16T14:09:44.565 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-16T14:09:44.565 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix 2023-10-16T14:09:44.565 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-16T14:09:44.565 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs 2023-10-16T14:09:44.566 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-16T14:09:44.566 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs 2023-10-16T14:09:44.566 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout 2023-10-16T14:09:44.566 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-16T14:09:44.566 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout 2023-10-16T14:09:44.567 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-16T14:09:44.567 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout 2023-10-16T14:09:44.567 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-16T14:09:44.567 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-16T14:09:44.567 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-16T14:09:44.567 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-16T14:09:44.568 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common 2023-10-16T14:09:44.568 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-16T14:09:44.568 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-16T14:09:44.568 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd 2023-10-16T14:09:44.568 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-16T14:09:44.569 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2 2023-10-16T14:09:44.569 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-16T14:09:44.569 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls 2023-10-16T14:09:44.569 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-16T14:09:44.569 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-16T14:09:44.569 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-16T14:09:44.570 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-16T14:09:44.570 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-16T14:09:44.570 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-16T14:09:44.570 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-16T14:09:44.570 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-16T14:09:44.571 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-16T14:09:44.571 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-16T14:09:44.571 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-16T14:09:44.571 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-16T14:09:44.571 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-16T14:09:44.572 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-16T14:09:44.572 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-16T14:09:44.572 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-16T14:09:44.572 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-16T14:09:44.572 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-16T14:09:44.572 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-16T14:09:44.573 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-16T14:09:44.573 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-16T14:09:44.573 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-16T14:09:44.573 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-16T14:09:44.573 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-16T14:09:44.574 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-16T14:09:44.574 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-16T14:09:44.574 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-16T14:09:44.574 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-16T14:09:44.574 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-16T14:09:44.574 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-16T14:09:44.575 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-16T14:09:44.575 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-16T14:09:44.575 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-16T14:09:44.575 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-16T14:09:44.575 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-16T14:09:44.576 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-16T14:09:44.576 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-16T14:09:44.576 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-16T14:09:44.576 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-16T14:09:44.576 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-16T14:09:44.576 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-16T14:09:44.577 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-16T14:09:44.577 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-16T14:09:44.577 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-16T14:09:44.577 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-16T14:09:44.577 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-16T14:09:44.578 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-16T14:09:44.578 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-16T14:09:44.578 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-16T14:09:44.578 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-16T14:09:44.578 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2 2023-10-16T14:09:44.579 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster 2023-10-16T14:09:44.579 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-16T14:09:44.579 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm 2023-10-16T14:09:44.579 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-16T14:09:44.579 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs 2023-10-16T14:09:44.579 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-16T14:09:44.580 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-16T14:09:44.580 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-16T14:09:44.580 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-16T14:09:44.580 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-16T14:09:44.580 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs 2023-10-16T14:09:44.581 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-16T14:09:44.581 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore 2023-10-16T14:09:44.581 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-16T14:09:44.581 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs 2023-10-16T14:09:44.581 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-16T14:09:44.582 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs 2023-10-16T14:09:44.582 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-16T14:09:44.582 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb 2023-10-16T14:09:44.582 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client 2023-10-16T14:09:44.582 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-16T14:09:44.582 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common 2023-10-16T14:09:44.583 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-16T14:09:44.583 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-16T14:09:44.583 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs 2023-10-16T14:09:44.583 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-16T14:09:44.583 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv 2023-10-16T14:09:44.584 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-16T14:09:44.584 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf 2023-10-16T14:09:44.584 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-16T14:09:44.584 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs 2023-10-16T14:09:44.584 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-16T14:09:44.584 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs 2023-10-16T14:09:44.585 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-16T14:09:44.585 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel 2023-10-16T14:09:44.585 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu 2023-10-16T14:09:44.585 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu/rcutorture.ko 2023-10-16T14:09:44.585 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-16T14:09:44.586 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace 2023-10-16T14:09:44.586 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-16T14:09:44.586 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib 2023-10-16T14:09:44.586 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/asn1_encoder.ko 2023-10-16T14:09:44.586 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-16T14:09:44.586 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-16T14:09:44.587 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto 2023-10-16T14:09:44.587 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-16T14:09:44.587 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-16T14:09:44.587 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-16T14:09:44.587 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-16T14:09:44.588 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4 2023-10-16T14:09:44.588 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-16T14:09:44.588 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-16T14:09:44.588 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math 2023-10-16T14:09:44.588 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-16T14:09:44.589 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6 2023-10-16T14:09:44.589 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-16T14:09:44.589 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon 2023-10-16T14:09:44.589 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-16T14:09:44.589 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-16T14:09:44.589 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-16T14:09:44.590 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-16T14:09:44.590 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd 2023-10-16T14:09:44.590 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd/zstd_compress.ko 2023-10-16T14:09:44.590 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm 2023-10-16T14:09:44.590 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-16T14:09:44.591 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net 2023-10-16T14:09:44.591 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan 2023-10-16T14:09:44.591 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-16T14:09:44.591 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-16T14:09:44.591 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-16T14:09:44.591 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-16T14:09:44.592 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-16T14:09:44.592 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-16T14:09:44.592 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-16T14:09:44.592 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-16T14:09:44.592 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802 2023-10-16T14:09:44.593 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-16T14:09:44.593 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-16T14:09:44.593 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-16T14:09:44.593 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-16T14:09:44.593 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-16T14:09:44.593 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q 2023-10-16T14:09:44.594 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-16T14:09:44.594 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p 2023-10-16T14:09:44.594 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-16T14:09:44.594 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-16T14:09:44.594 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-16T14:09:44.595 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-16T14:09:44.595 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv 2023-10-16T14:09:44.595 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-16T14:09:44.595 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge 2023-10-16T14:09:44.595 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-16T14:09:44.595 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-16T14:09:44.596 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter 2023-10-16T14:09:44.596 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-16T14:09:44.596 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-16T14:09:44.596 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-16T14:09:44.596 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-16T14:09:44.597 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-16T14:09:44.597 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-16T14:09:44.597 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-16T14:09:44.597 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-16T14:09:44.597 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-16T14:09:44.597 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-16T14:09:44.598 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-16T14:09:44.598 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-16T14:09:44.598 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-16T14:09:44.598 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-16T14:09:44.598 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-16T14:09:44.599 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-16T14:09:44.599 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-16T14:09:44.599 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-16T14:09:44.599 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-16T14:09:44.599 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-16T14:09:44.600 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-16T14:09:44.600 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-16T14:09:44.600 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-16T14:09:44.600 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-16T14:09:44.600 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph 2023-10-16T14:09:44.601 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-16T14:09:44.601 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core 2023-10-16T14:09:44.601 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/failover.ko 2023-10-16T14:09:44.601 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-16T14:09:44.601 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp 2023-10-16T14:09:44.601 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-16T14:09:44.602 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-16T14:09:44.602 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-16T14:09:44.602 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-16T14:09:44.602 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver 2023-10-16T14:09:44.602 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-16T14:09:44.603 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa 2023-10-16T14:09:44.603 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-16T14:09:44.603 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-16T14:09:44.603 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-16T14:09:44.603 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-16T14:09:44.604 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-16T14:09:44.604 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154 2023-10-16T14:09:44.604 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan 2023-10-16T14:09:44.604 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-16T14:09:44.604 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-16T14:09:44.604 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-16T14:09:44.605 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4 2023-10-16T14:09:44.605 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-16T14:09:44.605 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-16T14:09:44.605 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-16T14:09:44.605 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-16T14:09:44.606 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-16T14:09:44.606 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-16T14:09:44.606 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-16T14:09:44.606 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-16T14:09:44.606 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-16T14:09:44.607 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-16T14:09:44.607 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter 2023-10-16T14:09:44.607 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-16T14:09:44.607 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-16T14:09:44.607 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-16T14:09:44.607 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-16T14:09:44.608 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-16T14:09:44.608 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-16T14:09:44.608 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-16T14:09:44.608 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-16T14:09:44.608 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-16T14:09:44.609 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-16T14:09:44.609 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-16T14:09:44.609 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-16T14:09:44.609 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-16T14:09:44.609 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-16T14:09:44.610 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-16T14:09:44.610 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-16T14:09:44.610 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-16T14:09:44.610 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-16T14:09:44.610 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-16T14:09:44.611 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-16T14:09:44.611 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-16T14:09:44.611 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-16T14:09:44.611 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-16T14:09:44.611 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-16T14:09:44.611 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-16T14:09:44.612 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-16T14:09:44.612 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-16T14:09:44.612 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-16T14:09:44.612 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-16T14:09:44.612 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-16T14:09:44.613 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-16T14:09:44.613 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-16T14:09:44.613 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-16T14:09:44.613 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-16T14:09:44.613 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-16T14:09:44.613 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-16T14:09:44.614 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-16T14:09:44.614 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-16T14:09:44.614 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6 2023-10-16T14:09:44.614 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-16T14:09:44.614 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-16T14:09:44.615 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-16T14:09:44.615 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-16T14:09:44.615 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-16T14:09:44.615 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-16T14:09:44.615 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-16T14:09:44.615 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter 2023-10-16T14:09:44.616 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-16T14:09:44.616 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-16T14:09:44.616 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-16T14:09:44.616 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-16T14:09:44.616 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-16T14:09:44.617 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-16T14:09:44.617 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-16T14:09:44.617 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-16T14:09:44.617 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-16T14:09:44.617 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-16T14:09:44.617 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-16T14:09:44.618 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-16T14:09:44.618 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-16T14:09:44.618 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-16T14:09:44.618 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-16T14:09:44.618 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-16T14:09:44.619 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-16T14:09:44.619 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-16T14:09:44.619 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-16T14:09:44.619 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-16T14:09:44.619 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-16T14:09:44.620 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-16T14:09:44.620 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-16T14:09:44.620 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-16T14:09:44.620 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-16T14:09:44.620 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-16T14:09:44.620 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-16T14:09:44.621 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key 2023-10-16T14:09:44.621 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-16T14:09:44.621 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp 2023-10-16T14:09:44.621 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-16T14:09:44.621 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-16T14:09:44.622 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-16T14:09:44.622 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-16T14:09:44.622 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-16T14:09:44.622 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-16T14:09:44.622 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-16T14:09:44.623 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc 2023-10-16T14:09:44.623 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-16T14:09:44.623 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154 2023-10-16T14:09:44.623 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-16T14:09:44.623 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls 2023-10-16T14:09:44.624 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-16T14:09:44.624 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter 2023-10-16T14:09:44.624 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset 2023-10-16T14:09:44.624 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-16T14:09:44.624 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-16T14:09:44.624 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-16T14:09:44.625 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-16T14:09:44.625 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-16T14:09:44.625 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-16T14:09:44.625 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-16T14:09:44.625 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-16T14:09:44.626 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-16T14:09:44.626 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-16T14:09:44.626 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-16T14:09:44.626 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-16T14:09:44.626 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-16T14:09:44.626 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-16T14:09:44.627 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-16T14:09:44.627 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-16T14:09:44.627 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs 2023-10-16T14:09:44.627 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-16T14:09:44.627 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-16T14:09:44.628 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-16T14:09:44.628 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-16T14:09:44.628 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-16T14:09:44.628 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-16T14:09:44.628 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-16T14:09:44.628 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-16T14:09:44.629 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-16T14:09:44.629 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-16T14:09:44.629 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-16T14:09:44.629 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-16T14:09:44.629 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-16T14:09:44.630 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-16T14:09:44.630 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-16T14:09:44.630 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-16T14:09:44.630 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-16T14:09:44.630 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-16T14:09:44.631 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-16T14:09:44.631 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-16T14:09:44.631 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-16T14:09:44.631 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-16T14:09:44.631 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-16T14:09:44.631 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-16T14:09:44.632 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-16T14:09:44.632 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-16T14:09:44.632 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-16T14:09:44.632 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-16T14:09:44.632 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-16T14:09:44.633 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-16T14:09:44.633 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-16T14:09:44.633 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-16T14:09:44.633 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-16T14:09:44.633 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-16T14:09:44.634 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-16T14:09:44.634 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-16T14:09:44.634 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-16T14:09:44.634 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-16T14:09:44.634 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-16T14:09:44.634 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-16T14:09:44.635 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-16T14:09:44.635 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-16T14:09:44.635 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-16T14:09:44.635 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-16T14:09:44.635 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-16T14:09:44.636 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-16T14:09:44.636 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-16T14:09:44.636 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-16T14:09:44.636 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-16T14:09:44.636 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-16T14:09:44.636 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-16T14:09:44.637 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-16T14:09:44.637 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-16T14:09:44.637 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-16T14:09:44.637 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-16T14:09:44.637 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-16T14:09:44.638 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-16T14:09:44.638 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-16T14:09:44.638 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_quota.ko 2023-10-16T14:09:44.638 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-16T14:09:44.638 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-16T14:09:44.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-16T14:09:44.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-16T14:09:44.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tunnel.ko 2023-10-16T14:09:44.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-16T14:09:44.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-16T14:09:44.639 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-16T14:09:44.640 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-16T14:09:44.640 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-16T14:09:44.640 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-16T14:09:44.640 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-16T14:09:44.640 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-16T14:09:44.641 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-16T14:09:44.641 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-16T14:09:44.641 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-16T14:09:44.641 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-16T14:09:44.641 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-16T14:09:44.642 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-16T14:09:44.642 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-16T14:09:44.642 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-16T14:09:44.642 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-16T14:09:44.642 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-16T14:09:44.643 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-16T14:09:44.643 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-16T14:09:44.643 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-16T14:09:44.643 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-16T14:09:44.643 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-16T14:09:44.643 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-16T14:09:44.644 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-16T14:09:44.644 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-16T14:09:44.644 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-16T14:09:44.644 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-16T14:09:44.644 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-16T14:09:44.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-16T14:09:44.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-16T14:09:44.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-16T14:09:44.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-16T14:09:44.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-16T14:09:44.645 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-16T14:09:44.646 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-16T14:09:44.646 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-16T14:09:44.646 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-16T14:09:44.646 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-16T14:09:44.646 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-16T14:09:44.647 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-16T14:09:44.647 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-16T14:09:44.647 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-16T14:09:44.647 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-16T14:09:44.647 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-16T14:09:44.647 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-16T14:09:44.648 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-16T14:09:44.648 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-16T14:09:44.648 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-16T14:09:44.648 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-16T14:09:44.648 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-16T14:09:44.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-16T14:09:44.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-16T14:09:44.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-16T14:09:44.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-16T14:09:44.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-16T14:09:44.649 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-16T14:09:44.650 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-16T14:09:44.650 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-16T14:09:44.650 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-16T14:09:44.650 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-16T14:09:44.650 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-16T14:09:44.651 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-16T14:09:44.651 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-16T14:09:44.651 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-16T14:09:44.651 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-16T14:09:44.651 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-16T14:09:44.652 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-16T14:09:44.652 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-16T14:09:44.652 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-16T14:09:44.652 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-16T14:09:44.652 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink 2023-10-16T14:09:44.652 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-16T14:09:44.653 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh 2023-10-16T14:09:44.653 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-16T14:09:44.653 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch 2023-10-16T14:09:44.653 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-16T14:09:44.653 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-16T14:09:44.654 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-16T14:09:44.654 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-16T14:09:44.654 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet 2023-10-16T14:09:44.654 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-16T14:09:44.654 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds 2023-10-16T14:09:44.655 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-16T14:09:44.655 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-16T14:09:44.655 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-16T14:09:44.655 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched 2023-10-16T14:09:44.655 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-16T14:09:44.655 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-16T14:09:44.656 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-16T14:09:44.656 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-16T14:09:44.656 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-16T14:09:44.656 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-16T14:09:44.656 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-16T14:09:44.657 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-16T14:09:44.657 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-16T14:09:44.657 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-16T14:09:44.657 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-16T14:09:44.657 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-16T14:09:44.657 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-16T14:09:44.658 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-16T14:09:44.658 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-16T14:09:44.658 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-16T14:09:44.658 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-16T14:09:44.658 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-16T14:09:44.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-16T14:09:44.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-16T14:09:44.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-16T14:09:44.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-16T14:09:44.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-16T14:09:44.659 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-16T14:09:44.660 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-16T14:09:44.660 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-16T14:09:44.660 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-16T14:09:44.660 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-16T14:09:44.660 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-16T14:09:44.661 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-16T14:09:44.661 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-16T14:09:44.661 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-16T14:09:44.661 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-16T14:09:44.661 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-16T14:09:44.662 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-16T14:09:44.662 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-16T14:09:44.662 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-16T14:09:44.662 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-16T14:09:44.662 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-16T14:09:44.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-16T14:09:44.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-16T14:09:44.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-16T14:09:44.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-16T14:09:44.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-16T14:09:44.663 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp 2023-10-16T14:09:44.664 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-16T14:09:44.664 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-16T14:09:44.664 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc 2023-10-16T14:09:44.664 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss 2023-10-16T14:09:44.664 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-16T14:09:44.665 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-16T14:09:44.665 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-16T14:09:44.665 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma 2023-10-16T14:09:44.665 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-16T14:09:44.665 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc 2023-10-16T14:09:44.665 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-16T14:09:44.666 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-16T14:09:44.666 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix 2023-10-16T14:09:44.666 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-16T14:09:44.666 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock 2023-10-16T14:09:44.666 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-16T14:09:44.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-16T14:09:44.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-16T14:09:44.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-16T14:09:44.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-16T14:09:44.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm 2023-10-16T14:09:44.667 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-16T14:09:44.668 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security 2023-10-16T14:09:44.668 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys 2023-10-16T14:09:44.668 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys 2023-10-16T14:09:44.668 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-16T14:09:44.668 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys 2023-10-16T14:09:44.669 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-16T14:09:44.669 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt 2023-10-16T14:09:44.669 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib 2023-10-16T14:09:44.669 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-16T14:09:44.669 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-16T14:09:44.669 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-16T14:09:44.670 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-16T14:09:44.670 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-16T14:09:44.670 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-16T14:09:44.670 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-16T14:09:44.670 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-16T14:09:44.671 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-16T14:09:44.671 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-16T14:09:44.671 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-16T14:09:44.671 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-16T14:09:44.671 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-16T14:09:44.672 INFO:teuthology.orchestra.run.smithi059.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-16T14:09:44.672 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-16T14:09:44.672 DEBUG:teuthology.orchestra.run.smithi059:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-16T14:09:44.697 INFO:teuthology.orchestra.run.smithi059.stdout:postinstall scriptlet (using /bin/sh): 2023-10-16T14:09:44.697 INFO:teuthology.orchestra.run.smithi059.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g47672119149b -a -r /boot/System.map-6.6.0-rc5-g47672119149b ]; then 2023-10-16T14:09:44.697 INFO:teuthology.orchestra.run.smithi059.stdout:cp /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm 2023-10-16T14:09:44.698 INFO:teuthology.orchestra.run.smithi059.stdout:cp /boot/System.map-6.6.0-rc5-g47672119149b /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-16T14:09:44.698 INFO:teuthology.orchestra.run.smithi059.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/System.map-6.6.0-rc5-g47672119149b 2023-10-16T14:09:44.698 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/installkernel 6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-16T14:09:44.698 INFO:teuthology.orchestra.run.smithi059.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-16T14:09:44.698 INFO:teuthology.orchestra.run.smithi059.stdout:fi 2023-10-16T14:09:44.699 INFO:teuthology.orchestra.run.smithi059.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-16T14:09:44.699 INFO:teuthology.orchestra.run.smithi059.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-16T14:09:44.699 INFO:teuthology.orchestra.run.smithi059.stdout:new-kernel-pkg --remove 6.6.0-rc5-g47672119149b --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g47672119149b.img 2023-10-16T14:09:44.699 INFO:teuthology.orchestra.run.smithi059.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-16T14:09:44.699 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-install remove 6.6.0-rc5-g47672119149b 2023-10-16T14:09:44.700 INFO:teuthology.orchestra.run.smithi059.stdout:fi 2023-10-16T14:09:44.700 INFO:teuthology.orchestra.run.smithi059.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-16T14:09:44.700 INFO:teuthology.orchestra.run.smithi059.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-16T14:09:44.700 INFO:teuthology.orchestra.run.smithi059.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g47672119149b 2023-10-16T14:09:44.700 INFO:teuthology.orchestra.run.smithi059.stdout:fi 2023-10-16T14:09:44.701 DEBUG:teuthology.orchestra.run.smithi059:> sudo rpm -qi grub2-tools 2023-10-16T14:09:44.783 INFO:teuthology.orchestra.run.smithi059.stdout:Name : grub2-tools 2023-10-16T14:09:44.783 INFO:teuthology.orchestra.run.smithi059.stdout:Epoch : 1 2023-10-16T14:09:44.783 INFO:teuthology.orchestra.run.smithi059.stdout:Version : 2.06 2023-10-16T14:09:44.783 INFO:teuthology.orchestra.run.smithi059.stdout:Release : 68.el9 2023-10-16T14:09:44.784 INFO:teuthology.orchestra.run.smithi059.stdout:Architecture: x86_64 2023-10-16T14:09:44.784 INFO:teuthology.orchestra.run.smithi059.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-16T14:09:44.784 INFO:teuthology.orchestra.run.smithi059.stdout:Group : Unspecified 2023-10-16T14:09:44.784 INFO:teuthology.orchestra.run.smithi059.stdout:Size : 8264254 2023-10-16T14:09:44.784 INFO:teuthology.orchestra.run.smithi059.stdout:License : GPLv3+ 2023-10-16T14:09:44.785 INFO:teuthology.orchestra.run.smithi059.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-16T14:09:44.785 INFO:teuthology.orchestra.run.smithi059.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-16T14:09:44.785 INFO:teuthology.orchestra.run.smithi059.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-16T14:09:44.785 INFO:teuthology.orchestra.run.smithi059.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-16T14:09:44.785 INFO:teuthology.orchestra.run.smithi059.stdout:Packager : builder@centos.org 2023-10-16T14:09:44.786 INFO:teuthology.orchestra.run.smithi059.stdout:Vendor : CentOS 2023-10-16T14:09:44.786 INFO:teuthology.orchestra.run.smithi059.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-16T14:09:44.786 INFO:teuthology.orchestra.run.smithi059.stdout:Summary : Support tools for GRUB. 2023-10-16T14:09:44.786 INFO:teuthology.orchestra.run.smithi059.stdout:Description : 2023-10-16T14:09:44.786 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:09:44.787 INFO:teuthology.orchestra.run.smithi059.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-16T14:09:44.787 INFO:teuthology.orchestra.run.smithi059.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-16T14:09:44.787 INFO:teuthology.orchestra.run.smithi059.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-16T14:09:44.787 INFO:teuthology.orchestra.run.smithi059.stdout:hardware devices. 2023-10-16T14:09:44.787 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:09:44.788 INFO:teuthology.orchestra.run.smithi059.stdout:This subpackage provides tools for support of all platforms. 2023-10-16T14:09:44.789 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-16T14:09:44.789 INFO:teuthology.task.kernel:Updating grub on smithi059 to boot 6.6.0-rc5-g47672119149b 2023-10-16T14:09:44.789 DEBUG:teuthology.orchestra.run.smithi059:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-16T14:09:45.402 INFO:teuthology.orchestra.run.smithi059.stderr:Generating grub configuration file ... 2023-10-16T14:09:46.816 INFO:teuthology.orchestra.run.smithi059.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-16T14:09:46.837 INFO:teuthology.orchestra.run.smithi059.stderr:done 2023-10-16T14:09:46.839 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2023-10-16T14:09:46.857 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.SFkmiUcA6H 2023-10-16T14:09:46.858 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SFkmiUcA6H 2023-10-16T14:09:46.940 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.SFkmiUcA6H 2023-10-16T14:09:47.025 INFO:teuthology.orchestra.run.smithi151.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-16T14:09:47.081 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.SFkmiUcA6H is 6KB 2023-10-16T14:09:47.130 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.SFkmiUcA6H 2023-10-16T14:09:47.145 DEBUG:teuthology.orchestra.run.smithi059:> sudo /bin/ls /boot/loader/entries || true 2023-10-16T14:09:47.214 INFO:teuthology.orchestra.run.smithi059.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-16T14:09:47.215 INFO:teuthology.orchestra.run.smithi059.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-16T14:09:47.215 INFO:teuthology.orchestra.run.smithi059.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-16T14:09:47.215 INFO:teuthology.orchestra.run.smithi059.stdout:15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b.conf 2023-10-16T14:09:47.217 DEBUG:teuthology.orchestra.run.smithi059:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b 2023-10-16T14:09:47.402 DEBUG:teuthology.orchestra.run.smithi059:> sudo shutdown -r now 2023-10-16T14:10:08.367 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi151.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-16T14:10:08.367 DEBUG:teuthology.orchestra.run.smithi151:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-16T14:10:08.434 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/System.map-6.6.0-rc5-g47672119149b 2023-10-16T14:10:08.435 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/config-6.6.0-rc5-g47672119149b 2023-10-16T14:10:08.435 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-16T14:10:08.435 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b 2023-10-16T14:10:08.435 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel 2023-10-16T14:10:08.435 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch 2023-10-16T14:10:08.436 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86 2023-10-16T14:10:08.436 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto 2023-10-16T14:10:08.436 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-16T14:10:08.436 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-16T14:10:08.437 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-16T14:10:08.437 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-16T14:10:08.437 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-16T14:10:08.437 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-16T14:10:08.437 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-16T14:10:08.438 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-16T14:10:08.438 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-16T14:10:08.438 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-16T14:10:08.438 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-16T14:10:08.438 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-16T14:10:08.439 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-16T14:10:08.439 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-16T14:10:08.439 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-16T14:10:08.439 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-16T14:10:08.439 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-16T14:10:08.439 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-16T14:10:08.440 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-16T14:10:08.440 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-16T14:10:08.440 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel 2023-10-16T14:10:08.440 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu 2023-10-16T14:10:08.440 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce 2023-10-16T14:10:08.441 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-16T14:10:08.441 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm 2023-10-16T14:10:08.441 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-16T14:10:08.441 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-16T14:10:08.441 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-16T14:10:08.442 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto 2023-10-16T14:10:08.442 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-16T14:10:08.442 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-16T14:10:08.442 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-16T14:10:08.442 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx 2023-10-16T14:10:08.443 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-16T14:10:08.443 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-16T14:10:08.443 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-16T14:10:08.443 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-16T14:10:08.443 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-16T14:10:08.444 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-16T14:10:08.444 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-16T14:10:08.444 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-16T14:10:08.444 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-16T14:10:08.444 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-16T14:10:08.445 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-16T14:10:08.445 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-16T14:10:08.445 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-16T14:10:08.445 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-16T14:10:08.445 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-16T14:10:08.446 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-16T14:10:08.446 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-16T14:10:08.446 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-16T14:10:08.446 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-16T14:10:08.447 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-16T14:10:08.447 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-16T14:10:08.447 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-16T14:10:08.447 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-16T14:10:08.448 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-16T14:10:08.448 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-16T14:10:08.448 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-16T14:10:08.448 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-16T14:10:08.448 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-16T14:10:08.449 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-16T14:10:08.449 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-16T14:10:08.449 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-16T14:10:08.449 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-16T14:10:08.449 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-16T14:10:08.450 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-16T14:10:08.450 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-16T14:10:08.450 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-16T14:10:08.450 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-16T14:10:08.450 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-16T14:10:08.451 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-16T14:10:08.451 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-16T14:10:08.451 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-16T14:10:08.451 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-16T14:10:08.451 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-16T14:10:08.452 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-16T14:10:08.452 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-16T14:10:08.452 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers 2023-10-16T14:10:08.452 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi 2023-10-16T14:10:08.452 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-16T14:10:08.452 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-16T14:10:08.453 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/custom_method.ko 2023-10-16T14:10:08.453 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-16T14:10:08.453 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-16T14:10:08.453 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-16T14:10:08.453 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-16T14:10:08.454 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-16T14:10:08.454 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata 2023-10-16T14:10:08.454 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-16T14:10:08.454 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-16T14:10:08.454 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ata_generic.ko 2023-10-16T14:10:08.455 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-16T14:10:08.455 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-16T14:10:08.455 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-16T14:10:08.455 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-16T14:10:08.455 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-16T14:10:08.456 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-16T14:10:08.456 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-16T14:10:08.456 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-16T14:10:08.456 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-16T14:10:08.456 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-16T14:10:08.457 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-16T14:10:08.457 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-16T14:10:08.457 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-16T14:10:08.457 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-16T14:10:08.457 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-16T14:10:08.458 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-16T14:10:08.458 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-16T14:10:08.458 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-16T14:10:08.458 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-16T14:10:08.458 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-16T14:10:08.459 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-16T14:10:08.459 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-16T14:10:08.459 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-16T14:10:08.459 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-16T14:10:08.459 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-16T14:10:08.460 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-16T14:10:08.460 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-16T14:10:08.460 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-16T14:10:08.460 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-16T14:10:08.460 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-16T14:10:08.461 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-16T14:10:08.461 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-16T14:10:08.461 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-16T14:10:08.461 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-16T14:10:08.461 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-16T14:10:08.461 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sis.ko 2023-10-16T14:10:08.462 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-16T14:10:08.462 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-16T14:10:08.462 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-16T14:10:08.462 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-16T14:10:08.462 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-16T14:10:08.463 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-16T14:10:08.463 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-16T14:10:08.463 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-16T14:10:08.463 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-16T14:10:08.463 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-16T14:10:08.464 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-16T14:10:08.464 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-16T14:10:08.464 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-16T14:10:08.464 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-16T14:10:08.464 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-16T14:10:08.465 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-16T14:10:08.465 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-16T14:10:08.465 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay 2023-10-16T14:10:08.465 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-16T14:10:08.465 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base 2023-10-16T14:10:08.465 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap 2023-10-16T14:10:08.466 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-16T14:10:08.466 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-16T14:10:08.466 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma 2023-10-16T14:10:08.466 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-16T14:10:08.466 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block 2023-10-16T14:10:08.467 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe 2023-10-16T14:10:08.467 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-16T14:10:08.467 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/brd.ko 2023-10-16T14:10:08.467 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd 2023-10-16T14:10:08.467 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-16T14:10:08.468 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-16T14:10:08.468 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/loop.ko 2023-10-16T14:10:08.468 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx 2023-10-16T14:10:08.468 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-16T14:10:08.468 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-16T14:10:08.468 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk 2023-10-16T14:10:08.469 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-16T14:10:08.469 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-16T14:10:08.469 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-16T14:10:08.469 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/virtio_blk.ko 2023-10-16T14:10:08.469 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback 2023-10-16T14:10:08.470 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-16T14:10:08.470 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkfront.ko 2023-10-16T14:10:08.470 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram 2023-10-16T14:10:08.470 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-16T14:10:08.470 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char 2023-10-16T14:10:08.471 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-16T14:10:08.471 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random 2023-10-16T14:10:08.471 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-16T14:10:08.471 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-16T14:10:08.471 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-16T14:10:08.472 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-16T14:10:08.472 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-16T14:10:08.472 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi 2023-10-16T14:10:08.472 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-16T14:10:08.472 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-16T14:10:08.472 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-16T14:10:08.473 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-16T14:10:08.473 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-16T14:10:08.473 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-16T14:10:08.473 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-16T14:10:08.473 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave 2023-10-16T14:10:08.474 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-16T14:10:08.474 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-16T14:10:08.474 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-16T14:10:08.474 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm 2023-10-16T14:10:08.474 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm.ko 2023-10-16T14:10:08.475 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-16T14:10:08.475 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-16T14:10:08.475 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-16T14:10:08.475 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-16T14:10:08.475 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-16T14:10:08.476 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/uv_mmtimer.ko 2023-10-16T14:10:08.476 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/virtio_console.ko 2023-10-16T14:10:08.476 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq 2023-10-16T14:10:08.476 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-16T14:10:08.476 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-16T14:10:08.477 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-16T14:10:08.477 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-16T14:10:08.477 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-16T14:10:08.477 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-16T14:10:08.477 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto 2023-10-16T14:10:08.478 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp 2023-10-16T14:10:08.478 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-16T14:10:08.478 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-16T14:10:08.478 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel 2023-10-16T14:10:08.478 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat 2023-10-16T14:10:08.479 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-16T14:10:08.479 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-16T14:10:08.479 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-16T14:10:08.479 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-16T14:10:08.479 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-16T14:10:08.480 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-16T14:10:08.480 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio 2023-10-16T14:10:08.480 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-16T14:10:08.480 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca 2023-10-16T14:10:08.480 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-16T14:10:08.481 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq 2023-10-16T14:10:08.481 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-16T14:10:08.481 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma 2023-10-16T14:10:08.481 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw 2023-10-16T14:10:08.482 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-16T14:10:08.482 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat 2023-10-16T14:10:08.482 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-16T14:10:08.482 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac 2023-10-16T14:10:08.482 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-16T14:10:08.483 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-16T14:10:08.483 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-16T14:10:08.483 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-16T14:10:08.483 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-16T14:10:08.483 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-16T14:10:08.484 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-16T14:10:08.484 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-16T14:10:08.484 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-16T14:10:08.484 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-16T14:10:08.484 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-16T14:10:08.484 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-16T14:10:08.485 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-16T14:10:08.485 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware 2023-10-16T14:10:08.485 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/edd.ko 2023-10-16T14:10:08.485 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-16T14:10:08.485 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio 2023-10-16T14:10:08.486 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-16T14:10:08.486 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-16T14:10:08.486 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid 2023-10-16T14:10:08.486 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-16T14:10:08.486 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-16T14:10:08.487 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-16T14:10:08.487 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-16T14:10:08.487 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-16T14:10:08.487 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-16T14:10:08.487 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-16T14:10:08.488 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-16T14:10:08.488 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-16T14:10:08.488 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-16T14:10:08.488 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-16T14:10:08.488 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-16T14:10:08.489 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-16T14:10:08.489 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-16T14:10:08.489 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-16T14:10:08.489 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-16T14:10:08.489 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-16T14:10:08.489 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-16T14:10:08.490 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-16T14:10:08.490 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-16T14:10:08.490 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-16T14:10:08.490 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-16T14:10:08.490 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-16T14:10:08.491 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-16T14:10:08.491 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-16T14:10:08.491 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-16T14:10:08.491 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-16T14:10:08.491 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-16T14:10:08.492 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-16T14:10:08.492 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-16T14:10:08.492 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-16T14:10:08.492 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-16T14:10:08.492 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-16T14:10:08.493 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-16T14:10:08.493 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-16T14:10:08.493 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-16T14:10:08.493 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-16T14:10:08.493 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-16T14:10:08.494 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-16T14:10:08.494 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-16T14:10:08.494 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-16T14:10:08.494 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-16T14:10:08.494 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-16T14:10:08.495 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-16T14:10:08.495 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-16T14:10:08.495 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-16T14:10:08.495 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-16T14:10:08.495 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-16T14:10:08.496 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-16T14:10:08.496 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-16T14:10:08.496 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-16T14:10:08.496 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-16T14:10:08.496 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-16T14:10:08.497 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-16T14:10:08.497 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-16T14:10:08.497 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-16T14:10:08.497 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-16T14:10:08.497 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-16T14:10:08.498 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-16T14:10:08.498 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-16T14:10:08.498 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-16T14:10:08.498 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-16T14:10:08.498 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-16T14:10:08.499 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-16T14:10:08.499 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv 2023-10-16T14:10:08.499 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-16T14:10:08.499 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-16T14:10:08.499 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-16T14:10:08.500 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon 2023-10-16T14:10:08.500 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-16T14:10:08.500 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-16T14:10:08.500 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-16T14:10:08.500 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-16T14:10:08.501 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-16T14:10:08.501 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-16T14:10:08.501 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-16T14:10:08.501 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-16T14:10:08.501 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-16T14:10:08.502 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-16T14:10:08.502 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-16T14:10:08.502 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-16T14:10:08.502 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-16T14:10:08.502 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-16T14:10:08.503 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-16T14:10:08.503 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-16T14:10:08.503 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-16T14:10:08.503 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-16T14:10:08.503 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-16T14:10:08.504 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-16T14:10:08.504 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-16T14:10:08.504 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-16T14:10:08.504 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-16T14:10:08.504 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-16T14:10:08.505 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-16T14:10:08.505 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-16T14:10:08.505 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-16T14:10:08.505 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-16T14:10:08.505 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-16T14:10:08.506 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-16T14:10:08.506 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-16T14:10:08.506 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-16T14:10:08.506 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-16T14:10:08.507 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-16T14:10:08.507 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-16T14:10:08.507 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-16T14:10:08.507 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-16T14:10:08.507 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-16T14:10:08.507 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-16T14:10:08.508 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-16T14:10:08.508 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-16T14:10:08.508 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-16T14:10:08.508 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-16T14:10:08.508 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-16T14:10:08.509 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-16T14:10:08.509 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-16T14:10:08.509 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-16T14:10:08.509 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-16T14:10:08.509 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-16T14:10:08.509 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-16T14:10:08.510 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-16T14:10:08.510 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-16T14:10:08.510 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-16T14:10:08.510 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-16T14:10:08.510 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-16T14:10:08.511 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-16T14:10:08.511 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-16T14:10:08.511 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-16T14:10:08.511 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-16T14:10:08.511 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-16T14:10:08.512 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-16T14:10:08.512 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-16T14:10:08.512 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-16T14:10:08.512 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-16T14:10:08.512 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-16T14:10:08.512 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-16T14:10:08.513 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-16T14:10:08.513 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-16T14:10:08.513 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-16T14:10:08.513 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-16T14:10:08.513 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-16T14:10:08.514 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-16T14:10:08.514 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-16T14:10:08.514 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-16T14:10:08.514 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-16T14:10:08.514 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-16T14:10:08.515 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-16T14:10:08.515 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-16T14:10:08.515 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-16T14:10:08.515 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-16T14:10:08.515 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-16T14:10:08.515 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-16T14:10:08.516 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-16T14:10:08.516 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-16T14:10:08.516 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-16T14:10:08.516 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-16T14:10:08.516 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-16T14:10:08.517 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-16T14:10:08.517 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus 2023-10-16T14:10:08.517 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-16T14:10:08.517 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-16T14:10:08.517 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-16T14:10:08.517 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-16T14:10:08.518 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-16T14:10:08.518 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-16T14:10:08.518 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-16T14:10:08.518 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-16T14:10:08.518 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-16T14:10:08.519 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-16T14:10:08.519 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-16T14:10:08.519 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-16T14:10:08.519 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-16T14:10:08.519 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-16T14:10:08.519 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-16T14:10:08.520 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-16T14:10:08.520 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-16T14:10:08.520 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-16T14:10:08.520 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-16T14:10:08.520 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-16T14:10:08.521 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-16T14:10:08.521 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-16T14:10:08.521 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-16T14:10:08.521 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-16T14:10:08.521 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-16T14:10:08.522 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-16T14:10:08.522 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-16T14:10:08.522 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-16T14:10:08.522 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-16T14:10:08.522 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-16T14:10:08.523 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-16T14:10:08.523 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-16T14:10:08.523 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-16T14:10:08.523 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-16T14:10:08.523 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-16T14:10:08.524 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-16T14:10:08.524 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-16T14:10:08.524 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-16T14:10:08.524 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-16T14:10:08.524 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-16T14:10:08.524 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-16T14:10:08.525 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c 2023-10-16T14:10:08.525 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos 2023-10-16T14:10:08.525 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-16T14:10:08.525 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-16T14:10:08.525 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses 2023-10-16T14:10:08.525 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-16T14:10:08.526 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-16T14:10:08.526 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-16T14:10:08.526 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-16T14:10:08.526 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-16T14:10:08.526 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-16T14:10:08.527 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-16T14:10:08.527 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-16T14:10:08.527 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-16T14:10:08.527 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-16T14:10:08.527 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-16T14:10:08.528 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-16T14:10:08.528 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-16T14:10:08.528 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-16T14:10:08.528 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-16T14:10:08.528 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-16T14:10:08.528 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-16T14:10:08.529 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-16T14:10:08.529 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-16T14:10:08.529 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-16T14:10:08.529 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-16T14:10:08.529 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-16T14:10:08.530 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-16T14:10:08.530 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-dev.ko 2023-10-16T14:10:08.530 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-16T14:10:08.530 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-16T14:10:08.530 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-16T14:10:08.531 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-16T14:10:08.531 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband 2023-10-16T14:10:08.531 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core 2023-10-16T14:10:08.531 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-16T14:10:08.531 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-16T14:10:08.532 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-16T14:10:08.532 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-16T14:10:08.532 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-16T14:10:08.532 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-16T14:10:08.532 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-16T14:10:08.533 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw 2023-10-16T14:10:08.533 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4 2023-10-16T14:10:08.533 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-16T14:10:08.533 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4 2023-10-16T14:10:08.533 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-16T14:10:08.534 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5 2023-10-16T14:10:08.534 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-16T14:10:08.534 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca 2023-10-16T14:10:08.534 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-16T14:10:08.534 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp 2023-10-16T14:10:08.535 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib 2023-10-16T14:10:08.535 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-16T14:10:08.535 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser 2023-10-16T14:10:08.535 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-16T14:10:08.535 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert 2023-10-16T14:10:08.535 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-16T14:10:08.536 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp 2023-10-16T14:10:08.536 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-16T14:10:08.536 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt 2023-10-16T14:10:08.536 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-16T14:10:08.536 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input 2023-10-16T14:10:08.537 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport 2023-10-16T14:10:08.537 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-16T14:10:08.537 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-16T14:10:08.537 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-16T14:10:08.537 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-16T14:10:08.538 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard 2023-10-16T14:10:08.538 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-16T14:10:08.538 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse 2023-10-16T14:10:08.538 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-16T14:10:08.538 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-16T14:10:08.539 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-16T14:10:08.539 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-16T14:10:08.539 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-16T14:10:08.539 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-16T14:10:08.539 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-16T14:10:08.540 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-16T14:10:08.540 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4 2023-10-16T14:10:08.540 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-16T14:10:08.540 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio 2023-10-16T14:10:08.540 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-16T14:10:08.540 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-16T14:10:08.541 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-16T14:10:08.541 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-16T14:10:08.541 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-16T14:10:08.541 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu 2023-10-16T14:10:08.541 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd 2023-10-16T14:10:08.542 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-16T14:10:08.542 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds 2023-10-16T14:10:08.542 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-16T14:10:08.542 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-16T14:10:08.542 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-16T14:10:08.543 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-16T14:10:08.543 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger 2023-10-16T14:10:08.543 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-16T14:10:08.543 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-16T14:10:08.543 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-16T14:10:08.543 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-16T14:10:08.544 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-16T14:10:08.544 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-16T14:10:08.544 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-16T14:10:08.544 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-16T14:10:08.544 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md 2023-10-16T14:10:08.545 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache 2023-10-16T14:10:08.545 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-16T14:10:08.545 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-16T14:10:08.545 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-16T14:10:08.545 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-16T14:10:08.545 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-16T14:10:08.546 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-16T14:10:08.546 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-16T14:10:08.546 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-16T14:10:08.546 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-16T14:10:08.547 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-16T14:10:08.547 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-16T14:10:08.547 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-16T14:10:08.547 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-16T14:10:08.547 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-16T14:10:08.547 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-16T14:10:08.548 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-16T14:10:08.548 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-16T14:10:08.548 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-16T14:10:08.548 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-16T14:10:08.548 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data 2023-10-16T14:10:08.549 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-16T14:10:08.549 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-16T14:10:08.549 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-16T14:10:08.549 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-16T14:10:08.549 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-16T14:10:08.549 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message 2023-10-16T14:10:08.550 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion 2023-10-16T14:10:08.550 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-16T14:10:08.550 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-16T14:10:08.550 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-16T14:10:08.550 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-16T14:10:08.551 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-16T14:10:08.551 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-16T14:10:08.551 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-16T14:10:08.551 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd 2023-10-16T14:10:08.551 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-16T14:10:08.552 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-16T14:10:08.552 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mfd-core.ko 2023-10-16T14:10:08.552 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-16T14:10:08.552 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-16T14:10:08.552 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-16T14:10:08.552 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-16T14:10:08.553 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc 2023-10-16T14:10:08.553 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl 2023-10-16T14:10:08.553 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-16T14:10:08.553 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-16T14:10:08.553 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-16T14:10:08.553 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-16T14:10:08.554 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710 2023-10-16T14:10:08.554 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-16T14:10:08.554 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom 2023-10-16T14:10:08.554 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-16T14:10:08.554 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-16T14:10:08.555 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-16T14:10:08.555 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-16T14:10:08.555 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-16T14:10:08.555 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-16T14:10:08.555 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-16T14:10:08.556 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-16T14:10:08.556 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d 2023-10-16T14:10:08.556 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-16T14:10:08.556 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-16T14:10:08.557 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei 2023-10-16T14:10:08.557 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-16T14:10:08.557 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-16T14:10:08.557 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-16T14:10:08.557 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru 2023-10-16T14:10:08.558 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-16T14:10:08.558 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp 2023-10-16T14:10:08.558 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-16T14:10:08.558 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-16T14:10:08.558 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-16T14:10:08.559 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-16T14:10:08.559 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-16T14:10:08.559 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-16T14:10:08.559 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-16T14:10:08.559 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci 2023-10-16T14:10:08.560 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-16T14:10:08.560 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net 2023-10-16T14:10:08.560 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding 2023-10-16T14:10:08.560 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-16T14:10:08.560 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa 2023-10-16T14:10:08.561 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53 2023-10-16T14:10:08.561 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-16T14:10:08.561 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-16T14:10:08.561 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-16T14:10:08.561 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-16T14:10:08.562 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-16T14:10:08.562 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-16T14:10:08.562 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-16T14:10:08.562 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet 2023-10-16T14:10:08.562 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com 2023-10-16T14:10:08.563 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-16T14:10:08.563 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-16T14:10:08.563 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-16T14:10:08.563 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-16T14:10:08.564 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390 2023-10-16T14:10:08.564 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-16T14:10:08.564 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-16T14:10:08.564 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-16T14:10:08.564 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-16T14:10:08.565 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec 2023-10-16T14:10:08.565 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-16T14:10:08.565 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere 2023-10-16T14:10:08.565 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-16T14:10:08.565 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon 2023-10-16T14:10:08.566 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-16T14:10:08.566 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera 2023-10-16T14:10:08.566 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-16T14:10:08.566 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd 2023-10-16T14:10:08.566 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-16T14:10:08.567 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-16T14:10:08.567 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-16T14:10:08.567 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros 2023-10-16T14:10:08.567 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx 2023-10-16T14:10:08.567 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-16T14:10:08.567 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-16T14:10:08.568 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-16T14:10:08.568 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-16T14:10:08.568 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-16T14:10:08.568 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-16T14:10:08.568 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-16T14:10:08.569 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-16T14:10:08.569 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom 2023-10-16T14:10:08.569 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-16T14:10:08.569 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-16T14:10:08.569 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-16T14:10:08.570 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-16T14:10:08.570 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-16T14:10:08.570 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-16T14:10:08.570 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-16T14:10:08.570 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-16T14:10:08.571 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade 2023-10-16T14:10:08.571 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna 2023-10-16T14:10:08.571 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-16T14:10:08.571 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio 2023-10-16T14:10:08.571 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-16T14:10:08.572 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-16T14:10:08.572 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-16T14:10:08.572 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-16T14:10:08.572 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-16T14:10:08.572 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-16T14:10:08.572 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-16T14:10:08.573 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-16T14:10:08.573 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-16T14:10:08.573 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-16T14:10:08.573 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco 2023-10-16T14:10:08.573 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic 2023-10-16T14:10:08.574 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-16T14:10:08.574 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec 2023-10-16T14:10:08.574 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip 2023-10-16T14:10:08.574 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-16T14:10:08.574 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-16T14:10:08.575 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-16T14:10:08.575 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-16T14:10:08.575 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-16T14:10:08.575 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-16T14:10:08.575 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink 2023-10-16T14:10:08.576 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-16T14:10:08.576 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-16T14:10:08.576 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-16T14:10:08.576 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex 2023-10-16T14:10:08.576 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet 2023-10-16T14:10:08.577 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-16T14:10:08.577 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-16T14:10:08.577 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-16T14:10:08.577 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel 2023-10-16T14:10:08.578 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-16T14:10:08.578 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000 2023-10-16T14:10:08.578 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-16T14:10:08.578 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-16T14:10:08.578 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-16T14:10:08.579 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-16T14:10:08.579 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-16T14:10:08.579 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e 2023-10-16T14:10:08.579 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-16T14:10:08.579 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf 2023-10-16T14:10:08.580 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-16T14:10:08.580 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb 2023-10-16T14:10:08.580 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-16T14:10:08.580 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-16T14:10:08.580 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-16T14:10:08.581 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-16T14:10:08.581 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-16T14:10:08.581 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-16T14:10:08.581 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-16T14:10:08.581 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-16T14:10:08.582 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell 2023-10-16T14:10:08.582 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-16T14:10:08.582 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-16T14:10:08.582 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-16T14:10:08.582 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox 2023-10-16T14:10:08.583 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-16T14:10:08.583 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-16T14:10:08.583 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-16T14:10:08.583 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-16T14:10:08.583 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-16T14:10:08.584 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-16T14:10:08.584 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel 2023-10-16T14:10:08.584 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-16T14:10:08.584 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom 2023-10-16T14:10:08.585 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-16T14:10:08.585 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-16T14:10:08.585 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi 2023-10-16T14:10:08.585 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-16T14:10:08.585 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-16T14:10:08.586 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion 2023-10-16T14:10:08.586 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-16T14:10:08.586 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia 2023-10-16T14:10:08.586 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-16T14:10:08.586 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines 2023-10-16T14:10:08.587 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-16T14:10:08.587 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-16T14:10:08.587 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic 2023-10-16T14:10:08.587 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-16T14:10:08.587 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-16T14:10:08.587 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-16T14:10:08.588 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-16T14:10:08.588 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-16T14:10:08.588 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc 2023-10-16T14:10:08.588 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-16T14:10:08.588 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek 2023-10-16T14:10:08.589 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-16T14:10:08.589 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-16T14:10:08.589 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-16T14:10:08.589 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-16T14:10:08.589 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker 2023-10-16T14:10:08.590 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-16T14:10:08.590 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc 2023-10-16T14:10:08.590 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-16T14:10:08.590 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan 2023-10-16T14:10:08.590 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-16T14:10:08.591 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis 2023-10-16T14:10:08.591 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-16T14:10:08.591 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-16T14:10:08.591 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc 2023-10-16T14:10:08.591 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-16T14:10:08.592 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-16T14:10:08.592 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-16T14:10:08.592 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-16T14:10:08.592 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro 2023-10-16T14:10:08.592 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-16T14:10:08.593 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-16T14:10:08.593 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-16T14:10:08.593 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun 2023-10-16T14:10:08.593 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-16T14:10:08.593 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-16T14:10:08.593 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-16T14:10:08.594 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-16T14:10:08.594 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti 2023-10-16T14:10:08.594 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-16T14:10:08.594 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti 2023-10-16T14:10:08.595 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-16T14:10:08.595 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via 2023-10-16T14:10:08.595 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-16T14:10:08.595 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-16T14:10:08.595 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet 2023-10-16T14:10:08.595 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-16T14:10:08.596 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-16T14:10:08.596 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom 2023-10-16T14:10:08.596 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-16T14:10:08.596 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-16T14:10:08.596 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv 2023-10-16T14:10:08.597 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-16T14:10:08.597 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154 2023-10-16T14:10:08.597 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-16T14:10:08.597 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-16T14:10:08.597 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan 2023-10-16T14:10:08.597 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-16T14:10:08.598 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-16T14:10:08.598 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-16T14:10:08.598 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio 2023-10-16T14:10:08.598 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-16T14:10:08.598 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-16T14:10:08.599 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-16T14:10:08.599 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-16T14:10:08.599 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-16T14:10:08.599 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/net_failover.ko 2023-10-16T14:10:08.599 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-16T14:10:08.599 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-16T14:10:08.600 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs 2023-10-16T14:10:08.600 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-16T14:10:08.600 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-16T14:10:08.600 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy 2023-10-16T14:10:08.600 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-16T14:10:08.601 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-16T14:10:08.601 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-16T14:10:08.601 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-16T14:10:08.601 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-16T14:10:08.601 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-16T14:10:08.601 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-16T14:10:08.602 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-16T14:10:08.602 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/dp83640.ko 2023-10-16T14:10:08.602 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-16T14:10:08.602 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-16T14:10:08.602 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-16T14:10:08.603 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-16T14:10:08.603 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-16T14:10:08.603 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-16T14:10:08.603 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-16T14:10:08.603 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-16T14:10:08.603 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-16T14:10:08.604 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-16T14:10:08.604 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-16T14:10:08.604 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-16T14:10:08.604 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp 2023-10-16T14:10:08.604 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-16T14:10:08.604 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-16T14:10:08.605 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-16T14:10:08.605 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-16T14:10:08.605 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-16T14:10:08.605 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-16T14:10:08.605 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-16T14:10:08.605 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-16T14:10:08.606 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-16T14:10:08.606 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip 2023-10-16T14:10:08.606 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slhc.ko 2023-10-16T14:10:08.606 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-16T14:10:08.606 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-16T14:10:08.606 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-16T14:10:08.607 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team 2023-10-16T14:10:08.607 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-16T14:10:08.607 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-16T14:10:08.607 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-16T14:10:08.607 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-16T14:10:08.607 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-16T14:10:08.608 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-16T14:10:08.608 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tun.ko 2023-10-16T14:10:08.608 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-16T14:10:08.608 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/virtio_net.ko 2023-10-16T14:10:08.608 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3 2023-10-16T14:10:08.609 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-16T14:10:08.609 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan 2023-10-16T14:10:08.609 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-16T14:10:08.609 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback 2023-10-16T14:10:08.609 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-16T14:10:08.610 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netfront.ko 2023-10-16T14:10:08.610 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb 2023-10-16T14:10:08.610 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-16T14:10:08.610 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme 2023-10-16T14:10:08.610 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host 2023-10-16T14:10:08.611 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-16T14:10:08.611 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-16T14:10:08.611 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport 2023-10-16T14:10:08.611 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-16T14:10:08.611 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-16T14:10:08.612 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-16T14:10:08.612 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-16T14:10:08.612 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci 2023-10-16T14:10:08.612 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug 2023-10-16T14:10:08.612 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-16T14:10:08.612 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie 2023-10-16T14:10:08.613 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-16T14:10:08.613 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-16T14:10:08.613 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia 2023-10-16T14:10:08.613 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-16T14:10:08.613 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-16T14:10:08.613 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-16T14:10:08.614 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl 2023-10-16T14:10:08.614 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel 2023-10-16T14:10:08.614 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-16T14:10:08.614 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform 2023-10-16T14:10:08.614 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86 2023-10-16T14:10:08.615 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-16T14:10:08.615 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-16T14:10:08.615 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-16T14:10:08.615 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-16T14:10:08.615 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-16T14:10:08.616 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-16T14:10:08.616 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-16T14:10:08.616 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-16T14:10:08.616 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-16T14:10:08.616 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-16T14:10:08.617 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-16T14:10:08.617 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-16T14:10:08.617 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel 2023-10-16T14:10:08.617 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-16T14:10:08.617 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-16T14:10:08.618 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-16T14:10:08.618 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-16T14:10:08.618 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-16T14:10:08.618 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-16T14:10:08.618 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-16T14:10:08.618 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-16T14:10:08.619 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-16T14:10:08.619 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-16T14:10:08.619 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-16T14:10:08.619 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-16T14:10:08.619 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap 2023-10-16T14:10:08.620 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-16T14:10:08.620 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-16T14:10:08.620 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps 2023-10-16T14:10:08.620 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients 2023-10-16T14:10:08.620 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-16T14:10:08.621 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-16T14:10:08.621 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-16T14:10:08.621 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-16T14:10:08.621 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp 2023-10-16T14:10:08.621 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-16T14:10:08.622 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-16T14:10:08.622 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc 2023-10-16T14:10:08.622 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-16T14:10:08.622 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-16T14:10:08.622 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-16T14:10:08.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-16T14:10:08.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-16T14:10:08.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-16T14:10:08.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-16T14:10:08.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-16T14:10:08.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-16T14:10:08.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-16T14:10:08.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-16T14:10:08.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-16T14:10:08.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-16T14:10:08.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-16T14:10:08.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-16T14:10:08.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-16T14:10:08.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-16T14:10:08.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-16T14:10:08.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-16T14:10:08.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-16T14:10:08.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-16T14:10:08.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-16T14:10:08.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-16T14:10:08.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-16T14:10:08.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-16T14:10:08.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-16T14:10:08.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-16T14:10:08.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-16T14:10:08.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-16T14:10:08.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-16T14:10:08.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-16T14:10:08.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi 2023-10-16T14:10:08.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-16T14:10:08.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-16T14:10:08.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-16T14:10:08.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-16T14:10:08.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-16T14:10:08.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid 2023-10-16T14:10:08.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-16T14:10:08.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-16T14:10:08.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx 2023-10-16T14:10:08.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-16T14:10:08.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-16T14:10:08.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-16T14:10:08.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr 2023-10-16T14:10:08.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-16T14:10:08.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-16T14:10:08.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi 2023-10-16T14:10:08.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-16T14:10:08.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa 2023-10-16T14:10:08.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-16T14:10:08.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc 2023-10-16T14:10:08.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-16T14:10:08.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i 2023-10-16T14:10:08.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-16T14:10:08.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-16T14:10:08.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor 2023-10-16T14:10:08.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-16T14:10:08.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi 2023-10-16T14:10:08.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-16T14:10:08.634 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-16T14:10:08.634 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-16T14:10:08.634 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-16T14:10:08.634 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-16T14:10:08.634 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-16T14:10:08.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler 2023-10-16T14:10:08.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-16T14:10:08.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-16T14:10:08.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-16T14:10:08.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-16T14:10:08.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-16T14:10:08.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r 2023-10-16T14:10:08.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-16T14:10:08.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-16T14:10:08.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe 2023-10-16T14:10:08.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-16T14:10:08.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-16T14:10:08.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic 2023-10-16T14:10:08.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-16T14:10:08.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-16T14:10:08.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-16T14:10:08.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-16T14:10:08.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-16T14:10:08.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-16T14:10:08.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-16T14:10:08.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci 2023-10-16T14:10:08.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-16T14:10:08.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-16T14:10:08.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-16T14:10:08.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc 2023-10-16T14:10:08.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-16T14:10:08.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-16T14:10:08.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-16T14:10:08.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas 2023-10-16T14:10:08.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-16T14:10:08.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc 2023-10-16T14:10:08.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-16T14:10:08.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid 2023-10-16T14:10:08.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-16T14:10:08.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-16T14:10:08.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-16T14:10:08.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-16T14:10:08.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas 2023-10-16T14:10:08.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-16T14:10:08.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas 2023-10-16T14:10:08.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-16T14:10:08.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-16T14:10:08.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001 2023-10-16T14:10:08.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-16T14:10:08.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-16T14:10:08.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-16T14:10:08.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx 2023-10-16T14:10:08.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-16T14:10:08.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-16T14:10:08.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx 2023-10-16T14:10:08.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-16T14:10:08.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-16T14:10:08.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-16T14:10:08.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-16T14:10:08.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-16T14:10:08.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-16T14:10:08.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-16T14:10:08.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-16T14:10:08.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-16T14:10:08.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-16T14:10:08.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-16T14:10:08.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2 2023-10-16T14:10:08.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-16T14:10:08.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-16T14:10:08.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-16T14:10:08.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-16T14:10:08.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb 2023-10-16T14:10:08.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-16T14:10:08.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target 2023-10-16T14:10:08.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi 2023-10-16T14:10:08.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-16T14:10:08.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback 2023-10-16T14:10:08.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-16T14:10:08.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-16T14:10:08.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-16T14:10:08.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-16T14:10:08.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-16T14:10:08.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-16T14:10:08.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc 2023-10-16T14:10:08.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-16T14:10:08.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal 2023-10-16T14:10:08.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel 2023-10-16T14:10:08.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-16T14:10:08.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-16T14:10:08.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-16T14:10:08.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-16T14:10:08.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-16T14:10:08.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-16T14:10:08.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-16T14:10:08.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-16T14:10:08.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-16T14:10:08.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-16T14:10:08.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-16T14:10:08.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-16T14:10:08.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-16T14:10:08.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-16T14:10:08.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-16T14:10:08.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-16T14:10:08.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty 2023-10-16T14:10:08.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless 2023-10-16T14:10:08.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-16T14:10:08.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-16T14:10:08.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-16T14:10:08.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-16T14:10:08.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial 2023-10-16T14:10:08.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250 2023-10-16T14:10:08.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-16T14:10:08.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-16T14:10:08.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm 2023-10-16T14:10:08.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-16T14:10:08.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs 2023-10-16T14:10:08.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core 2023-10-16T14:10:08.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-16T14:10:08.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host 2023-10-16T14:10:08.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-16T14:10:08.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio 2023-10-16T14:10:08.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-16T14:10:08.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-16T14:10:08.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-16T14:10:08.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-16T14:10:08.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-16T14:10:08.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb 2023-10-16T14:10:08.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class 2023-10-16T14:10:08.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-16T14:10:08.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-16T14:10:08.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-16T14:10:08.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-16T14:10:08.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host 2023-10-16T14:10:08.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-16T14:10:08.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image 2023-10-16T14:10:08.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-16T14:10:08.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-16T14:10:08.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc 2023-10-16T14:10:08.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-16T14:10:08.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-16T14:10:08.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-16T14:10:08.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-16T14:10:08.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-16T14:10:08.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-16T14:10:08.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-16T14:10:08.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-16T14:10:08.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-16T14:10:08.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-16T14:10:08.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga 2023-10-16T14:10:08.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-16T14:10:08.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-16T14:10:08.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-16T14:10:08.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-16T14:10:08.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-16T14:10:08.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-16T14:10:08.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-16T14:10:08.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy 2023-10-16T14:10:08.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-16T14:10:08.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial 2023-10-16T14:10:08.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-16T14:10:08.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-16T14:10:08.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-16T14:10:08.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-16T14:10:08.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-16T14:10:08.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-16T14:10:08.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-16T14:10:08.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-16T14:10:08.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-16T14:10:08.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-16T14:10:08.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-16T14:10:08.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-16T14:10:08.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-16T14:10:08.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-16T14:10:08.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-16T14:10:08.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-16T14:10:08.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-16T14:10:08.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-16T14:10:08.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-16T14:10:08.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-16T14:10:08.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-16T14:10:08.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-16T14:10:08.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-16T14:10:08.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-16T14:10:08.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-16T14:10:08.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-16T14:10:08.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-16T14:10:08.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-16T14:10:08.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-16T14:10:08.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-16T14:10:08.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-16T14:10:08.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-16T14:10:08.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-16T14:10:08.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-16T14:10:08.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-16T14:10:08.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-16T14:10:08.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-16T14:10:08.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-16T14:10:08.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-16T14:10:08.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-16T14:10:08.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-16T14:10:08.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-16T14:10:08.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-16T14:10:08.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-16T14:10:08.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-16T14:10:08.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage 2023-10-16T14:10:08.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-16T14:10:08.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-16T14:10:08.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-16T14:10:08.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-16T14:10:08.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-16T14:10:08.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-16T14:10:08.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-16T14:10:08.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-16T14:10:08.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-16T14:10:08.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-16T14:10:08.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-16T14:10:08.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-16T14:10:08.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-16T14:10:08.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-16T14:10:08.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-16T14:10:08.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip 2023-10-16T14:10:08.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-16T14:10:08.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-16T14:10:08.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-16T14:10:08.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio 2023-10-16T14:10:08.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci 2023-10-16T14:10:08.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-16T14:10:08.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-16T14:10:08.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-16T14:10:08.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-16T14:10:08.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost 2023-10-16T14:10:08.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-16T14:10:08.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-16T14:10:08.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-16T14:10:08.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-16T14:10:08.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video 2023-10-16T14:10:08.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight 2023-10-16T14:10:08.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-16T14:10:08.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-16T14:10:08.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-16T14:10:08.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio 2023-10-16T14:10:08.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio.ko 2023-10-16T14:10:08.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-16T14:10:08.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-16T14:10:08.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci.ko 2023-10-16T14:10:08.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-16T14:10:08.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-16T14:10:08.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_ring.ko 2023-10-16T14:10:08.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1 2023-10-16T14:10:08.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters 2023-10-16T14:10:08.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-16T14:10:08.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-16T14:10:08.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves 2023-10-16T14:10:08.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-16T14:10:08.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-16T14:10:08.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-16T14:10:08.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-16T14:10:08.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-16T14:10:08.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-16T14:10:08.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-16T14:10:08.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-16T14:10:08.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-16T14:10:08.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-16T14:10:08.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-16T14:10:08.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-16T14:10:08.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog 2023-10-16T14:10:08.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-16T14:10:08.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-16T14:10:08.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-16T14:10:08.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-16T14:10:08.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-16T14:10:08.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-16T14:10:08.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-16T14:10:08.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-16T14:10:08.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-16T14:10:08.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-16T14:10:08.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-16T14:10:08.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-16T14:10:08.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-16T14:10:08.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-16T14:10:08.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-16T14:10:08.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-16T14:10:08.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-16T14:10:08.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-16T14:10:08.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-16T14:10:08.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-16T14:10:08.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-16T14:10:08.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-16T14:10:08.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-16T14:10:08.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-16T14:10:08.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-16T14:10:08.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-16T14:10:08.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen 2023-10-16T14:10:08.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-16T14:10:08.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-16T14:10:08.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-16T14:10:08.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-16T14:10:08.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback 2023-10-16T14:10:08.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-16T14:10:08.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-16T14:10:08.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs 2023-10-16T14:10:08.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-16T14:10:08.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs 2023-10-16T14:10:08.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p 2023-10-16T14:10:08.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-16T14:10:08.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs 2023-10-16T14:10:08.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-16T14:10:08.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs 2023-10-16T14:10:08.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-16T14:10:08.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-16T14:10:08.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs 2023-10-16T14:10:08.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-16T14:10:08.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles 2023-10-16T14:10:08.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-16T14:10:08.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph 2023-10-16T14:10:08.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-16T14:10:08.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda 2023-10-16T14:10:08.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-16T14:10:08.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs 2023-10-16T14:10:08.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-16T14:10:08.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm 2023-10-16T14:10:08.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-16T14:10:08.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs 2023-10-16T14:10:08.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-16T14:10:08.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs 2023-10-16T14:10:08.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-16T14:10:08.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat 2023-10-16T14:10:08.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/fat.ko 2023-10-16T14:10:08.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-16T14:10:08.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/vfat.ko 2023-10-16T14:10:08.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache 2023-10-16T14:10:08.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-16T14:10:08.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse 2023-10-16T14:10:08.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-16T14:10:08.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/fuse.ko 2023-10-16T14:10:08.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2 2023-10-16T14:10:08.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-16T14:10:08.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs 2023-10-16T14:10:08.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-16T14:10:08.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus 2023-10-16T14:10:08.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-16T14:10:08.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs 2023-10-16T14:10:08.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-16T14:10:08.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs 2023-10-16T14:10:08.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-16T14:10:08.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd 2023-10-16T14:10:08.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-16T14:10:08.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix 2023-10-16T14:10:08.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-16T14:10:08.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs 2023-10-16T14:10:08.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-16T14:10:08.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs 2023-10-16T14:10:08.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout 2023-10-16T14:10:08.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-16T14:10:08.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout 2023-10-16T14:10:08.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-16T14:10:08.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout 2023-10-16T14:10:08.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-16T14:10:08.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-16T14:10:08.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-16T14:10:08.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-16T14:10:08.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common 2023-10-16T14:10:08.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-16T14:10:08.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-16T14:10:08.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd 2023-10-16T14:10:08.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-16T14:10:08.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2 2023-10-16T14:10:08.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-16T14:10:08.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls 2023-10-16T14:10:08.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-16T14:10:08.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-16T14:10:08.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-16T14:10:08.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-16T14:10:08.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-16T14:10:08.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-16T14:10:08.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-16T14:10:08.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-16T14:10:08.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-16T14:10:08.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-16T14:10:08.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-16T14:10:08.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-16T14:10:08.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-16T14:10:08.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-16T14:10:08.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-16T14:10:08.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-16T14:10:08.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-16T14:10:08.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-16T14:10:08.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-16T14:10:08.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-16T14:10:08.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-16T14:10:08.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-16T14:10:08.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-16T14:10:08.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-16T14:10:08.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-16T14:10:08.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-16T14:10:08.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-16T14:10:08.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-16T14:10:08.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-16T14:10:08.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-16T14:10:08.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-16T14:10:08.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-16T14:10:08.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-16T14:10:08.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-16T14:10:08.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-16T14:10:08.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-16T14:10:08.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-16T14:10:08.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-16T14:10:08.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-16T14:10:08.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-16T14:10:08.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-16T14:10:08.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-16T14:10:08.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-16T14:10:08.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-16T14:10:08.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-16T14:10:08.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-16T14:10:08.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-16T14:10:08.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-16T14:10:08.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-16T14:10:08.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-16T14:10:08.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2 2023-10-16T14:10:08.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster 2023-10-16T14:10:08.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-16T14:10:08.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm 2023-10-16T14:10:08.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-16T14:10:08.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs 2023-10-16T14:10:08.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-16T14:10:08.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-16T14:10:08.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-16T14:10:08.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-16T14:10:08.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-16T14:10:08.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs 2023-10-16T14:10:08.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-16T14:10:08.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore 2023-10-16T14:10:08.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-16T14:10:08.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs 2023-10-16T14:10:08.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-16T14:10:08.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs 2023-10-16T14:10:08.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-16T14:10:08.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb 2023-10-16T14:10:08.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client 2023-10-16T14:10:08.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-16T14:10:08.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common 2023-10-16T14:10:08.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-16T14:10:08.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-16T14:10:08.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs 2023-10-16T14:10:08.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-16T14:10:08.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv 2023-10-16T14:10:08.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-16T14:10:08.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf 2023-10-16T14:10:08.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-16T14:10:08.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs 2023-10-16T14:10:08.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-16T14:10:08.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs 2023-10-16T14:10:08.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-16T14:10:08.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel 2023-10-16T14:10:08.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu 2023-10-16T14:10:08.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu/rcutorture.ko 2023-10-16T14:10:08.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-16T14:10:08.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace 2023-10-16T14:10:08.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-16T14:10:08.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib 2023-10-16T14:10:08.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/asn1_encoder.ko 2023-10-16T14:10:08.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-16T14:10:08.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-16T14:10:08.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto 2023-10-16T14:10:08.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-16T14:10:08.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-16T14:10:08.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-16T14:10:08.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-16T14:10:08.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4 2023-10-16T14:10:08.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-16T14:10:08.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-16T14:10:08.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math 2023-10-16T14:10:08.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-16T14:10:08.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6 2023-10-16T14:10:08.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-16T14:10:08.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon 2023-10-16T14:10:08.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-16T14:10:08.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-16T14:10:08.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-16T14:10:08.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-16T14:10:08.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd 2023-10-16T14:10:08.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd/zstd_compress.ko 2023-10-16T14:10:08.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm 2023-10-16T14:10:08.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-16T14:10:08.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net 2023-10-16T14:10:08.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan 2023-10-16T14:10:08.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-16T14:10:08.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-16T14:10:08.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-16T14:10:08.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-16T14:10:08.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-16T14:10:08.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-16T14:10:08.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-16T14:10:08.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-16T14:10:08.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802 2023-10-16T14:10:08.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-16T14:10:08.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-16T14:10:08.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-16T14:10:08.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-16T14:10:08.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-16T14:10:08.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q 2023-10-16T14:10:08.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-16T14:10:08.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p 2023-10-16T14:10:08.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-16T14:10:08.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-16T14:10:08.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-16T14:10:08.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-16T14:10:08.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv 2023-10-16T14:10:08.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-16T14:10:08.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge 2023-10-16T14:10:08.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-16T14:10:08.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-16T14:10:08.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter 2023-10-16T14:10:08.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-16T14:10:08.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-16T14:10:08.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-16T14:10:08.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-16T14:10:08.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-16T14:10:08.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-16T14:10:08.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-16T14:10:08.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-16T14:10:08.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-16T14:10:08.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-16T14:10:08.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-16T14:10:08.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-16T14:10:08.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-16T14:10:08.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-16T14:10:08.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-16T14:10:08.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-16T14:10:08.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-16T14:10:08.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-16T14:10:08.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-16T14:10:08.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-16T14:10:08.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-16T14:10:08.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-16T14:10:08.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-16T14:10:08.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-16T14:10:08.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph 2023-10-16T14:10:08.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-16T14:10:08.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core 2023-10-16T14:10:08.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/failover.ko 2023-10-16T14:10:08.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-16T14:10:08.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp 2023-10-16T14:10:08.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-16T14:10:08.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-16T14:10:08.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-16T14:10:08.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-16T14:10:08.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver 2023-10-16T14:10:08.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-16T14:10:08.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa 2023-10-16T14:10:08.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-16T14:10:08.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-16T14:10:08.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-16T14:10:08.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-16T14:10:08.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-16T14:10:08.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154 2023-10-16T14:10:08.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan 2023-10-16T14:10:08.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-16T14:10:08.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-16T14:10:08.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-16T14:10:08.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4 2023-10-16T14:10:08.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-16T14:10:08.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-16T14:10:08.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-16T14:10:08.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-16T14:10:08.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-16T14:10:08.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-16T14:10:08.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-16T14:10:08.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-16T14:10:08.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-16T14:10:08.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-16T14:10:08.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter 2023-10-16T14:10:08.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-16T14:10:08.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-16T14:10:08.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-16T14:10:08.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-16T14:10:08.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-16T14:10:08.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-16T14:10:08.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-16T14:10:08.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-16T14:10:08.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-16T14:10:08.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-16T14:10:08.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-16T14:10:08.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-16T14:10:08.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-16T14:10:08.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-16T14:10:08.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-16T14:10:08.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-16T14:10:08.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-16T14:10:08.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-16T14:10:08.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-16T14:10:08.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-16T14:10:08.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-16T14:10:08.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-16T14:10:08.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-16T14:10:08.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-16T14:10:08.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-16T14:10:08.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-16T14:10:08.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-16T14:10:08.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-16T14:10:08.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-16T14:10:08.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-16T14:10:08.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-16T14:10:08.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-16T14:10:08.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-16T14:10:08.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-16T14:10:08.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-16T14:10:08.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-16T14:10:08.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-16T14:10:08.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-16T14:10:08.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6 2023-10-16T14:10:08.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-16T14:10:08.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-16T14:10:08.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-16T14:10:08.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-16T14:10:08.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-16T14:10:08.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-16T14:10:08.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-16T14:10:08.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter 2023-10-16T14:10:08.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-16T14:10:08.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-16T14:10:08.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-16T14:10:08.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-16T14:10:08.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-16T14:10:08.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-16T14:10:08.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-16T14:10:08.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-16T14:10:08.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-16T14:10:08.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-16T14:10:08.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-16T14:10:08.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-16T14:10:08.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-16T14:10:08.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-16T14:10:08.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-16T14:10:08.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-16T14:10:08.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-16T14:10:08.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-16T14:10:08.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-16T14:10:08.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-16T14:10:08.754 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-16T14:10:08.754 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-16T14:10:08.754 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-16T14:10:08.754 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-16T14:10:08.754 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-16T14:10:08.755 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-16T14:10:08.755 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-16T14:10:08.755 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key 2023-10-16T14:10:08.755 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-16T14:10:08.755 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp 2023-10-16T14:10:08.756 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-16T14:10:08.756 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-16T14:10:08.756 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-16T14:10:08.756 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-16T14:10:08.756 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-16T14:10:08.756 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-16T14:10:08.757 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-16T14:10:08.757 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc 2023-10-16T14:10:08.757 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-16T14:10:08.757 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154 2023-10-16T14:10:08.757 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-16T14:10:08.758 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls 2023-10-16T14:10:08.758 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-16T14:10:08.758 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter 2023-10-16T14:10:08.758 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset 2023-10-16T14:10:08.758 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-16T14:10:08.759 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-16T14:10:08.759 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-16T14:10:08.759 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-16T14:10:08.759 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-16T14:10:08.759 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-16T14:10:08.760 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-16T14:10:08.760 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-16T14:10:08.760 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-16T14:10:08.760 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-16T14:10:08.760 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-16T14:10:08.761 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-16T14:10:08.761 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-16T14:10:08.761 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-16T14:10:08.761 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-16T14:10:08.761 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-16T14:10:08.761 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs 2023-10-16T14:10:08.762 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-16T14:10:08.762 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-16T14:10:08.762 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-16T14:10:08.762 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-16T14:10:08.762 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-16T14:10:08.763 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-16T14:10:08.763 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-16T14:10:08.763 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-16T14:10:08.763 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-16T14:10:08.763 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-16T14:10:08.764 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-16T14:10:08.764 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-16T14:10:08.764 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-16T14:10:08.764 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-16T14:10:08.764 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-16T14:10:08.765 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-16T14:10:08.765 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-16T14:10:08.765 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-16T14:10:08.765 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-16T14:10:08.765 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-16T14:10:08.765 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-16T14:10:08.766 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-16T14:10:08.766 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-16T14:10:08.766 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-16T14:10:08.766 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-16T14:10:08.766 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-16T14:10:08.767 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-16T14:10:08.767 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-16T14:10:08.767 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-16T14:10:08.767 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-16T14:10:08.767 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-16T14:10:08.768 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-16T14:10:08.768 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-16T14:10:08.768 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-16T14:10:08.768 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-16T14:10:08.768 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-16T14:10:08.768 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-16T14:10:08.769 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-16T14:10:08.769 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-16T14:10:08.769 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-16T14:10:08.769 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-16T14:10:08.769 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-16T14:10:08.769 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-16T14:10:08.770 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-16T14:10:08.770 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-16T14:10:08.770 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-16T14:10:08.770 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-16T14:10:08.770 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-16T14:10:08.771 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-16T14:10:08.771 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-16T14:10:08.771 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-16T14:10:08.771 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-16T14:10:08.771 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-16T14:10:08.772 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-16T14:10:08.772 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-16T14:10:08.772 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-16T14:10:08.772 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-16T14:10:08.772 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-16T14:10:08.773 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_quota.ko 2023-10-16T14:10:08.773 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-16T14:10:08.773 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-16T14:10:08.773 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-16T14:10:08.773 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-16T14:10:08.773 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tunnel.ko 2023-10-16T14:10:08.774 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-16T14:10:08.774 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-16T14:10:08.774 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-16T14:10:08.774 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-16T14:10:08.774 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-16T14:10:08.775 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-16T14:10:08.775 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-16T14:10:08.775 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-16T14:10:08.775 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-16T14:10:08.775 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-16T14:10:08.776 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-16T14:10:08.776 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-16T14:10:08.776 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-16T14:10:08.776 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-16T14:10:08.776 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-16T14:10:08.777 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-16T14:10:08.777 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-16T14:10:08.777 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-16T14:10:08.777 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-16T14:10:08.777 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-16T14:10:08.778 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-16T14:10:08.778 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-16T14:10:08.778 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-16T14:10:08.778 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-16T14:10:08.778 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-16T14:10:08.779 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-16T14:10:08.779 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-16T14:10:08.779 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-16T14:10:08.779 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-16T14:10:08.779 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-16T14:10:08.780 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-16T14:10:08.780 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-16T14:10:08.780 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-16T14:10:08.780 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-16T14:10:08.780 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-16T14:10:08.780 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-16T14:10:08.781 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-16T14:10:08.781 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-16T14:10:08.781 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-16T14:10:08.781 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-16T14:10:08.781 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-16T14:10:08.782 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-16T14:10:08.782 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-16T14:10:08.782 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-16T14:10:08.782 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-16T14:10:08.782 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-16T14:10:08.783 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-16T14:10:08.783 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-16T14:10:08.783 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-16T14:10:08.783 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-16T14:10:08.783 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-16T14:10:08.783 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-16T14:10:08.784 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-16T14:10:08.784 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-16T14:10:08.784 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-16T14:10:08.784 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-16T14:10:08.784 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-16T14:10:08.785 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-16T14:10:08.785 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-16T14:10:08.785 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-16T14:10:08.785 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-16T14:10:08.785 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-16T14:10:08.786 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-16T14:10:08.786 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-16T14:10:08.786 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-16T14:10:08.786 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-16T14:10:08.786 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-16T14:10:08.787 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-16T14:10:08.787 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-16T14:10:08.787 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-16T14:10:08.787 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-16T14:10:08.787 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink 2023-10-16T14:10:08.788 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-16T14:10:08.788 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh 2023-10-16T14:10:08.788 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-16T14:10:08.788 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch 2023-10-16T14:10:08.788 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-16T14:10:08.788 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-16T14:10:08.789 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-16T14:10:08.789 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-16T14:10:08.789 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet 2023-10-16T14:10:08.789 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-16T14:10:08.789 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds 2023-10-16T14:10:08.790 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-16T14:10:08.790 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-16T14:10:08.790 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-16T14:10:08.790 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched 2023-10-16T14:10:08.790 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-16T14:10:08.791 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-16T14:10:08.791 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-16T14:10:08.791 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-16T14:10:08.791 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-16T14:10:08.791 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-16T14:10:08.792 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-16T14:10:08.792 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-16T14:10:08.792 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-16T14:10:08.792 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-16T14:10:08.792 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-16T14:10:08.792 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-16T14:10:08.793 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-16T14:10:08.793 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-16T14:10:08.793 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-16T14:10:08.793 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-16T14:10:08.793 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-16T14:10:08.794 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-16T14:10:08.794 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-16T14:10:08.794 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-16T14:10:08.794 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-16T14:10:08.795 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-16T14:10:08.795 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-16T14:10:08.795 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-16T14:10:08.795 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-16T14:10:08.795 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-16T14:10:08.795 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-16T14:10:08.796 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-16T14:10:08.796 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-16T14:10:08.796 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-16T14:10:08.796 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-16T14:10:08.796 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-16T14:10:08.797 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-16T14:10:08.797 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-16T14:10:08.797 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-16T14:10:08.797 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-16T14:10:08.797 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-16T14:10:08.798 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-16T14:10:08.798 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-16T14:10:08.798 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-16T14:10:08.798 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-16T14:10:08.798 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-16T14:10:08.798 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-16T14:10:08.799 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-16T14:10:08.799 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp 2023-10-16T14:10:08.799 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-16T14:10:08.799 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-16T14:10:08.799 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc 2023-10-16T14:10:08.800 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss 2023-10-16T14:10:08.800 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-16T14:10:08.800 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-16T14:10:08.800 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-16T14:10:08.800 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma 2023-10-16T14:10:08.801 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-16T14:10:08.801 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc 2023-10-16T14:10:08.801 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-16T14:10:08.801 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-16T14:10:08.801 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix 2023-10-16T14:10:08.802 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-16T14:10:08.802 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock 2023-10-16T14:10:08.802 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-16T14:10:08.802 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-16T14:10:08.802 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-16T14:10:08.802 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-16T14:10:08.803 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-16T14:10:08.803 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm 2023-10-16T14:10:08.803 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-16T14:10:08.803 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security 2023-10-16T14:10:08.803 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys 2023-10-16T14:10:08.804 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys 2023-10-16T14:10:08.804 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-16T14:10:08.804 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys 2023-10-16T14:10:08.804 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-16T14:10:08.804 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt 2023-10-16T14:10:08.805 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib 2023-10-16T14:10:08.805 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-16T14:10:08.805 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-16T14:10:08.805 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-16T14:10:08.805 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-16T14:10:08.806 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-16T14:10:08.806 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-16T14:10:08.806 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-16T14:10:08.806 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-16T14:10:08.806 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-16T14:10:08.807 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-16T14:10:08.807 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-16T14:10:08.807 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-16T14:10:08.807 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-16T14:10:08.807 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-16T14:10:08.808 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-16T14:10:08.808 DEBUG:teuthology.orchestra.run.smithi151:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-16T14:10:08.831 INFO:teuthology.orchestra.run.smithi151.stdout:postinstall scriptlet (using /bin/sh): 2023-10-16T14:10:08.831 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g47672119149b -a -r /boot/System.map-6.6.0-rc5-g47672119149b ]; then 2023-10-16T14:10:08.832 INFO:teuthology.orchestra.run.smithi151.stdout:cp /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm 2023-10-16T14:10:08.832 INFO:teuthology.orchestra.run.smithi151.stdout:cp /boot/System.map-6.6.0-rc5-g47672119149b /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-16T14:10:08.832 INFO:teuthology.orchestra.run.smithi151.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/System.map-6.6.0-rc5-g47672119149b 2023-10-16T14:10:08.832 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/installkernel 6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-16T14:10:08.832 INFO:teuthology.orchestra.run.smithi151.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-16T14:10:08.833 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-10-16T14:10:08.833 INFO:teuthology.orchestra.run.smithi151.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-16T14:10:08.833 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-16T14:10:08.833 INFO:teuthology.orchestra.run.smithi151.stdout:new-kernel-pkg --remove 6.6.0-rc5-g47672119149b --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g47672119149b.img 2023-10-16T14:10:08.833 INFO:teuthology.orchestra.run.smithi151.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-16T14:10:08.834 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-install remove 6.6.0-rc5-g47672119149b 2023-10-16T14:10:08.834 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-10-16T14:10:08.834 INFO:teuthology.orchestra.run.smithi151.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-16T14:10:08.834 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-16T14:10:08.834 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g47672119149b 2023-10-16T14:10:08.835 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-10-16T14:10:08.836 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -qi grub2-tools 2023-10-16T14:10:08.910 INFO:teuthology.orchestra.run.smithi151.stdout:Name : grub2-tools 2023-10-16T14:10:08.910 INFO:teuthology.orchestra.run.smithi151.stdout:Epoch : 1 2023-10-16T14:10:08.911 INFO:teuthology.orchestra.run.smithi151.stdout:Version : 2.06 2023-10-16T14:10:08.911 INFO:teuthology.orchestra.run.smithi151.stdout:Release : 68.el9 2023-10-16T14:10:08.911 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: x86_64 2023-10-16T14:10:08.911 INFO:teuthology.orchestra.run.smithi151.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-16T14:10:08.911 INFO:teuthology.orchestra.run.smithi151.stdout:Group : Unspecified 2023-10-16T14:10:08.912 INFO:teuthology.orchestra.run.smithi151.stdout:Size : 8264254 2023-10-16T14:10:08.912 INFO:teuthology.orchestra.run.smithi151.stdout:License : GPLv3+ 2023-10-16T14:10:08.912 INFO:teuthology.orchestra.run.smithi151.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-16T14:10:08.912 INFO:teuthology.orchestra.run.smithi151.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-16T14:10:08.913 INFO:teuthology.orchestra.run.smithi151.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-16T14:10:08.913 INFO:teuthology.orchestra.run.smithi151.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-16T14:10:08.913 INFO:teuthology.orchestra.run.smithi151.stdout:Packager : builder@centos.org 2023-10-16T14:10:08.913 INFO:teuthology.orchestra.run.smithi151.stdout:Vendor : CentOS 2023-10-16T14:10:08.913 INFO:teuthology.orchestra.run.smithi151.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-16T14:10:08.913 INFO:teuthology.orchestra.run.smithi151.stdout:Summary : Support tools for GRUB. 2023-10-16T14:10:08.914 INFO:teuthology.orchestra.run.smithi151.stdout:Description : 2023-10-16T14:10:08.914 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:10:08.914 INFO:teuthology.orchestra.run.smithi151.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-16T14:10:08.914 INFO:teuthology.orchestra.run.smithi151.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-16T14:10:08.915 INFO:teuthology.orchestra.run.smithi151.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-16T14:10:08.915 INFO:teuthology.orchestra.run.smithi151.stdout:hardware devices. 2023-10-16T14:10:08.915 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:10:08.915 INFO:teuthology.orchestra.run.smithi151.stdout:This subpackage provides tools for support of all platforms. 2023-10-16T14:10:08.916 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-16T14:10:08.916 INFO:teuthology.task.kernel:Updating grub on smithi151 to boot 6.6.0-rc5-g47672119149b 2023-10-16T14:10:08.917 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-16T14:10:09.477 INFO:teuthology.orchestra.run.smithi151.stderr:Generating grub configuration file ... 2023-10-16T14:10:10.972 INFO:teuthology.orchestra.run.smithi151.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-16T14:10:11.011 INFO:teuthology.orchestra.run.smithi151.stderr:done 2023-10-16T14:10:11.014 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2023-10-16T14:10:11.029 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.Jcjavu6kz1 2023-10-16T14:10:11.030 DEBUG:teuthology.orchestra.run.smithi151:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Jcjavu6kz1 2023-10-16T14:10:11.099 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.Jcjavu6kz1 2023-10-16T14:10:11.244 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.Jcjavu6kz1 is 6KB 2023-10-16T14:10:11.263 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.Jcjavu6kz1 2023-10-16T14:10:11.277 DEBUG:teuthology.orchestra.run.smithi151:> sudo /bin/ls /boot/loader/entries || true 2023-10-16T14:10:11.342 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-16T14:10:11.342 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-16T14:10:11.343 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-16T14:10:11.343 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b.conf 2023-10-16T14:10:11.344 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b 2023-10-16T14:10:11.497 DEBUG:teuthology.orchestra.run.smithi151:> sudo shutdown -r now 2023-10-16T14:10:17.410 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-16T14:10:17.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-16T14:10:17.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T14:10:41.522 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-16T14:10:41.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-16T14:10:41.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T14:11:16.223 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-16T14:11:17.414 DEBUG:teuthology.orchestra.remote:timed out 2023-10-16T14:11:25.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-16T14:11:25.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T14:11:26.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-16T14:11:26.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T14:11:29.781 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-10-16T14:11:30.532 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-16T14:11:30.533 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-rc5-g47672119149b"... 2023-10-16T14:11:30.533 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2023-10-16T14:11:30.574 INFO:teuthology.orchestra.run.smithi059.stdout:6.6.0-rc5-g47672119149b 2023-10-16T14:11:30.574 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-16T14:11:30.575 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-16T14:11:30.575 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-16T14:11:31.576 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-16T14:11:31.577 DEBUG:teuthology.orchestra.run.smithi059:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-16T14:11:31.780 INFO:teuthology.orchestra.run.smithi059.stdout:ttyS1 2023-10-16T14:11:31.837 DEBUG:teuthology.parallel:result is None 2023-10-16T14:11:43.610 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-16T14:11:55.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-16T14:11:55.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T14:11:58.686 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-16T14:12:13.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-16T14:12:13.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T14:12:14.164 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-10-16T14:12:14.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-16T14:12:14.728 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-rc5-g47672119149b"... 2023-10-16T14:12:14.728 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2023-10-16T14:12:14.767 INFO:teuthology.orchestra.run.smithi151.stdout:6.6.0-rc5-g47672119149b 2023-10-16T14:12:14.767 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-16T14:12:14.768 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-16T14:12:14.768 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-16T14:12:15.769 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-16T14:12:15.770 DEBUG:teuthology.orchestra.run.smithi151:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-16T14:12:15.907 INFO:teuthology.orchestra.run.smithi151.stdout:ttyS1 2023-10-16T14:12:15.947 DEBUG:teuthology.parallel:result is None 2023-10-16T14:12:15.948 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-16T14:12:15.956 INFO:teuthology.task.internal:Creating test directory... 2023-10-16T14:12:15.956 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T14:12:15.966 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-16T14:12:16.022 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-16T14:12:16.029 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-16T14:12:16.036 INFO:teuthology.task.internal:Creating archive directory... 2023-10-16T14:12:16.036 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T14:12:16.042 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-16T14:12:16.110 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-16T14:12:16.119 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-16T14:12:16.119 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T14:12:16.125 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-16T14:12:16.217 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T14:12:16.252 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T14:12:16.257 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T14:12:16.297 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-16T14:12:16.301 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-16T14:12:16.308 INFO:teuthology.task.internal:Configuring sudo... 2023-10-16T14:12:16.309 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T14:12:16.314 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-16T14:12:16.412 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-16T14:12:16.421 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-16T14:12:16.422 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T14:12:16.428 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-16T14:12:16.479 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T14:12:16.565 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T14:12:16.682 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T14:12:16.774 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T14:12:16.884 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:12:16.885 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T14:12:16.990 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T14:12:17.066 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-16T14:12:17.151 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T14:12:17.267 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-16T14:12:17.440 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:12:17.441 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-16T14:12:17.590 DEBUG:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2023-10-16T14:12:17.599 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2023-10-16T14:12:17.741 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T14:12:17.800 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T14:12:18.324 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-16T14:12:18.333 INFO:teuthology.task.internal:Starting timer... 2023-10-16T14:12:18.333 INFO:teuthology.run_tasks:Running task pcp... 2023-10-16T14:12:18.344 INFO:teuthology.run_tasks:Running task selinux... 2023-10-16T14:12:18.352 DEBUG:teuthology.orchestra.run.smithi059:> sudo service auditd rotate 2023-10-16T14:12:18.520 INFO:teuthology.orchestra.run.smithi059.stdout:Rotating logs: 2023-10-16T14:12:18.526 DEBUG:teuthology.orchestra.run.smithi151:> sudo service auditd rotate 2023-10-16T14:12:18.753 INFO:teuthology.orchestra.run.smithi151.stdout:Rotating logs: 2023-10-16T14:12:18.758 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-16T14:12:18.758 DEBUG:teuthology.orchestra.run.smithi059:> /usr/sbin/getenforce 2023-10-16T14:12:18.829 INFO:teuthology.orchestra.run.smithi059.stdout:Permissive 2023-10-16T14:12:18.830 DEBUG:teuthology.orchestra.run.smithi151:> /usr/sbin/getenforce 2023-10-16T14:12:18.880 INFO:teuthology.orchestra.run.smithi151.stdout:Permissive 2023-10-16T14:12:18.880 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi059.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi151.front.sepia.ceph.com': 'permissive'} 2023-10-16T14:12:18.881 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T14:12:18.983 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T14:12:18.984 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-16T14:12:19.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T14:12:19.066 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-16T14:12:19.067 DEBUG:teuthology.orchestra.run.smithi059:> sudo /usr/sbin/setenforce permissive 2023-10-16T14:12:19.185 DEBUG:teuthology.orchestra.run.smithi151:> sudo /usr/sbin/setenforce permissive 2023-10-16T14:12:19.276 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-16T14:12:19.286 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-16T14:12:19.291 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-16T14:12:19.439 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-16T14:12:19.455 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-16T14:12:19.457 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi059.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-16T14:22:31.375 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi059.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2023-10-16T14:22:31.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-16T14:22:31.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T14:22:31.526 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-10-16T14:22:31.686 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-16T14:22:31.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-16T14:22:31.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T14:22:31.819 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-10-16T14:22:31.963 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-16T14:22:31.963 INFO:teuthology.run_tasks:Running task clock... 2023-10-16T14:22:31.974 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-16T14:22:31.974 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T14:22:31.975 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T14:22:31.984 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-16T14:22:31.985 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T14:22:32.087 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-16T14:22:32.090 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-16T14:22:32.137 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-16T14:22:32.144 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-16T14:22:32.227 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: ntpd: command not found 2023-10-16T14:22:32.245 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: ntpd: command not found 2023-10-16T14:22:32.267 INFO:teuthology.orchestra.run.smithi151.stdout:506 Cannot talk to daemon 2023-10-16T14:22:32.292 INFO:teuthology.orchestra.run.smithi059.stdout:506 Cannot talk to daemon 2023-10-16T14:22:32.319 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-16T14:22:32.350 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-16T14:22:32.370 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-16T14:22:32.410 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-16T14:22:32.499 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2023-10-16T14:22:32.508 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T14:22:32.508 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2023-10-16T14:22:32.509 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T14:22:32.509 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T14:22:32.509 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T14:22:32.509 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T14:22:32.548 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: ntpq: command not found 2023-10-16T14:22:32.557 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T14:22:32.558 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2023-10-16T14:22:32.558 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T14:22:32.558 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T14:22:32.558 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T14:22:32.559 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T14:22:32.560 INFO:teuthology.run_tasks:Running task install... 2023-10-16T14:22:32.568 DEBUG:teuthology.task.install:project ceph 2023-10-16T14:22:32.568 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}} 2023-10-16T14:22:32.568 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'} 2023-10-16T14:22:32.569 INFO:teuthology.task.install:Using flavor: default 2023-10-16T14:22:32.575 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-16T14:22:32.575 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-16T14:22:32.576 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-16T14:22:32.576 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T14:22:32.578 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-16T14:22:32.579 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T14:22:32.723 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/ 2023-10-16T14:22:32.723 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-16T14:22:32.737 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/ 2023-10-16T14:22:32.737 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-16T14:22:32.900 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-16T14:22:32.901 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:22:32.901 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-16T14:22:32.907 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-16T14:22:32.907 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:22:32.908 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-16T14:22:33.004 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-16T14:22:33.005 DEBUG:teuthology.orchestra.run.smithi151:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-16T14:22:33.014 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-16T14:22:33.014 DEBUG:teuthology.orchestra.run.smithi059:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-16T14:22:33.151 DEBUG:teuthology.orchestra.run.smithi151:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-16T14:22:33.162 DEBUG:teuthology.orchestra.run.smithi059:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-16T14:22:33.278 DEBUG:teuthology.orchestra.run.smithi151:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-16T14:22:33.309 DEBUG:teuthology.orchestra.run.smithi059:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-16T14:22:33.369 INFO:teuthology.orchestra.run.smithi151.stdout:check_obsoletes = 1 2023-10-16T14:22:33.373 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum clean all 2023-10-16T14:22:33.410 INFO:teuthology.orchestra.run.smithi059.stdout:check_obsoletes = 1 2023-10-16T14:22:33.414 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum clean all 2023-10-16T14:22:33.711 INFO:teuthology.orchestra.run.smithi151.stdout:72 files removed 2023-10-16T14:22:33.750 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-16T14:22:33.793 INFO:teuthology.orchestra.run.smithi059.stdout:72 files removed 2023-10-16T14:22:33.834 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-16T14:22:34.772 INFO:teuthology.orchestra.run.smithi059.stdout:ceph packages for x86_64 189 kB/s | 78 kB 00:00 2023-10-16T14:22:34.782 INFO:teuthology.orchestra.run.smithi151.stdout:ceph packages for x86_64 151 kB/s | 78 kB 00:00 2023-10-16T14:22:35.289 INFO:teuthology.orchestra.run.smithi059.stdout:ceph noarch packages 22 kB/s | 9.4 kB 00:00 2023-10-16T14:22:35.340 INFO:teuthology.orchestra.run.smithi151.stdout:ceph noarch packages 20 kB/s | 9.4 kB 00:00 2023-10-16T14:22:35.790 INFO:teuthology.orchestra.run.smithi059.stdout:ceph source packages 4.4 kB/s | 1.9 kB 00:00 2023-10-16T14:22:35.858 INFO:teuthology.orchestra.run.smithi151.stdout:ceph source packages 4.2 kB/s | 1.9 kB 00:00 2023-10-16T14:22:36.459 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS-9 - AppStream 11 MB/s | 6.3 MB 00:00 2023-10-16T14:22:36.528 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - AppStream 11 MB/s | 6.3 MB 00:00 2023-10-16T14:22:38.027 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS-9 - BaseOS 5.7 MB/s | 2.0 MB 00:00 2023-10-16T14:22:38.187 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - BaseOS 4.4 MB/s | 2.0 MB 00:00 2023-10-16T14:22:39.382 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - BaseOS 8.1 MB/s | 7.9 MB 00:00 2023-10-16T14:22:39.866 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 6.1 MB/s | 7.9 MB 00:01 2023-10-16T14:22:41.875 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 22 MB/s | 18 MB 00:00 2023-10-16T14:22:42.250 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - AppStream 10 MB/s | 18 MB 00:01 2023-10-16T14:22:46.142 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 9.2 MB/s | 5.7 MB 00:00 2023-10-16T14:22:47.635 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 14 kB 00:00 2023-10-16T14:22:48.708 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 5.7 MB 00:02 2023-10-16T14:22:48.914 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 17 MB/s | 19 MB 00:01 2023-10-16T14:22:50.934 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 14 kB 00:00 2023-10-16T14:22:52.958 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 10 MB/s | 19 MB 00:01 2023-10-16T14:22:54.353 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2023-10-16T14:22:56.980 INFO:teuthology.orchestra.run.smithi151.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-16T14:22:56.982 INFO:teuthology.orchestra.run.smithi151.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-16T14:22:57.005 INFO:teuthology.orchestra.run.smithi151.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-10-16T14:22:57.006 INFO:teuthology.orchestra.run.smithi151.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-10-16T14:22:57.008 INFO:teuthology.orchestra.run.smithi151.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-10-16T14:22:57.009 INFO:teuthology.orchestra.run.smithi151.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-10-16T14:22:57.012 INFO:teuthology.orchestra.run.smithi151.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-10-16T14:22:57.016 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-10-16T14:22:57.017 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-16T14:22:57.095 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-16T14:22:57.109 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================================ 2023-10-16T14:22:57.109 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-10-16T14:22:57.109 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================================ 2023-10-16T14:22:57.109 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-10-16T14:22:57.110 INFO:teuthology.orchestra.run.smithi151.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-10-16T14:22:57.110 INFO:teuthology.orchestra.run.smithi151.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 6.5 k 2023-10-16T14:22:57.110 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 5.2 M 2023-10-16T14:22:57.110 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 855 k 2023-10-16T14:22:57.111 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 141 k 2023-10-16T14:22:57.111 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 1.5 M 2023-10-16T14:22:57.111 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 132 k 2023-10-16T14:22:57.111 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 1.8 M 2023-10-16T14:22:57.111 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 7.4 M 2023-10-16T14:22:57.112 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 47 k 2023-10-16T14:22:57.112 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 8.6 M 2023-10-16T14:22:57.112 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 41 M 2023-10-16T14:22:57.112 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 262 k 2023-10-16T14:22:57.112 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 269 k 2023-10-16T14:22:57.112 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 218 k 2023-10-16T14:22:57.113 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 18 k 2023-10-16T14:22:57.113 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-10-16T14:22:57.113 INFO:teuthology.orchestra.run.smithi151.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-10-16T14:22:57.113 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-10-16T14:22:57.113 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 31 k 2023-10-16T14:22:57.114 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 715 k 2023-10-16T14:22:57.114 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-16T14:22:57.114 INFO:teuthology.orchestra.run.smithi151.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-10-16T14:22:57.114 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-10-16T14:22:57.115 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-10-16T14:22:57.115 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-10-16T14:22:57.115 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-10-16T14:22:57.115 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-10-16T14:22:57.115 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 162 k 2023-10-16T14:22:57.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 321 k 2023-10-16T14:22:57.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 298 k 2023-10-16T14:22:57.116 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 99 k 2023-10-16T14:22:57.116 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 85 k 2023-10-16T14:22:57.116 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-16T14:22:57.117 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 169 k 2023-10-16T14:22:57.117 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-10-16T14:22:57.117 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2023-10-16T14:22:57.117 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager x86_64 1:1.45.4-1.el9 CentOS-BaseOS 2.2 M 2023-10-16T14:22:57.117 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm x86_64 1:1.45.4-1.el9 CentOS-BaseOS 1.8 M 2023-10-16T14:22:57.118 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team x86_64 1:1.45.4-1.el9 CentOS-BaseOS 41 k 2023-10-16T14:22:57.118 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui x86_64 1:1.45.4-1.el9 CentOS-BaseOS 244 k 2023-10-16T14:22:57.118 INFO:teuthology.orchestra.run.smithi151.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-10-16T14:22:57.118 INFO:teuthology.orchestra.run.smithi151.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-10-16T14:22:57.119 INFO:teuthology.orchestra.run.smithi151.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-10-16T14:22:57.119 INFO:teuthology.orchestra.run.smithi151.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.3 M 2023-10-16T14:22:57.119 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-16T14:22:57.119 INFO:teuthology.orchestra.run.smithi151.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-10-16T14:22:57.120 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-10-16T14:22:57.120 INFO:teuthology.orchestra.run.smithi151.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-10-16T14:22:57.120 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-16T14:22:57.120 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 19 M 2023-10-16T14:22:57.120 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 23 k 2023-10-16T14:22:57.121 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 2.1 M 2023-10-16T14:22:57.121 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 242 k 2023-10-16T14:22:57.121 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.4 M 2023-10-16T14:22:57.121 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 18 M 2023-10-16T14:22:57.121 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 15 k 2023-10-16T14:22:57.122 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 24 k 2023-10-16T14:22:57.122 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-16T14:22:57.122 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-16T14:22:57.122 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-16T14:22:57.122 INFO:teuthology.orchestra.run.smithi151.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-16T14:22:57.123 INFO:teuthology.orchestra.run.smithi151.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-16T14:22:57.123 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-16T14:22:57.123 INFO:teuthology.orchestra.run.smithi151.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-16T14:22:57.123 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-16T14:22:57.123 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-16T14:22:57.123 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 163 k 2023-10-16T14:22:57.124 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-16T14:22:57.124 INFO:teuthology.orchestra.run.smithi151.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-16T14:22:57.124 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-16T14:22:57.124 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-16T14:22:57.124 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-16T14:22:57.125 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 472 k 2023-10-16T14:22:57.125 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-16T14:22:57.125 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.8 M 2023-10-16T14:22:57.125 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-16T14:22:57.125 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-10-16T14:22:57.125 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-16T14:22:57.126 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-16T14:22:57.126 INFO:teuthology.orchestra.run.smithi151.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-16T14:22:57.126 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-16T14:22:57.126 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-16T14:22:57.127 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-10-16T14:22:57.127 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-16T14:22:57.127 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-16T14:22:57.127 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-16T14:22:57.127 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-16T14:22:57.128 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 45 k 2023-10-16T14:22:57.128 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-16T14:22:57.128 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-16T14:22:57.128 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-16T14:22:57.128 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-16T14:22:57.129 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-16T14:22:57.129 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-16T14:22:57.129 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-16T14:22:57.129 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth noarch 1:2.23.2-1.el9 epel 196 k 2023-10-16T14:22:57.130 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-16T14:22:57.130 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-16T14:22:57.130 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-16T14:22:57.130 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-16T14:22:57.131 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-16T14:22:57.131 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-16T14:22:57.131 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-16T14:22:57.131 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-16T14:22:57.132 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-16T14:22:57.132 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-16T14:22:57.132 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-16T14:22:57.132 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-16T14:22:57.132 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-16T14:22:57.133 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-16T14:22:57.133 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-16T14:22:57.133 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-16T14:22:57.133 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-16T14:22:57.134 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-16T14:22:57.134 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-16T14:22:57.134 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-16T14:22:57.134 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-16T14:22:57.135 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-16T14:22:57.135 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-16T14:22:57.135 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-16T14:22:57.135 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-16T14:22:57.136 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-16T14:22:57.136 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-16T14:22:57.136 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-16T14:22:57.136 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-16T14:22:57.136 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-16T14:22:57.137 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-16T14:22:57.137 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-16T14:22:57.137 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-16T14:22:57.137 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-16T14:22:57.138 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-16T14:22:57.138 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-16T14:22:57.138 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-10-16T14:22:57.139 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-16T14:22:57.139 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-16T14:22:57.139 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-16T14:22:57.139 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-16T14:22:57.140 INFO:teuthology.orchestra.run.smithi151.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-16T14:22:57.140 INFO:teuthology.orchestra.run.smithi151.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-16T14:22:57.140 INFO:teuthology.orchestra.run.smithi151.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-16T14:22:57.140 INFO:teuthology.orchestra.run.smithi151.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-10-16T14:22:57.140 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-16T14:22:57.141 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-10-16T14:22:57.141 INFO:teuthology.orchestra.run.smithi151.stdout:Installing weak dependencies: 2023-10-16T14:22:57.141 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-16T14:22:57.141 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:22:57.142 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-16T14:22:57.142 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================================ 2023-10-16T14:22:57.142 INFO:teuthology.orchestra.run.smithi151.stdout:Install 133 Packages 2023-10-16T14:22:57.142 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 10 Packages 2023-10-16T14:22:57.142 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:22:57.143 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 199 M 2023-10-16T14:22:57.143 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-16T14:22:58.277 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2023-10-16T14:22:58.279 INFO:teuthology.orchestra.run.smithi151.stdout:(1/143): ceph-18.0.0-6730.g4ba8a190.el9.x86_64. 17 kB/s | 6.5 kB 00:00 2023-10-16T14:22:58.938 INFO:teuthology.orchestra.run.smithi151.stdout:(2/143): ceph-fuse-18.0.0-6730.g4ba8a190.el9.x8 1.3 MB/s | 855 kB 00:00 2023-10-16T14:22:59.121 INFO:teuthology.orchestra.run.smithi151.stdout:(3/143): ceph-immutable-object-cache-18.0.0-673 774 kB/s | 141 kB 00:00 2023-10-16T14:22:59.613 INFO:teuthology.orchestra.run.smithi151.stdout:(4/143): ceph-common-18.0.0-6730.g4ba8a190.el9. 11 MB/s | 19 MB 00:01 2023-10-16T14:22:59.738 INFO:teuthology.orchestra.run.smithi151.stdout:(5/143): ceph-mgr-18.0.0-6730.g4ba8a190.el9.x86 12 MB/s | 1.5 MB 00:00 2023-10-16T14:23:00.022 INFO:teuthology.orchestra.run.smithi151.stdout:(6/143): ceph-mon-18.0.0-6730.g4ba8a190.el9.x86 15 MB/s | 4.4 MB 00:00 2023-10-16T14:23:00.114 INFO:teuthology.orchestra.run.smithi151.stdout:(7/143): ceph-mds-18.0.0-6730.g4ba8a190.el9.x86 2.1 MB/s | 2.1 MB 00:00 2023-10-16T14:23:00.548 INFO:teuthology.orchestra.run.smithi151.stdout:(8/143): ceph-base-18.0.0-6730.g4ba8a190.el9.x8 2.0 MB/s | 5.2 MB 00:02 2023-10-16T14:23:00.656 INFO:teuthology.orchestra.run.smithi151.stdout:(9/143): ceph-selinux-18.0.0-6730.g4ba8a190.el9 224 kB/s | 24 kB 00:00 2023-10-16T14:23:00.915 INFO:teuthology.orchestra.run.smithi059.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-16T14:23:00.917 INFO:teuthology.orchestra.run.smithi059.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-16T14:23:00.940 INFO:teuthology.orchestra.run.smithi059.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-10-16T14:23:00.942 INFO:teuthology.orchestra.run.smithi059.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-10-16T14:23:00.943 INFO:teuthology.orchestra.run.smithi059.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-10-16T14:23:00.945 INFO:teuthology.orchestra.run.smithi059.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-10-16T14:23:00.948 INFO:teuthology.orchestra.run.smithi059.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-10-16T14:23:00.952 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-10-16T14:23:00.953 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-16T14:23:00.998 INFO:teuthology.orchestra.run.smithi151.stdout:(10/143): ceph-osd-18.0.0-6730.g4ba8a190.el9.x8 18 MB/s | 18 MB 00:00 2023-10-16T14:23:01.035 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2023-10-16T14:23:01.055 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================================ 2023-10-16T14:23:01.055 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2023-10-16T14:23:01.055 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================================ 2023-10-16T14:23:01.055 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2023-10-16T14:23:01.056 INFO:teuthology.orchestra.run.smithi059.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-10-16T14:23:01.056 INFO:teuthology.orchestra.run.smithi059.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 6.5 k 2023-10-16T14:23:01.056 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 5.2 M 2023-10-16T14:23:01.056 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 855 k 2023-10-16T14:23:01.056 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 141 k 2023-10-16T14:23:01.057 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 1.5 M 2023-10-16T14:23:01.057 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 132 k 2023-10-16T14:23:01.057 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 1.8 M 2023-10-16T14:23:01.057 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 7.4 M 2023-10-16T14:23:01.057 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 47 k 2023-10-16T14:23:01.058 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 8.6 M 2023-10-16T14:23:01.058 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 41 M 2023-10-16T14:23:01.058 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 262 k 2023-10-16T14:23:01.058 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 269 k 2023-10-16T14:23:01.058 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 218 k 2023-10-16T14:23:01.059 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 18 k 2023-10-16T14:23:01.059 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-10-16T14:23:01.059 INFO:teuthology.orchestra.run.smithi059.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-10-16T14:23:01.059 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-10-16T14:23:01.059 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 31 k 2023-10-16T14:23:01.060 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 715 k 2023-10-16T14:23:01.060 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-16T14:23:01.060 INFO:teuthology.orchestra.run.smithi059.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-10-16T14:23:01.060 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-10-16T14:23:01.060 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-10-16T14:23:01.061 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-10-16T14:23:01.061 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-10-16T14:23:01.061 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-10-16T14:23:01.061 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 162 k 2023-10-16T14:23:01.061 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 321 k 2023-10-16T14:23:01.062 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 298 k 2023-10-16T14:23:01.062 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 99 k 2023-10-16T14:23:01.062 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 85 k 2023-10-16T14:23:01.062 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-16T14:23:01.062 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 169 k 2023-10-16T14:23:01.062 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-10-16T14:23:01.063 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2023-10-16T14:23:01.063 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager x86_64 1:1.45.4-1.el9 CentOS-BaseOS 2.2 M 2023-10-16T14:23:01.063 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-libnm x86_64 1:1.45.4-1.el9 CentOS-BaseOS 1.8 M 2023-10-16T14:23:01.063 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-team x86_64 1:1.45.4-1.el9 CentOS-BaseOS 41 k 2023-10-16T14:23:01.063 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-tui x86_64 1:1.45.4-1.el9 CentOS-BaseOS 244 k 2023-10-16T14:23:01.064 INFO:teuthology.orchestra.run.smithi059.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-10-16T14:23:01.064 INFO:teuthology.orchestra.run.smithi059.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-10-16T14:23:01.064 INFO:teuthology.orchestra.run.smithi059.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-10-16T14:23:01.064 INFO:teuthology.orchestra.run.smithi059.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.3 M 2023-10-16T14:23:01.064 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-16T14:23:01.065 INFO:teuthology.orchestra.run.smithi059.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-10-16T14:23:01.065 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2023-10-16T14:23:01.065 INFO:teuthology.orchestra.run.smithi059.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-10-16T14:23:01.065 INFO:teuthology.orchestra.run.smithi059.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-16T14:23:01.065 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 19 M 2023-10-16T14:23:01.066 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 23 k 2023-10-16T14:23:01.066 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 2.1 M 2023-10-16T14:23:01.066 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 242 k 2023-10-16T14:23:01.066 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.4 M 2023-10-16T14:23:01.066 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 18 M 2023-10-16T14:23:01.067 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 15 k 2023-10-16T14:23:01.067 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 24 k 2023-10-16T14:23:01.067 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-16T14:23:01.067 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-16T14:23:01.068 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-16T14:23:01.068 INFO:teuthology.orchestra.run.smithi059.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-16T14:23:01.068 INFO:teuthology.orchestra.run.smithi059.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-16T14:23:01.069 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-16T14:23:01.069 INFO:teuthology.orchestra.run.smithi059.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-16T14:23:01.069 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-16T14:23:01.069 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-16T14:23:01.070 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 163 k 2023-10-16T14:23:01.070 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-16T14:23:01.070 INFO:teuthology.orchestra.run.smithi059.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-16T14:23:01.070 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-16T14:23:01.070 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-16T14:23:01.071 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-16T14:23:01.071 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 472 k 2023-10-16T14:23:01.071 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-16T14:23:01.071 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.8 M 2023-10-16T14:23:01.072 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-16T14:23:01.072 INFO:teuthology.orchestra.run.smithi059.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-10-16T14:23:01.072 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-16T14:23:01.072 INFO:teuthology.orchestra.run.smithi059.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-16T14:23:01.072 INFO:teuthology.orchestra.run.smithi059.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-16T14:23:01.073 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-16T14:23:01.073 INFO:teuthology.orchestra.run.smithi059.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-16T14:23:01.073 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-10-16T14:23:01.073 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-16T14:23:01.074 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-16T14:23:01.074 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-16T14:23:01.074 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-16T14:23:01.074 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 45 k 2023-10-16T14:23:01.075 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-16T14:23:01.075 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-16T14:23:01.075 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-16T14:23:01.075 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-16T14:23:01.075 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-16T14:23:01.076 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-16T14:23:01.076 INFO:teuthology.orchestra.run.smithi059.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-16T14:23:01.076 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth noarch 1:2.23.2-1.el9 epel 196 k 2023-10-16T14:23:01.076 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-16T14:23:01.077 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-16T14:23:01.077 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-16T14:23:01.077 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-16T14:23:01.077 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-16T14:23:01.077 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-16T14:23:01.078 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-16T14:23:01.078 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-16T14:23:01.078 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-16T14:23:01.078 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-16T14:23:01.078 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-16T14:23:01.079 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-16T14:23:01.079 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-16T14:23:01.079 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-16T14:23:01.079 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-16T14:23:01.079 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-16T14:23:01.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-16T14:23:01.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-16T14:23:01.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-16T14:23:01.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-16T14:23:01.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-16T14:23:01.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-16T14:23:01.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-16T14:23:01.082 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-16T14:23:01.082 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-16T14:23:01.082 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-16T14:23:01.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-16T14:23:01.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-16T14:23:01.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-16T14:23:01.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-16T14:23:01.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-16T14:23:01.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-16T14:23:01.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-16T14:23:01.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-16T14:23:01.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-16T14:23:01.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-16T14:23:01.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-10-16T14:23:01.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-16T14:23:01.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-16T14:23:01.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-16T14:23:01.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-16T14:23:01.085 INFO:teuthology.orchestra.run.smithi059.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-16T14:23:01.086 INFO:teuthology.orchestra.run.smithi059.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-16T14:23:01.086 INFO:teuthology.orchestra.run.smithi059.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-16T14:23:01.086 INFO:teuthology.orchestra.run.smithi059.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-10-16T14:23:01.086 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-16T14:23:01.086 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-10-16T14:23:01.087 INFO:teuthology.orchestra.run.smithi059.stdout:Installing weak dependencies: 2023-10-16T14:23:01.087 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-16T14:23:01.087 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:23:01.087 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2023-10-16T14:23:01.087 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================================ 2023-10-16T14:23:01.088 INFO:teuthology.orchestra.run.smithi059.stdout:Install 133 Packages 2023-10-16T14:23:01.088 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 10 Packages 2023-10-16T14:23:01.088 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:23:01.089 INFO:teuthology.orchestra.run.smithi151.stdout:(11/143): cephfs-mirror-18.0.0-6730.g4ba8a190.e 3.7 MB/s | 218 kB 00:00 2023-10-16T14:23:01.089 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 199 M 2023-10-16T14:23:01.089 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2023-10-16T14:23:01.115 INFO:teuthology.orchestra.run.smithi151.stdout:(12/143): libcephfs-devel-18.0.0-6730.g4ba8a190 544 kB/s | 31 kB 00:00 2023-10-16T14:23:01.210 INFO:teuthology.orchestra.run.smithi151.stdout:(13/143): libcephfs2-18.0.0-6730.g4ba8a190.el9. 7.4 MB/s | 715 kB 00:00 2023-10-16T14:23:01.282 INFO:teuthology.orchestra.run.smithi151.stdout:(14/143): libcephsqlite-18.0.0-6730.g4ba8a190.e 2.3 MB/s | 163 kB 00:00 2023-10-16T14:23:01.374 INFO:teuthology.orchestra.run.smithi151.stdout:(15/143): librados-devel-18.0.0-6730.g4ba8a190. 1.4 MB/s | 127 kB 00:00 2023-10-16T14:23:01.466 INFO:teuthology.orchestra.run.smithi151.stdout:(16/143): libradosstriper1-18.0.0-6730.g4ba8a19 5.1 MB/s | 472 kB 00:00 2023-10-16T14:23:01.816 INFO:teuthology.orchestra.run.smithi151.stdout:(17/143): librgw2-18.0.0-6730.g4ba8a190.el9.x86 14 MB/s | 4.8 MB 00:00 2023-10-16T14:23:01.866 INFO:teuthology.orchestra.run.smithi151.stdout:(18/143): python3-ceph-argparse-18.0.0-6730.g4b 924 kB/s | 45 kB 00:00 2023-10-16T14:23:01.908 INFO:teuthology.orchestra.run.smithi151.stdout:(19/143): python3-ceph-common-18.0.0-6730.g4ba8 3.0 MB/s | 127 kB 00:00 2023-10-16T14:23:01.961 INFO:teuthology.orchestra.run.smithi151.stdout:(20/143): python3-cephfs-18.0.0-6730.g4ba8a190. 3.1 MB/s | 162 kB 00:00 2023-10-16T14:23:02.020 INFO:teuthology.orchestra.run.smithi151.stdout:(21/143): python3-rados-18.0.0-6730.g4ba8a190.e 5.5 MB/s | 321 kB 00:00 2023-10-16T14:23:02.107 INFO:teuthology.orchestra.run.smithi059.stdout:(1/143): ceph-18.0.0-6730.g4ba8a190.el9.x86_64. 15 kB/s | 6.5 kB 00:00 2023-10-16T14:23:02.195 INFO:teuthology.orchestra.run.smithi151.stdout:(22/143): ceph-radosgw-18.0.0-6730.g4ba8a190.el 4.1 MB/s | 8.6 MB 00:02 2023-10-16T14:23:02.228 INFO:teuthology.orchestra.run.smithi151.stdout:(23/143): python3-rbd-18.0.0-6730.g4ba8a190.el9 1.4 MB/s | 298 kB 00:00 2023-10-16T14:23:02.279 INFO:teuthology.orchestra.run.smithi151.stdout:(24/143): rbd-fuse-18.0.0-6730.g4ba8a190.el9.x8 1.7 MB/s | 85 kB 00:00 2023-10-16T14:23:02.304 INFO:teuthology.orchestra.run.smithi151.stdout:(25/143): python3-rgw-18.0.0-6730.g4ba8a190.el9 920 kB/s | 99 kB 00:00 2023-10-16T14:23:02.438 INFO:teuthology.orchestra.run.smithi151.stdout:(26/143): rbd-nbd-18.0.0-6730.g4ba8a190.el9.x86 1.2 MB/s | 169 kB 00:00 2023-10-16T14:23:02.538 INFO:teuthology.orchestra.run.smithi151.stdout:(27/143): rbd-mirror-18.0.0-6730.g4ba8a190.el9. 12 MB/s | 3.0 MB 00:00 2023-10-16T14:23:02.564 INFO:teuthology.orchestra.run.smithi151.stdout:(28/143): ceph-grafana-dashboards-18.0.0-6730.g 186 kB/s | 23 kB 00:00 2023-10-16T14:23:02.597 INFO:teuthology.orchestra.run.smithi151.stdout:(29/143): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 2.2 MB/s | 132 kB 00:00 2023-10-16T14:23:03.086 INFO:teuthology.orchestra.run.smithi151.stdout:(30/143): ceph-mgr-diskprediction-local-18.0.0- 15 MB/s | 7.4 MB 00:00 2023-10-16T14:23:03.090 INFO:teuthology.orchestra.run.smithi059.stdout:(2/143): ceph-fuse-18.0.0-6730.g4ba8a190.el9.x8 871 kB/s | 855 kB 00:00 2023-10-16T14:23:03.153 INFO:teuthology.orchestra.run.smithi151.stdout:(31/143): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 3.0 MB/s | 1.8 MB 00:00 2023-10-16T14:23:03.187 INFO:teuthology.orchestra.run.smithi151.stdout:(32/143): ceph-mgr-modules-core-18.0.0-6730.g4b 2.4 MB/s | 242 kB 00:00 2023-10-16T14:23:03.263 INFO:teuthology.orchestra.run.smithi151.stdout:(33/143): ceph-prometheus-alerts-18.0.0-6730.g4 202 kB/s | 15 kB 00:00 2023-10-16T14:23:03.273 INFO:teuthology.orchestra.run.smithi059.stdout:(3/143): ceph-immutable-object-cache-18.0.0-673 776 kB/s | 141 kB 00:00 2023-10-16T14:23:03.288 INFO:teuthology.orchestra.run.smithi151.stdout:(34/143): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 356 kB/s | 47 kB 00:00 2023-10-16T14:23:03.322 INFO:teuthology.orchestra.run.smithi151.stdout:(35/143): ceph-volume-18.0.0-6730.g4ba8a190.el9 4.4 MB/s | 262 kB 00:00 2023-10-16T14:23:03.372 INFO:teuthology.orchestra.run.smithi151.stdout:(36/143): cephfs-top-18.0.0-6730.g4ba8a190.el9. 367 kB/s | 18 kB 00:00 2023-10-16T14:23:03.414 INFO:teuthology.orchestra.run.smithi151.stdout:(37/143): cephadm-18.0.0-6730.g4ba8a190.el9.noa 2.1 MB/s | 269 kB 00:00 2023-10-16T14:23:03.698 INFO:teuthology.orchestra.run.smithi151.stdout:(38/143): boost-program-options-1.75.0-8.el9.x8 495 kB/s | 106 kB 00:00 2023-10-16T14:23:03.773 INFO:teuthology.orchestra.run.smithi151.stdout:(39/143): bison-3.7.4-5.el9.x86_64.rpm 2.2 MB/s | 920 kB 00:00 2023-10-16T14:23:03.807 INFO:teuthology.orchestra.run.smithi151.stdout:(40/143): flex-2.6.4-9.el9.x86_64.rpm 2.9 MB/s | 307 kB 00:00 2023-10-16T14:23:03.832 INFO:teuthology.orchestra.run.smithi151.stdout:(41/143): flexiblas-3.0.4-8.el9.x86_64.rpm 566 kB/s | 32 kB 00:00 2023-10-16T14:23:03.908 INFO:teuthology.orchestra.run.smithi151.stdout:(42/143): flexiblas-openblas-openmp-3.0.4-8.el9 230 kB/s | 17 kB 00:00 2023-10-16T14:23:04.016 INFO:teuthology.orchestra.run.smithi151.stdout:(43/143): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2023-10-16T14:23:04.058 INFO:teuthology.orchestra.run.smithi151.stdout:(44/143): libaio-devel-0.3.111-13.el9.x86_64.rp 74 kB/s | 10 kB 00:00 2023-10-16T14:23:04.084 INFO:teuthology.orchestra.run.smithi151.stdout:(45/143): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 159 kB 00:00 2023-10-16T14:23:04.151 INFO:teuthology.orchestra.run.smithi151.stdout:(46/143): librdkafka-1.6.1-102.el9.x86_64.rpm 7.2 MB/s | 661 kB 00:00 2023-10-16T14:23:04.201 INFO:teuthology.orchestra.run.smithi151.stdout:(47/143): libtool-2.4.6-45.el9.x86_64.rpm 4.9 MB/s | 578 kB 00:00 2023-10-16T14:23:04.243 INFO:teuthology.orchestra.run.smithi151.stdout:(48/143): libzstd-devel-1.5.1-2.el9.x86_64.rpm 516 kB/s | 46 kB 00:00 2023-10-16T14:23:04.293 INFO:teuthology.orchestra.run.smithi151.stdout:(49/143): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 282 kB 00:00 2023-10-16T14:23:04.327 INFO:teuthology.orchestra.run.smithi151.stdout:(50/143): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.6 MB/s | 217 kB 00:00 2023-10-16T14:23:04.394 INFO:teuthology.orchestra.run.smithi151.stdout:(51/143): openblas-0.3.21-2.el9.x86_64.rpm 347 kB/s | 34 kB 00:00 2023-10-16T14:23:04.520 INFO:teuthology.orchestra.run.smithi151.stdout:(52/143): openblas-openmp-0.3.21-2.el9.x86_64.r 25 MB/s | 4.7 MB 00:00 2023-10-16T14:23:04.558 INFO:teuthology.orchestra.run.smithi059.stdout:(4/143): ceph-mds-18.0.0-6730.g4ba8a190.el9.x86 1.6 MB/s | 2.1 MB 00:01 2023-10-16T14:23:04.578 INFO:teuthology.orchestra.run.smithi151.stdout:(53/143): postgresql-13.11-1.el9.x86_64.rpm 9.0 MB/s | 1.5 MB 00:00 2023-10-16T14:23:04.621 INFO:teuthology.orchestra.run.smithi151.stdout:(54/143): postgresql-contrib-13.11-1.el9.x86_64 9.1 MB/s | 811 kB 00:00 2023-10-16T14:23:04.646 INFO:teuthology.orchestra.run.smithi151.stdout:(55/143): postgresql-private-libs-13.11-1.el9.x 2.2 MB/s | 134 kB 00:00 2023-10-16T14:23:04.838 INFO:teuthology.orchestra.run.smithi151.stdout:(56/143): postgresql-server-13.11-1.el9.x86_64. 26 MB/s | 5.7 MB 00:00 2023-10-16T14:23:04.980 INFO:teuthology.orchestra.run.smithi151.stdout:(57/143): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2023-10-16T14:23:05.014 INFO:teuthology.orchestra.run.smithi151.stdout:(58/143): python3-devel-3.9.17-2.el9.x86_64.rpm 1.2 MB/s | 205 kB 00:00 2023-10-16T14:23:05.047 INFO:teuthology.orchestra.run.smithi151.stdout:(59/143): python3-jinja2-2.11.3-4.el9.noarch.rp 3.4 MB/s | 228 kB 00:00 2023-10-16T14:23:05.098 INFO:teuthology.orchestra.run.smithi151.stdout:(60/143): python3-jsonpatch-1.21-16.el9.noarch. 301 kB/s | 24 kB 00:00 2023-10-16T14:23:05.165 INFO:teuthology.orchestra.run.smithi151.stdout:(61/143): python3-jsonpointer-2.0-4.el9.noarch. 156 kB/s | 18 kB 00:00 2023-10-16T14:23:05.174 INFO:teuthology.orchestra.run.smithi059.stdout:(5/143): ceph-base-18.0.0-6730.g4ba8a190.el9.x8 1.5 MB/s | 5.2 MB 00:03 2023-10-16T14:23:05.190 INFO:teuthology.orchestra.run.smithi151.stdout:(62/143): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 144 kB 00:00 2023-10-16T14:23:05.241 INFO:teuthology.orchestra.run.smithi151.stdout:(63/143): python3-markupsafe-1.1.1-12.el9.x86_6 431 kB/s | 32 kB 00:00 2023-10-16T14:23:05.325 INFO:teuthology.orchestra.run.smithi059.stdout:(6/143): ceph-mgr-18.0.0-6730.g4ba8a190.el9.x86 1.9 MB/s | 1.5 MB 00:00 2023-10-16T14:23:05.399 INFO:teuthology.orchestra.run.smithi151.stdout:(64/143): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 4.8 MB 00:00 2023-10-16T14:23:05.433 INFO:teuthology.orchestra.run.smithi151.stdout:(65/143): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2023-10-16T14:23:05.467 INFO:teuthology.orchestra.run.smithi151.stdout:(66/143): python3-oauthlib-3.1.1-5.el9.noarch.r 2.7 MB/s | 174 kB 00:00 2023-10-16T14:23:05.518 INFO:teuthology.orchestra.run.smithi151.stdout:(67/143): python3-prettytable-0.7.2-27.el9.noar 500 kB/s | 41 kB 00:00 2023-10-16T14:23:05.551 INFO:teuthology.orchestra.run.smithi151.stdout:(68/143): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 132 kB 00:00 2023-10-16T14:23:05.585 INFO:teuthology.orchestra.run.smithi151.stdout:(69/143): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 211 kB 00:00 2023-10-16T14:23:05.610 INFO:teuthology.orchestra.run.smithi151.stdout:(70/143): python3-requests-oauthlib-1.3.0-12.el 763 kB/s | 43 kB 00:00 2023-10-16T14:23:05.944 INFO:teuthology.orchestra.run.smithi151.stdout:(71/143): python3-toml-0.10.2-6.el9.noarch.rpm 118 kB/s | 39 kB 00:00 2023-10-16T14:23:06.194 INFO:teuthology.orchestra.run.smithi151.stdout:(72/143): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2023-10-16T14:23:06.236 INFO:teuthology.orchestra.run.smithi151.stdout:(73/143): socat-1.7.4.1-5.el9.x86_64.rpm 1.0 MB/s | 300 kB 00:00 2023-10-16T14:23:06.286 INFO:teuthology.orchestra.run.smithi151.stdout:(74/143): uuid-1.6.2-55.el9.x86_64.rpm 638 kB/s | 56 kB 00:00 2023-10-16T14:23:06.333 INFO:teuthology.orchestra.run.smithi151.stdout:(75/143): xmlstarlet-1.6.1-20.el9.x86_64.rpm 654 kB/s | 63 kB 00:00 2023-10-16T14:23:06.362 INFO:teuthology.orchestra.run.smithi151.stdout:(76/143): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2023-10-16T14:23:06.426 INFO:teuthology.orchestra.run.smithi151.stdout:(77/143): libgfortran-11.4.1-2.3.el9.x86_64.rpm 10 MB/s | 803 kB 00:00 2023-10-16T14:23:06.446 INFO:teuthology.orchestra.run.smithi151.stdout:(78/143): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2023-10-16T14:23:06.480 INFO:teuthology.orchestra.run.smithi151.stdout:(79/143): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 241 kB 00:00 2023-10-16T14:23:06.505 INFO:teuthology.orchestra.run.smithi151.stdout:(80/143): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-10-16T14:23:06.531 INFO:teuthology.orchestra.run.smithi151.stdout:(81/143): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2023-10-16T14:23:06.548 INFO:teuthology.orchestra.run.smithi151.stdout:(82/143): python3-requests-2.25.1-7.el9.noarch. 2.7 MB/s | 113 kB 00:00 2023-10-16T14:23:06.582 INFO:teuthology.orchestra.run.smithi151.stdout:(83/143): python3-urllib3-1.26.5-3.el9.noarch.r 3.8 MB/s | 188 kB 00:00 2023-10-16T14:23:06.600 INFO:teuthology.orchestra.run.smithi059.stdout:(7/143): ceph-common-18.0.0-6730.g4ba8a190.el9. 3.9 MB/s | 19 MB 00:04 2023-10-16T14:23:06.832 INFO:teuthology.orchestra.run.smithi151.stdout:(84/143): automake-1.16.2-8.el9.noarch.rpm 2.7 MB/s | 689 kB 00:00 2023-10-16T14:23:06.907 INFO:teuthology.orchestra.run.smithi151.stdout:(85/143): python3-cryptography-36.0.1-4.el9.x86 3.4 MB/s | 1.2 MB 00:00 2023-10-16T14:23:06.933 INFO:teuthology.orchestra.run.smithi151.stdout:(86/143): elfutils-libelf-devel-0.189-3.el9.x86 224 kB/s | 22 kB 00:00 2023-10-16T14:23:07.025 INFO:teuthology.orchestra.run.smithi059.stdout:(8/143): ceph-mon-18.0.0-6730.g4ba8a190.el9.x86 2.4 MB/s | 4.4 MB 00:01 2023-10-16T14:23:07.031 INFO:teuthology.orchestra.run.smithi151.stdout:(87/143): librabbitmq-0.11.0-7.el9.x86_64.rpm 463 kB/s | 45 kB 00:00 2023-10-16T14:23:07.092 INFO:teuthology.orchestra.run.smithi151.stdout:(88/143): libuuid-devel-2.37.4-15.el9.x86_64.rp 432 kB/s | 26 kB 00:00 2023-10-16T14:23:07.108 INFO:teuthology.orchestra.run.smithi059.stdout:(9/143): ceph-selinux-18.0.0-6730.g4ba8a190.el9 293 kB/s | 24 kB 00:00 2023-10-16T14:23:07.159 INFO:teuthology.orchestra.run.smithi151.stdout:(89/143): jq-1.6-15.el9.x86_64.rpm 747 kB/s | 187 kB 00:00 2023-10-16T14:23:07.226 INFO:teuthology.orchestra.run.smithi151.stdout:(90/143): python3-pytz-2021.1-5.el9.noarch.rpm 775 kB/s | 51 kB 00:00 2023-10-16T14:23:07.276 INFO:teuthology.orchestra.run.smithi151.stdout:(91/143): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.7 MB/s | 86 kB 00:00 2023-10-16T14:23:07.343 INFO:teuthology.orchestra.run.smithi151.stdout:(92/143): zlib-devel-1.2.11-40.el9.x86_64.rpm 683 kB/s | 45 kB 00:00 2023-10-16T14:23:07.494 INFO:teuthology.orchestra.run.smithi151.stdout:(93/143): openssl-devel-3.0.7-24.el9.x86_64.rpm 10 MB/s | 4.1 MB 00:00 2023-10-16T14:23:08.259 INFO:teuthology.orchestra.run.smithi059.stdout:(10/143): ceph-radosgw-18.0.0-6730.g4ba8a190.el 5.2 MB/s | 8.6 MB 00:01 2023-10-16T14:23:08.376 INFO:teuthology.orchestra.run.smithi059.stdout:(11/143): cephfs-mirror-18.0.0-6730.g4ba8a190.e 1.8 MB/s | 218 kB 00:00 2023-10-16T14:23:08.443 INFO:teuthology.orchestra.run.smithi059.stdout:(12/143): libcephfs-devel-18.0.0-6730.g4ba8a190 471 kB/s | 31 kB 00:00 2023-10-16T14:23:08.639 INFO:teuthology.orchestra.run.smithi059.stdout:(13/143): libcephfs2-18.0.0-6730.g4ba8a190.el9. 3.6 MB/s | 715 kB 00:00 2023-10-16T14:23:08.718 INFO:teuthology.orchestra.run.smithi059.stdout:(14/143): libcephsqlite-18.0.0-6730.g4ba8a190.e 2.1 MB/s | 163 kB 00:00 2023-10-16T14:23:08.793 INFO:teuthology.orchestra.run.smithi059.stdout:(15/143): librados-devel-18.0.0-6730.g4ba8a190. 1.7 MB/s | 127 kB 00:00 2023-10-16T14:23:08.910 INFO:teuthology.orchestra.run.smithi059.stdout:(16/143): libradosstriper1-18.0.0-6730.g4ba8a19 4.0 MB/s | 472 kB 00:00 2023-10-16T14:23:09.036 INFO:teuthology.orchestra.run.smithi151.stdout:(94/143): gperftools-libs-2.9.1-2.el9.x86_64.rp 200 kB/s | 309 kB 00:01 2023-10-16T14:23:09.544 INFO:teuthology.orchestra.run.smithi059.stdout:(17/143): librgw2-18.0.0-6730.g4ba8a190.el9.x86 7.5 MB/s | 4.8 MB 00:00 2023-10-16T14:23:09.642 INFO:teuthology.orchestra.run.smithi059.stdout:(18/143): python3-ceph-argparse-18.0.0-6730.g4b 468 kB/s | 45 kB 00:00 2023-10-16T14:23:09.711 INFO:teuthology.orchestra.run.smithi059.stdout:(19/143): python3-ceph-common-18.0.0-6730.g4ba8 1.8 MB/s | 127 kB 00:00 2023-10-16T14:23:09.778 INFO:teuthology.orchestra.run.smithi059.stdout:(20/143): python3-cephfs-18.0.0-6730.g4ba8a190. 2.4 MB/s | 162 kB 00:00 2023-10-16T14:23:09.854 INFO:teuthology.orchestra.run.smithi059.stdout:(21/143): python3-rados-18.0.0-6730.g4ba8a190.e 4.2 MB/s | 321 kB 00:00 2023-10-16T14:23:09.946 INFO:teuthology.orchestra.run.smithi059.stdout:(22/143): python3-rbd-18.0.0-6730.g4ba8a190.el9 3.2 MB/s | 298 kB 00:00 2023-10-16T14:23:10.013 INFO:teuthology.orchestra.run.smithi059.stdout:(23/143): python3-rgw-18.0.0-6730.g4ba8a190.el9 1.5 MB/s | 99 kB 00:00 2023-10-16T14:23:10.080 INFO:teuthology.orchestra.run.smithi059.stdout:(24/143): rbd-fuse-18.0.0-6730.g4ba8a190.el9.x8 1.3 MB/s | 85 kB 00:00 2023-10-16T14:23:10.220 INFO:teuthology.orchestra.run.smithi151.stdout:(95/143): ceph-test-18.0.0-6730.g4ba8a190.el9.x 4.3 MB/s | 41 MB 00:09 2023-10-16T14:23:10.505 INFO:teuthology.orchestra.run.smithi059.stdout:(25/143): rbd-mirror-18.0.0-6730.g4ba8a190.el9. 7.1 MB/s | 3.0 MB 00:00 2023-10-16T14:23:10.511 INFO:teuthology.orchestra.run.smithi151.stdout:(96/143): libarrow-doc-9.0.0-9.el9.noarch.rpm 84 kB/s | 24 kB 00:00 2023-10-16T14:23:10.588 INFO:teuthology.orchestra.run.smithi059.stdout:(26/143): rbd-nbd-18.0.0-6730.g4ba8a190.el9.x86 2.0 MB/s | 169 kB 00:00 2023-10-16T14:23:10.655 INFO:teuthology.orchestra.run.smithi059.stdout:(27/143): ceph-grafana-dashboards-18.0.0-6730.g 352 kB/s | 23 kB 00:00 2023-10-16T14:23:10.723 INFO:teuthology.orchestra.run.smithi059.stdout:(28/143): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 2.0 MB/s | 132 kB 00:00 2023-10-16T14:23:10.729 INFO:teuthology.orchestra.run.smithi151.stdout:(97/143): liboath-2.6.7-2.el9.x86_64.rpm 224 kB/s | 49 kB 00:00 2023-10-16T14:23:10.912 INFO:teuthology.orchestra.run.smithi151.stdout:(98/143): libunwind-1.6.2-1.el9.x86_64.rpm 368 kB/s | 67 kB 00:00 2023-10-16T14:23:10.998 INFO:teuthology.orchestra.run.smithi059.stdout:(29/143): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 6.4 MB/s | 1.8 MB 00:00 2023-10-16T14:23:11.265 INFO:teuthology.orchestra.run.smithi059.stdout:(30/143): ceph-osd-18.0.0-6730.g4ba8a190.el9.x8 3.0 MB/s | 18 MB 00:05 2023-10-16T14:23:11.296 INFO:teuthology.orchestra.run.smithi151.stdout:(99/143): parquet-libs-9.0.0-9.el9.x86_64.rpm 2.1 MB/s | 837 kB 00:00 2023-10-16T14:23:11.382 INFO:teuthology.orchestra.run.smithi059.stdout:(31/143): ceph-mgr-modules-core-18.0.0-6730.g4b 2.1 MB/s | 242 kB 00:00 2023-10-16T14:23:11.457 INFO:teuthology.orchestra.run.smithi059.stdout:(32/143): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 643 kB/s | 47 kB 00:00 2023-10-16T14:23:11.525 INFO:teuthology.orchestra.run.smithi059.stdout:(33/143): ceph-prometheus-alerts-18.0.0-6730.g4 231 kB/s | 15 kB 00:00 2023-10-16T14:23:11.580 INFO:teuthology.orchestra.run.smithi151.stdout:(100/143): python3-asyncssh-2.13.2-3.el9.noarch 1.9 MB/s | 548 kB 00:00 2023-10-16T14:23:11.641 INFO:teuthology.orchestra.run.smithi059.stdout:(34/143): ceph-volume-18.0.0-6730.g4ba8a190.el9 2.2 MB/s | 262 kB 00:00 2023-10-16T14:23:11.680 INFO:teuthology.orchestra.run.smithi151.stdout:(101/143): python3-bcrypt-3.2.2-1.el9.x86_64.rp 438 kB/s | 43 kB 00:00 2023-10-16T14:23:11.750 INFO:teuthology.orchestra.run.smithi059.stdout:(35/143): cephadm-18.0.0-6730.g4ba8a190.el9.noa 2.5 MB/s | 269 kB 00:00 2023-10-16T14:23:11.781 INFO:teuthology.orchestra.run.smithi151.stdout:(102/143): python3-cachetools-4.2.4-1.el9.noarc 324 kB/s | 32 kB 00:00 2023-10-16T14:23:11.816 INFO:teuthology.orchestra.run.smithi059.stdout:(36/143): cephfs-top-18.0.0-6730.g4ba8a190.el9. 278 kB/s | 18 kB 00:00 2023-10-16T14:23:11.889 INFO:teuthology.orchestra.run.smithi151.stdout:(103/143): python3-certifi-2021.10.8-2.el9.noar 139 kB/s | 15 kB 00:00 2023-10-16T14:23:12.017 INFO:teuthology.orchestra.run.smithi059.stdout:(37/143): bison-3.7.4-5.el9.x86_64.rpm 4.5 MB/s | 920 kB 00:00 2023-10-16T14:23:12.031 INFO:teuthology.orchestra.run.smithi151.stdout:(104/143): python3-cheroot-8.6.0-4.el9.noarch.r 1.2 MB/s | 172 kB 00:00 2023-10-16T14:23:12.059 INFO:teuthology.orchestra.run.smithi059.stdout:(38/143): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2023-10-16T14:23:12.156 INFO:teuthology.orchestra.run.smithi151.stdout:(105/143): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2023-10-16T14:23:12.192 INFO:teuthology.orchestra.run.smithi059.stdout:(39/143): ceph-mgr-diskprediction-local-18.0.0- 6.2 MB/s | 7.4 MB 00:01 2023-10-16T14:23:12.226 INFO:teuthology.orchestra.run.smithi059.stdout:(40/143): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 307 kB 00:00 2023-10-16T14:23:12.252 INFO:teuthology.orchestra.run.smithi059.stdout:(41/143): flexiblas-3.0.4-8.el9.x86_64.rpm 575 kB/s | 32 kB 00:00 2023-10-16T14:23:12.274 INFO:teuthology.orchestra.run.smithi151.stdout:(106/143): python3-google-auth-2.23.2-1.el9.noa 1.7 MB/s | 196 kB 00:00 2023-10-16T14:23:12.352 INFO:teuthology.orchestra.run.smithi059.stdout:(42/143): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2023-10-16T14:23:12.376 INFO:teuthology.orchestra.run.smithi059.stdout:(43/143): flexiblas-openblas-openmp-3.0.4-8.el9 158 kB/s | 17 kB 00:00 2023-10-16T14:23:12.407 INFO:teuthology.orchestra.run.smithi151.stdout:(107/143): python3-jaraco-8.2.1-3.el9.noarch.rp 80 kB/s | 11 kB 00:00 2023-10-16T14:23:12.427 INFO:teuthology.orchestra.run.smithi059.stdout:(44/143): libaio-devel-0.3.111-13.el9.x86_64.rp 204 kB/s | 10 kB 00:00 2023-10-16T14:23:12.452 INFO:teuthology.orchestra.run.smithi059.stdout:(45/143): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2023-10-16T14:23:12.507 INFO:teuthology.orchestra.run.smithi151.stdout:(108/143): python3-jaraco-classes-3.2.1-5.el9.n 178 kB/s | 18 kB 00:00 2023-10-16T14:23:12.511 INFO:teuthology.orchestra.run.smithi059.stdout:(46/143): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2023-10-16T14:23:12.553 INFO:teuthology.orchestra.run.smithi059.stdout:(47/143): libtool-2.4.6-45.el9.x86_64.rpm 5.7 MB/s | 578 kB 00:00 2023-10-16T14:23:12.612 INFO:teuthology.orchestra.run.smithi059.stdout:(48/143): libzstd-devel-1.5.1-2.el9.x86_64.rpm 804 kB/s | 46 kB 00:00 2023-10-16T14:23:12.624 INFO:teuthology.orchestra.run.smithi151.stdout:(109/143): python3-jaraco-collections-3.0.0-8.e 199 kB/s | 23 kB 00:00 2023-10-16T14:23:12.645 INFO:teuthology.orchestra.run.smithi059.stdout:(49/143): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.0 MB/s | 282 kB 00:00 2023-10-16T14:23:12.679 INFO:teuthology.orchestra.run.smithi059.stdout:(50/143): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2023-10-16T14:23:12.704 INFO:teuthology.orchestra.run.smithi059.stdout:(51/143): openblas-0.3.21-2.el9.x86_64.rpm 613 kB/s | 34 kB 00:00 2023-10-16T14:23:12.775 INFO:teuthology.orchestra.run.smithi151.stdout:(110/143): python3-jaraco-functools-3.5.0-2.el9 130 kB/s | 19 kB 00:00 2023-10-16T14:23:12.838 INFO:teuthology.orchestra.run.smithi059.stdout:(52/143): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2023-10-16T14:23:12.892 INFO:teuthology.orchestra.run.smithi151.stdout:(111/143): python3-jaraco-text-3.2.0-6.el9.noar 169 kB/s | 20 kB 00:00 2023-10-16T14:23:12.905 INFO:teuthology.orchestra.run.smithi059.stdout:(53/143): postgresql-13.11-1.el9.x86_64.rpm 7.6 MB/s | 1.5 MB 00:00 2023-10-16T14:23:12.955 INFO:teuthology.orchestra.run.smithi059.stdout:(54/143): postgresql-contrib-13.11-1.el9.x86_64 7.5 MB/s | 811 kB 00:00 2023-10-16T14:23:12.980 INFO:teuthology.orchestra.run.smithi059.stdout:(55/143): postgresql-private-libs-13.11-1.el9.x 2.0 MB/s | 134 kB 00:00 2023-10-16T14:23:13.009 INFO:teuthology.orchestra.run.smithi151.stdout:(112/143): python3-jwt+crypto-2.4.0-1.el9.noarc 78 kB/s | 9.0 kB 00:00 2023-10-16T14:23:13.159 INFO:teuthology.orchestra.run.smithi151.stdout:(113/143): python3-jwt-2.4.0-1.el9.noarch.rpm 273 kB/s | 41 kB 00:00 2023-10-16T14:23:13.247 INFO:teuthology.orchestra.run.smithi059.stdout:(56/143): postgresql-server-13.11-1.el9.x86_64. 20 MB/s | 5.7 MB 00:00 2023-10-16T14:23:13.351 INFO:teuthology.orchestra.run.smithi151.stdout:(114/143): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2023-10-16T14:23:13.398 INFO:teuthology.orchestra.run.smithi059.stdout:(57/143): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 5.8 MB 00:00 2023-10-16T14:23:13.422 INFO:teuthology.orchestra.run.smithi059.stdout:(58/143): python3-devel-3.9.17-2.el9.x86_64.rpm 1.3 MB/s | 205 kB 00:00 2023-10-16T14:23:13.448 INFO:teuthology.orchestra.run.smithi059.stdout:(59/143): python3-jsonpatch-1.21-16.el9.noarch. 1.0 MB/s | 24 kB 00:00 2023-10-16T14:23:13.460 INFO:teuthology.orchestra.run.smithi151.stdout:(115/143): python3-logutils-0.3.5-21.el9.noarch 430 kB/s | 46 kB 00:00 2023-10-16T14:23:13.482 INFO:teuthology.orchestra.run.smithi059.stdout:(60/143): python3-jinja2-2.11.3-4.el9.noarch.rp 3.9 MB/s | 228 kB 00:00 2023-10-16T14:23:13.507 INFO:teuthology.orchestra.run.smithi059.stdout:(61/143): python3-jsonpointer-2.0-4.el9.noarch. 322 kB/s | 18 kB 00:00 2023-10-16T14:23:13.533 INFO:teuthology.orchestra.run.smithi059.stdout:(62/143): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 144 kB 00:00 2023-10-16T14:23:13.560 INFO:teuthology.orchestra.run.smithi151.stdout:(116/143): python3-more-itertools-8.12.0-2.el9. 792 kB/s | 79 kB 00:00 2023-10-16T14:23:13.583 INFO:teuthology.orchestra.run.smithi059.stdout:(63/143): python3-markupsafe-1.1.1-12.el9.x86_6 434 kB/s | 32 kB 00:00 2023-10-16T14:23:13.661 INFO:teuthology.orchestra.run.smithi151.stdout:(117/143): python3-natsort-7.1.1-5.el9.noarch.r 581 kB/s | 58 kB 00:00 2023-10-16T14:23:13.717 INFO:teuthology.orchestra.run.smithi059.stdout:(64/143): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2023-10-16T14:23:13.750 INFO:teuthology.orchestra.run.smithi059.stdout:(65/143): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2023-10-16T14:23:13.784 INFO:teuthology.orchestra.run.smithi059.stdout:(66/143): python3-oauthlib-3.1.1-5.el9.noarch.r 2.7 MB/s | 174 kB 00:00 2023-10-16T14:23:13.803 INFO:teuthology.orchestra.run.smithi151.stdout:(118/143): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2023-10-16T14:23:13.809 INFO:teuthology.orchestra.run.smithi059.stdout:(67/143): python3-prettytable-0.7.2-27.el9.noar 735 kB/s | 41 kB 00:00 2023-10-16T14:23:13.834 INFO:teuthology.orchestra.run.smithi059.stdout:(68/143): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-10-16T14:23:13.868 INFO:teuthology.orchestra.run.smithi059.stdout:(69/143): python3-pyasn1-modules-0.4.8-6.el9.no 3.7 MB/s | 211 kB 00:00 2023-10-16T14:23:13.893 INFO:teuthology.orchestra.run.smithi059.stdout:(70/143): python3-requests-oauthlib-1.3.0-12.el 764 kB/s | 43 kB 00:00 2023-10-16T14:23:13.911 INFO:teuthology.orchestra.run.smithi151.stdout:(119/143): python3-portend-3.1.0-2.el9.noarch.r 152 kB/s | 16 kB 00:00 2023-10-16T14:23:14.037 INFO:teuthology.orchestra.run.smithi151.stdout:(120/143): python3-pyOpenSSL-21.0.0-1.el9.noarc 722 kB/s | 90 kB 00:00 2023-10-16T14:23:14.127 INFO:teuthology.orchestra.run.smithi059.stdout:(71/143): python3-toml-0.10.2-6.el9.noarch.rpm 179 kB/s | 39 kB 00:00 2023-10-16T14:23:14.145 INFO:teuthology.orchestra.run.smithi151.stdout:(121/143): python3-repoze-lru-0.7-16.el9.noarch 285 kB/s | 31 kB 00:00 2023-10-16T14:23:14.352 INFO:teuthology.orchestra.run.smithi059.stdout:(72/143): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2023-10-16T14:23:14.371 INFO:teuthology.orchestra.run.smithi151.stdout:(122/143): python3-routes-2.5.1-5.el9.noarch.rp 840 kB/s | 188 kB 00:00 2023-10-16T14:23:14.385 INFO:teuthology.orchestra.run.smithi059.stdout:(73/143): socat-1.7.4.1-5.el9.x86_64.rpm 1.2 MB/s | 300 kB 00:00 2023-10-16T14:23:14.411 INFO:teuthology.orchestra.run.smithi059.stdout:(74/143): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2023-10-16T14:23:14.436 INFO:teuthology.orchestra.run.smithi059.stdout:(75/143): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-10-16T14:23:14.461 INFO:teuthology.orchestra.run.smithi059.stdout:(76/143): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2023-10-16T14:23:14.479 INFO:teuthology.orchestra.run.smithi151.stdout:(123/143): python3-rsa-4.9-2.el9.noarch.rpm 548 kB/s | 59 kB 00:00 2023-10-16T14:23:14.503 INFO:teuthology.orchestra.run.smithi059.stdout:(77/143): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-10-16T14:23:14.562 INFO:teuthology.orchestra.run.smithi059.stdout:(78/143): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2023-10-16T14:23:14.596 INFO:teuthology.orchestra.run.smithi059.stdout:(79/143): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 241 kB 00:00 2023-10-16T14:23:14.596 INFO:teuthology.orchestra.run.smithi151.stdout:(124/143): python3-tempora-5.0.0-2.el9.noarch.r 308 kB/s | 36 kB 00:00 2023-10-16T14:23:14.621 INFO:teuthology.orchestra.run.smithi059.stdout:(80/143): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-10-16T14:23:14.646 INFO:teuthology.orchestra.run.smithi059.stdout:(81/143): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2023-10-16T14:23:14.672 INFO:teuthology.orchestra.run.smithi059.stdout:(82/143): python3-requests-2.25.1-7.el9.noarch. 2.3 MB/s | 113 kB 00:00 2023-10-16T14:23:14.705 INFO:teuthology.orchestra.run.smithi151.stdout:(125/143): fmt-8.1.1-5.el9.x86_64.rpm 15 kB/s | 111 kB 00:07 2023-10-16T14:23:14.706 INFO:teuthology.orchestra.run.smithi059.stdout:(83/143): python3-urllib3-1.26.5-3.el9.noarch.r 3.2 MB/s | 188 kB 00:00 2023-10-16T14:23:14.731 INFO:teuthology.orchestra.run.smithi151.stdout:(126/143): python3-typing-extensions-4.4.0-2.el 383 kB/s | 51 kB 00:00 2023-10-16T14:23:14.832 INFO:teuthology.orchestra.run.smithi151.stdout:(127/143): python3-websocket-client-1.2.3-2.el9 903 kB/s | 90 kB 00:00 2023-10-16T14:23:14.972 INFO:teuthology.orchestra.run.smithi059.stdout:(84/143): python3-cryptography-36.0.1-4.el9.x86 4.1 MB/s | 1.2 MB 00:00 2023-10-16T14:23:15.040 INFO:teuthology.orchestra.run.smithi151.stdout:(128/143): libarrow-9.0.0-9.el9.x86_64.rpm 754 kB/s | 4.4 MB 00:06 2023-10-16T14:23:15.073 INFO:teuthology.orchestra.run.smithi151.stdout:(129/143): python3-werkzeug-2.0.3-3.el9.1.noarc 1.7 MB/s | 427 kB 00:00 2023-10-16T14:23:15.249 INFO:teuthology.orchestra.run.smithi151.stdout:(130/143): python3-zc-lockfile-2.0-10.el9.noarc 96 kB/s | 20 kB 00:00 2023-10-16T14:23:15.282 INFO:teuthology.orchestra.run.smithi151.stdout:(131/143): python3-webob-1.8.7-6.el9.noarch.rpm 399 kB/s | 230 kB 00:00 2023-10-16T14:23:15.307 INFO:teuthology.orchestra.run.smithi151.stdout:(132/143): re2-20211101-3.el9.x86_64.rpm 821 kB/s | 192 kB 00:00 2023-10-16T14:23:15.322 INFO:teuthology.orchestra.run.smithi059.stdout:(85/143): elfutils-libelf-devel-0.189-3.el9.x86 65 kB/s | 22 kB 00:00 2023-10-16T14:23:15.540 INFO:teuthology.orchestra.run.smithi059.stdout:(86/143): automake-1.16.2-8.el9.noarch.rpm 827 kB/s | 689 kB 00:00 2023-10-16T14:23:15.573 INFO:teuthology.orchestra.run.smithi059.stdout:(87/143): jq-1.6-15.el9.x86_64.rpm 750 kB/s | 187 kB 00:00 2023-10-16T14:23:15.649 INFO:teuthology.orchestra.run.smithi059.stdout:(88/143): librabbitmq-0.11.0-7.el9.x86_64.rpm 425 kB/s | 45 kB 00:00 2023-10-16T14:23:15.674 INFO:teuthology.orchestra.run.smithi059.stdout:(89/143): libuuid-devel-2.37.4-15.el9.x86_64.rp 255 kB/s | 26 kB 00:00 2023-10-16T14:23:15.900 INFO:teuthology.orchestra.run.smithi151.stdout:(133/143): librados2-18.0.0-6730.g4ba8a190.el9. 5.4 MB/s | 3.3 MB 00:00 2023-10-16T14:23:15.967 INFO:teuthology.orchestra.run.smithi151.stdout:(134/143): librbd1-18.0.0-6730.g4ba8a190.el9.x8 4.6 MB/s | 3.0 MB 00:00 2023-10-16T14:23:15.984 INFO:teuthology.orchestra.run.smithi151.stdout:(135/143): libacl-devel-2.3.1-4.el9.x86_64.rpm 818 kB/s | 68 kB 00:00 2023-10-16T14:23:15.991 INFO:teuthology.orchestra.run.smithi059.stdout:(90/143): python3-pytz-2021.1-5.el9.noarch.rpm 161 kB/s | 51 kB 00:00 2023-10-16T14:23:16.076 INFO:teuthology.orchestra.run.smithi151.stdout:(136/143): NetworkManager-1.45.4-1.el9.x86_64.r 21 MB/s | 2.2 MB 00:00 2023-10-16T14:23:16.099 INFO:teuthology.orchestra.run.smithi059.stdout:(91/143): openssl-devel-3.0.7-24.el9.x86_64.rpm 9.2 MB/s | 4.1 MB 00:00 2023-10-16T14:23:16.125 INFO:teuthology.orchestra.run.smithi059.stdout:(92/143): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 660 kB/s | 86 kB 00:00 2023-10-16T14:23:16.168 INFO:teuthology.orchestra.run.smithi151.stdout:(137/143): NetworkManager-libnm-1.45.4-1.el9.x8 10 MB/s | 1.8 MB 00:00 2023-10-16T14:23:16.193 INFO:teuthology.orchestra.run.smithi151.stdout:(138/143): NetworkManager-team-1.45.4-1.el9.x86 399 kB/s | 41 kB 00:00 2023-10-16T14:23:16.227 INFO:teuthology.orchestra.run.smithi151.stdout:(139/143): NetworkManager-tui-1.45.4-1.el9.x86_ 4.2 MB/s | 244 kB 00:00 2023-10-16T14:23:16.233 INFO:teuthology.orchestra.run.smithi059.stdout:(93/143): zlib-devel-1.2.11-40.el9.x86_64.rpm 339 kB/s | 45 kB 00:00 2023-10-16T14:23:16.252 INFO:teuthology.orchestra.run.smithi151.stdout:(140/143): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 69 kB 00:00 2023-10-16T14:23:16.278 INFO:teuthology.orchestra.run.smithi151.stdout:(141/143): libacl-2.3.1-4.el9.x86_64.rpm 449 kB/s | 22 kB 00:00 2023-10-16T14:23:16.320 INFO:teuthology.orchestra.run.smithi151.stdout:(142/143): xfsdump-3.1.12-4.el9.x86_64.rpm 4.8 MB/s | 321 kB 00:00 2023-10-16T14:23:16.384 INFO:teuthology.orchestra.run.smithi059.stdout:(94/143): fmt-8.1.1-5.el9.x86_64.rpm 430 kB/s | 111 kB 00:00 2023-10-16T14:23:16.551 INFO:teuthology.orchestra.run.smithi059.stdout:(95/143): gperftools-libs-2.9.1-2.el9.x86_64.rp 985 kB/s | 309 kB 00:00 2023-10-16T14:23:16.584 INFO:teuthology.orchestra.run.smithi059.stdout:(96/143): libarrow-doc-9.0.0-9.el9.noarch.rpm 752 kB/s | 24 kB 00:00 2023-10-16T14:23:16.618 INFO:teuthology.orchestra.run.smithi059.stdout:(97/143): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2023-10-16T14:23:16.685 INFO:teuthology.orchestra.run.smithi059.stdout:(98/143): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2023-10-16T14:23:17.024 INFO:teuthology.orchestra.run.smithi059.stdout:(99/143): parquet-libs-9.0.0-9.el9.x86_64.rpm 2.4 MB/s | 837 kB 00:00 2023-10-16T14:23:17.137 INFO:teuthology.orchestra.run.smithi151.stdout:(143/143): thrift-0.15.0-2.el9.x86_64.rpm 858 kB/s | 1.6 MB 00:01 2023-10-16T14:23:17.146 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-16T14:23:17.147 INFO:teuthology.orchestra.run.smithi151.stdout:Total 10 MB/s | 199 MB 00:20 2023-10-16T14:23:17.227 INFO:teuthology.orchestra.run.smithi059.stdout:(100/143): python3-asyncssh-2.13.2-3.el9.noarch 2.7 MB/s | 548 kB 00:00 2023-10-16T14:23:17.269 INFO:teuthology.orchestra.run.smithi059.stdout:(101/143): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2023-10-16T14:23:17.311 INFO:teuthology.orchestra.run.smithi059.stdout:(102/143): python3-cachetools-4.2.4-1.el9.noarc 791 kB/s | 32 kB 00:00 2023-10-16T14:23:17.353 INFO:teuthology.orchestra.run.smithi059.stdout:(103/143): python3-certifi-2021.10.8-2.el9.noar 369 kB/s | 15 kB 00:00 2023-10-16T14:23:17.445 INFO:teuthology.orchestra.run.smithi059.stdout:(104/143): python3-cheroot-8.6.0-4.el9.noarch.r 1.9 MB/s | 172 kB 00:00 2023-10-16T14:23:17.584 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-16T14:23:17.603 INFO:teuthology.orchestra.run.smithi059.stdout:(105/143): python3-cherrypy-18.6.1-2.el9.noarch 2.2 MB/s | 358 kB 00:00 2023-10-16T14:23:17.704 INFO:teuthology.orchestra.run.smithi059.stdout:(106/143): python3-google-auth-2.23.2-1.el9.noa 1.9 MB/s | 196 kB 00:00 2023-10-16T14:23:17.746 INFO:teuthology.orchestra.run.smithi059.stdout:(107/143): python3-jaraco-8.2.1-3.el9.noarch.rp 263 kB/s | 11 kB 00:00 2023-10-16T14:23:17.786 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-16T14:23:17.787 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-16T14:23:17.787 INFO:teuthology.orchestra.run.smithi059.stdout:(108/143): python3-jaraco-classes-3.2.1-5.el9.n 434 kB/s | 18 kB 00:00 2023-10-16T14:23:17.830 INFO:teuthology.orchestra.run.smithi059.stdout:(109/143): python3-jaraco-collections-3.0.0-8.e 570 kB/s | 23 kB 00:00 2023-10-16T14:23:17.921 INFO:teuthology.orchestra.run.smithi059.stdout:(110/143): libarrow-9.0.0-9.el9.x86_64.rpm 2.9 MB/s | 4.4 MB 00:01 2023-10-16T14:23:17.947 INFO:teuthology.orchestra.run.smithi059.stdout:(111/143): python3-jaraco-functools-3.5.0-2.el9 167 kB/s | 19 kB 00:00 2023-10-16T14:23:17.972 INFO:teuthology.orchestra.run.smithi059.stdout:(112/143): python3-jaraco-text-3.2.0-6.el9.noar 395 kB/s | 20 kB 00:00 2023-10-16T14:23:18.014 INFO:teuthology.orchestra.run.smithi059.stdout:(113/143): python3-jwt+crypto-2.4.0-1.el9.noarc 137 kB/s | 9.0 kB 00:00 2023-10-16T14:23:18.039 INFO:teuthology.orchestra.run.smithi059.stdout:(114/143): python3-jwt-2.4.0-1.el9.noarch.rpm 621 kB/s | 41 kB 00:00 2023-10-16T14:23:18.081 INFO:teuthology.orchestra.run.smithi059.stdout:(115/143): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2023-10-16T14:23:18.142 INFO:teuthology.orchestra.run.smithi059.stdout:(116/143): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2023-10-16T14:23:18.601 INFO:teuthology.orchestra.run.smithi059.stdout:(117/143): ceph-test-18.0.0-6730.g4ba8a190.el9. 3.6 MB/s | 41 MB 00:11 2023-10-16T14:23:18.626 INFO:teuthology.orchestra.run.smithi059.stdout:(118/143): python3-natsort-7.1.1-5.el9.noarch.r 119 kB/s | 58 kB 00:00 2023-10-16T14:23:18.768 INFO:teuthology.orchestra.run.smithi059.stdout:(119/143): python3-portend-3.1.0-2.el9.noarch.r 236 kB/s | 16 kB 00:00 2023-10-16T14:23:18.860 INFO:teuthology.orchestra.run.smithi059.stdout:(120/143): python3-pyOpenSSL-21.0.0-1.el9.noarc 994 kB/s | 90 kB 00:00 2023-10-16T14:23:18.902 INFO:teuthology.orchestra.run.smithi059.stdout:(121/143): python3-repoze-lru-0.7-16.el9.noarch 756 kB/s | 31 kB 00:00 2023-10-16T14:23:18.935 INFO:teuthology.orchestra.run.smithi059.stdout:(122/143): python3-pecan-1.4.2-3.el9.noarch.rpm 817 kB/s | 272 kB 00:00 2023-10-16T14:23:18.985 INFO:teuthology.orchestra.run.smithi059.stdout:(123/143): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2023-10-16T14:23:19.053 INFO:teuthology.orchestra.run.smithi059.stdout:(124/143): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2023-10-16T14:23:19.094 INFO:teuthology.orchestra.run.smithi059.stdout:(125/143): python3-kubernetes-26.1.0-2.el9.noar 969 kB/s | 1.0 MB 00:01 2023-10-16T14:23:19.111 INFO:teuthology.orchestra.run.smithi059.stdout:(126/143): python3-tempora-5.0.0-2.el9.noarch.r 287 kB/s | 36 kB 00:00 2023-10-16T14:23:19.153 INFO:teuthology.orchestra.run.smithi059.stdout:(127/143): python3-typing-extensions-4.4.0-2.el 513 kB/s | 51 kB 00:00 2023-10-16T14:23:19.204 INFO:teuthology.orchestra.run.smithi059.stdout:(128/143): python3-websocket-client-1.2.3-2.el9 994 kB/s | 90 kB 00:00 2023-10-16T14:23:19.254 INFO:teuthology.orchestra.run.smithi059.stdout:(129/143): python3-zc-lockfile-2.0-10.el9.noarc 406 kB/s | 20 kB 00:00 2023-10-16T14:23:19.288 INFO:teuthology.orchestra.run.smithi059.stdout:(130/143): python3-webob-1.8.7-6.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2023-10-16T14:23:19.438 INFO:teuthology.orchestra.run.smithi059.stdout:(131/143): re2-20211101-3.el9.x86_64.rpm 1.0 MB/s | 192 kB 00:00 2023-10-16T14:23:19.538 INFO:teuthology.orchestra.run.smithi059.stdout:(132/143): python3-werkzeug-2.0.3-3.el9.1.noarc 1.1 MB/s | 427 kB 00:00 2023-10-16T14:23:19.968 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-16T14:23:19.968 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-16T14:23:20.272 INFO:teuthology.orchestra.run.smithi059.stdout:(133/143): thrift-0.15.0-2.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:00 2023-10-16T14:23:20.314 INFO:teuthology.orchestra.run.smithi059.stdout:(134/143): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2023-10-16T14:23:20.397 INFO:teuthology.orchestra.run.smithi059.stdout:(135/143): librbd1-18.0.0-6730.g4ba8a190.el9.x8 3.5 MB/s | 3.0 MB 00:00 2023-10-16T14:23:20.502 INFO:teuthology.orchestra.run.smithi059.stdout:(136/143): NetworkManager-1.45.4-1.el9.x86_64.r 12 MB/s | 2.2 MB 00:00 2023-10-16T14:23:20.590 INFO:teuthology.orchestra.run.smithi059.stdout:(137/143): librados2-18.0.0-6730.g4ba8a190.el9. 2.9 MB/s | 3.3 MB 00:01 2023-10-16T14:23:20.873 INFO:teuthology.orchestra.run.smithi059.stdout:(138/143): NetworkManager-libnm-1.45.4-1.el9.x8 3.9 MB/s | 1.8 MB 00:00 2023-10-16T14:23:20.907 INFO:teuthology.orchestra.run.smithi059.stdout:(139/143): NetworkManager-team-1.45.4-1.el9.x86 103 kB/s | 41 kB 00:00 2023-10-16T14:23:20.932 INFO:teuthology.orchestra.run.smithi059.stdout:(140/143): NetworkManager-tui-1.45.4-1.el9.x86_ 721 kB/s | 244 kB 00:00 2023-10-16T14:23:20.957 INFO:teuthology.orchestra.run.smithi059.stdout:(141/143): acl-2.3.1-4.el9.x86_64.rpm 857 kB/s | 69 kB 00:00 2023-10-16T14:23:21.013 INFO:teuthology.orchestra.run.smithi059.stdout:(142/143): libacl-2.3.1-4.el9.x86_64.rpm 277 kB/s | 22 kB 00:00 2023-10-16T14:23:21.049 INFO:teuthology.orchestra.run.smithi059.stdout:(143/143): xfsdump-3.1.12-4.el9.x86_64.rpm 2.7 MB/s | 321 kB 00:00 2023-10-16T14:23:21.065 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2023-10-16T14:23:21.066 INFO:teuthology.orchestra.run.smithi059.stdout:Total 10 MB/s | 199 MB 00:19 2023-10-16T14:23:21.530 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2023-10-16T14:23:21.748 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2023-10-16T14:23:21.748 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2023-10-16T14:23:23.927 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2023-10-16T14:23:23.942 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2023-10-16T14:23:26.318 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-16T14:23:26.476 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/153 2023-10-16T14:23:26.509 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/153 2023-10-16T14:23:26.547 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/153 2023-10-16T14:23:26.646 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/153 2023-10-16T14:23:27.040 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/153 2023-10-16T14:23:27.092 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-16T14:23:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-16T14:23:27.285 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-16T14:23:27.457 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-16T14:23:27.565 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/153 2023-10-16T14:23:27.612 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/153 2023-10-16T14:23:27.882 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 10/153 2023-10-16T14:23:27.940 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-13.11-1.el9.x86_64 11/153 2023-10-16T14:23:27.966 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-16T14:23:28.150 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-16T14:23:28.184 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 13/153 2023-10-16T14:23:28.327 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 13/153 2023-10-16T14:23:28.702 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 14/153 2023-10-16T14:23:28.916 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 15/153 2023-10-16T14:23:29.037 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 15/153 2023-10-16T14:23:29.243 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-16T14:23:29.294 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-16T14:23:29.751 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-16T14:23:29.808 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/153 2023-10-16T14:23:29.854 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/153 2023-10-16T14:23:29.977 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/153 2023-10-16T14:23:30.041 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 20/153 2023-10-16T14:23:30.081 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/153 2023-10-16T14:23:30.141 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/153 2023-10-16T14:23:30.258 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/153 2023-10-16T14:23:30.307 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2023-10-16T14:23:30.309 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/153 2023-10-16T14:23:30.342 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/153 2023-10-16T14:23:30.401 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/153 2023-10-16T14:23:30.437 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/153 2023-10-16T14:23:30.451 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/153 2023-10-16T14:23:30.465 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/153 2023-10-16T14:23:30.488 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 27/153 2023-10-16T14:23:30.563 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 28/153 2023-10-16T14:23:30.566 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/153 2023-10-16T14:23:30.670 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 29/153 2023-10-16T14:23:30.840 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/153 2023-10-16T14:23:30.909 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/153 2023-10-16T14:23:30.986 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/153 2023-10-16T14:23:31.028 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-16T14:23:31.226 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-16T14:23:31.262 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-16T14:23:31.390 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-16T14:23:31.465 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/153 2023-10-16T14:23:31.508 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/153 2023-10-16T14:23:31.616 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/153 2023-10-16T14:23:31.731 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/153 2023-10-16T14:23:31.775 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 10/153 2023-10-16T14:23:31.794 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 34/153 2023-10-16T14:23:31.834 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-13.11-1.el9.x86_64 11/153 2023-10-16T14:23:31.835 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 35/153 2023-10-16T14:23:31.873 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/153 2023-10-16T14:23:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-16T14:23:32.035 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/153 2023-10-16T14:23:32.037 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-16T14:23:32.068 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 13/153 2023-10-16T14:23:32.084 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 38/153 2023-10-16T14:23:32.155 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/153 2023-10-16T14:23:32.160 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 13/153 2023-10-16T14:23:32.248 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/153 2023-10-16T14:23:32.285 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/153 2023-10-16T14:23:32.324 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/153 2023-10-16T14:23:32.390 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/153 2023-10-16T14:23:32.467 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/153 2023-10-16T14:23:32.510 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 14/153 2023-10-16T14:23:32.527 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/153 2023-10-16T14:23:32.673 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 15/153 2023-10-16T14:23:32.715 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/153 2023-10-16T14:23:32.759 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/153 2023-10-16T14:23:32.761 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 15/153 2023-10-16T14:23:32.840 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/153 2023-10-16T14:23:32.967 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/153 2023-10-16T14:23:32.970 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-16T14:23:33.011 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-google-auth-1:2.23.2-1.el9.noarch 50/153 2023-10-16T14:23:33.017 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-16T14:23:33.070 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/153 2023-10-16T14:23:33.110 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/153 2023-10-16T14:23:33.150 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 53/153 2023-10-16T14:23:33.210 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fmt-8.1.1-5.el9.x86_64 54/153 2023-10-16T14:23:33.252 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 55/153 2023-10-16T14:23:33.403 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 56/153 2023-10-16T14:23:33.454 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : automake-1.16.2-8.el9.noarch 57/153 2023-10-16T14:23:33.510 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-16T14:23:33.522 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ply-3.11-14.el9.noarch 58/153 2023-10-16T14:23:33.555 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/153 2023-10-16T14:23:33.610 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/153 2023-10-16T14:23:33.619 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 59/153 2023-10-16T14:23:33.730 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/153 2023-10-16T14:23:33.800 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 20/153 2023-10-16T14:23:33.843 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/153 2023-10-16T14:23:33.865 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 60/153 2023-10-16T14:23:33.902 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/153 2023-10-16T14:23:33.955 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 61/153 2023-10-16T14:23:34.012 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/153 2023-10-16T14:23:34.054 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/153 2023-10-16T14:23:34.086 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/153 2023-10-16T14:23:34.127 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 62/153 2023-10-16T14:23:34.185 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 63/153 2023-10-16T14:23:34.201 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/153 2023-10-16T14:23:34.210 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 64/153 2023-10-16T14:23:34.241 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 27/153 2023-10-16T14:23:34.249 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 65/153 2023-10-16T14:23:34.292 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 28/153 2023-10-16T14:23:34.297 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 66/153 2023-10-16T14:23:34.361 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fuse-2.9.9-15.el9.x86_64 67/153 2023-10-16T14:23:34.415 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 29/153 2023-10-16T14:23:34.419 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/153 2023-10-16T14:23:34.511 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/153 2023-10-16T14:23:34.568 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 70/153 2023-10-16T14:23:34.597 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/153 2023-10-16T14:23:34.614 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/153 2023-10-16T14:23:34.671 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/153 2023-10-16T14:23:34.755 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/153 2023-10-16T14:23:34.802 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 73/153 2023-10-16T14:23:34.838 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/153 2023-10-16T14:23:34.900 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/153 2023-10-16T14:23:34.941 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/153 2023-10-16T14:23:35.084 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/153 2023-10-16T14:23:35.132 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/153 2023-10-16T14:23:35.276 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/153 2023-10-16T14:23:35.347 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/153 2023-10-16T14:23:35.427 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/153 2023-10-16T14:23:35.520 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/153 2023-10-16T14:23:35.570 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 34/153 2023-10-16T14:23:35.608 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 35/153 2023-10-16T14:23:35.656 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/153 2023-10-16T14:23:35.816 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/153 2023-10-16T14:23:35.867 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 38/153 2023-10-16T14:23:35.939 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/153 2023-10-16T14:23:36.035 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/153 2023-10-16T14:23:36.076 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/153 2023-10-16T14:23:36.115 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/153 2023-10-16T14:23:36.187 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/153 2023-10-16T14:23:36.348 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/153 2023-10-16T14:23:36.380 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/153 2023-10-16T14:23:36.405 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/153 2023-10-16T14:23:36.439 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/153 2023-10-16T14:23:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/153 2023-10-16T14:23:36.566 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/153 2023-10-16T14:23:36.615 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 85/153 2023-10-16T14:23:36.660 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/153 2023-10-16T14:23:36.716 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/153 2023-10-16T14:23:36.785 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/153 2023-10-16T14:23:36.851 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-0.3.21-2.el9.x86_64 86/153 2023-10-16T14:23:36.887 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 87/153 2023-10-16T14:23:36.950 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/153 2023-10-16T14:23:36.981 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 88/153 2023-10-16T14:23:36.991 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-google-auth-1:2.23.2-1.el9.noarch 50/153 2023-10-16T14:23:37.043 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/153 2023-10-16T14:23:37.081 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/153 2023-10-16T14:23:37.122 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 53/153 2023-10-16T14:23:37.165 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fmt-8.1.1-5.el9.x86_64 54/153 2023-10-16T14:23:37.218 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 55/153 2023-10-16T14:23:37.376 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 56/153 2023-10-16T14:23:37.433 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : automake-1.16.2-8.el9.noarch 57/153 2023-10-16T14:23:37.516 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ply-3.11-14.el9.noarch 58/153 2023-10-16T14:23:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 59/153 2023-10-16T14:23:37.813 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 89/153 2023-10-16T14:23:37.885 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 60/153 2023-10-16T14:23:37.941 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 61/153 2023-10-16T14:23:37.953 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 90/153 2023-10-16T14:23:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 62/153 2023-10-16T14:23:38.184 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 63/153 2023-10-16T14:23:38.215 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 64/153 2023-10-16T14:23:38.255 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 65/153 2023-10-16T14:23:38.326 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 66/153 2023-10-16T14:23:38.380 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fuse-2.9.9-15.el9.x86_64 67/153 2023-10-16T14:23:38.436 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/153 2023-10-16T14:23:38.524 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/153 2023-10-16T14:23:38.618 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 70/153 2023-10-16T14:23:38.662 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/153 2023-10-16T14:23:38.799 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/153 2023-10-16T14:23:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 73/153 2023-10-16T14:23:38.882 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/153 2023-10-16T14:23:38.946 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/153 2023-10-16T14:23:38.986 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/153 2023-10-16T14:23:39.137 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/153 2023-10-16T14:23:39.175 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/153 2023-10-16T14:23:39.324 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/153 2023-10-16T14:23:39.399 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/153 2023-10-16T14:23:39.598 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 91/153 2023-10-16T14:23:39.705 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 92/153 2023-10-16T14:23:39.744 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 93/153 2023-10-16T14:23:39.774 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : jq-1.6-15.el9.x86_64 94/153 2023-10-16T14:23:39.815 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 95/153 2023-10-16T14:23:40.177 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/153 2023-10-16T14:23:40.221 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 97/153 2023-10-16T14:23:40.408 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 97/153 2023-10-16T14:23:40.445 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/153 2023-10-16T14:23:40.446 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 98/153 2023-10-16T14:23:40.497 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/153 2023-10-16T14:23:40.503 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/153 2023-10-16T14:23:40.530 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/153 2023-10-16T14:23:40.661 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/153 2023-10-16T14:23:40.714 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 85/153 2023-10-16T14:23:40.975 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-0.3.21-2.el9.x86_64 86/153 2023-10-16T14:23:41.007 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 100/153 2023-10-16T14:23:41.010 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 87/153 2023-10-16T14:23:41.053 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 101/153 2023-10-16T14:23:41.108 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 88/153 2023-10-16T14:23:41.228 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 101/153 2023-10-16T14:23:41.254 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 102/153 2023-10-16T14:23:41.995 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 89/153 2023-10-16T14:23:42.139 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 90/153 2023-10-16T14:23:43.875 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 91/153 2023-10-16T14:23:43.953 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-16T14:23:43.963 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 92/153 2023-10-16T14:23:44.000 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 93/153 2023-10-16T14:23:44.002 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-16T14:23:44.031 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : jq-1.6-15.el9.x86_64 94/153 2023-10-16T14:23:44.071 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 95/153 2023-10-16T14:23:44.453 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/153 2023-10-16T14:23:44.486 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 97/153 2023-10-16T14:23:44.608 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 97/153 2023-10-16T14:23:44.636 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-16T14:23:44.664 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 98/153 2023-10-16T14:23:44.690 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/153 2023-10-16T14:23:44.730 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/153 2023-10-16T14:23:44.911 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/153 2023-10-16T14:23:44.911 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-16T14:23:44.911 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-16T14:23:44.912 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:23:44.971 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/153 2023-10-16T14:23:45.240 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 100/153 2023-10-16T14:23:45.271 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 101/153 2023-10-16T14:23:45.364 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 101/153 2023-10-16T14:23:45.399 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 102/153 2023-10-16T14:23:47.956 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-16T14:23:47.994 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-16T14:23:48.653 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-16T14:23:48.706 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/153 2023-10-16T14:23:48.873 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/153 2023-10-16T14:23:48.873 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-16T14:23:48.873 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-16T14:23:48.874 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:23:48.915 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/153 2023-10-16T14:23:57.785 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/153 2023-10-16T14:23:57.785 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /sys 2023-10-16T14:23:57.785 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /proc 2023-10-16T14:23:57.785 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /mnt 2023-10-16T14:23:57.786 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /var/tmp 2023-10-16T14:23:57.786 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /home 2023-10-16T14:23:57.786 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /root 2023-10-16T14:23:57.786 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /tmp 2023-10-16T14:23:57.786 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:23:58.040 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 106/153 2023-10-16T14:23:58.088 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 106/153 2023-10-16T14:23:58.088 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T14:23:58.088 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-16T14:23:58.088 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:23:59.785 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 107/153 2023-10-16T14:23:59.876 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 107/153 2023-10-16T14:23:59.876 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T14:23:59.876 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-16T14:23:59.877 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-16T14:23:59.877 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-16T14:23:59.877 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:00.102 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/153 2023-10-16T14:24:00.180 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/153 2023-10-16T14:24:00.180 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T14:24:00.181 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-16T14:24:00.181 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-16T14:24:00.181 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-16T14:24:00.181 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:00.703 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/153 2023-10-16T14:24:00.786 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/153 2023-10-16T14:24:00.787 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T14:24:00.787 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-16T14:24:00.787 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-16T14:24:00.787 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-16T14:24:00.788 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:01.497 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 110/153 2023-10-16T14:24:01.541 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 110/153 2023-10-16T14:24:01.588 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 111/153 2023-10-16T14:24:01.702 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 112/153 2023-10-16T14:24:01.735 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 113/153 2023-10-16T14:24:02.046 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/153 2023-10-16T14:24:02.047 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /sys 2023-10-16T14:24:02.047 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /proc 2023-10-16T14:24:02.047 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /mnt 2023-10-16T14:24:02.047 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /var/tmp 2023-10-16T14:24:02.047 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /home 2023-10-16T14:24:02.047 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /root 2023-10-16T14:24:02.048 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /tmp 2023-10-16T14:24:02.048 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:02.058 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 113/153 2023-10-16T14:24:02.103 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 114/153 2023-10-16T14:24:02.252 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 106/153 2023-10-16T14:24:02.301 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 106/153 2023-10-16T14:24:02.301 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T14:24:02.301 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-16T14:24:02.301 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:03.200 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 114/153 2023-10-16T14:24:03.237 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 115/153 2023-10-16T14:24:03.378 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 115/153 2023-10-16T14:24:03.554 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 116/153 2023-10-16T14:24:03.602 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 117/153 2023-10-16T14:24:03.701 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 117/153 2023-10-16T14:24:03.701 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T14:24:03.701 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-16T14:24:03.701 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-16T14:24:03.702 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-16T14:24:03.702 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:03.766 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 118/153 2023-10-16T14:24:03.807 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 118/153 2023-10-16T14:24:04.078 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 107/153 2023-10-16T14:24:04.188 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 107/153 2023-10-16T14:24:04.188 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T14:24:04.188 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-16T14:24:04.189 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-16T14:24:04.189 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-16T14:24:04.189 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:04.436 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/153 2023-10-16T14:24:04.540 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/153 2023-10-16T14:24:04.541 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T14:24:04.541 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-16T14:24:04.541 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-16T14:24:04.541 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-16T14:24:04.542 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:04.660 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 119/153 2023-10-16T14:24:04.692 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/153 2023-10-16T14:24:04.769 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/153 2023-10-16T14:24:04.770 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T14:24:04.770 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-16T14:24:04.770 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-16T14:24:04.770 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-16T14:24:04.770 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:04.826 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 121/153 2023-10-16T14:24:04.895 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 121/153 2023-10-16T14:24:04.895 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T14:24:04.895 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-16T14:24:04.896 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:04.960 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 122/153 2023-10-16T14:24:05.037 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 122/153 2023-10-16T14:24:05.038 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T14:24:05.038 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-10-16T14:24:05.038 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-16T14:24:05.038 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-16T14:24:05.038 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:05.070 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/153 2023-10-16T14:24:05.169 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/153 2023-10-16T14:24:05.169 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T14:24:05.169 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-16T14:24:05.169 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-16T14:24:05.170 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-16T14:24:05.170 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:05.395 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/153 2023-10-16T14:24:05.465 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/153 2023-10-16T14:24:05.466 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T14:24:05.466 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-16T14:24:05.466 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-16T14:24:05.467 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-16T14:24:05.467 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:05.839 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 110/153 2023-10-16T14:24:05.882 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 110/153 2023-10-16T14:24:05.930 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 111/153 2023-10-16T14:24:06.046 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 112/153 2023-10-16T14:24:06.084 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 113/153 2023-10-16T14:24:06.419 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 113/153 2023-10-16T14:24:06.460 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 114/153 2023-10-16T14:24:07.666 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 114/153 2023-10-16T14:24:07.701 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 115/153 2023-10-16T14:24:07.849 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 115/153 2023-10-16T14:24:08.027 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 116/153 2023-10-16T14:24:08.053 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 117/153 2023-10-16T14:24:08.138 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 117/153 2023-10-16T14:24:08.139 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T14:24:08.139 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-16T14:24:08.139 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-16T14:24:08.139 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-16T14:24:08.140 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:08.187 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 118/153 2023-10-16T14:24:08.228 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 118/153 2023-10-16T14:24:09.188 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 119/153 2023-10-16T14:24:09.222 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/153 2023-10-16T14:24:09.302 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/153 2023-10-16T14:24:09.302 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T14:24:09.302 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-16T14:24:09.302 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-16T14:24:09.303 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-16T14:24:09.303 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:09.364 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 121/153 2023-10-16T14:24:09.451 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 121/153 2023-10-16T14:24:09.452 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T14:24:09.452 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-16T14:24:09.452 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:09.515 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 122/153 2023-10-16T14:24:09.577 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 124/153 2023-10-16T14:24:09.611 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 122/153 2023-10-16T14:24:09.612 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T14:24:09.612 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-10-16T14:24:09.612 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-16T14:24:09.612 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-16T14:24:09.613 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:09.633 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 125/153 2023-10-16T14:24:09.675 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 126/153 2023-10-16T14:24:09.972 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 127/153 2023-10-16T14:24:09.990 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/153 2023-10-16T14:24:10.070 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/153 2023-10-16T14:24:10.070 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-16T14:24:10.070 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-16T14:24:10.071 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-16T14:24:10.071 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-16T14:24:10.071 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:10.093 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 128/153 2023-10-16T14:24:10.168 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 129/153 2023-10-16T14:24:10.221 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/153 2023-10-16T14:24:10.267 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/153 2023-10-16T14:24:10.306 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 132/153 2023-10-16T14:24:10.354 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-team-1:1.45.4-1.el9.x86_64 133/153 2023-10-16T14:24:10.465 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-tui-1:1.45.4-1.el9.x86_64 134/153 2023-10-16T14:24:10.553 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 135/153 2023-10-16T14:24:10.603 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 136/153 2023-10-16T14:24:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-16T14:24:11.636 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-16T14:24:11.694 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-16T14:24:11.752 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 138/153 2023-10-16T14:24:13.144 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 139/153 2023-10-16T14:24:13.237 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 140/153 2023-10-16T14:24:13.293 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 141/153 2023-10-16T14:24:13.437 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flex-2.6.4-9.el9.x86_64 142/153 2023-10-16T14:24:13.499 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : bison-3.7.4-5.el9.x86_64 143/153 2023-10-16T14:24:13.537 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 144/153 2023-10-16T14:24:13.537 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 145/153 2023-10-16T14:24:13.707 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 145/153 2023-10-16T14:24:13.742 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 146/153 2023-10-16T14:24:13.779 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 147/153 2023-10-16T14:24:13.811 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 148/153 2023-10-16T14:24:13.850 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-16T14:24:13.851 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-16T14:24:14.162 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-16T14:24:14.163 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/153 2023-10-16T14:24:14.376 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/153 2023-10-16T14:24:14.407 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 151/153 2023-10-16T14:24:14.407 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/153 2023-10-16T14:24:14.463 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 124/153 2023-10-16T14:24:14.519 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 125/153 2023-10-16T14:24:14.552 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 126/153 2023-10-16T14:24:14.615 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/153 2023-10-16T14:24:14.746 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-16T14:24:14.838 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 127/153 2023-10-16T14:24:14.965 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 128/153 2023-10-16T14:24:15.004 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-16T14:24:15.004 INFO:teuthology.orchestra.run.smithi151.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-16T14:24:15.004 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:15.036 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 129/153 2023-10-16T14:24:15.088 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/153 2023-10-16T14:24:15.142 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/153 2023-10-16T14:24:15.172 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 132/153 2023-10-16T14:24:15.218 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-team-1:1.45.4-1.el9.x86_64 133/153 2023-10-16T14:24:15.337 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-tui-1:1.45.4-1.el9.x86_64 134/153 2023-10-16T14:24:15.416 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 135/153 2023-10-16T14:24:15.458 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 136/153 2023-10-16T14:24:16.390 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-16T14:24:16.430 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-16T14:24:16.492 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-16T14:24:16.560 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 138/153 2023-10-16T14:24:18.066 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 139/153 2023-10-16T14:24:18.169 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 140/153 2023-10-16T14:24:18.214 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 141/153 2023-10-16T14:24:18.346 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flex-2.6.4-9.el9.x86_64 142/153 2023-10-16T14:24:18.381 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : bison-3.7.4-5.el9.x86_64 143/153 2023-10-16T14:24:18.418 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 144/153 2023-10-16T14:24:18.419 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 145/153 2023-10-16T14:24:18.571 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 145/153 2023-10-16T14:24:18.603 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 146/153 2023-10-16T14:24:18.635 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 147/153 2023-10-16T14:24:18.668 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 148/153 2023-10-16T14:24:18.708 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-16T14:24:18.709 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-16T14:24:19.186 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-16T14:24:19.188 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/153 2023-10-16T14:24:19.348 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/153 2023-10-16T14:24:19.379 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 151/153 2023-10-16T14:24:19.380 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/153 2023-10-16T14:24:19.537 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/153 2023-10-16T14:24:19.672 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-16T14:24:19.937 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 1/153 2023-10-16T14:24:19.937 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2/153 2023-10-16T14:24:19.937 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 3/153 2023-10-16T14:24:19.937 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 4/153 2023-10-16T14:24:19.938 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/153 2023-10-16T14:24:19.938 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-16T14:24:19.938 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-16T14:24:19.938 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/153 2023-10-16T14:24:19.938 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 9/153 2023-10-16T14:24:19.939 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 10/153 2023-10-16T14:24:19.939 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 11/153 2023-10-16T14:24:19.939 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-16T14:24:19.939 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 13/153 2023-10-16T14:24:19.939 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 14/153 2023-10-16T14:24:19.940 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 15/153 2023-10-16T14:24:19.940 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 16/153 2023-10-16T14:24:19.940 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 17/153 2023-10-16T14:24:19.940 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 18/153 2023-10-16T14:24:19.940 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 19/153 2023-10-16T14:24:19.941 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/153 2023-10-16T14:24:19.941 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 21/153 2023-10-16T14:24:19.941 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 22/153 2023-10-16T14:24:19.941 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 23/153 2023-10-16T14:24:19.941 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 24/153 2023-10-16T14:24:19.942 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 25/153 2023-10-16T14:24:19.942 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 26/153 2023-10-16T14:24:19.942 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 27/153 2023-10-16T14:24:19.949 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-16T14:24:19.949 INFO:teuthology.orchestra.run.smithi059.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-16T14:24:19.949 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:19.953 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 28/153 2023-10-16T14:24:19.954 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/153 2023-10-16T14:24:19.954 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 30/153 2023-10-16T14:24:19.954 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 31/153 2023-10-16T14:24:19.954 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/153 2023-10-16T14:24:19.954 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/153 2023-10-16T14:24:19.955 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 34/153 2023-10-16T14:24:19.955 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/153 2023-10-16T14:24:19.955 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 36/153 2023-10-16T14:24:19.955 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 37/153 2023-10-16T14:24:19.955 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 38/153 2023-10-16T14:24:19.956 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/153 2023-10-16T14:24:19.956 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/153 2023-10-16T14:24:19.956 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/153 2023-10-16T14:24:19.956 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/153 2023-10-16T14:24:19.956 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/153 2023-10-16T14:24:19.956 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/153 2023-10-16T14:24:19.957 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/153 2023-10-16T14:24:19.957 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/153 2023-10-16T14:24:19.957 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/153 2023-10-16T14:24:19.957 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/153 2023-10-16T14:24:19.957 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/153 2023-10-16T14:24:19.958 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/153 2023-10-16T14:24:19.958 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/153 2023-10-16T14:24:19.958 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/153 2023-10-16T14:24:19.958 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/153 2023-10-16T14:24:19.958 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/153 2023-10-16T14:24:19.959 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/153 2023-10-16T14:24:19.959 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/153 2023-10-16T14:24:19.959 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/153 2023-10-16T14:24:19.959 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/153 2023-10-16T14:24:19.959 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/153 2023-10-16T14:24:19.960 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/153 2023-10-16T14:24:19.960 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/153 2023-10-16T14:24:19.960 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/153 2023-10-16T14:24:19.960 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/153 2023-10-16T14:24:19.960 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/153 2023-10-16T14:24:19.961 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/153 2023-10-16T14:24:19.961 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/153 2023-10-16T14:24:19.961 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/153 2023-10-16T14:24:19.961 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/153 2023-10-16T14:24:19.961 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/153 2023-10-16T14:24:19.962 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/153 2023-10-16T14:24:19.962 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/153 2023-10-16T14:24:19.962 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/153 2023-10-16T14:24:19.962 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/153 2023-10-16T14:24:19.962 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/153 2023-10-16T14:24:19.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 75/153 2023-10-16T14:24:19.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/153 2023-10-16T14:24:19.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 77/153 2023-10-16T14:24:19.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 78/153 2023-10-16T14:24:19.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 79/153 2023-10-16T14:24:19.963 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/153 2023-10-16T14:24:19.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ply-3.11-14.el9.noarch 81/153 2023-10-16T14:24:19.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/153 2023-10-16T14:24:19.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 83/153 2023-10-16T14:24:19.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 84/153 2023-10-16T14:24:19.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 85/153 2023-10-16T14:24:19.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : automake-1.16.2-8.el9.noarch 86/153 2023-10-16T14:24:19.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 87/153 2023-10-16T14:24:19.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : jq-1.6-15.el9.x86_64 88/153 2023-10-16T14:24:19.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 89/153 2023-10-16T14:24:19.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 90/153 2023-10-16T14:24:19.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 91/153 2023-10-16T14:24:19.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/153 2023-10-16T14:24:19.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 93/153 2023-10-16T14:24:19.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 94/153 2023-10-16T14:24:19.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 95/153 2023-10-16T14:24:19.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/153 2023-10-16T14:24:19.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 97/153 2023-10-16T14:24:19.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 98/153 2023-10-16T14:24:19.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 99/153 2023-10-16T14:24:19.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 100/153 2023-10-16T14:24:19.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 101/153 2023-10-16T14:24:19.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 102/153 2023-10-16T14:24:19.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 103/153 2023-10-16T14:24:19.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 104/153 2023-10-16T14:24:19.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 105/153 2023-10-16T14:24:19.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 106/153 2023-10-16T14:24:19.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 107/153 2023-10-16T14:24:19.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-google-auth-1:2.23.2-1.el9.noarch 108/153 2023-10-16T14:24:19.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 109/153 2023-10-16T14:24:19.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 110/153 2023-10-16T14:24:19.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 111/153 2023-10-16T14:24:19.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 112/153 2023-10-16T14:24:19.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 113/153 2023-10-16T14:24:19.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 114/153 2023-10-16T14:24:19.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 115/153 2023-10-16T14:24:19.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 116/153 2023-10-16T14:24:19.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 117/153 2023-10-16T14:24:19.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 118/153 2023-10-16T14:24:19.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 119/153 2023-10-16T14:24:19.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 120/153 2023-10-16T14:24:19.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 121/153 2023-10-16T14:24:19.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/153 2023-10-16T14:24:19.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 123/153 2023-10-16T14:24:19.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 124/153 2023-10-16T14:24:19.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 125/153 2023-10-16T14:24:19.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 126/153 2023-10-16T14:24:19.973 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 127/153 2023-10-16T14:24:19.973 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 128/153 2023-10-16T14:24:19.973 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 129/153 2023-10-16T14:24:19.973 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 130/153 2023-10-16T14:24:19.973 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 131/153 2023-10-16T14:24:19.973 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : re2-1:20211101-3.el9.x86_64 132/153 2023-10-16T14:24:19.974 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 133/153 2023-10-16T14:24:19.974 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 134/153 2023-10-16T14:24:19.974 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 135/153 2023-10-16T14:24:19.974 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 136/153 2023-10-16T14:24:19.974 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 137/153 2023-10-16T14:24:19.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 138/153 2023-10-16T14:24:19.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 139/153 2023-10-16T14:24:19.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.45.4-1.el9.x86_64 140/153 2023-10-16T14:24:19.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 141/153 2023-10-16T14:24:19.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 142/153 2023-10-16T14:24:19.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 143/153 2023-10-16T14:24:19.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.45.4-1.el9.x86_64 144/153 2023-10-16T14:24:19.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 145/153 2023-10-16T14:24:19.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.45.4-1.el9.x86_64 146/153 2023-10-16T14:24:19.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 147/153 2023-10-16T14:24:19.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : acl-2.3.1-4.el9.x86_64 148/153 2023-10-16T14:24:19.977 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : acl-2.3.1-3.el9.x86_64 149/153 2023-10-16T14:24:19.977 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 150/153 2023-10-16T14:24:19.977 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 151/153 2023-10-16T14:24:19.977 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 152/153 2023-10-16T14:24:22.117 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-16T14:24:22.117 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:22.117 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2023-10-16T14:24:22.117 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-1:1.45.4-1.el9.x86_64 2023-10-16T14:24:22.117 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 2023-10-16T14:24:22.118 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team-1:1.45.4-1.el9.x86_64 2023-10-16T14:24:22.118 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui-1:1.45.4-1.el9.x86_64 2023-10-16T14:24:22.118 INFO:teuthology.orchestra.run.smithi151.stdout: acl-2.3.1-4.el9.x86_64 2023-10-16T14:24:22.118 INFO:teuthology.orchestra.run.smithi151.stdout: libacl-2.3.1-4.el9.x86_64 2023-10-16T14:24:22.119 INFO:teuthology.orchestra.run.smithi151.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-10-16T14:24:22.119 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.119 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.119 INFO:teuthology.orchestra.run.smithi151.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-10-16T14:24:22.119 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-10-16T14:24:22.120 INFO:teuthology.orchestra.run.smithi151.stdout: automake-1.16.2-8.el9.noarch 2023-10-16T14:24:22.120 INFO:teuthology.orchestra.run.smithi151.stdout: bison-3.7.4-5.el9.x86_64 2023-10-16T14:24:22.120 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-16T14:24:22.120 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.120 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.121 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.121 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.121 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T14:24:22.121 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.121 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.122 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.122 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T14:24:22.122 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T14:24:22.122 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T14:24:22.122 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T14:24:22.123 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T14:24:22.123 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.123 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.123 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T14:24:22.123 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.124 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.124 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.124 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T14:24:22.124 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T14:24:22.125 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.125 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T14:24:22.125 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-10-16T14:24:22.125 INFO:teuthology.orchestra.run.smithi151.stdout: flex-2.6.4-9.el9.x86_64 2023-10-16T14:24:22.125 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-16T14:24:22.125 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-16T14:24:22.126 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-16T14:24:22.126 INFO:teuthology.orchestra.run.smithi151.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-16T14:24:22.126 INFO:teuthology.orchestra.run.smithi151.stdout: fuse-2.9.9-15.el9.x86_64 2023-10-16T14:24:22.126 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-16T14:24:22.126 INFO:teuthology.orchestra.run.smithi151.stdout: jq-1.6-15.el9.x86_64 2023-10-16T14:24:22.127 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-10-16T14:24:22.127 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-16T14:24:22.127 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-16T14:24:22.127 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.127 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.128 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.128 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-16T14:24:22.128 INFO:teuthology.orchestra.run.smithi151.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-16T14:24:22.128 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-16T14:24:22.128 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-16T14:24:22.129 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-16T14:24:22.129 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.129 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.129 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-16T14:24:22.129 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.130 INFO:teuthology.orchestra.run.smithi151.stdout: libtool-2.4.6-45.el9.x86_64 2023-10-16T14:24:22.130 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-16T14:24:22.130 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-10-16T14:24:22.130 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-10-16T14:24:22.130 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-16T14:24:22.131 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-16T14:24:22.131 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-16T14:24:22.131 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-16T14:24:22.131 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-10-16T14:24:22.131 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-16T14:24:22.131 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-13.11-1.el9.x86_64 2023-10-16T14:24:22.132 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-10-16T14:24:22.132 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-10-16T14:24:22.132 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server-13.11-1.el9.x86_64 2023-10-16T14:24:22.132 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-16T14:24:22.132 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-16T14:24:22.133 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-16T14:24:22.133 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-16T14:24:22.133 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.133 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.133 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.134 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-16T14:24:22.134 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-16T14:24:22.134 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-16T14:24:22.134 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-16T14:24:22.134 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-16T14:24:22.135 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-16T14:24:22.135 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth-1:2.23.2-1.el9.noarch 2023-10-16T14:24:22.135 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-16T14:24:22.135 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-16T14:24:22.135 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-16T14:24:22.135 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-16T14:24:22.136 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-16T14:24:22.136 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-16T14:24:22.136 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-16T14:24:22.136 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-16T14:24:22.136 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-16T14:24:22.137 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-16T14:24:22.137 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-16T14:24:22.137 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-16T14:24:22.137 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-16T14:24:22.137 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-16T14:24:22.138 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-16T14:24:22.138 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-16T14:24:22.138 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-16T14:24:22.138 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-16T14:24:22.138 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-16T14:24:22.139 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-16T14:24:22.139 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply-3.11-14.el9.noarch 2023-10-16T14:24:22.139 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-16T14:24:22.139 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-16T14:24:22.139 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-16T14:24:22.140 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-16T14:24:22.140 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-16T14:24:22.140 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-16T14:24:22.140 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-16T14:24:22.140 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.141 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.141 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-16T14:24:22.141 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-16T14:24:22.141 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-16T14:24:22.141 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.142 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-16T14:24:22.142 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-16T14:24:22.142 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-16T14:24:22.142 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-16T14:24:22.142 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-16T14:24:22.143 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-16T14:24:22.143 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-10-16T14:24:22.143 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-16T14:24:22.143 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-16T14:24:22.143 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-16T14:24:22.143 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-16T14:24:22.144 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.144 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.144 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:22.144 INFO:teuthology.orchestra.run.smithi151.stdout: re2-1:20211101-3.el9.x86_64 2023-10-16T14:24:22.144 INFO:teuthology.orchestra.run.smithi151.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-16T14:24:22.145 INFO:teuthology.orchestra.run.smithi151.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-16T14:24:22.145 INFO:teuthology.orchestra.run.smithi151.stdout: uuid-1.6.2-55.el9.x86_64 2023-10-16T14:24:22.145 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-10-16T14:24:22.145 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-16T14:24:22.146 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-10-16T14:24:22.146 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:22.146 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-16T14:24:22.684 DEBUG:teuthology.parallel:result is None 2023-10-16T14:24:24.811 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 1/153 2023-10-16T14:24:24.812 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2/153 2023-10-16T14:24:24.812 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 3/153 2023-10-16T14:24:24.812 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 4/153 2023-10-16T14:24:24.812 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/153 2023-10-16T14:24:24.812 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-16T14:24:24.812 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-16T14:24:24.813 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/153 2023-10-16T14:24:24.813 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 9/153 2023-10-16T14:24:24.813 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 10/153 2023-10-16T14:24:24.813 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 11/153 2023-10-16T14:24:24.813 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-16T14:24:24.814 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 13/153 2023-10-16T14:24:24.814 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 14/153 2023-10-16T14:24:24.814 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 15/153 2023-10-16T14:24:24.814 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 16/153 2023-10-16T14:24:24.814 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 17/153 2023-10-16T14:24:24.814 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 18/153 2023-10-16T14:24:24.815 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 19/153 2023-10-16T14:24:24.815 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/153 2023-10-16T14:24:24.815 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 21/153 2023-10-16T14:24:24.815 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 22/153 2023-10-16T14:24:24.815 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 23/153 2023-10-16T14:24:24.815 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 24/153 2023-10-16T14:24:24.816 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 25/153 2023-10-16T14:24:24.816 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 26/153 2023-10-16T14:24:24.816 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 27/153 2023-10-16T14:24:24.816 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 28/153 2023-10-16T14:24:24.816 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/153 2023-10-16T14:24:24.816 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 30/153 2023-10-16T14:24:24.817 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 31/153 2023-10-16T14:24:24.817 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/153 2023-10-16T14:24:24.817 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/153 2023-10-16T14:24:24.817 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 34/153 2023-10-16T14:24:24.817 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/153 2023-10-16T14:24:24.818 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 36/153 2023-10-16T14:24:24.818 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 37/153 2023-10-16T14:24:24.818 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 38/153 2023-10-16T14:24:24.818 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/153 2023-10-16T14:24:24.818 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/153 2023-10-16T14:24:24.819 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/153 2023-10-16T14:24:24.819 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/153 2023-10-16T14:24:24.819 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/153 2023-10-16T14:24:24.819 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/153 2023-10-16T14:24:24.819 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/153 2023-10-16T14:24:24.819 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/153 2023-10-16T14:24:24.820 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/153 2023-10-16T14:24:24.820 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/153 2023-10-16T14:24:24.820 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/153 2023-10-16T14:24:24.820 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/153 2023-10-16T14:24:24.820 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/153 2023-10-16T14:24:24.821 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/153 2023-10-16T14:24:24.821 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/153 2023-10-16T14:24:24.821 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/153 2023-10-16T14:24:24.821 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/153 2023-10-16T14:24:24.821 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/153 2023-10-16T14:24:24.822 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/153 2023-10-16T14:24:24.822 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/153 2023-10-16T14:24:24.822 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/153 2023-10-16T14:24:24.822 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/153 2023-10-16T14:24:24.822 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/153 2023-10-16T14:24:24.823 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/153 2023-10-16T14:24:24.823 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/153 2023-10-16T14:24:24.823 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/153 2023-10-16T14:24:24.823 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/153 2023-10-16T14:24:24.823 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/153 2023-10-16T14:24:24.823 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/153 2023-10-16T14:24:24.824 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/153 2023-10-16T14:24:24.824 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/153 2023-10-16T14:24:24.824 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/153 2023-10-16T14:24:24.824 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/153 2023-10-16T14:24:24.824 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/153 2023-10-16T14:24:24.825 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/153 2023-10-16T14:24:24.825 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/153 2023-10-16T14:24:24.825 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 75/153 2023-10-16T14:24:24.825 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/153 2023-10-16T14:24:24.825 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 77/153 2023-10-16T14:24:24.825 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 78/153 2023-10-16T14:24:24.826 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 79/153 2023-10-16T14:24:24.826 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/153 2023-10-16T14:24:24.826 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ply-3.11-14.el9.noarch 81/153 2023-10-16T14:24:24.826 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/153 2023-10-16T14:24:24.826 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 83/153 2023-10-16T14:24:24.827 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 84/153 2023-10-16T14:24:24.827 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 85/153 2023-10-16T14:24:24.827 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : automake-1.16.2-8.el9.noarch 86/153 2023-10-16T14:24:24.827 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 87/153 2023-10-16T14:24:24.827 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : jq-1.6-15.el9.x86_64 88/153 2023-10-16T14:24:24.828 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 89/153 2023-10-16T14:24:24.828 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 90/153 2023-10-16T14:24:24.828 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 91/153 2023-10-16T14:24:24.828 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/153 2023-10-16T14:24:24.828 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 93/153 2023-10-16T14:24:24.828 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 94/153 2023-10-16T14:24:24.829 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 95/153 2023-10-16T14:24:24.829 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/153 2023-10-16T14:24:24.829 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 97/153 2023-10-16T14:24:24.829 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 98/153 2023-10-16T14:24:24.829 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 99/153 2023-10-16T14:24:24.830 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 100/153 2023-10-16T14:24:24.830 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 101/153 2023-10-16T14:24:24.830 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 102/153 2023-10-16T14:24:24.830 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 103/153 2023-10-16T14:24:24.830 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 104/153 2023-10-16T14:24:24.831 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 105/153 2023-10-16T14:24:24.831 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 106/153 2023-10-16T14:24:24.831 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 107/153 2023-10-16T14:24:24.831 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-google-auth-1:2.23.2-1.el9.noarch 108/153 2023-10-16T14:24:24.831 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 109/153 2023-10-16T14:24:24.831 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 110/153 2023-10-16T14:24:24.832 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 111/153 2023-10-16T14:24:24.832 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 112/153 2023-10-16T14:24:24.832 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 113/153 2023-10-16T14:24:24.832 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 114/153 2023-10-16T14:24:24.832 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 115/153 2023-10-16T14:24:24.833 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 116/153 2023-10-16T14:24:24.833 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 117/153 2023-10-16T14:24:24.833 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 118/153 2023-10-16T14:24:24.833 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 119/153 2023-10-16T14:24:24.833 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 120/153 2023-10-16T14:24:24.833 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 121/153 2023-10-16T14:24:24.834 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/153 2023-10-16T14:24:24.834 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 123/153 2023-10-16T14:24:24.834 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 124/153 2023-10-16T14:24:24.834 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 125/153 2023-10-16T14:24:24.834 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 126/153 2023-10-16T14:24:24.835 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 127/153 2023-10-16T14:24:24.835 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 128/153 2023-10-16T14:24:24.835 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 129/153 2023-10-16T14:24:24.835 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 130/153 2023-10-16T14:24:24.835 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 131/153 2023-10-16T14:24:24.835 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : re2-1:20211101-3.el9.x86_64 132/153 2023-10-16T14:24:24.836 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 133/153 2023-10-16T14:24:24.836 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 134/153 2023-10-16T14:24:24.836 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 135/153 2023-10-16T14:24:24.836 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 136/153 2023-10-16T14:24:24.836 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 137/153 2023-10-16T14:24:24.836 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 138/153 2023-10-16T14:24:24.837 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 139/153 2023-10-16T14:24:24.837 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-1:1.45.4-1.el9.x86_64 140/153 2023-10-16T14:24:24.837 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 141/153 2023-10-16T14:24:24.837 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 142/153 2023-10-16T14:24:24.837 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 143/153 2023-10-16T14:24:24.838 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-team-1:1.45.4-1.el9.x86_64 144/153 2023-10-16T14:24:24.838 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 145/153 2023-10-16T14:24:24.838 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-tui-1:1.45.4-1.el9.x86_64 146/153 2023-10-16T14:24:24.838 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 147/153 2023-10-16T14:24:24.838 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : acl-2.3.1-4.el9.x86_64 148/153 2023-10-16T14:24:24.839 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : acl-2.3.1-3.el9.x86_64 149/153 2023-10-16T14:24:24.839 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 150/153 2023-10-16T14:24:24.839 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 151/153 2023-10-16T14:24:24.839 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 152/153 2023-10-16T14:24:27.062 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-16T14:24:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:27.063 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2023-10-16T14:24:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-1:1.45.4-1.el9.x86_64 2023-10-16T14:24:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 2023-10-16T14:24:27.063 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-team-1:1.45.4-1.el9.x86_64 2023-10-16T14:24:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-tui-1:1.45.4-1.el9.x86_64 2023-10-16T14:24:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: acl-2.3.1-4.el9.x86_64 2023-10-16T14:24:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: libacl-2.3.1-4.el9.x86_64 2023-10-16T14:24:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-10-16T14:24:27.064 INFO:teuthology.orchestra.run.smithi059.stdout: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-10-16T14:24:27.065 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2023-10-16T14:24:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: automake-1.16.2-8.el9.noarch 2023-10-16T14:24:27.065 INFO:teuthology.orchestra.run.smithi059.stdout: bison-3.7.4-5.el9.x86_64 2023-10-16T14:24:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-16T14:24:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.066 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T14:24:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T14:24:27.067 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T14:24:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T14:24:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T14:24:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T14:24:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.068 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T14:24:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T14:24:27.069 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T14:24:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-16T14:24:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-10-16T14:24:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: flex-2.6.4-9.el9.x86_64 2023-10-16T14:24:27.070 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-16T14:24:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-16T14:24:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-16T14:24:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-16T14:24:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: fuse-2.9.9-15.el9.x86_64 2023-10-16T14:24:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-16T14:24:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: jq-1.6-15.el9.x86_64 2023-10-16T14:24:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-10-16T14:24:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-16T14:24:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-16T14:24:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.072 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-16T14:24:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-16T14:24:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-16T14:24:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-16T14:24:27.073 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-16T14:24:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-16T14:24:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.074 INFO:teuthology.orchestra.run.smithi059.stdout: libtool-2.4.6-45.el9.x86_64 2023-10-16T14:24:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-16T14:24:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-10-16T14:24:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-10-16T14:24:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-16T14:24:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-16T14:24:27.075 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-16T14:24:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-16T14:24:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-10-16T14:24:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-16T14:24:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-13.11-1.el9.x86_64 2023-10-16T14:24:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-10-16T14:24:27.076 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-10-16T14:24:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-server-13.11-1.el9.x86_64 2023-10-16T14:24:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-16T14:24:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-16T14:24:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-16T14:24:27.077 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-16T14:24:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-16T14:24:27.078 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-16T14:24:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-16T14:24:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-16T14:24:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-16T14:24:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-16T14:24:27.079 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth-1:2.23.2-1.el9.noarch 2023-10-16T14:24:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-16T14:24:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-16T14:24:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-16T14:24:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-16T14:24:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-16T14:24:27.080 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-16T14:24:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-16T14:24:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-16T14:24:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-16T14:24:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-16T14:24:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-16T14:24:27.081 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-16T14:24:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-16T14:24:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-16T14:24:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-16T14:24:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-16T14:24:27.082 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-16T14:24:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-16T14:24:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-16T14:24:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-16T14:24:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ply-3.11-14.el9.noarch 2023-10-16T14:24:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-16T14:24:27.083 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-16T14:24:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-16T14:24:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-16T14:24:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-16T14:24:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-16T14:24:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-16T14:24:27.084 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-16T14:24:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-16T14:24:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-16T14:24:27.085 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-16T14:24:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-16T14:24:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-16T14:24:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-16T14:24:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-16T14:24:27.086 INFO:teuthology.orchestra.run.smithi059.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-16T14:24:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-10-16T14:24:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-16T14:24:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-16T14:24:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-16T14:24:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-16T14:24:27.087 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.088 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.088 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-16T14:24:27.088 INFO:teuthology.orchestra.run.smithi059.stdout: re2-1:20211101-3.el9.x86_64 2023-10-16T14:24:27.088 INFO:teuthology.orchestra.run.smithi059.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-16T14:24:27.088 INFO:teuthology.orchestra.run.smithi059.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-16T14:24:27.088 INFO:teuthology.orchestra.run.smithi059.stdout: uuid-1.6.2-55.el9.x86_64 2023-10-16T14:24:27.089 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-10-16T14:24:27.089 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-16T14:24:27.089 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-10-16T14:24:27.089 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:27.090 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2023-10-16T14:24:27.750 DEBUG:teuthology.parallel:result is None 2023-10-16T14:24:27.751 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T14:24:27.992 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-16T14:24:28.054 INFO:teuthology.orchestra.run.smithi059.stdout:18.0.0-6730.g4ba8a190.el9 2023-10-16T14:24:28.055 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el9 2023-10-16T14:24:28.055 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-16T14:24:28.056 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-16T14:24:28.277 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-16T14:24:28.353 INFO:teuthology.orchestra.run.smithi151.stdout:18.0.0-6730.g4ba8a190.el9 2023-10-16T14:24:28.354 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el9 2023-10-16T14:24:28.354 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-16T14:24:28.355 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-16T14:24:28.355 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:24:28.356 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T14:24:28.442 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:24:28.443 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-16T14:24:28.551 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-16T14:24:28.551 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:24:28.552 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T14:24:28.632 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T14:24:28.747 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:24:28.747 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2023-10-16T14:24:28.849 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-16T14:24:28.946 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-16T14:24:28.946 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:24:28.947 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T14:24:29.027 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T14:24:29.172 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:24:29.172 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-16T14:24:29.276 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-16T14:24:29.404 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-16T14:24:29.405 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:24:29.405 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T14:24:29.497 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T14:24:29.616 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:24:29.617 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2023-10-16T14:24:29.709 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-16T14:24:29.789 INFO:teuthology.run_tasks:Running task ceph... 2023-10-16T14:24:29.855 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-16T14:24:29.856 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /var/log/ceph 2023-10-16T14:24:29.862 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2023-10-16T14:24:29.947 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-16T14:24:29.947 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T14:24:29.952 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-16T14:24:30.037 INFO:tasks.ceph:Creating extra log directories... 2023-10-16T14:24:30.038 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T14:24:30.043 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-16T14:24:30.129 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-16T14:24:30.130 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-16T14:24:30.130 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-16T14:24:30.131 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:24:30.131 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T14:24:30.173 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T14:24:30.391 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-16T14:24:30.471 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:24:30.472 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-16T14:24:30.524 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-16T14:24:30.785 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-16T14:24:30.881 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-16T14:24:30.882 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-16T14:24:30.882 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429048', 'branch': 'rishabh-2023oct13', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7429048', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-2023oct13'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2023oct13-b2', 'sha1': '33be745ec4531df08cd1bb70b4c9c1f89be58078'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6006, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'sleep_before_teardown': 0, 'subset': '402/512', 'suite': 'fs', 'suite_branch': 'rishabh-2023oct13-b2', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '33be745ec4531df08cd1bb70b4c9c1f89be58078', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi059.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLFbm9GBm0PuOVOy7gqpNI4KVYVxUv4j23Db55DLRWpftPvEn6sIuxTsSyj7oDjY/SWP93oKV2mme1EVRwNtdrM=', 'smithi151.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMHTziqB5teh/lBoPv1jHxEa7Ze7bDZZsPZSvuFJeywXK46LMBc8xATc6PAW4Srivx2tZtkFYf9CfflFypvKsME='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-16_12:17:50', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-16T14:24:30.883 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T14:24:30.889 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-16T14:24:30.940 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T14:24:30.975 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2023-10-16T14:24:31.069 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:24:31.069 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T14:24:31.111 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T14:24:31.111 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 2023-10-16T14:24:31.194 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T14:24:31.195 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T14:24:31.195 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 632 Links: 1 2023-10-16T14:24:31.195 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T14:24:31.195 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T14:24:31.196 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-10-16 14:24:20.545913524 +0000 2023-10-16T14:24:31.196 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-10-16 14:21:47.747146627 +0000 2023-10-16T14:24:31.196 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-10-16 14:21:47.747146627 +0000 2023-10-16T14:24:31.196 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2023-10-16 14:21:47.747146627 +0000 2023-10-16T14:24:31.197 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T14:24:31.339 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-10-16T14:24:31.340 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-10-16T14:24:31.340 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000406718 s, 1.3 MB/s 2023-10-16T14:24:31.344 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T14:24:31.398 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 2023-10-16T14:24:31.447 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T14:24:31.447 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T14:24:31.448 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 650 Links: 1 2023-10-16T14:24:31.448 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T14:24:31.448 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T14:24:31.448 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-10-16 14:24:20.546913512 +0000 2023-10-16T14:24:31.448 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-10-16 14:21:48.803134013 +0000 2023-10-16T14:24:31.448 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-10-16 14:21:48.803134013 +0000 2023-10-16T14:24:31.449 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2023-10-16 14:21:48.803134013 +0000 2023-10-16T14:24:31.449 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T14:24:31.529 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-10-16T14:24:31.529 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-10-16T14:24:31.529 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000306434 s, 1.7 MB/s 2023-10-16T14:24:31.534 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T14:24:31.579 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 2023-10-16T14:24:31.666 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T14:24:31.667 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T14:24:31.667 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 671 Links: 1 2023-10-16T14:24:31.667 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T14:24:31.667 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T14:24:31.668 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-10-16 14:24:20.547913500 +0000 2023-10-16T14:24:31.668 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-10-16 14:21:49.880121147 +0000 2023-10-16T14:24:31.668 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-10-16 14:21:49.880121147 +0000 2023-10-16T14:24:31.668 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2023-10-16 14:21:49.880121147 +0000 2023-10-16T14:24:31.669 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T14:24:31.781 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-10-16T14:24:31.781 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-10-16T14:24:31.782 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000291769 s, 1.8 MB/s 2023-10-16T14:24:31.784 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T14:24:31.831 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 2023-10-16T14:24:31.873 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T14:24:31.873 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T14:24:31.873 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 690 Links: 1 2023-10-16T14:24:31.874 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T14:24:31.874 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T14:24:31.874 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-10-16 14:24:20.547913500 +0000 2023-10-16T14:24:31.874 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-10-16 14:21:50.968108151 +0000 2023-10-16T14:24:31.874 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-10-16 14:21:50.968108151 +0000 2023-10-16T14:24:31.875 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2023-10-16 14:21:50.968108151 +0000 2023-10-16T14:24:31.875 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T14:24:31.998 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-10-16T14:24:31.998 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-10-16T14:24:31.998 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000314458 s, 1.6 MB/s 2023-10-16T14:24:32.001 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T14:24:32.047 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T14:24:32.048 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:24:32.048 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2023-10-16T14:24:32.109 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-16T14:24:32.109 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2023-10-16T14:24:32.163 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-16T14:24:32.164 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T14:24:32.164 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 639 Links: 1 2023-10-16T14:24:32.164 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T14:24:32.164 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T14:24:32.164 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-10-16 14:24:15.503954651 +0000 2023-10-16T14:24:32.164 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-10-16 14:21:27.490209622 +0000 2023-10-16T14:24:32.165 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-10-16 14:21:27.490209622 +0000 2023-10-16T14:24:32.165 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-10-16 14:21:27.490209622 +0000 2023-10-16T14:24:32.165 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-16T14:24:32.250 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-10-16T14:24:32.250 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-10-16T14:24:32.250 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000334209 s, 1.5 MB/s 2023-10-16T14:24:32.253 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-16T14:24:32.308 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2023-10-16T14:24:32.357 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-16T14:24:32.357 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T14:24:32.357 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 658 Links: 1 2023-10-16T14:24:32.357 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T14:24:32.358 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T14:24:32.358 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-10-16 14:24:15.504954639 +0000 2023-10-16T14:24:32.358 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-10-16 14:21:28.549197151 +0000 2023-10-16T14:24:32.358 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-10-16 14:21:28.549197151 +0000 2023-10-16T14:24:32.358 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-10-16 14:21:28.549197151 +0000 2023-10-16T14:24:32.359 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-16T14:24:32.455 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-10-16T14:24:32.455 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-10-16T14:24:32.455 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000397498 s, 1.3 MB/s 2023-10-16T14:24:32.459 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-16T14:24:32.519 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2023-10-16T14:24:32.571 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-16T14:24:32.571 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T14:24:32.571 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 678 Links: 1 2023-10-16T14:24:32.571 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T14:24:32.572 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T14:24:32.572 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-10-16 14:24:15.505954627 +0000 2023-10-16T14:24:32.572 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-10-16 14:21:29.593184856 +0000 2023-10-16T14:24:32.572 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-10-16 14:21:29.593184856 +0000 2023-10-16T14:24:32.572 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-10-16 14:21:29.593184856 +0000 2023-10-16T14:24:32.573 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-16T14:24:32.658 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-10-16T14:24:32.658 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-10-16T14:24:32.659 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000373396 s, 1.4 MB/s 2023-10-16T14:24:32.662 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-16T14:24:32.720 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2023-10-16T14:24:32.772 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-16T14:24:32.772 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-16T14:24:32.773 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 697 Links: 1 2023-10-16T14:24:32.773 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-16T14:24:32.773 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-10-16T14:24:32.773 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-10-16 14:24:15.505954627 +0000 2023-10-16T14:24:32.773 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-10-16 14:21:30.617172797 +0000 2023-10-16T14:24:32.774 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-10-16 14:21:30.617172797 +0000 2023-10-16T14:24:32.774 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-10-16 14:21:30.617172797 +0000 2023-10-16T14:24:32.774 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-16T14:24:32.863 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-10-16T14:24:32.863 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-10-16T14:24:32.863 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.0003341 s, 1.5 MB/s 2023-10-16T14:24:32.867 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-16T14:24:32.926 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T14:24:32.927 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-16T14:24:32.927 INFO:tasks.ceph:Generating config... 2023-10-16T14:24:32.928 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-16T14:24:32.929 INFO:tasks.ceph:[client] debug client = 20 2023-10-16T14:24:32.929 INFO:tasks.ceph:[client] debug ms = 1 2023-10-16T14:24:32.929 INFO:tasks.ceph:[client] pid file = 2023-10-16T14:24:32.929 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-16T14:24:32.930 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-16T14:24:32.930 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-16T14:24:32.930 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-16T14:24:32.930 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-16T14:24:32.931 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-16T14:24:32.931 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-16T14:24:32.931 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-16T14:24:32.932 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-16T14:24:32.932 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-16T14:24:32.932 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-16T14:24:32.932 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-16T14:24:32.933 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-16T14:24:32.933 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-16T14:24:32.933 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-16T14:24:32.933 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-16T14:24:32.933 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-16T14:24:32.934 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-16T14:24:32.934 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-16T14:24:32.934 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-16T14:24:32.935 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-16T14:24:32.935 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-16T14:24:32.935 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-16T14:24:32.935 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-16T14:24:32.935 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-16T14:24:32.936 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-16T14:24:32.936 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-16T14:24:32.936 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-16T14:24:32.936 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-16T14:24:32.937 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-16T14:24:32.937 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-16T14:24:32.937 INFO:tasks.ceph:Setting up mon.a... 2023-10-16T14:24:32.938 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-16T14:24:33.061 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.keyring 2023-10-16T14:24:33.069 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-16T14:24:33.201 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T14:24:33.306 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.59'), ('mon.b', '172.21.15.151'), ('mon.c', '[v2:172.21.15.151:3301,v1:172.21.15.151:6790]')] 2023-10-16T14:24:33.307 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.59,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-16T14:24:33.308 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:24:33.308 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-16T14:24:33.369 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.59 --add b 172.21.15.151 --addv c '[v2:172.21.15.151:3301,v1:172.21.15.151:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-16T14:24:33.530 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-16T14:24:33.531 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: generated fsid c3201022-15a8-4479-95cd-5e66eaaa456b 2023-10-16T14:24:33.531 INFO:teuthology.orchestra.run.smithi059.stdout:setting min_mon_release = pacific 2023-10-16T14:24:33.531 INFO:teuthology.orchestra.run.smithi059.stdout:epoch 0 2023-10-16T14:24:33.531 INFO:teuthology.orchestra.run.smithi059.stdout:fsid c3201022-15a8-4479-95cd-5e66eaaa456b 2023-10-16T14:24:33.532 INFO:teuthology.orchestra.run.smithi059.stdout:last_changed 2023-10-16T14:24:33.528625+0000 2023-10-16T14:24:33.532 INFO:teuthology.orchestra.run.smithi059.stdout:created 2023-10-16T14:24:33.528625+0000 2023-10-16T14:24:33.532 INFO:teuthology.orchestra.run.smithi059.stdout:min_mon_release 16 (pacific) 2023-10-16T14:24:33.532 INFO:teuthology.orchestra.run.smithi059.stdout:election_strategy: 1 2023-10-16T14:24:33.532 INFO:teuthology.orchestra.run.smithi059.stdout:0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2023-10-16T14:24:33.533 INFO:teuthology.orchestra.run.smithi059.stdout:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2023-10-16T14:24:33.533 INFO:teuthology.orchestra.run.smithi059.stdout:2: [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] mon.c 2023-10-16T14:24:33.533 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-16T14:24:33.534 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-16T14:24:33.589 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c3201022-15a8-4479-95cd-5e66eaaa456b... 2023-10-16T14:24:33.590 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T14:24:33.596 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-16T14:24:33.770 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2023-10-16T14:24:33.770 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2023-10-16T14:24:33.771 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T14:24:33.771 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2023-10-16T14:24:33.771 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.771 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2023-10-16T14:24:33.771 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.772 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2023-10-16T14:24:33.772 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.772 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2023-10-16T14:24:33.772 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2023-10-16T14:24:33.772 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.773 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2023-10-16T14:24:33.773 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2023-10-16T14:24:33.773 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.773 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T14:24:33.773 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2023-10-16T14:24:33.774 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.774 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T14:24:33.774 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T14:24:33.774 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.774 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2023-10-16T14:24:33.775 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.775 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2023-10-16T14:24:33.775 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2023-10-16T14:24:33.775 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2023-10-16T14:24:33.775 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2023-10-16T14:24:33.776 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2023-10-16T14:24:33.776 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2023-10-16T14:24:33.776 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2023-10-16T14:24:33.776 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T14:24:33.776 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T14:24:33.776 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2023-10-16T14:24:33.777 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.777 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T14:24:33.777 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.777 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2023-10-16T14:24:33.777 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.778 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2023-10-16T14:24:33.778 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.778 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2023-10-16T14:24:33.778 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2023-10-16T14:24:33.778 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2023-10-16T14:24:33.779 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = "172.21.15.59,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2023-10-16T14:24:33.779 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = c3201022-15a8-4479-95cd-5e66eaaa456b 2023-10-16T14:24:33.779 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.779 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2023-10-16T14:24:33.779 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2023-10-16T14:24:33.780 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.780 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2023-10-16T14:24:33.780 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2023-10-16T14:24:33.780 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2023-10-16T14:24:33.780 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.780 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2023-10-16T14:24:33.781 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2023-10-16T14:24:33.781 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.781 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2023-10-16T14:24:33.781 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2023-10-16T14:24:33.781 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2023-10-16T14:24:33.782 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.782 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2023-10-16T14:24:33.782 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2023-10-16T14:24:33.782 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.782 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2023-10-16T14:24:33.783 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.783 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2023-10-16T14:24:33.783 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.783 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2023-10-16T14:24:33.783 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.784 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2023-10-16T14:24:33.784 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2023-10-16T14:24:33.784 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.784 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2023-10-16T14:24:33.784 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2023-10-16T14:24:33.784 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2023-10-16T14:24:33.785 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2023-10-16T14:24:33.785 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 20 2023-10-16T14:24:33.785 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 20 2023-10-16T14:24:33.785 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-16T14:24:33.785 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2023-10-16T14:24:33.786 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 10 2023-10-16T14:24:33.786 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T14:24:33.786 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2023-10-16T14:24:33.786 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2023-10-16T14:24:33.786 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2023-10-16T14:24:33.787 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2023-10-16T14:24:33.787 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-10-16T14:24:33.787 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.787 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2023-10-16T14:24:33.787 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-16T14:24:33.787 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2023-10-16T14:24:33.788 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-10-16T14:24:33.788 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-10-16T14:24:33.788 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-10-16T14:24:33.788 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-10-16T14:24:33.788 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2023-10-16T14:24:33.789 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.789 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2023-10-16T14:24:33.789 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-16T14:24:33.789 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-10-16T14:24:33.789 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2023-10-16T14:24:33.790 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-10-16T14:24:33.790 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2023-10-16T14:24:33.790 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2023-10-16T14:24:33.790 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-10-16T14:24:33.790 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2023-10-16T14:24:33.790 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2023-10-16T14:24:33.791 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-10-16T14:24:33.791 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.791 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T14:24:33.791 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T14:24:33.791 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T14:24:33.792 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.792 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T14:24:33.792 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T14:24:33.792 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T14:24:33.792 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.793 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2023-10-16T14:24:33.793 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2023-10-16T14:24:33.793 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.793 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2023-10-16T14:24:33.793 INFO:teuthology.orchestra.run.smithi151.stdout: mon op complaint time = 120 2023-10-16T14:24:33.793 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-16T14:24:33.794 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2023-10-16T14:24:33.794 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2023-10-16T14:24:33.794 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2023-10-16T14:24:33.794 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2023-10-16T14:24:33.794 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T14:24:33.795 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T14:24:33.795 INFO:teuthology.orchestra.run.smithi151.stdout: client mount timeout = 600 2023-10-16T14:24:33.795 INFO:teuthology.orchestra.run.smithi151.stdout: debug client = 20 2023-10-16T14:24:33.795 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-16T14:24:33.795 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = "" 2023-10-16T14:24:33.796 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-10-16T14:24:33.796 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-10-16T14:24:33.796 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2023-10-16T14:24:33.796 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.b] 2023-10-16T14:24:33.796 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.c] 2023-10-16T14:24:33.796 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2023-10-16T14:24:33.797 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2023-10-16T14:24:33.797 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2023-10-16T14:24:33.797 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2023-10-16T14:24:33.797 INFO:teuthology.orchestra.run.smithi151.stdout:[mds] 2023-10-16T14:24:33.797 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds = 20 2023-10-16T14:24:33.797 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds balancer = 20 2023-10-16T14:24:33.798 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-16T14:24:33.798 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug frag = True 2023-10-16T14:24:33.798 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug scatterstat = True 2023-10-16T14:24:33.798 INFO:teuthology.orchestra.run.smithi151.stdout: mds op complaint time = 180 2023-10-16T14:24:33.798 INFO:teuthology.orchestra.run.smithi151.stdout: mds verify scatter = True 2023-10-16T14:24:33.799 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-10-16T14:24:33.799 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-10-16T14:24:33.799 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-10-16T14:24:33.800 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2023-10-16T14:24:33.800 INFO:teuthology.orchestra.run.smithi059.stdout: chdir = "" 2023-10-16T14:24:33.800 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-16T14:24:33.800 INFO:teuthology.orchestra.run.smithi059.stdout: auth supported = cephx 2023-10-16T14:24:33.800 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.801 INFO:teuthology.orchestra.run.smithi059.stdout: filestore xattr use omap = true 2023-10-16T14:24:33.801 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.801 INFO:teuthology.orchestra.run.smithi059.stdout: mon clock drift allowed = 1.000 2023-10-16T14:24:33.801 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.801 INFO:teuthology.orchestra.run.smithi059.stdout: osd crush chooseleaf type = 0 2023-10-16T14:24:33.802 INFO:teuthology.orchestra.run.smithi059.stdout: auth debug = true 2023-10-16T14:24:33.802 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.802 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on old message = true 2023-10-16T14:24:33.802 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on bug = true 2023-10-16T14:24:33.802 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.803 INFO:teuthology.orchestra.run.smithi059.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-16T14:24:33.803 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn max object skew = 0 2023-10-16T14:24:33.803 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.803 INFO:teuthology.orchestra.run.smithi059.stdout: # disable pg_autoscaler by default for new pools 2023-10-16T14:24:33.803 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-16T14:24:33.803 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.804 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default size = 2 2023-10-16T14:24:33.804 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.804 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow primary affinity = true 2023-10-16T14:24:33.804 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow pg remap = true 2023-10-16T14:24:33.804 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on legacy crush tunables = false 2023-10-16T14:24:33.805 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on crush straw calc version zero = false 2023-10-16T14:24:33.805 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on no sortbitwise = false 2023-10-16T14:24:33.805 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = false 2023-10-16T14:24:33.805 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on too few osds = false 2023-10-16T14:24:33.805 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-16T14:24:33.805 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-16T14:24:33.806 INFO:teuthology.orchestra.run.smithi059.stdout: mon_allow_pool_size_one = true 2023-10-16T14:24:33.806 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.806 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-16T14:24:33.806 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.806 INFO:teuthology.orchestra.run.smithi059.stdout: osd default data pool replay window = 5 2023-10-16T14:24:33.807 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.807 INFO:teuthology.orchestra.run.smithi059.stdout: mon allow pool delete = true 2023-10-16T14:24:33.807 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.807 INFO:teuthology.orchestra.run.smithi059.stdout: mon cluster log file level = debug 2023-10-16T14:24:33.807 INFO:teuthology.orchestra.run.smithi059.stdout: debug asserts on shutdown = true 2023-10-16T14:24:33.808 INFO:teuthology.orchestra.run.smithi059.stdout: mon health detail to clog = false 2023-10-16T14:24:33.808 INFO:teuthology.orchestra.run.smithi059.stdout: mon host = "172.21.15.59,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2023-10-16T14:24:33.808 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = c3201022-15a8-4479-95cd-5e66eaaa456b 2023-10-16T14:24:33.808 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.808 INFO:teuthology.orchestra.run.smithi059.stdout:[osd] 2023-10-16T14:24:33.808 INFO:teuthology.orchestra.run.smithi059.stdout: osd journal size = 100 2023-10-16T14:24:33.809 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.809 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub load threshold = 5.0 2023-10-16T14:24:33.809 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub max interval = 600 2023-10-16T14:24:33.809 INFO:teuthology.orchestra.run.smithi059.stdout: osd mclock profile = high_recovery_ops 2023-10-16T14:24:33.809 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.810 INFO:teuthology.orchestra.run.smithi059.stdout: osd recover clone overlap = true 2023-10-16T14:24:33.810 INFO:teuthology.orchestra.run.smithi059.stdout: osd recovery max chunk = 1048576 2023-10-16T14:24:33.810 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.810 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug shutdown = true 2023-10-16T14:24:33.810 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug op order = true 2023-10-16T14:24:33.811 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify stray on activate = true 2023-10-16T14:24:33.811 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.811 INFO:teuthology.orchestra.run.smithi059.stdout: osd open classes on start = true 2023-10-16T14:24:33.811 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug pg log writeout = true 2023-10-16T14:24:33.811 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.811 INFO:teuthology.orchestra.run.smithi059.stdout: osd deep scrub update digest min age = 30 2023-10-16T14:24:33.812 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.812 INFO:teuthology.orchestra.run.smithi059.stdout: osd map max advance = 10 2023-10-16T14:24:33.812 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.812 INFO:teuthology.orchestra.run.smithi059.stdout: journal zero on create = true 2023-10-16T14:24:33.812 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.813 INFO:teuthology.orchestra.run.smithi059.stdout: filestore ondisk finisher threads = 3 2023-10-16T14:24:33.813 INFO:teuthology.orchestra.run.smithi059.stdout: filestore apply finisher threads = 3 2023-10-16T14:24:33.813 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.813 INFO:teuthology.orchestra.run.smithi059.stdout: bdev debug aio = true 2023-10-16T14:24:33.813 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug misdirected ops = true 2023-10-16T14:24:33.813 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore block size = 96636764160 2023-10-16T14:24:33.814 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore fsck on mount = True 2023-10-16T14:24:33.814 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluefs = 20 2023-10-16T14:24:33.814 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluestore = 20 2023-10-16T14:24:33.814 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-10-16T14:24:33.814 INFO:teuthology.orchestra.run.smithi059.stdout: debug osd = 20 2023-10-16T14:24:33.815 INFO:teuthology.orchestra.run.smithi059.stdout: debug rocksdb = 10 2023-10-16T14:24:33.815 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd backfillfull_ratio = 0.85 2023-10-16T14:24:33.815 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd full ratio = 0.9 2023-10-16T14:24:33.815 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd nearfull ratio = 0.8 2023-10-16T14:24:33.815 INFO:teuthology.orchestra.run.smithi059.stdout: osd failsafe full ratio = 0.95 2023-10-16T14:24:33.816 INFO:teuthology.orchestra.run.smithi059.stdout: osd objectstore = bluestore 2023-10-16T14:24:33.816 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2023-10-16T14:24:33.816 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.816 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr] 2023-10-16T14:24:33.816 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-10-16T14:24:33.816 INFO:teuthology.orchestra.run.smithi059.stdout: debug mgr = 20 2023-10-16T14:24:33.817 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2023-10-16T14:24:33.817 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2023-10-16T14:24:33.817 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2023-10-16T14:24:33.817 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2023-10-16T14:24:33.817 INFO:teuthology.orchestra.run.smithi059.stdout: mgr/telemetry/nag = false 2023-10-16T14:24:33.818 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.818 INFO:teuthology.orchestra.run.smithi059.stdout:[mon] 2023-10-16T14:24:33.818 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-10-16T14:24:33.818 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2023-10-16T14:24:33.818 INFO:teuthology.orchestra.run.smithi059.stdout: debug paxos = 20 2023-10-16T14:24:33.819 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2023-10-16T14:24:33.819 INFO:teuthology.orchestra.run.smithi059.stdout: mon data avail warn = 5 2023-10-16T14:24:33.819 INFO:teuthology.orchestra.run.smithi059.stdout: mon mgr mkfs grace = 240 2023-10-16T14:24:33.819 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2023-10-16T14:24:33.819 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd reporter subtree level = osd 2023-10-16T14:24:33.820 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd prime pg temp = true 2023-10-16T14:24:33.820 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2023-10-16T14:24:33.820 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.820 INFO:teuthology.orchestra.run.smithi059.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-16T14:24:33.820 INFO:teuthology.orchestra.run.smithi059.stdout: auth mon ticket ttl = 660 # 11m 2023-10-16T14:24:33.820 INFO:teuthology.orchestra.run.smithi059.stdout: auth service ticket ttl = 240 # 4m 2023-10-16T14:24:33.821 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.821 INFO:teuthology.orchestra.run.smithi059.stdout: # don't complain about insecure global_id in the test suite 2023-10-16T14:24:33.821 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-16T14:24:33.821 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-16T14:24:33.821 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.822 INFO:teuthology.orchestra.run.smithi059.stdout: # 1m isn't quite enough 2023-10-16T14:24:33.822 INFO:teuthology.orchestra.run.smithi059.stdout: mon_down_mkfs_grace = 2m 2023-10-16T14:24:33.822 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.822 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_filestore_osds = false 2023-10-16T14:24:33.822 INFO:teuthology.orchestra.run.smithi059.stdout: mon op complaint time = 120 2023-10-16T14:24:33.823 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:24:33.823 INFO:teuthology.orchestra.run.smithi059.stdout:[client] 2023-10-16T14:24:33.823 INFO:teuthology.orchestra.run.smithi059.stdout: rgw cache enabled = true 2023-10-16T14:24:33.823 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable ops log = true 2023-10-16T14:24:33.823 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable usage log = true 2023-10-16T14:24:33.824 INFO:teuthology.orchestra.run.smithi059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-16T14:24:33.824 INFO:teuthology.orchestra.run.smithi059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-16T14:24:33.824 INFO:teuthology.orchestra.run.smithi059.stdout: client mount timeout = 600 2023-10-16T14:24:33.824 INFO:teuthology.orchestra.run.smithi059.stdout: debug client = 20 2023-10-16T14:24:33.824 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-10-16T14:24:33.824 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = "" 2023-10-16T14:24:33.825 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2023-10-16T14:24:33.825 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2023-10-16T14:24:33.825 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.a] 2023-10-16T14:24:33.825 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.b] 2023-10-16T14:24:33.825 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.c] 2023-10-16T14:24:33.825 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2023-10-16T14:24:33.826 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c] 2023-10-16T14:24:33.826 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2023-10-16T14:24:33.826 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.d] 2023-10-16T14:24:33.826 INFO:teuthology.orchestra.run.smithi059.stdout:[mds] 2023-10-16T14:24:33.826 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds = 20 2023-10-16T14:24:33.827 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds balancer = 20 2023-10-16T14:24:33.827 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-10-16T14:24:33.827 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug frag = True 2023-10-16T14:24:33.827 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug scatterstat = True 2023-10-16T14:24:33.827 INFO:teuthology.orchestra.run.smithi059.stdout: mds op complaint time = 180 2023-10-16T14:24:33.827 INFO:teuthology.orchestra.run.smithi059.stdout: mds verify scatter = True 2023-10-16T14:24:33.828 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2023-10-16T14:24:33.828 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2023-10-16T14:24:33.828 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2023-10-16T14:24:33.829 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-16T14:24:33.830 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-16T14:24:33.986 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-16T14:24:33.987 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:24:33.987 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-16T14:24:34.043 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:24:34.043 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-16T14:24:34.099 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi059.front.sepia.ceph.com 2023-10-16T14:24:34.099 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:24:34.099 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T14:24:34.100 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T14:24:34.265 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:24:34.266 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T14:24:34.369 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2023-10-16T14:24:34.369 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:24:34.370 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-16T14:24:34.370 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-16T14:24:34.526 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:24:34.526 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-16T14:24:34.625 INFO:tasks.ceph:Setting up mon nodes... 2023-10-16T14:24:34.625 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-16T14:24:34.626 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-16T14:24:34.838 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-16T14:24:34.849 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-16T14:24:35.047 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-16T14:24:35.059 INFO:tasks.ceph:Setting up mds nodes... 2023-10-16T14:24:35.059 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-16T14:24:35.271 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-16T14:24:35.281 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-16T14:24:35.389 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-16T14:24:35.597 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-16T14:24:35.607 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-16T14:24:35.706 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-16T14:24:35.898 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-16T14:24:35.908 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-16T14:24:36.003 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-16T14:24:36.186 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-16T14:24:36.195 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-16T14:24:36.289 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-16T14:24:36.290 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-16T14:24:36.434 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-16T14:24:36.510 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-16T14:24:36.651 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-16T14:24:36.706 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-16T14:24:36.841 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-16T14:24:36.891 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-16T14:24:37.018 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-16T14:24:37.070 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-16T14:24:37.070 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-16T14:24:37.070 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-16T14:24:37.179 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T14:24:37.179 INFO:tasks.ceph:role: osd.0 2023-10-16T14:24:37.179 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-16T14:24:37.180 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-16T14:24:37.289 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T14:24:37.289 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T14:24:37.289 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T14:24:37.289 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T14:24:37.290 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T14:24:37.290 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2023-10-16T14:24:37.290 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T14:24:37.290 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T14:24:37.290 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T14:24:37.291 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T14:24:37.803 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2023-10-16T14:24:37.811 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2023-10-16T14:24:37.811 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-16T14:24:38.008 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-16T14:24:38.123 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-16T14:24:38.226 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T14:24:38.226 INFO:tasks.ceph:role: osd.1 2023-10-16T14:24:38.227 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-16T14:24:38.227 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-16T14:24:38.334 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T14:24:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T14:24:38.334 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T14:24:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T14:24:38.335 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T14:24:38.335 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2023-10-16T14:24:38.335 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T14:24:38.336 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T14:24:38.336 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T14:24:38.336 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T14:24:38.841 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2023-10-16T14:24:38.849 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2023-10-16T14:24:38.849 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-16T14:24:39.009 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-16T14:24:39.108 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-16T14:24:39.205 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T14:24:39.205 INFO:tasks.ceph:role: osd.2 2023-10-16T14:24:39.206 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-16T14:24:39.206 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-16T14:24:39.310 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T14:24:39.310 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T14:24:39.310 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T14:24:39.310 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T14:24:39.311 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T14:24:39.311 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2023-10-16T14:24:39.311 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T14:24:39.311 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T14:24:39.311 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T14:24:39.312 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T14:24:39.826 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2023-10-16T14:24:39.832 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2023-10-16T14:24:39.833 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-16T14:24:40.037 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-16T14:24:40.155 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-16T14:24:40.258 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-16T14:24:40.259 INFO:tasks.ceph:role: osd.3 2023-10-16T14:24:40.259 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-16T14:24:40.259 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-16T14:24:40.366 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T14:24:40.366 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T14:24:40.366 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T14:24:40.366 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T14:24:40.366 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T14:24:40.367 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2023-10-16T14:24:40.367 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T14:24:40.367 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T14:24:40.367 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T14:24:40.367 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T14:24:40.857 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2023-10-16T14:24:40.865 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2023-10-16T14:24:40.866 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-16T14:24:41.011 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-16T14:24:41.113 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T14:24:41.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:41.296+0000 7f04c2425500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-16T14:24:41.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:41.301+0000 7f04c2425500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-16T14:24:41.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:41.301+0000 7f04c2425500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T14:24:41.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:41.301+0000 7f04c2425500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T14:24:41.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:41.301+0000 7f04c2425500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-16T14:24:41.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:41.310+0000 7f04c2425500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-16T14:24:44.491 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-16T14:24:44.598 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T14:24:44.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:44.744+0000 7fa2946a7500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-16T14:24:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:44.745+0000 7fa2946a7500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-16T14:24:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:44.745+0000 7fa2946a7500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T14:24:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:44.745+0000 7fa2946a7500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T14:24:44.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:44.745+0000 7fa2946a7500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-16T14:24:44.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:44.747+0000 7fa2946a7500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-16T14:24:47.917 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-16T14:24:48.030 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T14:24:48.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:48.198+0000 7f0744b22500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-16T14:24:48.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:48.199+0000 7f0744b22500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-16T14:24:48.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:48.199+0000 7f0744b22500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T14:24:48.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:48.199+0000 7f0744b22500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T14:24:48.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:48.199+0000 7f0744b22500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-16T14:24:48.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:48.201+0000 7f0744b22500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-16T14:24:51.397 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-16T14:24:51.501 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T14:24:51.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:51.650+0000 7ff269616500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-16T14:24:51.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:51.652+0000 7ff269616500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-16T14:24:51.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:51.652+0000 7ff269616500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T14:24:51.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:51.652+0000 7ff269616500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T14:24:51.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:51.652+0000 7ff269616500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-16T14:24:51.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:24:51.654+0000 7ff269616500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-16T14:24:54.841 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-16T14:24:54.945 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-16T14:24:55.048 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T14:24:55.048 INFO:tasks.ceph:role: osd.4 2023-10-16T14:24:55.049 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-16T14:24:55.049 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-16T14:24:55.147 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T14:24:55.147 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T14:24:55.147 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T14:24:55.147 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T14:24:55.148 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T14:24:55.148 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-10-16T14:24:55.148 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T14:24:55.148 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T14:24:55.149 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T14:24:55.149 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T14:24:55.672 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-10-16T14:24:55.679 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-10-16T14:24:55.680 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-16T14:24:55.882 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-16T14:24:55.998 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-16T14:24:56.084 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T14:24:56.085 INFO:tasks.ceph:role: osd.5 2023-10-16T14:24:56.085 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-16T14:24:56.085 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-16T14:24:56.176 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T14:24:56.177 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T14:24:56.177 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T14:24:56.177 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T14:24:56.177 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T14:24:56.177 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-10-16T14:24:56.178 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T14:24:56.178 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T14:24:56.178 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T14:24:56.178 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T14:24:56.660 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-10-16T14:24:56.666 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-10-16T14:24:56.666 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-16T14:24:56.813 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-16T14:24:56.896 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-16T14:24:56.972 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T14:24:56.972 INFO:tasks.ceph:role: osd.6 2023-10-16T14:24:56.972 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-16T14:24:56.973 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-16T14:24:57.059 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T14:24:57.060 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T14:24:57.060 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T14:24:57.060 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T14:24:57.060 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T14:24:57.061 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-10-16T14:24:57.061 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T14:24:57.061 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T14:24:57.061 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T14:24:57.061 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T14:24:57.576 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-10-16T14:24:57.581 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-10-16T14:24:57.582 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-16T14:24:57.772 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-16T14:24:57.883 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-16T14:24:57.980 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-16T14:24:57.981 INFO:tasks.ceph:role: osd.7 2023-10-16T14:24:57.981 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-16T14:24:57.981 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-16T14:24:58.076 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-16T14:24:58.077 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-16T14:24:58.077 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-16T14:24:58.077 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-16T14:24:58.077 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-16T14:24:58.077 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-10-16T14:24:58.077 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-16T14:24:58.078 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-16T14:24:58.078 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-16T14:24:58.078 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-16T14:24:58.536 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-10-16T14:24:58.542 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-10-16T14:24:58.542 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-16T14:24:58.696 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-16T14:24:58.792 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T14:24:58.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:24:58.945+0000 7f310fa14500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-16T14:24:58.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:24:58.946+0000 7f310fa14500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-16T14:24:58.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:24:58.946+0000 7f310fa14500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T14:24:58.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:24:58.946+0000 7f310fa14500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T14:24:58.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:24:58.946+0000 7f310fa14500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-16T14:24:58.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:24:58.953+0000 7f310fa14500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-16T14:25:00.885 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:25:00.894 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:25:01.891 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-16T14:25:01.988 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T14:25:02.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:02.124+0000 7f8cbd1ad500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-16T14:25:02.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:02.125+0000 7f8cbd1ad500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-16T14:25:02.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:02.125+0000 7f8cbd1ad500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T14:25:02.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:02.125+0000 7f8cbd1ad500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T14:25:02.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:02.125+0000 7f8cbd1ad500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-16T14:25:02.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:02.127+0000 7f8cbd1ad500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-16T14:25:05.062 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-16T14:25:05.162 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T14:25:05.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:05.301+0000 7f1fededa500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-16T14:25:05.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:05.302+0000 7f1fededa500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-16T14:25:05.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:05.302+0000 7f1fededa500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T14:25:05.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:05.302+0000 7f1fededa500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T14:25:05.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:05.302+0000 7f1fededa500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-16T14:25:05.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:05.304+0000 7f1fededa500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-16T14:25:08.472 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-16T14:25:08.569 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-16T14:25:08.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:08.709+0000 7fde39d29500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-16T14:25:08.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:08.709+0000 7fde39d29500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-16T14:25:08.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:08.709+0000 7fde39d29500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T14:25:08.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:08.709+0000 7fde39d29500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T14:25:08.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:08.709+0000 7fde39d29500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-16T14:25:08.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:08.711+0000 7fde39d29500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-16T14:25:11.643 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-16T14:25:11.740 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-16T14:25:11.741 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:25:11.741 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-16T14:25:11.853 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:25:11.853 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-16T14:25:11.950 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:25:11.950 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-16T14:25:12.045 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:25:12.045 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-16T14:25:12.138 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:25:12.139 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-16T14:25:12.242 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:25:12.243 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-16T14:25:12.352 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:25:12.352 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-16T14:25:12.460 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:25:12.460 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-16T14:25:12.562 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:25:12.562 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-16T14:25:12.655 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:25:12.655 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-16T14:25:12.753 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:25:12.753 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-16T14:25:12.897 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:25:12.897 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-16T14:25:12.992 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:25:12.992 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-16T14:25:13.088 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:25:13.088 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-16T14:25:13.180 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:25:13.181 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-16T14:25:13.243 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:25:13.243 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-16T14:25:13.300 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:25:13.300 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-16T14:25:13.362 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:25:13.362 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-16T14:25:13.419 INFO:tasks.ceph:Adding keys to all mons... 2023-10-16T14:25:13.420 DEBUG:teuthology.orchestra.run.smithi059:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-16T14:25:13.429 DEBUG:teuthology.orchestra.run.smithi151:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-16T14:25:13.522 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.y] 2023-10-16T14:25:13.523 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCiRy1lLVrdMRAAJQwqX2hxjfJ7yMlliTmyNg== 2023-10-16T14:25:13.523 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2023-10-16T14:25:13.523 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCjRy1l4GwTEBAANcB53Pn8FMjW98g6q2LIrQ== 2023-10-16T14:25:13.524 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2023-10-16T14:25:13.524 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCjRy1l4kB9IxAAkhhiHutclRiE7RyYp7sdSA== 2023-10-16T14:25:13.524 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.0] 2023-10-16T14:25:13.524 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCpRy1l5szHERAAcTBgMktkB3e9yjqrfimPtw== 2023-10-16T14:25:13.525 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.1] 2023-10-16T14:25:13.525 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCsRy1l5jp4LBAAA0WYE8TuSsxd/Ho/+AeQug== 2023-10-16T14:25:13.526 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.2] 2023-10-16T14:25:13.526 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCwRy1lQXDvCxAA38WqySNCjb7tecXdGcR92w== 2023-10-16T14:25:13.526 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.3] 2023-10-16T14:25:13.527 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCzRy1lQ77fJhAAt+P92hLij3seqawmbqgC8Q== 2023-10-16T14:25:13.527 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.x] 2023-10-16T14:25:13.527 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCjRy1lde27AhAAYFsZui4JAeWc8L6X+QnpqA== 2023-10-16T14:25:13.527 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2023-10-16T14:25:13.527 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCjRy1lBoJsNRAAhl3lxc7MOAOjQOOqO+v1Pg== 2023-10-16T14:25:13.528 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2023-10-16T14:25:13.528 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCkRy1lgPL+ChAATd1DKeNsbkWz32ljaGE9VA== 2023-10-16T14:25:13.528 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.4] 2023-10-16T14:25:13.528 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQC6Ry1lgpltOBAA4lrfv/3xxtxjzVG9exDNtg== 2023-10-16T14:25:13.528 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.5] 2023-10-16T14:25:13.529 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQC+Ry1lei2BBxAA/eK6hS9d0cTtF17v7r+VPA== 2023-10-16T14:25:13.529 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.6] 2023-10-16T14:25:13.529 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDBRy1l2ZgLEhAAJZFG0Xe+RNg5WFwRDdBJRA== 2023-10-16T14:25:13.529 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.7] 2023-10-16T14:25:13.530 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDERy1lTt1YKhAAvfzPPoWd7iQXYMO1tK0eoA== 2023-10-16T14:25:13.530 INFO:teuthology.orchestra.run.smithi151.stdout:[client.0] 2023-10-16T14:25:13.530 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCkRy1l4wK6GRAAR5d+NsU5HztNqOlUy6gD+Q== 2023-10-16T14:25:13.531 INFO:teuthology.orchestra.run.smithi151.stdout:[client.2] 2023-10-16T14:25:13.531 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCkRy1lNbmxJhAAif4uBVPV2dSJDSJx6W3V4A== 2023-10-16T14:25:13.531 INFO:teuthology.orchestra.run.smithi151.stdout:[client.1] 2023-10-16T14:25:13.531 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQCkRy1ln38BMhAAYJ1x976qWsRBfjZobRv/+g== 2023-10-16T14:25:13.531 INFO:teuthology.orchestra.run.smithi151.stdout:[client.3] 2023-10-16T14:25:13.532 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQClRy1lUSrzABAAZhXtyAszl0XcI3ZCs09UVw== 2023-10-16T14:25:13.533 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.y] 2023-10-16T14:25:13.533 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCiRy1lLVrdMRAAJQwqX2hxjfJ7yMlliTmyNg== 2023-10-16T14:25:13.534 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2023-10-16T14:25:13.534 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCjRy1l4GwTEBAANcB53Pn8FMjW98g6q2LIrQ== 2023-10-16T14:25:13.534 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c] 2023-10-16T14:25:13.534 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCjRy1l4kB9IxAAkhhiHutclRiE7RyYp7sdSA== 2023-10-16T14:25:13.534 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.0] 2023-10-16T14:25:13.535 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCpRy1l5szHERAAcTBgMktkB3e9yjqrfimPtw== 2023-10-16T14:25:13.535 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.1] 2023-10-16T14:25:13.535 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCsRy1l5jp4LBAAA0WYE8TuSsxd/Ho/+AeQug== 2023-10-16T14:25:13.535 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.2] 2023-10-16T14:25:13.535 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCwRy1lQXDvCxAA38WqySNCjb7tecXdGcR92w== 2023-10-16T14:25:13.536 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.3] 2023-10-16T14:25:13.536 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCzRy1lQ77fJhAAt+P92hLij3seqawmbqgC8Q== 2023-10-16T14:25:13.536 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.x] 2023-10-16T14:25:13.536 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCjRy1lde27AhAAYFsZui4JAeWc8L6X+QnpqA== 2023-10-16T14:25:13.536 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2023-10-16T14:25:13.537 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCjRy1lBoJsNRAAhl3lxc7MOAOjQOOqO+v1Pg== 2023-10-16T14:25:13.537 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.d] 2023-10-16T14:25:13.537 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCkRy1lgPL+ChAATd1DKeNsbkWz32ljaGE9VA== 2023-10-16T14:25:13.537 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.4] 2023-10-16T14:25:13.537 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQC6Ry1lgpltOBAA4lrfv/3xxtxjzVG9exDNtg== 2023-10-16T14:25:13.538 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.5] 2023-10-16T14:25:13.538 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQC+Ry1lei2BBxAA/eK6hS9d0cTtF17v7r+VPA== 2023-10-16T14:25:13.538 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.6] 2023-10-16T14:25:13.538 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDBRy1l2ZgLEhAAJZFG0Xe+RNg5WFwRDdBJRA== 2023-10-16T14:25:13.538 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.7] 2023-10-16T14:25:13.539 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDERy1lTt1YKhAAvfzPPoWd7iQXYMO1tK0eoA== 2023-10-16T14:25:13.539 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2023-10-16T14:25:13.539 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCkRy1l4wK6GRAAR5d+NsU5HztNqOlUy6gD+Q== 2023-10-16T14:25:13.539 INFO:teuthology.orchestra.run.smithi059.stdout:[client.2] 2023-10-16T14:25:13.539 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCkRy1lNbmxJhAAif4uBVPV2dSJDSJx6W3V4A== 2023-10-16T14:25:13.540 INFO:teuthology.orchestra.run.smithi059.stdout:[client.1] 2023-10-16T14:25:13.540 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCkRy1ln38BMhAAYJ1x976qWsRBfjZobRv/+g== 2023-10-16T14:25:13.540 INFO:teuthology.orchestra.run.smithi059.stdout:[client.3] 2023-10-16T14:25:13.540 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQClRy1lUSrzABAAZhXtyAszl0XcI3ZCs09UVw== 2023-10-16T14:25:13.541 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T14:25:13.550 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T14:25:13.699 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T14:25:13.705 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T14:25:13.855 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T14:25:13.862 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T14:25:14.012 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T14:25:14.018 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T14:25:14.163 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T14:25:14.170 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T14:25:14.316 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T14:25:14.326 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T14:25:14.475 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T14:25:14.483 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T14:25:14.632 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T14:25:14.640 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-16T14:25:14.787 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T14:25:14.793 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T14:25:14.942 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T14:25:14.949 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-16T14:25:15.096 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T14:25:15.104 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T14:25:15.249 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T14:25:15.256 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T14:25:15.401 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T14:25:15.410 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T14:25:15.556 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T14:25:15.563 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-16T14:25:15.705 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T14:25:15.711 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T14:25:15.859 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T14:25:15.868 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T14:25:16.018 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T14:25:16.024 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T14:25:16.167 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T14:25:16.173 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-16T14:25:16.324 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-16T14:25:16.324 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-16T14:25:16.418 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T14:25:16.573 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-16T14:25:16.665 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-16T14:25:16.772 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T14:25:16.935 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-16T14:25:17.012 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-16T14:25:17.101 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-16T14:25:17.257 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-16T14:25:17.341 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-16T14:25:17.350 DEBUG:teuthology.orchestra.run.smithi151:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-16T14:25:17.405 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-16T14:25:17.406 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-16T14:25:17.407 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-16T14:25:17.417 INFO:tasks.ceph.mon.a:Started 2023-10-16T14:25:17.418 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-16T14:25:17.419 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-16T14:25:17.428 INFO:tasks.ceph.mon.b:Started 2023-10-16T14:25:17.428 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-16T14:25:17.429 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-16T14:25:17.438 INFO:tasks.ceph.mon.c:Started 2023-10-16T14:25:17.438 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-16T14:25:17.439 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-16T14:25:17.440 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-16T14:25:17.449 INFO:tasks.ceph.mgr.y:Started 2023-10-16T14:25:17.449 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-16T14:25:17.450 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-16T14:25:17.456 INFO:tasks.ceph.mgr.x:Started 2023-10-16T14:25:17.456 INFO:tasks.ceph:Setting crush tunables to default 2023-10-16T14:25:17.456 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd crush tunables default 2023-10-16T14:25:17.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:17.639+0000 7fba10e10640 1 Processor -- start 2023-10-16T14:25:17.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:17.639+0000 7fba10e10640 1 -- start start 2023-10-16T14:25:17.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:17.640+0000 7fba10e10640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 0x7fba0c0d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:17.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:17.640+0000 7fba10e10640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0c15cfd0 con 0x7fba0c0b4410 2023-10-16T14:25:17.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:17.640+0000 7fba10e10640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0c0d30b0 con 0x7fba0c0b8400 2023-10-16T14:25:17.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:17.641+0000 7fba10e10640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0c0d0dc0 con 0x7fba0c15cbf0 2023-10-16T14:25:17.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:17.641+0000 7fba09d9b640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fba0c0b8400 0x7fba0c0d11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.59:33072/0 (socket says 172.21.15.59:33072) 2023-10-16T14:25:17.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:17.641+0000 7fba09d9b640 1 -- 172.21.15.59:0/808392761 learned_addr learned my addr 172.21.15.59:0/808392761 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:25:17.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:17.641+0000 7fba0a59c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 0x7fba0c0d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:17.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:17.641+0000 7fba0ad9d640 1 --1- 172.21.15.59:0/808392761 >> v1:172.21.15.59:6789/0 conn(0x7fba0c0b4410 0x7fba0c0b5ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57816/0 (socket says 172.21.15.59:57816) 2023-10-16T14:25:17.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:17.641+0000 7fba0a59c640 1 -- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 msgr2=0x7fba0c0d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T14:25:17.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:17.641+0000 7fba0a59c640 1 -- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 msgr2=0x7fba0c0d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T14:25:17.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:17.641+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 0x7fba0c0d29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T14:25:17.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:17.641+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 0x7fba0c0d29d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T14:25:17.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:17.842+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 0x7fba0c0d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:17.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:17.843+0000 7fba0a59c640 1 -- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 msgr2=0x7fba0c0d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T14:25:17.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:17.843+0000 7fba0a59c640 1 -- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 msgr2=0x7fba0c0d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T14:25:17.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:17.843+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 0x7fba0c0d29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T14:25:17.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:17.843+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 0x7fba0c0d29d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T14:25:18.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:18.244+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 0x7fba0c0d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:18.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:18.245+0000 7fba0a59c640 1 -- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 msgr2=0x7fba0c0d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T14:25:18.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:18.245+0000 7fba0a59c640 1 -- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 msgr2=0x7fba0c0d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T14:25:18.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:18.245+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 0x7fba0c0d29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T14:25:18.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:18.245+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 0x7fba0c0d29d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T14:25:19.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:19.046+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 0x7fba0c0d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:19.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:19.047+0000 7fba0a59c640 1 -- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 msgr2=0x7fba0c0d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T14:25:19.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:19.047+0000 7fba0a59c640 1 -- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 msgr2=0x7fba0c0d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T14:25:19.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:19.047+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 0x7fba0c0d29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T14:25:19.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:19.047+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 0x7fba0c0d29d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T14:25:20.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.641+0000 7fb9fbfff640 1 -- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 msgr2=0x7fba0c0d29d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T14:25:20.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.641+0000 7fb9fbfff640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 0x7fba0c0d29d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:20.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.641+0000 7fb9fbfff640 1 -- 172.21.15.59:0/808392761 >> v1:172.21.15.151:6789/0 conn(0x7fba0c0b8400 legacy=0x7fba0c0d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:20.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.641+0000 7fb9fbfff640 1 -- 172.21.15.59:0/808392761 >> v1:172.21.15.59:6789/0 conn(0x7fba0c0b4410 legacy=0x7fba0c0b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:20.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.641+0000 7fb9fbfff640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 0x7fb9ec005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:20.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.641+0000 7fb9fbfff640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 0x7fb9ec008640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:20.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.641+0000 7fb9fbfff640 1 -- 172.21.15.59:0/808392761 --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0c0d0dc0 con 0x7fb9ec0036e0 2023-10-16T14:25:20.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.641+0000 7fb9fbfff640 1 -- 172.21.15.59:0/808392761 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec008d60 con 0x7fb9ec006180 2023-10-16T14:25:20.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.642+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 0x7fb9ec005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:20.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.642+0000 7fba09d9b640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 0x7fb9ec008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:20.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.642+0000 7fba0a59c640 1 -- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 msgr2=0x7fb9ec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T14:25:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.642+0000 7fba0a59c640 1 -- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 msgr2=0x7fb9ec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T14:25:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.642+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 0x7fb9ec005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T14:25:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.642+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 0x7fb9ec005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T14:25:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.642+0000 7fba09d9b640 1 -- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 msgr2=0x7fb9ec008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T14:25:20.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.642+0000 7fba09d9b640 1 -- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 msgr2=0x7fb9ec008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T14:25:20.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.642+0000 7fba09d9b640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 0x7fb9ec008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T14:25:20.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.642+0000 7fba09d9b640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 0x7fb9ec008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-16T14:25:20.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.843+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 0x7fb9ec005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:20.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.843+0000 7fba09d9b640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 0x7fb9ec008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:20.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.844+0000 7fba0a59c640 1 -- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 msgr2=0x7fb9ec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T14:25:20.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.844+0000 7fba0a59c640 1 -- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 msgr2=0x7fb9ec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T14:25:20.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.844+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 0x7fb9ec005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T14:25:20.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.844+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 0x7fb9ec005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T14:25:20.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.844+0000 7fba09d9b640 1 -- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 msgr2=0x7fb9ec008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T14:25:20.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.844+0000 7fba09d9b640 1 -- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 msgr2=0x7fb9ec008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T14:25:20.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.844+0000 7fba09d9b640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 0x7fb9ec008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T14:25:20.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:20.844+0000 7fba09d9b640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 0x7fb9ec008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-16T14:25:21.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:21.245+0000 7fba09d9b640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 0x7fb9ec008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:21.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:21.246+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 0x7fb9ec005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:21.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:21.246+0000 7fba09d9b640 1 -- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 msgr2=0x7fb9ec008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T14:25:21.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:21.246+0000 7fba09d9b640 1 -- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 msgr2=0x7fb9ec008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T14:25:21.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:21.246+0000 7fba09d9b640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 0x7fb9ec008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T14:25:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:21.246+0000 7fba0a59c640 1 -- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 msgr2=0x7fb9ec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T14:25:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:21.246+0000 7fba0a59c640 1 -- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 msgr2=0x7fb9ec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T14:25:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:21.246+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 0x7fb9ec005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T14:25:21.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:21.246+0000 7fba09d9b640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 0x7fb9ec008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T14:25:21.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:21.246+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 0x7fb9ec005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-16T14:25:22.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:22.048+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 0x7fb9ec005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:22.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:22.048+0000 7fba09d9b640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 0x7fb9ec008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:22.048+0000 7fba0a59c640 1 -- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 msgr2=0x7fb9ec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-16T14:25:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:22.048+0000 7fba0a59c640 1 -- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 msgr2=0x7fb9ec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T14:25:22.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:22.048+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 0x7fb9ec005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T14:25:22.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:22.048+0000 7fba09d9b640 1 -- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 msgr2=0x7fb9ec008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-16T14:25:22.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:22.048+0000 7fba09d9b640 1 -- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 msgr2=0x7fb9ec008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-16T14:25:22.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:22.048+0000 7fba09d9b640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 0x7fb9ec008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-16T14:25:22.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:22.048+0000 7fba0a59c640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 0x7fb9ec005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T14:25:22.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:22.048+0000 7fba09d9b640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 0x7fb9ec008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-16T14:25:23.445 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:23.442+0000 7feb9b82f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T14:25:23.504 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:23.501+0000 7feb9b82f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T14:25:23.547 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:23.544+0000 7fcae1445040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-16T14:25:23.613 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:23.611+0000 7fcae1445040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-16T14:25:23.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.641+0000 7fb9fbfff640 1 -- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 msgr2=0x7fb9ec008640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T14:25:23.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.641+0000 7fb9fbfff640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 0x7fb9ec008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:23.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.641+0000 7fb9fbfff640 1 -- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 msgr2=0x7fb9ec005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T14:25:23.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.641+0000 7fb9fbfff640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.151:3300/0 conn(0x7fb9ec0036e0 0x7fb9ec005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:23.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.641+0000 7fba0ad9d640 1 -- 172.21.15.59:0/808392761 reap_dead start 2023-10-16T14:25:23.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.641+0000 7fb9fbfff640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 0x7fb9ec0085c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:23.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.641+0000 7fb9fbfff640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 0x7fb9ec00e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:23.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.641+0000 7fb9fbfff640 1 -- 172.21.15.59:0/808392761 --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0c0d0700 con 0x7fba0c0b8400 2023-10-16T14:25:23.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.641+0000 7fb9fbfff640 1 -- 172.21.15.59:0/808392761 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0c0d0dc0 con 0x7fba0c15cbf0 2023-10-16T14:25:23.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.641+0000 7fb9fbfff640 1 -- 172.21.15.59:0/808392761 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec008d60 con 0x7fb9ec006180 2023-10-16T14:25:23.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.642+0000 7fba0ad9d640 1 --2- 172.21.15.59:0/808392761 >> v2:172.21.15.59:3300/0 conn(0x7fba0c15cbf0 0x7fb9ec00e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:23.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.642+0000 7fba09d9b640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 0x7fb9ec0085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:23.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.643+0000 7fba0959a640 1 -- 172.21.15.59:0/808392761 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976765705 0 0) 0x7fba0c0d0700 con 0x7fba0c0b8400 2023-10-16T14:25:23.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.643+0000 7fba0959a640 1 -- 172.21.15.59:0/808392761 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9f4003520 con 0x7fba0c0b8400 2023-10-16T14:25:23.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.643+0000 7fba0ad9d640 1 -- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 msgr2=0x7fb9ec0085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:23.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.643+0000 7fba0ad9d640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 0x7fb9ec0085c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:23.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.643+0000 7fba0ad9d640 1 -- 172.21.15.59:0/808392761 >> v1:172.21.15.151:6789/0 conn(0x7fba0c0b8400 legacy=0x7fb9ec00b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:23.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.643+0000 7fba0ad9d640 1 -- 172.21.15.59:0/808392761 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec003b80 con 0x7fba0c15cbf0 2023-10-16T14:25:23.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.643+0000 7fba09d9b640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 0x7fb9ec0085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:25:23.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.646+0000 7fba0ad9d640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba0c15cbf0 0x7fb9ec00e8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0060d0 tx=0x7fba0402b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf66b724036bc1a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:23.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.646+0000 7fba0959a640 1 -- 172.21.15.59:0/808392761 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04004d60 con 0x7fba0c15cbf0 2023-10-16T14:25:23.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.646+0000 7fba0959a640 1 -- 172.21.15.59:0/808392761 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0402e070 con 0x7fba0c15cbf0 2023-10-16T14:25:23.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.646+0000 7fba0959a640 1 -- 172.21.15.59:0/808392761 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04034680 con 0x7fba0c15cbf0 2023-10-16T14:25:23.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.647+0000 7fba10e10640 1 -- 172.21.15.59:0/808392761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba0c15cbf0 msgr2=0x7fb9ec00e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:23.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.647+0000 7fba10e10640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba0c15cbf0 0x7fb9ec00e8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0060d0 tx=0x7fba0402b780 comp rx=0 tx=0).stop 2023-10-16T14:25:23.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.648+0000 7fba10e10640 1 -- 172.21.15.59:0/808392761 shutdown_connections 2023-10-16T14:25:23.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.648+0000 7fba10e10640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba0c15cbf0 0x7fb9ec00e8a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:23.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.648+0000 7fba10e10640 1 --2- 172.21.15.59:0/808392761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9ec006180 0x7fb9ec0085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:23.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.648+0000 7fba10e10640 1 -- 172.21.15.59:0/808392761 >> 172.21.15.59:0/808392761 conn(0x7fba0c071900 msgr2=0x7fba0c071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:23.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.648+0000 7fba10e10640 1 -- 172.21.15.59:0/808392761 shutdown_connections 2023-10-16T14:25:23.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.648+0000 7fba10e10640 1 -- 172.21.15.59:0/808392761 wait complete. 2023-10-16T14:25:23.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.653+0000 7fba10e10640 1 Processor -- start 2023-10-16T14:25:23.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.654+0000 7fba10e10640 1 -- start start 2023-10-16T14:25:23.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.656+0000 7fba10e10640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9ec006180 0x7fba0c14fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:23.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.656+0000 7fba10e10640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba0c0b8400 0x7fba0c155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:23.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.656+0000 7fba10e10640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba0c15cbf0 0x7fba0c0d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:23.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.656+0000 7fba10e10640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c150340 con 0x7fba0c15cbf0 2023-10-16T14:25:23.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.656+0000 7fba10e10640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c153b30 con 0x7fb9ec006180 2023-10-16T14:25:23.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.656+0000 7fba10e10640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c15f6b0 con 0x7fba0c0b8400 2023-10-16T14:25:23.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.657+0000 7fba0ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba0c15cbf0 0x7fba0c0d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:23.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.657+0000 7fba0ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba0c15cbf0 0x7fba0c0d10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48382/0 (socket says 172.21.15.59:48382) 2023-10-16T14:25:23.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.657+0000 7fba0ad9d640 1 -- 172.21.15.59:0/743674094 learned_addr learned my addr 172.21.15.59:0/743674094 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:23.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.657+0000 7fba0a59c640 1 --2- 172.21.15.59:0/743674094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9ec006180 0x7fba0c14fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:23.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.657+0000 7fba09d9b640 1 --2- 172.21.15.59:0/743674094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba0c0b8400 0x7fba0c155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:23.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.657+0000 7fba0ad9d640 1 -- 172.21.15.59:0/743674094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba0c0b8400 msgr2=0x7fba0c155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:23.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.657+0000 7fba0ad9d640 1 --2- 172.21.15.59:0/743674094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba0c0b8400 0x7fba0c155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:23.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.657+0000 7fba0ad9d640 1 -- 172.21.15.59:0/743674094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9ec006180 msgr2=0x7fba0c14fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:23.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.657+0000 7fba0ad9d640 1 --2- 172.21.15.59:0/743674094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9ec006180 0x7fba0c14fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:23.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.657+0000 7fba0ad9d640 1 -- 172.21.15.59:0/743674094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0000f040 con 0x7fba0c15cbf0 2023-10-16T14:25:23.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.658+0000 7fba0ad9d640 1 --2- 172.21.15.59:0/743674094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba0c15cbf0 0x7fba0c0d10e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fba0402b7c0 tx=0x7fba040014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:23.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.658+0000 7fb9faffd640 1 -- 172.21.15.59:0/743674094 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04034c40 con 0x7fba0c15cbf0 2023-10-16T14:25:23.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.658+0000 7fb9faffd640 1 -- 172.21.15.59:0/743674094 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba04034da0 con 0x7fba0c15cbf0 2023-10-16T14:25:23.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.658+0000 7fba10e10640 1 -- 172.21.15.59:0/743674094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0c15cfd0 con 0x7fba0c15cbf0 2023-10-16T14:25:23.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.658+0000 7fb9faffd640 1 -- 172.21.15.59:0/743674094 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04007290 con 0x7fba0c15cbf0 2023-10-16T14:25:23.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.658+0000 7fba10e10640 1 -- 172.21.15.59:0/743674094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0c15fc70 con 0x7fba0c15cbf0 2023-10-16T14:25:23.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.659+0000 7fb9faffd640 1 -- 172.21.15.59:0/743674094 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fba04030070 con 0x7fba0c15cbf0 2023-10-16T14:25:23.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.659+0000 7fb9faffd640 1 -- 172.21.15.59:0/743674094 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fba0404a5e0 con 0x7fba0c15cbf0 2023-10-16T14:25:23.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.660+0000 7fba10e10640 1 -- 172.21.15.59:0/743674094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0c0cf960 con 0x7fba0c15cbf0 2023-10-16T14:25:23.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.663+0000 7fb9faffd640 1 -- 172.21.15.59:0/743674094 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fba04007880 con 0x7fba0c15cbf0 2023-10-16T14:25:23.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.755+0000 7fba10e10640 1 -- 172.21.15.59:0/743674094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fba0c0d09b0 con 0x7fba0c15cbf0 2023-10-16T14:25:23.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.758+0000 7fb9faffd640 1 -- 172.21.15.59:0/743674094 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fba04007a20 con 0x7fba0c15cbf0 2023-10-16T14:25:23.761 INFO:teuthology.orchestra.run.smithi059.stderr:adjusted tunables profile to default 2023-10-16T14:25:23.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.760+0000 7fba10e10640 1 -- 172.21.15.59:0/743674094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba0c15cbf0 msgr2=0x7fba0c0d10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:23.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.760+0000 7fba10e10640 1 --2- 172.21.15.59:0/743674094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba0c15cbf0 0x7fba0c0d10e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fba0402b7c0 tx=0x7fba040014a0 comp rx=0 tx=0).stop 2023-10-16T14:25:23.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.760+0000 7fba10e10640 1 -- 172.21.15.59:0/743674094 shutdown_connections 2023-10-16T14:25:23.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.760+0000 7fba10e10640 1 --2- 172.21.15.59:0/743674094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba0c15cbf0 0x7fba0c0d10e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:23.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.760+0000 7fba10e10640 1 --2- 172.21.15.59:0/743674094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba0c0b8400 0x7fba0c155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:23.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.760+0000 7fba10e10640 1 --2- 172.21.15.59:0/743674094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9ec006180 0x7fba0c14fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:23.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.760+0000 7fba10e10640 1 -- 172.21.15.59:0/743674094 >> 172.21.15.59:0/743674094 conn(0x7fba0c071900 msgr2=0x7fba0c158610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:23.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.760+0000 7fba10e10640 1 -- 172.21.15.59:0/743674094 shutdown_connections 2023-10-16T14:25:23.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:23.760+0000 7fba10e10640 1 -- 172.21.15.59:0/743674094 wait complete. 2023-10-16T14:25:23.780 INFO:tasks.ceph:check_enable_crimson: False 2023-10-16T14:25:23.781 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-16T14:25:23.781 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:25:23.781 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-16T14:25:23.865 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:25:23.865 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-16T14:25:24.000 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:25:24.001 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-16T14:25:24.093 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:25:24.094 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-16T14:25:24.127 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:24.124+0000 7feb9b82f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T14:25:24.187 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:24.185+0000 7feb9b82f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T14:25:24.231 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:25:24.232 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-16T14:25:24.239 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:24.237+0000 7feb9b82f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T14:25:24.285 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:24.283+0000 7fcae1445040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-16T14:25:24.306 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:24.303+0000 7feb9b82f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T14:25:24.322 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:25:24.322 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-16T14:25:24.349 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:24.347+0000 7fcae1445040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-16T14:25:24.359 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:24.356+0000 7feb9b82f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T14:25:24.402 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:24.400+0000 7fcae1445040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-16T14:25:24.446 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:25:24.446 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-16T14:25:24.467 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:24.465+0000 7fcae1445040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-16T14:25:24.483 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:24.481+0000 7feb9b82f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T14:25:24.519 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:24.516+0000 7fcae1445040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-16T14:25:24.533 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:25:24.533 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-16T14:25:24.568 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:24.565+0000 7feb9b82f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T14:25:24.628 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:24.626+0000 7feb9b82f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T14:25:24.637 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:24.635+0000 7fcae1445040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-16T14:25:24.665 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new ecfef601-5846-4644-9d90-39255222e833 0 2023-10-16T14:25:24.696 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:24.694+0000 7feb9b82f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T14:25:24.721 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:24.718+0000 7fcae1445040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-16T14:25:24.754 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:24.751+0000 7feb9b82f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T14:25:24.776 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:24.774+0000 7fcae1445040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-16T14:25:24.840 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:24.837+0000 7fcae1445040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-16T14:25:24.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.855+0000 7fcf8f59e640 1 Processor -- start 2023-10-16T14:25:24.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.856+0000 7fcf8f59e640 1 -- start start 2023-10-16T14:25:24.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.857+0000 7fcf8f59e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf9006a4f0 0x7fcf900cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:24.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.857+0000 7fcf8f59e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf900aedb0 con 0x7fcf900ae9d0 2023-10-16T14:25:24.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.857+0000 7fcf8f59e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf900cbef0 con 0x7fcf900cb770 2023-10-16T14:25:24.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.857+0000 7fcf8f59e640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf900cc520 con 0x7fcf9006a4f0 2023-10-16T14:25:24.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.857+0000 7fcf8ed9d640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fcf900cb770 0x7fcf901606e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:52118/0 (socket says 172.21.15.151:52118) 2023-10-16T14:25:24.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.857+0000 7fcf8ed9d640 1 -- 172.21.15.151:0/2824453841 learned_addr learned my addr 172.21.15.151:0/2824453841 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-16T14:25:24.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.858+0000 7fcf87fff640 1 --2- 172.21.15.151:0/2824453841 >> v2:172.21.15.59:3300/0 conn(0x7fcf9006a4f0 0x7fcf900cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:24.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.858+0000 7fcf8dd9b640 1 -- 172.21.15.151:0/2824453841 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755915955 0 0) 0x7fcf900cbef0 con 0x7fcf900cb770 2023-10-16T14:25:24.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.858+0000 7fcf8dd9b640 1 -- 172.21.15.151:0/2824453841 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf7c003520 con 0x7fcf900cb770 2023-10-16T14:25:24.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.858+0000 7fcf8dd9b640 1 -- 172.21.15.151:0/2824453841 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1542268775 0 0) 0x7fcf7c003520 con 0x7fcf900cb770 2023-10-16T14:25:24.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.858+0000 7fcf8dd9b640 1 -- 172.21.15.151:0/2824453841 >> v2:172.21.15.59:3300/0 conn(0x7fcf9006a4f0 msgr2=0x7fcf900cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:24.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.858+0000 7fcf8dd9b640 1 --2- 172.21.15.151:0/2824453841 >> v2:172.21.15.59:3300/0 conn(0x7fcf9006a4f0 0x7fcf900cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:24.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.858+0000 7fcf8dd9b640 1 -- 172.21.15.151:0/2824453841 >> v1:172.21.15.59:6789/0 conn(0x7fcf900ae9d0 legacy=0x7fcf90069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:24.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.858+0000 7fcf8dd9b640 1 -- 172.21.15.151:0/2824453841 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9006e680 con 0x7fcf900cb770 2023-10-16T14:25:24.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.858+0000 7fcf8dd9b640 1 -- 172.21.15.151:0/2824453841 <== mon.1 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7fcf880019f0 con 0x7fcf900cb770 2023-10-16T14:25:24.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.858+0000 7fcf8dd9b640 1 -- 172.21.15.151:0/2824453841 >> v1:172.21.15.151:6789/0 conn(0x7fcf900cb770 legacy=0x7fcf901606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:24.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.858+0000 7fcf8dd9b640 1 --2- 172.21.15.151:0/2824453841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf7c003a30 0x7fcf7c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:24.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.858+0000 7fcf8dd9b640 1 --2- 172.21.15.151:0/2824453841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf7c0047c0 0x7fcf7c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:24.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.859+0000 7fcf8dd9b640 1 --2- 172.21.15.151:0/2824453841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf7c0052a0 0x7fcf7c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:24.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.859+0000 7fcf8dd9b640 1 -- 172.21.15.151:0/2824453841 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900cc520 con 0x7fcf7c003a30 2023-10-16T14:25:24.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.859+0000 7fcf8dd9b640 1 -- 172.21.15.151:0/2824453841 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c00c170 con 0x7fcf7c0052a0 2023-10-16T14:25:24.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.859+0000 7fcf8dd9b640 1 -- 172.21.15.151:0/2824453841 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c00c330 con 0x7fcf7c0047c0 2023-10-16T14:25:24.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.859+0000 7fcf8ed9d640 1 --2- 172.21.15.151:0/2824453841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf7c0052a0 0x7fcf7c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:24.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.859+0000 7fcf87fff640 1 --2- 172.21.15.151:0/2824453841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf7c0047c0 0x7fcf7c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:24.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.859+0000 7fcf8e59c640 1 --2- 172.21.15.151:0/2824453841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf7c003a30 0x7fcf7c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:24.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.859+0000 7fcf87fff640 1 -- 172.21.15.151:0/2824453841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf7c0052a0 msgr2=0x7fcf7c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:24.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.859+0000 7fcf87fff640 1 --2- 172.21.15.151:0/2824453841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf7c0052a0 0x7fcf7c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:24.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.859+0000 7fcf87fff640 1 -- 172.21.15.151:0/2824453841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf7c003a30 msgr2=0x7fcf7c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:24.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.859+0000 7fcf87fff640 1 --2- 172.21.15.151:0/2824453841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf7c003a30 0x7fcf7c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:24.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.859+0000 7fcf87fff640 1 -- 172.21.15.151:0/2824453841 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c003520 con 0x7fcf7c0047c0 2023-10-16T14:25:24.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.859+0000 7fcf8ed9d640 1 -- 172.21.15.151:0/2824453841 reap_dead start 2023-10-16T14:25:24.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.860+0000 7fcf87fff640 1 --2- 172.21.15.151:0/2824453841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf7c0047c0 0x7fcf7c004c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009ac0 tx=0x7fcf7c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba4b49aae07898b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:24.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.861+0000 7fcf8dd9b640 1 -- 172.21.15.151:0/2824453841 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7802c6b0 con 0x7fcf7c0047c0 2023-10-16T14:25:24.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.861+0000 7fcf8dd9b640 1 -- 172.21.15.151:0/2824453841 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7802c810 con 0x7fcf7c0047c0 2023-10-16T14:25:24.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.861+0000 7fcf8dd9b640 1 -- 172.21.15.151:0/2824453841 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7802cba0 con 0x7fcf7c0047c0 2023-10-16T14:25:24.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.861+0000 7fcf8f59e640 1 -- 172.21.15.151:0/2824453841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf7c0047c0 msgr2=0x7fcf7c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:24.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.861+0000 7fcf8f59e640 1 --2- 172.21.15.151:0/2824453841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf7c0047c0 0x7fcf7c004c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009ac0 tx=0x7fcf7c0057f0 comp rx=0 tx=0).stop 2023-10-16T14:25:24.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.861+0000 7fcf8f59e640 1 -- 172.21.15.151:0/2824453841 shutdown_connections 2023-10-16T14:25:24.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.861+0000 7fcf8f59e640 1 --2- 172.21.15.151:0/2824453841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf7c0047c0 0x7fcf7c004c40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:24.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.861+0000 7fcf8f59e640 1 -- 172.21.15.151:0/2824453841 >> 172.21.15.151:0/2824453841 conn(0x7fcf900cf4e0 msgr2=0x7fcf900cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:24.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.861+0000 7fcf8f59e640 1 -- 172.21.15.151:0/2824453841 shutdown_connections 2023-10-16T14:25:24.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.862+0000 7fcf8f59e640 1 -- 172.21.15.151:0/2824453841 wait complete. 2023-10-16T14:25:24.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.863+0000 7fcf8f59e640 1 Processor -- start 2023-10-16T14:25:24.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.863+0000 7fcf8f59e640 1 -- start start 2023-10-16T14:25:24.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.864+0000 7fcf8f59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf7c0047c0 0x7fcf9015d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:24.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.864+0000 7fcf8f59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf90152a20 0x7fcf900b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:24.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.864+0000 7fcf8f59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf900b3660 0x7fcf900b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:24.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.864+0000 7fcf8f59e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900b4b80 con 0x7fcf900b3660 2023-10-16T14:25:24.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.864+0000 7fcf8f59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900b4020 con 0x7fcf90152a20 2023-10-16T14:25:24.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.864+0000 7fcf8f59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900b48e0 con 0x7fcf7c0047c0 2023-10-16T14:25:24.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.864+0000 7fcf8e59c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf7c0047c0 0x7fcf9015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:24.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.864+0000 7fcf87fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf90152a20 0x7fcf900b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:24.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.864+0000 7fcf8e59c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf7c0047c0 0x7fcf9015d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:33664/0 (socket says 172.21.15.151:33664) 2023-10-16T14:25:24.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.864+0000 7fcf8e59c640 1 -- 172.21.15.151:0/2763786088 learned_addr learned my addr 172.21.15.151:0/2763786088 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-16T14:25:24.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.865+0000 7fcf87fff640 1 -- 172.21.15.151:0/2763786088 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf7c0047c0 msgr2=0x7fcf9015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:24.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.865+0000 7fcf87fff640 1 --2- 172.21.15.151:0/2763786088 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf7c0047c0 0x7fcf9015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:24.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.865+0000 7fcf87fff640 1 -- 172.21.15.151:0/2763786088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf900b3660 msgr2=0x7fcf900b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:24.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.865+0000 7fcf87fff640 1 --2- 172.21.15.151:0/2763786088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf900b3660 0x7fcf900b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:24.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.865+0000 7fcf87fff640 1 -- 172.21.15.151:0/2763786088 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf901f5680 con 0x7fcf90152a20 2023-10-16T14:25:24.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.865+0000 7fcf87fff640 1 --2- 172.21.15.151:0/2763786088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf90152a20 0x7fcf900b43a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00c4c0 tx=0x7fcf78004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:24.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.866+0000 7fcf86ffd640 1 -- 172.21.15.151:0/2763786088 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78004520 con 0x7fcf90152a20 2023-10-16T14:25:24.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.866+0000 7fcf86ffd640 1 -- 172.21.15.151:0/2763786088 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf78003810 con 0x7fcf90152a20 2023-10-16T14:25:24.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.866+0000 7fcf86ffd640 1 -- 172.21.15.151:0/2763786088 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78003ba0 con 0x7fcf90152a20 2023-10-16T14:25:24.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.866+0000 7fcf8f59e640 1 -- 172.21.15.151:0/2763786088 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf901f5960 con 0x7fcf90152a20 2023-10-16T14:25:24.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.866+0000 7fcf8f59e640 1 -- 172.21.15.151:0/2763786088 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf901f5f20 con 0x7fcf90152a20 2023-10-16T14:25:24.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.866+0000 7fcf86ffd640 1 -- 172.21.15.151:0/2763786088 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcf78047450 con 0x7fcf90152a20 2023-10-16T14:25:24.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.866+0000 7fcf86ffd640 1 -- 172.21.15.151:0/2763786088 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcf78034820 con 0x7fcf90152a20 2023-10-16T14:25:24.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.867+0000 7fcf8f59e640 1 -- 172.21.15.151:0/2763786088 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf901f60b0 con 0x7fcf90152a20 2023-10-16T14:25:24.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.870+0000 7fcf86ffd640 1 -- 172.21.15.151:0/2763786088 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fcf7804c060 con 0x7fcf90152a20 2023-10-16T14:25:24.897 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:24.895+0000 7fcae1445040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-16T14:25:24.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.947+0000 7fcf8f59e640 1 -- 172.21.15.151:0/2763786088 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ecfef601-5846-4644-9d90-39255222e833", "id": 0} v 0) v1 -- 0x7fcf900b4020 con 0x7fcf90152a20 2023-10-16T14:25:24.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.955+0000 7fcf86ffd640 1 -- 172.21.15.151:0/2763786088 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ecfef601-5846-4644-9d90-39255222e833", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcf780560b0 con 0x7fcf90152a20 2023-10-16T14:25:24.958 INFO:teuthology.orchestra.run.smithi151.stdout:0 2023-10-16T14:25:24.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.956+0000 7fcf8f59e640 1 -- 172.21.15.151:0/2763786088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf90152a20 msgr2=0x7fcf900b43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:24.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.956+0000 7fcf8f59e640 1 --2- 172.21.15.151:0/2763786088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf90152a20 0x7fcf900b43a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00c4c0 tx=0x7fcf78004730 comp rx=0 tx=0).stop 2023-10-16T14:25:24.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.956+0000 7fcf8f59e640 1 -- 172.21.15.151:0/2763786088 shutdown_connections 2023-10-16T14:25:24.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.956+0000 7fcf8f59e640 1 --2- 172.21.15.151:0/2763786088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf900b3660 0x7fcf900b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:24.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.956+0000 7fcf8f59e640 1 --2- 172.21.15.151:0/2763786088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf90152a20 0x7fcf900b43a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:24.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.956+0000 7fcf8f59e640 1 --2- 172.21.15.151:0/2763786088 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf7c0047c0 0x7fcf9015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:24.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.956+0000 7fcf8f59e640 1 -- 172.21.15.151:0/2763786088 >> 172.21.15.151:0/2763786088 conn(0x7fcf900cf4e0 msgr2=0x7fcf900aef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:24.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.956+0000 7fcf8f59e640 1 -- 172.21.15.151:0/2763786088 shutdown_connections 2023-10-16T14:25:24.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:24.956+0000 7fcf8f59e640 1 -- 172.21.15.151:0/2763786088 wait complete. 2023-10-16T14:25:24.976 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 24e481f7-971b-465f-92f4-55ae0c62b865 1 2023-10-16T14:25:25.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.219+0000 7f25a3765640 1 Processor -- start 2023-10-16T14:25:25.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.219+0000 7f25a3765640 1 -- start start 2023-10-16T14:25:25.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.220+0000 7f25a3765640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f259c0d29d0 0x7f259c0d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:25.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.220+0000 7f25a3765640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f259c0b4410 0x7f259c0b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:25.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.220+0000 7f25a3765640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259c0d2e40 con 0x7f259c15cbf0 2023-10-16T14:25:25.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.221+0000 7f25a3765640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259c0d0dc0 con 0x7f259c0d29d0 2023-10-16T14:25:25.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.221+0000 7f25a3765640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259c0b4dc0 con 0x7f259c0b4410 2023-10-16T14:25:25.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.221+0000 7f25a1501640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f259c15cbf0 0x7f259c0b8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:52126/0 (socket says 172.21.15.151:52126) 2023-10-16T14:25:25.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.221+0000 7f25a1501640 1 -- 172.21.15.151:0/2002163194 learned_addr learned my addr 172.21.15.151:0/2002163194 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-16T14:25:25.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.221+0000 7f25a1d02640 1 --2- 172.21.15.151:0/2002163194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f259c0b4410 0x7f259c0b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:25.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.221+0000 7f25a0d00640 1 --2- 172.21.15.151:0/2002163194 >> v2:172.21.15.59:3300/0 conn(0x7f259c0d29d0 0x7f259c0d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:25.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.221+0000 7f2593fff640 1 -- 172.21.15.151:0/2002163194 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265062187 0 0) 0x7f259c0d2e40 con 0x7f259c15cbf0 2023-10-16T14:25:25.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.221+0000 7f2593fff640 1 -- 172.21.15.151:0/2002163194 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2584003520 con 0x7f259c15cbf0 2023-10-16T14:25:25.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.221+0000 7f25a1d02640 1 -- 172.21.15.151:0/2002163194 >> v2:172.21.15.59:3300/0 conn(0x7f259c0d29d0 msgr2=0x7f259c0d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:25.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.221+0000 7f25a1d02640 1 --2- 172.21.15.151:0/2002163194 >> v2:172.21.15.59:3300/0 conn(0x7f259c0d29d0 0x7f259c0d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.221+0000 7f25a1d02640 1 -- 172.21.15.151:0/2002163194 >> v1:172.21.15.151:6789/0 conn(0x7f259c15cbf0 legacy=0x7f259c0b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:25.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.221+0000 7f25a1d02640 1 -- 172.21.15.151:0/2002163194 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c15cfd0 con 0x7f259c0b4410 2023-10-16T14:25:25.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.222+0000 7f25a0d00640 1 --2- 172.21.15.151:0/2002163194 >> v2:172.21.15.59:3300/0 conn(0x7f259c0d29d0 0x7f259c0d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:25:25.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.223+0000 7f25a1d02640 1 --2- 172.21.15.151:0/2002163194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f259c0b4410 0x7f259c0b4880 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f25940097a0 tx=0x7f259402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dce2cdd768e839db server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:25.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.223+0000 7f2593fff640 1 -- 172.21.15.151:0/2002163194 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259402d040 con 0x7f259c0b4410 2023-10-16T14:25:25.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.223+0000 7f2593fff640 1 -- 172.21.15.151:0/2002163194 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2594031810 con 0x7f259c0b4410 2023-10-16T14:25:25.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.223+0000 7f2593fff640 1 -- 172.21.15.151:0/2002163194 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2594031ba0 con 0x7f259c0b4410 2023-10-16T14:25:25.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.224+0000 7f25a3765640 1 -- 172.21.15.151:0/2002163194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f259c0b4410 msgr2=0x7f259c0b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:25.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.224+0000 7f25a3765640 1 --2- 172.21.15.151:0/2002163194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f259c0b4410 0x7f259c0b4880 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f25940097a0 tx=0x7f259402b8b0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.224+0000 7f25a3765640 1 -- 172.21.15.151:0/2002163194 shutdown_connections 2023-10-16T14:25:25.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.224+0000 7f25a3765640 1 --2- 172.21.15.151:0/2002163194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f259c0b4410 0x7f259c0b4880 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.224+0000 7f25a3765640 1 --2- 172.21.15.151:0/2002163194 >> v2:172.21.15.59:3300/0 conn(0x7f259c0d29d0 0x7f259c0d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.224+0000 7f25a3765640 1 -- 172.21.15.151:0/2002163194 >> 172.21.15.151:0/2002163194 conn(0x7f259c071900 msgr2=0x7f259c071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:25.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.224+0000 7f25a3765640 1 -- 172.21.15.151:0/2002163194 shutdown_connections 2023-10-16T14:25:25.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.224+0000 7f25a3765640 1 -- 172.21.15.151:0/2002163194 wait complete. 2023-10-16T14:25:25.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.226+0000 7f25a3765640 1 Processor -- start 2023-10-16T14:25:25.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.226+0000 7f25a3765640 1 -- start start 2023-10-16T14:25:25.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.227+0000 7f25a3765640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f259c0b4410 0x7f259c0c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:25.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.227+0000 7f25a3765640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f259c0d29d0 0x7f259c156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:25.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.227+0000 7f25a3765640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f259c15cbf0 0x7f259c1577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:25.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.227+0000 7f25a3765640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c0caf50 con 0x7f259c15cbf0 2023-10-16T14:25:25.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.227+0000 7f25a3765640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c0ca0a0 con 0x7f259c0b4410 2023-10-16T14:25:25.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.227+0000 7f25a3765640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259c0ca340 con 0x7f259c0d29d0 2023-10-16T14:25:25.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.227+0000 7f25a1501640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f259c0b4410 0x7f259c0c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:25.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.227+0000 7f25a1501640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f259c0b4410 0x7f259c0c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55016/0 (socket says 172.21.15.151:55016) 2023-10-16T14:25:25.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.227+0000 7f25a1501640 1 -- 172.21.15.151:0/48513484 learned_addr learned my addr 172.21.15.151:0/48513484 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-16T14:25:25.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.228+0000 7f25a0d00640 1 --2- 172.21.15.151:0/48513484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f259c0d29d0 0x7f259c156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:25.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.228+0000 7f25a1d02640 1 --2- 172.21.15.151:0/48513484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f259c15cbf0 0x7f259c1577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:25.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.228+0000 7f25a1501640 1 -- 172.21.15.151:0/48513484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f259c0d29d0 msgr2=0x7f259c156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:25.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.228+0000 7f25a1501640 1 --2- 172.21.15.151:0/48513484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f259c0d29d0 0x7f259c156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.228+0000 7f25a1501640 1 -- 172.21.15.151:0/48513484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f259c15cbf0 msgr2=0x7f259c1577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:25.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.228+0000 7f25a1501640 1 --2- 172.21.15.151:0/48513484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f259c15cbf0 0x7f259c1577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.228+0000 7f25a1501640 1 -- 172.21.15.151:0/48513484 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2594009400 con 0x7f259c0b4410 2023-10-16T14:25:25.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.228+0000 7f25a1501640 1 --2- 172.21.15.151:0/48513484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f259c0b4410 0x7f259c0c9b60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f258c00c410 tx=0x7f258c00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:25.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.228+0000 7f2591ffb640 1 -- 172.21.15.151:0/48513484 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c005ce0 con 0x7f259c0b4410 2023-10-16T14:25:25.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.229+0000 7f2591ffb640 1 -- 172.21.15.151:0/48513484 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258c005e40 con 0x7f259c0b4410 2023-10-16T14:25:25.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.229+0000 7f25a3765640 1 -- 172.21.15.151:0/48513484 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f259c0ca620 con 0x7f259c0b4410 2023-10-16T14:25:25.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.229+0000 7f2591ffb640 1 -- 172.21.15.151:0/48513484 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c0072f0 con 0x7f259c0b4410 2023-10-16T14:25:25.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.229+0000 7f25a3765640 1 -- 172.21.15.151:0/48513484 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f259c0cabe0 con 0x7f259c0b4410 2023-10-16T14:25:25.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.229+0000 7f2591ffb640 1 -- 172.21.15.151:0/48513484 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f258c01c440 con 0x7f259c0b4410 2023-10-16T14:25:25.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.229+0000 7f2591ffb640 1 -- 172.21.15.151:0/48513484 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f258c012930 con 0x7f259c0b4410 2023-10-16T14:25:25.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.230+0000 7f25a3765640 1 -- 172.21.15.151:0/48513484 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f259c073ef0 con 0x7f259c0b4410 2023-10-16T14:25:25.240 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:25.232+0000 7feb9b82f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T14:25:25.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.232+0000 7f2591ffb640 1 -- 172.21.15.151:0/48513484 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f258c017070 con 0x7f259c0b4410 2023-10-16T14:25:25.312 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.310+0000 7f25a3765640 1 -- 172.21.15.151:0/48513484 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "24e481f7-971b-465f-92f4-55ae0c62b865", "id": 1} v 0) v1 -- 0x7f259c0cda30 con 0x7f259c0b4410 2023-10-16T14:25:25.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.316+0000 7f2591ffb640 1 -- 172.21.15.151:0/48513484 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "24e481f7-971b-465f-92f4-55ae0c62b865", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f258c012c20 con 0x7f259c0b4410 2023-10-16T14:25:25.319 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-10-16T14:25:25.320 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.317+0000 7f25a3765640 1 -- 172.21.15.151:0/48513484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f259c0b4410 msgr2=0x7f259c0c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:25.320 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.317+0000 7f25a3765640 1 --2- 172.21.15.151:0/48513484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f259c0b4410 0x7f259c0c9b60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f258c00c410 tx=0x7f258c00c8d0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.320 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.317+0000 7f25a3765640 1 -- 172.21.15.151:0/48513484 shutdown_connections 2023-10-16T14:25:25.320 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.317+0000 7f25a3765640 1 --2- 172.21.15.151:0/48513484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f259c15cbf0 0x7f259c1577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.317+0000 7f25a3765640 1 --2- 172.21.15.151:0/48513484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f259c0d29d0 0x7f259c156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.317+0000 7f25a3765640 1 --2- 172.21.15.151:0/48513484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f259c0b4410 0x7f259c0c9b60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.317+0000 7f25a3765640 1 -- 172.21.15.151:0/48513484 >> 172.21.15.151:0/48513484 conn(0x7f259c071900 msgr2=0x7f259c1588a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:25.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.317+0000 7f25a3765640 1 -- 172.21.15.151:0/48513484 shutdown_connections 2023-10-16T14:25:25.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.317+0000 7f25a3765640 1 -- 172.21.15.151:0/48513484 wait complete. 2023-10-16T14:25:25.336 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new a6bfd0b1-f20b-4e88-acde-68c5c088b10b 2 2023-10-16T14:25:25.375 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:25.372+0000 7fcae1445040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-16T14:25:25.407 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:25.405+0000 7feb9b82f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T14:25:25.529 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.527+0000 7fa02d116640 1 Processor -- start 2023-10-16T14:25:25.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.527+0000 7fa02d116640 1 -- start start 2023-10-16T14:25:25.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.528+0000 7fa02d116640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa02815cbf0 0x7fa0280d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:25.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.528+0000 7fa02d116640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa02815cfd0 con 0x7fa0280b8400 2023-10-16T14:25:25.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.528+0000 7fa02d116640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0280d30b0 con 0x7fa0280b4410 2023-10-16T14:25:25.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.528+0000 7fa02d116640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0280d0dc0 con 0x7fa02815cbf0 2023-10-16T14:25:25.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.528+0000 7fa026d9d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa02815cbf0 0x7fa0280d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:25.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.529+0000 7fa026d9d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa02815cbf0 0x7fa0280d29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:33700/0 (socket says 172.21.15.151:33700) 2023-10-16T14:25:25.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.529+0000 7fa026d9d640 1 -- 172.21.15.151:0/2317789980 learned_addr learned my addr 172.21.15.151:0/2317789980 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-16T14:25:25.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.529+0000 7fa026d9d640 1 -- 172.21.15.151:0/2317789980 >> v1:172.21.15.151:6789/0 conn(0x7fa0280b4410 legacy=0x7fa0280b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:25.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.529+0000 7fa026d9d640 1 -- 172.21.15.151:0/2317789980 >> v1:172.21.15.59:6789/0 conn(0x7fa0280b8400 legacy=0x7fa0280d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:25.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.529+0000 7fa026d9d640 1 -- 172.21.15.151:0/2317789980 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0280d0700 con 0x7fa02815cbf0 2023-10-16T14:25:25.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.529+0000 7fa02659c640 1 -- 172.21.15.151:0/2317789980 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862995792 0 0) 0x7fa0280d30b0 con 0x7fa0280b4410 2023-10-16T14:25:25.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.530+0000 7fa026d9d640 1 --2- 172.21.15.151:0/2317789980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa02815cbf0 0x7fa0280d29d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa0180098a0 tx=0x7fa01802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3520c6d7a13a7a96 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:25.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.530+0000 7fa02659c640 1 -- 172.21.15.151:0/2317789980 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa018030840 con 0x7fa02815cbf0 2023-10-16T14:25:25.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.530+0000 7fa02659c640 1 -- 172.21.15.151:0/2317789980 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0180309a0 con 0x7fa02815cbf0 2023-10-16T14:25:25.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.530+0000 7fa02659c640 1 -- 172.21.15.151:0/2317789980 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa018030d30 con 0x7fa02815cbf0 2023-10-16T14:25:25.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.531+0000 7fa02d116640 1 -- 172.21.15.151:0/2317789980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa02815cbf0 msgr2=0x7fa0280d29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:25.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.531+0000 7fa02d116640 1 --2- 172.21.15.151:0/2317789980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa02815cbf0 0x7fa0280d29d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa0180098a0 tx=0x7fa01802b980 comp rx=0 tx=0).stop 2023-10-16T14:25:25.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.531+0000 7fa02d116640 1 -- 172.21.15.151:0/2317789980 shutdown_connections 2023-10-16T14:25:25.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.531+0000 7fa02d116640 1 --2- 172.21.15.151:0/2317789980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa02815cbf0 0x7fa0280d29d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.531+0000 7fa02d116640 1 -- 172.21.15.151:0/2317789980 >> 172.21.15.151:0/2317789980 conn(0x7fa028071900 msgr2=0x7fa028071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:25.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.531+0000 7fa02d116640 1 -- 172.21.15.151:0/2317789980 shutdown_connections 2023-10-16T14:25:25.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.531+0000 7fa02d116640 1 -- 172.21.15.151:0/2317789980 wait complete. 2023-10-16T14:25:25.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.533+0000 7fa02d116640 1 Processor -- start 2023-10-16T14:25:25.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.533+0000 7fa02d116640 1 -- start start 2023-10-16T14:25:25.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.534+0000 7fa02d116640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0280b4410 0x7fa02815d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:25.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.534+0000 7fa02d116640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0280b8400 0x7fa028148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:25.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.534+0000 7fa02d116640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa02815cbf0 0x7fa0280b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:25.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.534+0000 7fa02d116640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa028149370 con 0x7fa0280b8400 2023-10-16T14:25:25.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.534+0000 7fa02d116640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0280c68c0 con 0x7fa0280b4410 2023-10-16T14:25:25.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.534+0000 7fa02d116640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0280c6ba0 con 0x7fa02815cbf0 2023-10-16T14:25:25.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.534+0000 7fa026d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0280b4410 0x7fa02815d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:25.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.534+0000 7fa026d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0280b4410 0x7fa02815d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55020/0 (socket says 172.21.15.151:55020) 2023-10-16T14:25:25.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.534+0000 7fa026d9d640 1 -- 172.21.15.151:0/706699010 learned_addr learned my addr 172.21.15.151:0/706699010 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-16T14:25:25.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.534+0000 7fa02759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa02815cbf0 0x7fa0280b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:25.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.534+0000 7fa01ffff640 1 --2- 172.21.15.151:0/706699010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0280b8400 0x7fa028148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:25.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.535+0000 7fa026d9d640 1 -- 172.21.15.151:0/706699010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa02815cbf0 msgr2=0x7fa0280b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:25.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.535+0000 7fa026d9d640 1 --2- 172.21.15.151:0/706699010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa02815cbf0 0x7fa0280b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.535+0000 7fa026d9d640 1 -- 172.21.15.151:0/706699010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0280b8400 msgr2=0x7fa028148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:25.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.535+0000 7fa026d9d640 1 --2- 172.21.15.151:0/706699010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0280b8400 0x7fa028148710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.535+0000 7fa026d9d640 1 -- 172.21.15.151:0/706699010 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0180094d0 con 0x7fa0280b4410 2023-10-16T14:25:25.543 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.535+0000 7fa01ffff640 1 --2- 172.21.15.151:0/706699010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0280b8400 0x7fa028148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:25:25.543 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.535+0000 7fa02759e640 1 --2- 172.21.15.151:0/706699010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa02815cbf0 0x7fa0280b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:25:25.543 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.535+0000 7fa026d9d640 1 --2- 172.21.15.151:0/706699010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0280b4410 0x7fa02815d200 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa018000c00 tx=0x7fa0180046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:25.543 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.535+0000 7fa01f7fe640 1 -- 172.21.15.151:0/706699010 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01803e070 con 0x7fa0280b4410 2023-10-16T14:25:25.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.535+0000 7fa01f7fe640 1 -- 172.21.15.151:0/706699010 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0180398d0 con 0x7fa0280b4410 2023-10-16T14:25:25.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.535+0000 7fa01f7fe640 1 -- 172.21.15.151:0/706699010 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa018039c80 con 0x7fa0280b4410 2023-10-16T14:25:25.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.535+0000 7fa02d116640 1 -- 172.21.15.151:0/706699010 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0280c6e80 con 0x7fa0280b4410 2023-10-16T14:25:25.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.535+0000 7fa02d116640 1 -- 172.21.15.151:0/706699010 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0280c7440 con 0x7fa0280b4410 2023-10-16T14:25:25.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.536+0000 7fa01f7fe640 1 -- 172.21.15.151:0/706699010 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa018042070 con 0x7fa0280b4410 2023-10-16T14:25:25.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.536+0000 7fa01f7fe640 1 -- 172.21.15.151:0/706699010 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fa018044b40 con 0x7fa0280b4410 2023-10-16T14:25:25.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.536+0000 7fa02d116640 1 -- 172.21.15.151:0/706699010 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0280b8840 con 0x7fa0280b4410 2023-10-16T14:25:25.545 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:25.540+0000 7fcae1445040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-16T14:25:25.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.539+0000 7fa01f7fe640 1 -- 172.21.15.151:0/706699010 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa0280b8840 con 0x7fa0280b4410 2023-10-16T14:25:25.553 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:25.551+0000 7feb9b82f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T14:25:25.607 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:25.605+0000 7feb9b82f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T14:25:25.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.617+0000 7fa02d116640 1 -- 172.21.15.151:0/706699010 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a6bfd0b1-f20b-4e88-acde-68c5c088b10b", "id": 2} v 0) v1 -- 0x7fa028073ef0 con 0x7fa0280b4410 2023-10-16T14:25:25.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.623+0000 7fa01f7fe640 1 -- 172.21.15.151:0/706699010 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a6bfd0b1-f20b-4e88-acde-68c5c088b10b", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa018049070 con 0x7fa0280b4410 2023-10-16T14:25:25.627 INFO:teuthology.orchestra.run.smithi151.stdout:2 2023-10-16T14:25:25.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.624+0000 7fa02d116640 1 -- 172.21.15.151:0/706699010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0280b4410 msgr2=0x7fa02815d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:25.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.624+0000 7fa02d116640 1 --2- 172.21.15.151:0/706699010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0280b4410 0x7fa02815d200 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa018000c00 tx=0x7fa0180046c0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.624+0000 7fa02d116640 1 -- 172.21.15.151:0/706699010 shutdown_connections 2023-10-16T14:25:25.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.624+0000 7fa02d116640 1 --2- 172.21.15.151:0/706699010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa02815cbf0 0x7fa0280b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.625+0000 7fa02d116640 1 --2- 172.21.15.151:0/706699010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0280b8400 0x7fa028148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.625+0000 7fa02d116640 1 --2- 172.21.15.151:0/706699010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0280b4410 0x7fa02815d200 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.625+0000 7fa02d116640 1 -- 172.21.15.151:0/706699010 >> 172.21.15.151:0/706699010 conn(0x7fa028071900 msgr2=0x7fa0280d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:25.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.625+0000 7fa02d116640 1 -- 172.21.15.151:0/706699010 shutdown_connections 2023-10-16T14:25:25.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.625+0000 7fa02d116640 1 -- 172.21.15.151:0/706699010 wait complete. 2023-10-16T14:25:25.644 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new cb0fe00b-467a-4b4c-8387-8d5a27c0377e 3 2023-10-16T14:25:25.674 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:25.671+0000 7fcae1445040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-16T14:25:25.724 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:25.722+0000 7feb9b82f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T14:25:25.729 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:25.726+0000 7fcae1445040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-16T14:25:25.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.824+0000 7fb15e840640 1 Processor -- start 2023-10-16T14:25:25.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.824+0000 7fb15e840640 1 -- start start 2023-10-16T14:25:25.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.826+0000 7fb15e840640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb158161290 0x7fb15806adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:25.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.826+0000 7fb15e840640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb158161670 0x7fb15806b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:25.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.826+0000 7fb15e840640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb158065b50 con 0x7fb1580c9500 2023-10-16T14:25:25.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.827+0000 7fb15e840640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb158065e30 con 0x7fb158161670 2023-10-16T14:25:25.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.827+0000 7fb15e840640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1580cd6f0 con 0x7fb158161290 2023-10-16T14:25:25.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.827+0000 7fb157fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb158161290 0x7fb15806adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:25.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.827+0000 7fb157fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb158161290 0x7fb15806adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55036/0 (socket says 172.21.15.151:55036) 2023-10-16T14:25:25.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.827+0000 7fb157fff640 1 -- 172.21.15.151:0/226433070 learned_addr learned my addr 172.21.15.151:0/226433070 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-16T14:25:25.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.827+0000 7fb14ffff640 1 --2- 172.21.15.151:0/226433070 >> v2:172.21.15.59:3300/0 conn(0x7fb158161670 0x7fb15806b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:25.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.827+0000 7fb157fff640 1 -- 172.21.15.151:0/226433070 >> v2:172.21.15.59:3300/0 conn(0x7fb158161670 msgr2=0x7fb15806b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:25.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.827+0000 7fb157fff640 1 --2- 172.21.15.151:0/226433070 >> v2:172.21.15.59:3300/0 conn(0x7fb158161670 0x7fb15806b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.827+0000 7fb157fff640 1 -- 172.21.15.151:0/226433070 >> v1:172.21.15.59:6789/0 conn(0x7fb1580c9500 legacy=0x7fb1580c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:25.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.827+0000 7fb157fff640 1 -- 172.21.15.151:0/226433070 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1580cb1c0 con 0x7fb158161290 2023-10-16T14:25:25.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.827+0000 7fb14ffff640 1 --2- 172.21.15.151:0/226433070 >> v2:172.21.15.59:3300/0 conn(0x7fb158161670 0x7fb15806b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:25:25.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.828+0000 7fb157fff640 1 --2- 172.21.15.151:0/226433070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb158161290 0x7fb15806adf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb1580738d0 tx=0x7fb14802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93942782f90dd7ca server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:25.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.828+0000 7fb1577fe640 1 -- 172.21.15.151:0/226433070 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148031870 con 0x7fb158161290 2023-10-16T14:25:25.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.828+0000 7fb1577fe640 1 -- 172.21.15.151:0/226433070 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1480319d0 con 0x7fb158161290 2023-10-16T14:25:25.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.829+0000 7fb1577fe640 1 -- 172.21.15.151:0/226433070 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148031d60 con 0x7fb158161290 2023-10-16T14:25:25.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.829+0000 7fb15e840640 1 -- 172.21.15.151:0/226433070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb158161290 msgr2=0x7fb15806adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:25.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.829+0000 7fb15e840640 1 --2- 172.21.15.151:0/226433070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb158161290 0x7fb15806adf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb1580738d0 tx=0x7fb14802b910 comp rx=0 tx=0).stop 2023-10-16T14:25:25.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.829+0000 7fb15e840640 1 -- 172.21.15.151:0/226433070 shutdown_connections 2023-10-16T14:25:25.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.829+0000 7fb15e840640 1 --2- 172.21.15.151:0/226433070 >> v2:172.21.15.59:3300/0 conn(0x7fb158161670 0x7fb15806b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.829+0000 7fb15e840640 1 --2- 172.21.15.151:0/226433070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb158161290 0x7fb15806adf0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.829+0000 7fb15e840640 1 -- 172.21.15.151:0/226433070 >> 172.21.15.151:0/226433070 conn(0x7fb1580709f0 msgr2=0x7fb158070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:25.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.830+0000 7fb15e840640 1 -- 172.21.15.151:0/226433070 shutdown_connections 2023-10-16T14:25:25.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.830+0000 7fb15e840640 1 -- 172.21.15.151:0/226433070 wait complete. 2023-10-16T14:25:25.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.831+0000 7fb15e840640 1 Processor -- start 2023-10-16T14:25:25.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.831+0000 7fb15e840640 1 -- start start 2023-10-16T14:25:25.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.833+0000 7fb15e840640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1580c9500 0x7fb158151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:25.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.833+0000 7fb15e840640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb158161290 0x7fb1580b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:25.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.833+0000 7fb15e840640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb158161670 0x7fb1580c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:25.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.833+0000 7fb15e840640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1580c7900 con 0x7fb1580c9500 2023-10-16T14:25:25.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.833+0000 7fb15e840640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1581f2250 con 0x7fb158161290 2023-10-16T14:25:25.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.833+0000 7fb15e840640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1581f2460 con 0x7fb158161670 2023-10-16T14:25:25.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.833+0000 7fb14ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb158161290 0x7fb1580b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:25.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.833+0000 7fb15cddd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb158161670 0x7fb1580c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:25.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.833+0000 7fb14ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb158161290 0x7fb1580b23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55048/0 (socket says 172.21.15.151:55048) 2023-10-16T14:25:25.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.833+0000 7fb14ffff640 1 -- 172.21.15.151:0/3175872083 learned_addr learned my addr 172.21.15.151:0/3175872083 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-16T14:25:25.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.834+0000 7fb14ffff640 1 -- 172.21.15.151:0/3175872083 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb158161670 msgr2=0x7fb1580c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:25.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.834+0000 7fb14ffff640 1 --2- 172.21.15.151:0/3175872083 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb158161670 0x7fb1580c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.834+0000 7fb14ffff640 1 -- 172.21.15.151:0/3175872083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1580c9500 msgr2=0x7fb158151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:25.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.834+0000 7fb14ffff640 1 --2- 172.21.15.151:0/3175872083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1580c9500 0x7fb158151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.834+0000 7fb14ffff640 1 -- 172.21.15.151:0/3175872083 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1480094d0 con 0x7fb158161290 2023-10-16T14:25:25.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.834+0000 7fb14ffff640 1 --2- 172.21.15.151:0/3175872083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb158161290 0x7fb1580b23a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb14000c7f0 tx=0x7fb14000ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:25.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.834+0000 7fb1557fa640 1 -- 172.21.15.151:0/3175872083 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb140007820 con 0x7fb158161290 2023-10-16T14:25:25.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.834+0000 7fb1557fa640 1 -- 172.21.15.151:0/3175872083 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb140007980 con 0x7fb158161290 2023-10-16T14:25:25.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.834+0000 7fb1557fa640 1 -- 172.21.15.151:0/3175872083 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb140007cf0 con 0x7fb158161290 2023-10-16T14:25:25.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.834+0000 7fb15e840640 1 -- 172.21.15.151:0/3175872083 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1580b2e60 con 0x7fb158161290 2023-10-16T14:25:25.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.834+0000 7fb15e840640 1 -- 172.21.15.151:0/3175872083 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1581f29e0 con 0x7fb158161290 2023-10-16T14:25:25.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.835+0000 7fb1557fa640 1 -- 172.21.15.151:0/3175872083 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb14001a660 con 0x7fb158161290 2023-10-16T14:25:25.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.835+0000 7fb1557fa640 1 -- 172.21.15.151:0/3175872083 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fb140011a60 con 0x7fb158161290 2023-10-16T14:25:25.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.835+0000 7fb15e840640 1 -- 172.21.15.151:0/3175872083 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1580cd250 con 0x7fb158161290 2023-10-16T14:25:25.845 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:25.841+0000 7fcae1445040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-16T14:25:25.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.838+0000 7fb1557fa640 1 -- 172.21.15.151:0/3175872083 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fb140039b40 con 0x7fb158161290 2023-10-16T14:25:25.845 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:25.842+0000 7feb9b82f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T14:25:25.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.915+0000 7fb15e840640 1 -- 172.21.15.151:0/3175872083 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cb0fe00b-467a-4b4c-8387-8d5a27c0377e", "id": 3} v 0) v1 -- 0x7fb1581f3240 con 0x7fb158161290 2023-10-16T14:25:25.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.922+0000 7fb1557fa640 1 -- 172.21.15.151:0/3175872083 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cb0fe00b-467a-4b4c-8387-8d5a27c0377e", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb140028030 con 0x7fb158161290 2023-10-16T14:25:25.925 INFO:teuthology.orchestra.run.smithi151.stdout:3 2023-10-16T14:25:25.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.924+0000 7fb15e840640 1 -- 172.21.15.151:0/3175872083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb158161290 msgr2=0x7fb1580b23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:25.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.924+0000 7fb15e840640 1 --2- 172.21.15.151:0/3175872083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb158161290 0x7fb1580b23a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb14000c7f0 tx=0x7fb14000ccb0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.924+0000 7fb15e840640 1 -- 172.21.15.151:0/3175872083 shutdown_connections 2023-10-16T14:25:25.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.924+0000 7fb15e840640 1 --2- 172.21.15.151:0/3175872083 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb158161670 0x7fb1580c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.924+0000 7fb15e840640 1 --2- 172.21.15.151:0/3175872083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb158161290 0x7fb1580b23a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.924+0000 7fb15e840640 1 --2- 172.21.15.151:0/3175872083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1580c9500 0x7fb158151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:25.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.924+0000 7fb15e840640 1 -- 172.21.15.151:0/3175872083 >> 172.21.15.151:0/3175872083 conn(0x7fb1580709f0 msgr2=0x7fb158160560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:25.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.924+0000 7fb15e840640 1 -- 172.21.15.151:0/3175872083 shutdown_connections 2023-10-16T14:25:25.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:25.924+0000 7fb15e840640 1 -- 172.21.15.151:0/3175872083 wait complete. 2023-10-16T14:25:25.942 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new d18a92fc-8162-44ba-9199-d862e7fa99d9 4 2023-10-16T14:25:25.960 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:25.958+0000 7fcae1445040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-16T14:25:26.015 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:26.012+0000 7feb9b82f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T14:25:26.067 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:26.065+0000 7feb9b82f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T14:25:26.128 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:26.125+0000 7fcae1445040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-16T14:25:26.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.126+0000 7fde27fd7640 1 Processor -- start 2023-10-16T14:25:26.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.126+0000 7fde27fd7640 1 -- start start 2023-10-16T14:25:26.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.127+0000 7fde27fd7640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde200d30b0 0x7fde200cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:26.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.127+0000 7fde27fd7640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde200cdc70 con 0x7fde2015ca80 2023-10-16T14:25:26.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.127+0000 7fde27fd7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde200d0e80 con 0x7fde200cd890 2023-10-16T14:25:26.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.127+0000 7fde27fd7640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde200d1160 con 0x7fde200d30b0 2023-10-16T14:25:26.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.128+0000 7fde26574640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fde200cd890 0x7fde200b5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:52134/0 (socket says 172.21.15.151:52134) 2023-10-16T14:25:26.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.128+0000 7fde26574640 1 -- 172.21.15.151:0/2201410055 learned_addr learned my addr 172.21.15.151:0/2201410055 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-16T14:25:26.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.128+0000 7fde25572640 1 --2- 172.21.15.151:0/2201410055 >> v2:172.21.15.59:3300/0 conn(0x7fde200d30b0 0x7fde200cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:26.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.128+0000 7fde24d71640 1 -- 172.21.15.151:0/2201410055 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 170710566 0 0) 0x7fde200d0e80 con 0x7fde200cd890 2023-10-16T14:25:26.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.128+0000 7fde24d71640 1 -- 172.21.15.151:0/2201410055 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde0c003520 con 0x7fde200cd890 2023-10-16T14:25:26.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.128+0000 7fde24d71640 1 -- 172.21.15.151:0/2201410055 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4228579484 0 0) 0x7fde0c003520 con 0x7fde200cd890 2023-10-16T14:25:26.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.128+0000 7fde24d71640 1 -- 172.21.15.151:0/2201410055 >> v2:172.21.15.59:3300/0 conn(0x7fde200d30b0 msgr2=0x7fde200cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:26.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.128+0000 7fde24d71640 1 --2- 172.21.15.151:0/2201410055 >> v2:172.21.15.59:3300/0 conn(0x7fde200d30b0 0x7fde200cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.128+0000 7fde24d71640 1 -- 172.21.15.151:0/2201410055 >> v1:172.21.15.59:6789/0 conn(0x7fde2015ca80 legacy=0x7fde200d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:26.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.128+0000 7fde24d71640 1 -- 172.21.15.151:0/2201410055 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde200d1440 con 0x7fde200cd890 2023-10-16T14:25:26.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.128+0000 7fde24d71640 1 -- 172.21.15.151:0/2201410055 <== mon.1 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7fde180019f0 con 0x7fde200cd890 2023-10-16T14:25:26.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.128+0000 7fde24d71640 1 -- 172.21.15.151:0/2201410055 >> v1:172.21.15.151:6789/0 conn(0x7fde200cd890 legacy=0x7fde200b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:26.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.129+0000 7fde24d71640 1 --2- 172.21.15.151:0/2201410055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde0c003970 0x7fde0c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:26.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.129+0000 7fde24d71640 1 --2- 172.21.15.151:0/2201410055 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde0c0047c0 0x7fde0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:26.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.129+0000 7fde24d71640 1 --2- 172.21.15.151:0/2201410055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde0c005180 0x7fde0c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:26.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.129+0000 7fde24d71640 1 -- 172.21.15.151:0/2201410055 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde200d1160 con 0x7fde0c003970 2023-10-16T14:25:26.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.129+0000 7fde24d71640 1 -- 172.21.15.151:0/2201410055 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c00c020 con 0x7fde0c005180 2023-10-16T14:25:26.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.129+0000 7fde24d71640 1 -- 172.21.15.151:0/2201410055 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c00c1e0 con 0x7fde0c0047c0 2023-10-16T14:25:26.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.129+0000 7fde26574640 1 --2- 172.21.15.151:0/2201410055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde0c005180 0x7fde0c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:26.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.129+0000 7fde25572640 1 --2- 172.21.15.151:0/2201410055 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde0c0047c0 0x7fde0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:26.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.129+0000 7fde25d73640 1 --2- 172.21.15.151:0/2201410055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde0c003970 0x7fde0c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:26.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.129+0000 7fde26574640 1 -- 172.21.15.151:0/2201410055 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde0c0047c0 msgr2=0x7fde0c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:26.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.129+0000 7fde26574640 1 --2- 172.21.15.151:0/2201410055 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde0c0047c0 0x7fde0c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.129+0000 7fde26574640 1 -- 172.21.15.151:0/2201410055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde0c003970 msgr2=0x7fde0c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:26.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.129+0000 7fde26574640 1 --2- 172.21.15.151:0/2201410055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde0c003970 0x7fde0c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.129+0000 7fde26574640 1 -- 172.21.15.151:0/2201410055 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c003520 con 0x7fde0c005180 2023-10-16T14:25:26.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.130+0000 7fde26574640 1 -- 172.21.15.151:0/2201410055 reap_dead start 2023-10-16T14:25:26.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.130+0000 7fde26574640 1 --2- 172.21.15.151:0/2201410055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde0c005180 0x7fde0c00b980 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fde1800a830 tx=0x7fde0c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=828baf95373c5185 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:26.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.131+0000 7fde24d71640 1 -- 172.21.15.151:0/2201410055 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde180072d0 con 0x7fde0c005180 2023-10-16T14:25:26.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.131+0000 7fde24d71640 1 -- 172.21.15.151:0/2201410055 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1802f070 con 0x7fde0c005180 2023-10-16T14:25:26.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.131+0000 7fde24d71640 1 -- 172.21.15.151:0/2201410055 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde180076b0 con 0x7fde0c005180 2023-10-16T14:25:26.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.131+0000 7fde27fd7640 1 -- 172.21.15.151:0/2201410055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde0c005180 msgr2=0x7fde0c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:26.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.131+0000 7fde27fd7640 1 --2- 172.21.15.151:0/2201410055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde0c005180 0x7fde0c00b980 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fde1800a830 tx=0x7fde0c0057f0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.131+0000 7fde27fd7640 1 -- 172.21.15.151:0/2201410055 shutdown_connections 2023-10-16T14:25:26.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.131+0000 7fde27fd7640 1 --2- 172.21.15.151:0/2201410055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde0c005180 0x7fde0c00b980 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.131+0000 7fde27fd7640 1 -- 172.21.15.151:0/2201410055 >> 172.21.15.151:0/2201410055 conn(0x7fde20071900 msgr2=0x7fde20071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:26.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.131+0000 7fde27fd7640 1 -- 172.21.15.151:0/2201410055 shutdown_connections 2023-10-16T14:25:26.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.131+0000 7fde27fd7640 1 -- 172.21.15.151:0/2201410055 wait complete. 2023-10-16T14:25:26.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.133+0000 7fde27fd7640 1 Processor -- start 2023-10-16T14:25:26.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.133+0000 7fde27fd7640 1 -- start start 2023-10-16T14:25:26.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.134+0000 7fde27fd7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde0c005180 0x7fde20148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:26.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.134+0000 7fde27fd7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde200c9aa0 0x7fde200b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:26.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.134+0000 7fde27fd7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde20147b00 0x7fde2015f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:26.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.134+0000 7fde27fd7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde200b5300 con 0x7fde0c005180 2023-10-16T14:25:26.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.134+0000 7fde27fd7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2014ae90 con 0x7fde200c9aa0 2023-10-16T14:25:26.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.134+0000 7fde27fd7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2014b170 con 0x7fde20147b00 2023-10-16T14:25:26.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.134+0000 7fde25572640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde200c9aa0 0x7fde200b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:26.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.134+0000 7fde26574640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde20147b00 0x7fde2015f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:26.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.134+0000 7fde25572640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde200c9aa0 0x7fde200b4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55072/0 (socket says 172.21.15.151:55072) 2023-10-16T14:25:26.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.134+0000 7fde26574640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde20147b00 0x7fde2015f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:33736/0 (socket says 172.21.15.151:33736) 2023-10-16T14:25:26.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.134+0000 7fde25572640 1 -- 172.21.15.151:0/1293694753 learned_addr learned my addr 172.21.15.151:0/1293694753 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-16T14:25:26.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.135+0000 7fde25d73640 1 --2- 172.21.15.151:0/1293694753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde0c005180 0x7fde20148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:26.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.135+0000 7fde25572640 1 -- 172.21.15.151:0/1293694753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde20147b00 msgr2=0x7fde2015f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:26.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.135+0000 7fde25572640 1 --2- 172.21.15.151:0/1293694753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde20147b00 0x7fde2015f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.135+0000 7fde25572640 1 -- 172.21.15.151:0/1293694753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde0c005180 msgr2=0x7fde20148350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:26.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.135+0000 7fde25572640 1 --2- 172.21.15.151:0/1293694753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde0c005180 0x7fde20148350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.135+0000 7fde25572640 1 -- 172.21.15.151:0/1293694753 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde200cb400 con 0x7fde200c9aa0 2023-10-16T14:25:26.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.135+0000 7fde25d73640 1 --2- 172.21.15.151:0/1293694753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde0c005180 0x7fde20148350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:25:26.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.135+0000 7fde26574640 1 --2- 172.21.15.151:0/1293694753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde20147b00 0x7fde2015f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:25:26.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.135+0000 7fde25572640 1 --2- 172.21.15.151:0/1293694753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde200c9aa0 0x7fde200b4dc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fde100118e0 tx=0x7fde10011da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:26.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.135+0000 7fde167fc640 1 -- 172.21.15.151:0/1293694753 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1000faf0 con 0x7fde200c9aa0 2023-10-16T14:25:26.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.135+0000 7fde167fc640 1 -- 172.21.15.151:0/1293694753 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1000fc50 con 0x7fde200c9aa0 2023-10-16T14:25:26.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.135+0000 7fde27fd7640 1 -- 172.21.15.151:0/1293694753 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde200cb6e0 con 0x7fde200c9aa0 2023-10-16T14:25:26.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.135+0000 7fde167fc640 1 -- 172.21.15.151:0/1293694753 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde10014440 con 0x7fde200c9aa0 2023-10-16T14:25:26.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.135+0000 7fde27fd7640 1 -- 172.21.15.151:0/1293694753 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde200c9f20 con 0x7fde200c9aa0 2023-10-16T14:25:26.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.136+0000 7fde167fc640 1 -- 172.21.15.151:0/1293694753 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fde100148a0 con 0x7fde200c9aa0 2023-10-16T14:25:26.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.136+0000 7fde167fc640 1 -- 172.21.15.151:0/1293694753 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fde1001d400 con 0x7fde200c9aa0 2023-10-16T14:25:26.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.137+0000 7fde27fd7640 1 -- 172.21.15.151:0/1293694753 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde20067180 con 0x7fde200c9aa0 2023-10-16T14:25:26.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.139+0000 7fde167fc640 1 -- 172.21.15.151:0/1293694753 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fde1001d860 con 0x7fde200c9aa0 2023-10-16T14:25:26.180 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:26.177+0000 7fcae1445040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-16T14:25:26.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.216+0000 7fde27fd7640 1 -- 172.21.15.151:0/1293694753 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d18a92fc-8162-44ba-9199-d862e7fa99d9", "id": 4} v 0) v1 -- 0x7fde20160160 con 0x7fde200c9aa0 2023-10-16T14:25:26.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.223+0000 7fde167fc640 1 -- 172.21.15.151:0/1293694753 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d18a92fc-8162-44ba-9199-d862e7fa99d9", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fde10014bb0 con 0x7fde200c9aa0 2023-10-16T14:25:26.226 INFO:teuthology.orchestra.run.smithi151.stdout:4 2023-10-16T14:25:26.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.224+0000 7fde27fd7640 1 -- 172.21.15.151:0/1293694753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde200c9aa0 msgr2=0x7fde200b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:26.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.224+0000 7fde27fd7640 1 --2- 172.21.15.151:0/1293694753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde200c9aa0 0x7fde200b4dc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fde100118e0 tx=0x7fde10011da0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.224+0000 7fde27fd7640 1 -- 172.21.15.151:0/1293694753 shutdown_connections 2023-10-16T14:25:26.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.224+0000 7fde27fd7640 1 --2- 172.21.15.151:0/1293694753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde20147b00 0x7fde2015f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.224+0000 7fde27fd7640 1 --2- 172.21.15.151:0/1293694753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde200c9aa0 0x7fde200b4dc0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.224+0000 7fde27fd7640 1 --2- 172.21.15.151:0/1293694753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde0c005180 0x7fde20148350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.224+0000 7fde27fd7640 1 -- 172.21.15.151:0/1293694753 >> 172.21.15.151:0/1293694753 conn(0x7fde20071900 msgr2=0x7fde200b7280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:26.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.224+0000 7fde27fd7640 1 -- 172.21.15.151:0/1293694753 shutdown_connections 2023-10-16T14:25:26.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.224+0000 7fde27fd7640 1 -- 172.21.15.151:0/1293694753 wait complete. 2023-10-16T14:25:26.234 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:26.232+0000 7feb9b82f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T14:25:26.242 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new b0bbab42-0435-48b3-bc04-b16fdcfe05f4 5 2023-10-16T14:25:26.346 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:26.343+0000 7fcae1445040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-16T14:25:26.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.433+0000 7ff690f75640 1 Processor -- start 2023-10-16T14:25:26.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.433+0000 7ff690f75640 1 -- start start 2023-10-16T14:25:26.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.434+0000 7ff690f75640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff68c0d0d80 0x7ff68c0d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:26.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.434+0000 7ff690f75640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff68c0b5fd0 0x7ff68c0b6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:26.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.434+0000 7ff690f75640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff68c0ce810 con 0x7ff68c15c940 2023-10-16T14:25:26.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.434+0000 7ff690f75640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff68c0d1740 con 0x7ff68c0b5fd0 2023-10-16T14:25:26.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.434+0000 7ff690f75640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c0b5b40 con 0x7ff68c0d0d80 2023-10-16T14:25:26.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.435+0000 7ff683fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff68c0d0d80 0x7ff68c0d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:26.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.435+0000 7ff68bfff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff68c0b5fd0 0x7ff68c0b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:26.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.435+0000 7ff683fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff68c0d0d80 0x7ff68c0d1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:33750/0 (socket says 172.21.15.151:33750) 2023-10-16T14:25:26.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.435+0000 7ff683fff640 1 -- 172.21.15.151:0/2039412141 learned_addr learned my addr 172.21.15.151:0/2039412141 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-16T14:25:26.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.435+0000 7ff68bfff640 1 -- 172.21.15.151:0/2039412141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff68c0d0d80 msgr2=0x7ff68c0d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:26.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.435+0000 7ff68bfff640 1 --2- 172.21.15.151:0/2039412141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff68c0d0d80 0x7ff68c0d1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.435+0000 7ff68bfff640 1 -- 172.21.15.151:0/2039412141 >> v1:172.21.15.59:6789/0 conn(0x7ff68c15c940 legacy=0x7ff68c0d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:26.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.435+0000 7ff68bfff640 1 -- 172.21.15.151:0/2039412141 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68c0d0b10 con 0x7ff68c0b5fd0 2023-10-16T14:25:26.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.435+0000 7ff683fff640 1 --2- 172.21.15.151:0/2039412141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff68c0d0d80 0x7ff68c0d1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:25:26.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.437+0000 7ff68bfff640 1 --2- 172.21.15.151:0/2039412141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff68c0b5fd0 0x7ff68c0b6460 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff684009d90 tx=0x7ff68402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c588794b6f880d6f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:26.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.437+0000 7ff68affd640 1 -- 172.21.15.151:0/2039412141 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68402cbc0 con 0x7ff68c0b5fd0 2023-10-16T14:25:26.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.437+0000 7ff68affd640 1 -- 172.21.15.151:0/2039412141 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68402cd20 con 0x7ff68c0b5fd0 2023-10-16T14:25:26.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.437+0000 7ff68affd640 1 -- 172.21.15.151:0/2039412141 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684034660 con 0x7ff68c0b5fd0 2023-10-16T14:25:26.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.438+0000 7ff690f75640 1 -- 172.21.15.151:0/2039412141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff68c0b5fd0 msgr2=0x7ff68c0b6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:26.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.438+0000 7ff690f75640 1 --2- 172.21.15.151:0/2039412141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff68c0b5fd0 0x7ff68c0b6460 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff684009d90 tx=0x7ff68402be10 comp rx=0 tx=0).stop 2023-10-16T14:25:26.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.438+0000 7ff690f75640 1 -- 172.21.15.151:0/2039412141 shutdown_connections 2023-10-16T14:25:26.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.438+0000 7ff690f75640 1 --2- 172.21.15.151:0/2039412141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff68c0b5fd0 0x7ff68c0b6460 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.438+0000 7ff690f75640 1 --2- 172.21.15.151:0/2039412141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff68c0d0d80 0x7ff68c0d1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.438+0000 7ff690f75640 1 -- 172.21.15.151:0/2039412141 >> 172.21.15.151:0/2039412141 conn(0x7ff68c09bb30 msgr2=0x7ff68c0d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:26.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.438+0000 7ff690f75640 1 -- 172.21.15.151:0/2039412141 shutdown_connections 2023-10-16T14:25:26.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.438+0000 7ff690f75640 1 -- 172.21.15.151:0/2039412141 wait complete. 2023-10-16T14:25:26.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.440+0000 7ff690f75640 1 Processor -- start 2023-10-16T14:25:26.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.440+0000 7ff690f75640 1 -- start start 2023-10-16T14:25:26.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.441+0000 7ff690f75640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff68c0b5fd0 0x7ff68c0cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:26.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.441+0000 7ff690f75640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff68c0d0d80 0x7ff68c158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:26.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.441+0000 7ff690f75640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff68c15c940 0x7ff68c158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:26.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.441+0000 7ff690f75640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c0cbe80 con 0x7ff68c0d0d80 2023-10-16T14:25:26.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.441+0000 7ff690f75640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c0ca2a0 con 0x7ff68c0b5fd0 2023-10-16T14:25:26.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.441+0000 7ff690f75640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68c0cb280 con 0x7ff68c15c940 2023-10-16T14:25:26.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.441+0000 7ff68b7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff68c0b5fd0 0x7ff68c0cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:26.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.441+0000 7ff68bfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff68c15c940 0x7ff68c158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:26.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.441+0000 7ff68b7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff68c0b5fd0 0x7ff68c0cad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55092/0 (socket says 172.21.15.151:55092) 2023-10-16T14:25:26.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.441+0000 7ff68b7fe640 1 -- 172.21.15.151:0/2861982193 learned_addr learned my addr 172.21.15.151:0/2861982193 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-16T14:25:26.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.441+0000 7ff683fff640 1 --2- 172.21.15.151:0/2861982193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff68c0d0d80 0x7ff68c158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:26.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.441+0000 7ff68bfff640 1 -- 172.21.15.151:0/2861982193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff68c0b5fd0 msgr2=0x7ff68c0cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:26.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.441+0000 7ff68bfff640 1 --2- 172.21.15.151:0/2861982193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff68c0b5fd0 0x7ff68c0cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.441+0000 7ff68bfff640 1 -- 172.21.15.151:0/2861982193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff68c0d0d80 msgr2=0x7ff68c158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:26.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.441+0000 7ff68bfff640 1 --2- 172.21.15.151:0/2861982193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff68c0d0d80 0x7ff68c158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.441+0000 7ff68bfff640 1 -- 172.21.15.151:0/2861982193 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6740094d0 con 0x7ff68c15c940 2023-10-16T14:25:26.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.442+0000 7ff68b7fe640 1 --2- 172.21.15.151:0/2861982193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff68c0b5fd0 0x7ff68c0cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:25:26.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.442+0000 7ff683fff640 1 --2- 172.21.15.151:0/2861982193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff68c0d0d80 0x7ff68c158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:25:26.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.442+0000 7ff68bfff640 1 --2- 172.21.15.151:0/2861982193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff68c15c940 0x7ff68c158860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff684033000 tx=0x7ff684004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:26.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.442+0000 7ff688ff9640 1 -- 172.21.15.151:0/2861982193 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684040650 con 0x7ff68c15c940 2023-10-16T14:25:26.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.442+0000 7ff688ff9640 1 -- 172.21.15.151:0/2861982193 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68402ce90 con 0x7ff68c15c940 2023-10-16T14:25:26.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.442+0000 7ff690f75640 1 -- 172.21.15.151:0/2861982193 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff684009a70 con 0x7ff68c15c940 2023-10-16T14:25:26.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.442+0000 7ff688ff9640 1 -- 172.21.15.151:0/2861982193 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684040a30 con 0x7ff68c15c940 2023-10-16T14:25:26.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.442+0000 7ff690f75640 1 -- 172.21.15.151:0/2861982193 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff68c15e1b0 con 0x7ff68c15c940 2023-10-16T14:25:26.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.443+0000 7ff688ff9640 1 -- 172.21.15.151:0/2861982193 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff684049400 con 0x7ff68c15c940 2023-10-16T14:25:26.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.443+0000 7ff688ff9640 1 -- 172.21.15.151:0/2861982193 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7ff68403e980 con 0x7ff68c15c940 2023-10-16T14:25:26.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.443+0000 7ff690f75640 1 -- 172.21.15.151:0/2861982193 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff68c04e9b0 con 0x7ff68c15c940 2023-10-16T14:25:26.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.446+0000 7ff688ff9640 1 -- 172.21.15.151:0/2861982193 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7ff684044020 con 0x7ff68c15c940 2023-10-16T14:25:26.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.523+0000 7ff690f75640 1 -- 172.21.15.151:0/2861982193 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b0bbab42-0435-48b3-bc04-b16fdcfe05f4", "id": 5} v 0) v1 -- 0x7ff68c0a04e0 con 0x7ff68c15c940 2023-10-16T14:25:26.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.531+0000 7ff688ff9640 1 -- 172.21.15.151:0/2861982193 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b0bbab42-0435-48b3-bc04-b16fdcfe05f4", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff684039070 con 0x7ff68c15c940 2023-10-16T14:25:26.534 INFO:teuthology.orchestra.run.smithi151.stdout:5 2023-10-16T14:25:26.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.533+0000 7ff690f75640 1 -- 172.21.15.151:0/2861982193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff68c15c940 msgr2=0x7ff68c158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:26.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.533+0000 7ff690f75640 1 --2- 172.21.15.151:0/2861982193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff68c15c940 0x7ff68c158860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff684033000 tx=0x7ff684004a40 comp rx=0 tx=0).stop 2023-10-16T14:25:26.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.533+0000 7ff690f75640 1 -- 172.21.15.151:0/2861982193 shutdown_connections 2023-10-16T14:25:26.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.533+0000 7ff690f75640 1 --2- 172.21.15.151:0/2861982193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff68c15c940 0x7ff68c158860 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.533+0000 7ff690f75640 1 --2- 172.21.15.151:0/2861982193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff68c0d0d80 0x7ff68c158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.533+0000 7ff690f75640 1 --2- 172.21.15.151:0/2861982193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff68c0b5fd0 0x7ff68c0cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.533+0000 7ff690f75640 1 -- 172.21.15.151:0/2861982193 >> 172.21.15.151:0/2861982193 conn(0x7ff68c09bb30 msgr2=0x7ff68c0c80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:26.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.533+0000 7ff690f75640 1 -- 172.21.15.151:0/2861982193 shutdown_connections 2023-10-16T14:25:26.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.533+0000 7ff690f75640 1 -- 172.21.15.151:0/2861982193 wait complete. 2023-10-16T14:25:26.552 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new a8d8fd95-461a-4e77-8c7c-fab5630fe973 6 2023-10-16T14:25:26.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.744+0000 7fbb6758a640 1 Processor -- start 2023-10-16T14:25:26.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.744+0000 7fbb6758a640 1 -- start start 2023-10-16T14:25:26.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.746+0000 7fbb6758a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbb60159890 0x7fbb60071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:26.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.746+0000 7fbb6758a640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb600ca110 0x7fbb600ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:26.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.746+0000 7fbb6758a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb6015d3f0 0x7fbb6015d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:26.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.746+0000 7fbb6758a640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb600caae0 con 0x7fbb600ca110 2023-10-16T14:25:26.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.746+0000 7fbb6758a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb60072480 con 0x7fbb60159890 2023-10-16T14:25:26.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.746+0000 7fbb6758a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb600cd0c0 con 0x7fbb6015d3f0 2023-10-16T14:25:26.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.746+0000 7fbb65326640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbb60159890 0x7fbb60071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:26.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.746+0000 7fbb65326640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbb60159890 0x7fbb60071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55094/0 (socket says 172.21.15.151:55094) 2023-10-16T14:25:26.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.746+0000 7fbb65326640 1 -- 172.21.15.151:0/1012967291 learned_addr learned my addr 172.21.15.151:0/1012967291 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-16T14:25:26.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.746+0000 7fbb65b27640 1 --2- 172.21.15.151:0/1012967291 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb6015d3f0 0x7fbb6015d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:26.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.746+0000 7fbb64b25640 1 --2- 172.21.15.151:0/1012967291 >> v2:172.21.15.59:3300/0 conn(0x7fbb600ca110 0x7fbb600ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:26.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.746+0000 7fbb65326640 1 -- 172.21.15.151:0/1012967291 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb6015d3f0 msgr2=0x7fbb6015d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:26.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.746+0000 7fbb65326640 1 --2- 172.21.15.151:0/1012967291 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb6015d3f0 0x7fbb6015d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.746+0000 7fbb65326640 1 -- 172.21.15.151:0/1012967291 >> v2:172.21.15.59:3300/0 conn(0x7fbb600ca110 msgr2=0x7fbb600ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:26.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.746+0000 7fbb65326640 1 --2- 172.21.15.151:0/1012967291 >> v2:172.21.15.59:3300/0 conn(0x7fbb600ca110 0x7fbb600ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.746+0000 7fbb65326640 1 -- 172.21.15.151:0/1012967291 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb600cc540 con 0x7fbb60159890 2023-10-16T14:25:26.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.747+0000 7fbb65326640 1 --2- 172.21.15.151:0/1012967291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb60159890 0x7fbb60071f40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbb6006e450 tx=0x7fbb5c02e0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cdc4542ef202dc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:26.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.748+0000 7fbb57fff640 1 -- 172.21.15.151:0/1012967291 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c02ee80 con 0x7fbb60159890 2023-10-16T14:25:26.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.748+0000 7fbb57fff640 1 -- 172.21.15.151:0/1012967291 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5c036440 con 0x7fbb60159890 2023-10-16T14:25:26.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.748+0000 7fbb57fff640 1 -- 172.21.15.151:0/1012967291 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c0367b0 con 0x7fbb60159890 2023-10-16T14:25:26.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.749+0000 7fbb6758a640 1 -- 172.21.15.151:0/1012967291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb60159890 msgr2=0x7fbb60071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:26.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.749+0000 7fbb6758a640 1 --2- 172.21.15.151:0/1012967291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb60159890 0x7fbb60071f40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbb6006e450 tx=0x7fbb5c02e0d0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.749+0000 7fbb6758a640 1 -- 172.21.15.151:0/1012967291 shutdown_connections 2023-10-16T14:25:26.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.749+0000 7fbb6758a640 1 --2- 172.21.15.151:0/1012967291 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb6015d3f0 0x7fbb6015d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.749+0000 7fbb6758a640 1 --2- 172.21.15.151:0/1012967291 >> v2:172.21.15.59:3300/0 conn(0x7fbb600ca110 0x7fbb600ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.749+0000 7fbb6758a640 1 --2- 172.21.15.151:0/1012967291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb60159890 0x7fbb60071f40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.749+0000 7fbb6758a640 1 -- 172.21.15.151:0/1012967291 >> 172.21.15.151:0/1012967291 conn(0x7fbb600b0030 msgr2=0x7fbb600b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:26.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.749+0000 7fbb6758a640 1 -- 172.21.15.151:0/1012967291 shutdown_connections 2023-10-16T14:25:26.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.749+0000 7fbb6758a640 1 -- 172.21.15.151:0/1012967291 wait complete. 2023-10-16T14:25:26.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.751+0000 7fbb6758a640 1 Processor -- start 2023-10-16T14:25:26.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.751+0000 7fbb6758a640 1 -- start start 2023-10-16T14:25:26.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.752+0000 7fbb6758a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb600ca110 0x7fbb6014ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:26.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.752+0000 7fbb6758a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb60159890 0x7fbb60158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:26.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.752+0000 7fbb6758a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb6015d3f0 0x7fbb60158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:26.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.752+0000 7fbb6758a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb600c7290 con 0x7fbb600ca110 2023-10-16T14:25:26.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.752+0000 7fbb6758a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb600c66c0 con 0x7fbb6015d3f0 2023-10-16T14:25:26.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.752+0000 7fbb6758a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb600c6960 con 0x7fbb60159890 2023-10-16T14:25:26.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.752+0000 7fbb65b27640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb6015d3f0 0x7fbb60158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:26.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.752+0000 7fbb64b25640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb60159890 0x7fbb60158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:26.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.752+0000 7fbb65b27640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb6015d3f0 0x7fbb60158b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55104/0 (socket says 172.21.15.151:55104) 2023-10-16T14:25:26.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.752+0000 7fbb65b27640 1 -- 172.21.15.151:0/1574173722 learned_addr learned my addr 172.21.15.151:0/1574173722 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-16T14:25:26.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.752+0000 7fbb65326640 1 --2- 172.21.15.151:0/1574173722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb600ca110 0x7fbb6014ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:26.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.752+0000 7fbb65b27640 1 -- 172.21.15.151:0/1574173722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb60159890 msgr2=0x7fbb60158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:26.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.752+0000 7fbb65b27640 1 --2- 172.21.15.151:0/1574173722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb60159890 0x7fbb60158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.752+0000 7fbb65b27640 1 -- 172.21.15.151:0/1574173722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb600ca110 msgr2=0x7fbb6014ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:26.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.752+0000 7fbb65b27640 1 --2- 172.21.15.151:0/1574173722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb600ca110 0x7fbb6014ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.752+0000 7fbb65b27640 1 -- 172.21.15.151:0/1574173722 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5c00b770 con 0x7fbb6015d3f0 2023-10-16T14:25:26.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.752+0000 7fbb65326640 1 --2- 172.21.15.151:0/1574173722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb600ca110 0x7fbb6014ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:25:26.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.753+0000 7fbb65b27640 1 --2- 172.21.15.151:0/1574173722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb6015d3f0 0x7fbb60158b70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800efc0 tx=0x7fbb5800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:26.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.753+0000 7fbb55ffb640 1 -- 172.21.15.151:0/1574173722 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58014480 con 0x7fbb6015d3f0 2023-10-16T14:25:26.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.753+0000 7fbb55ffb640 1 -- 172.21.15.151:0/1574173722 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5800f040 con 0x7fbb6015d3f0 2023-10-16T14:25:26.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.753+0000 7fbb55ffb640 1 -- 172.21.15.151:0/1574173722 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58014820 con 0x7fbb6015d3f0 2023-10-16T14:25:26.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.753+0000 7fbb6758a640 1 -- 172.21.15.151:0/1574173722 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb600c6c40 con 0x7fbb6015d3f0 2023-10-16T14:25:26.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.753+0000 7fbb6758a640 1 -- 172.21.15.151:0/1574173722 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6014bfb0 con 0x7fbb6015d3f0 2023-10-16T14:25:26.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.753+0000 7fbb55ffb640 1 -- 172.21.15.151:0/1574173722 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbb58014c80 con 0x7fbb6015d3f0 2023-10-16T14:25:26.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.754+0000 7fbb55ffb640 1 -- 172.21.15.151:0/1574173722 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fbb580133e0 con 0x7fbb6015d3f0 2023-10-16T14:25:26.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.754+0000 7fbb6758a640 1 -- 172.21.15.151:0/1574173722 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb600c7440 con 0x7fbb6015d3f0 2023-10-16T14:25:26.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.756+0000 7fbb55ffb640 1 -- 172.21.15.151:0/1574173722 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fbb600c7440 con 0x7fbb6015d3f0 2023-10-16T14:25:26.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.835+0000 7fbb6758a640 1 -- 172.21.15.151:0/1574173722 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a8d8fd95-461a-4e77-8c7c-fab5630fe973", "id": 6} v 0) v1 -- 0x7fbb60073ef0 con 0x7fbb6015d3f0 2023-10-16T14:25:26.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.841+0000 7fbb55ffb640 1 -- 172.21.15.151:0/1574173722 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a8d8fd95-461a-4e77-8c7c-fab5630fe973", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbb58018020 con 0x7fbb6015d3f0 2023-10-16T14:25:26.844 INFO:teuthology.orchestra.run.smithi151.stdout:6 2023-10-16T14:25:26.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.842+0000 7fbb6758a640 1 -- 172.21.15.151:0/1574173722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb6015d3f0 msgr2=0x7fbb60158b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:26.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.842+0000 7fbb6758a640 1 --2- 172.21.15.151:0/1574173722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb6015d3f0 0x7fbb60158b70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800efc0 tx=0x7fbb5800c490 comp rx=0 tx=0).stop 2023-10-16T14:25:26.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.842+0000 7fbb6758a640 1 -- 172.21.15.151:0/1574173722 shutdown_connections 2023-10-16T14:25:26.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.842+0000 7fbb6758a640 1 --2- 172.21.15.151:0/1574173722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb6015d3f0 0x7fbb60158b70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.842+0000 7fbb6758a640 1 --2- 172.21.15.151:0/1574173722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb60159890 0x7fbb60158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.842+0000 7fbb6758a640 1 --2- 172.21.15.151:0/1574173722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb600ca110 0x7fbb6014ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:26.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.842+0000 7fbb6758a640 1 -- 172.21.15.151:0/1574173722 >> 172.21.15.151:0/1574173722 conn(0x7fbb600b0030 msgr2=0x7fbb600cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:26.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.843+0000 7fbb6758a640 1 -- 172.21.15.151:0/1574173722 shutdown_connections 2023-10-16T14:25:26.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:26.843+0000 7fbb6758a640 1 -- 172.21.15.151:0/1574173722 wait complete. 2023-10-16T14:25:26.861 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 08a304fa-295c-480a-bb67-9e263e07760b 7 2023-10-16T14:25:27.050 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.047+0000 7fba6cb4c640 1 Processor -- start 2023-10-16T14:25:27.050 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.047+0000 7fba6cb4c640 1 -- start start 2023-10-16T14:25:27.052 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.048+0000 7fba6cb4c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fba6815cbf0 0x7fba680d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:27.052 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.048+0000 7fba6cb4c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba680b8400 0x7fba680d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:27.052 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.049+0000 7fba6cb4c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fba680b4410 0x7fba680b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:27.052 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.049+0000 7fba6cb4c640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba680d0dc0 con 0x7fba6815cbf0 2023-10-16T14:25:27.052 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.049+0000 7fba6cb4c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba680b4dc0 con 0x7fba680b4410 2023-10-16T14:25:27.053 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.049+0000 7fba6cb4c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6815cfd0 con 0x7fba680b8400 2023-10-16T14:25:27.053 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.049+0000 7fba65d9b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba680b8400 0x7fba680d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:27.053 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.049+0000 7fba66d9d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fba680b4410 0x7fba680b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:27.053 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.049+0000 7fba65d9b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba680b8400 0x7fba680d11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:33774/0 (socket says 172.21.15.151:33774) 2023-10-16T14:25:27.053 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.049+0000 7fba65d9b640 1 -- 172.21.15.151:0/4202120247 learned_addr learned my addr 172.21.15.151:0/4202120247 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-16T14:25:27.054 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.049+0000 7fba6659c640 1 --2- 172.21.15.151:0/4202120247 >> v2:172.21.15.59:3300/0 conn(0x7fba6815cbf0 0x7fba680d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:27.054 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.049+0000 7fba65d9b640 1 -- 172.21.15.151:0/4202120247 >> v2:172.21.15.151:3300/0 conn(0x7fba680b4410 msgr2=0x7fba680b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:27.054 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.049+0000 7fba65d9b640 1 --2- 172.21.15.151:0/4202120247 >> v2:172.21.15.151:3300/0 conn(0x7fba680b4410 0x7fba680b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:27.054 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.049+0000 7fba65d9b640 1 -- 172.21.15.151:0/4202120247 >> v2:172.21.15.59:3300/0 conn(0x7fba6815cbf0 msgr2=0x7fba680d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:27.054 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.049+0000 7fba65d9b640 1 --2- 172.21.15.151:0/4202120247 >> v2:172.21.15.59:3300/0 conn(0x7fba6815cbf0 0x7fba680d29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:27.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.049+0000 7fba65d9b640 1 -- 172.21.15.151:0/4202120247 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba680d30b0 con 0x7fba680b8400 2023-10-16T14:25:27.056 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.050+0000 7fba65d9b640 1 --2- 172.21.15.151:0/4202120247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba680b8400 0x7fba680d11e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fba680cf3a0 tx=0x7fba5c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=320a2a4b2a95514e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:27.056 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.051+0000 7fba6559a640 1 -- 172.21.15.151:0/4202120247 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c031640 con 0x7fba680b8400 2023-10-16T14:25:27.056 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.051+0000 7fba6559a640 1 -- 172.21.15.151:0/4202120247 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c0317a0 con 0x7fba680b8400 2023-10-16T14:25:27.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.051+0000 7fba6559a640 1 -- 172.21.15.151:0/4202120247 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c031b30 con 0x7fba680b8400 2023-10-16T14:25:27.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.051+0000 7fba6cb4c640 1 -- 172.21.15.151:0/4202120247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba680b8400 msgr2=0x7fba680d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:27.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.051+0000 7fba6cb4c640 1 --2- 172.21.15.151:0/4202120247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba680b8400 0x7fba680d11e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fba680cf3a0 tx=0x7fba5c02b8f0 comp rx=0 tx=0).stop 2023-10-16T14:25:27.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.052+0000 7fba6cb4c640 1 -- 172.21.15.151:0/4202120247 shutdown_connections 2023-10-16T14:25:27.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.052+0000 7fba6cb4c640 1 --2- 172.21.15.151:0/4202120247 >> v2:172.21.15.151:3300/0 conn(0x7fba680b4410 0x7fba680b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:27.058 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.052+0000 7fba6cb4c640 1 --2- 172.21.15.151:0/4202120247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba680b8400 0x7fba680d11e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:27.058 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.052+0000 7fba6cb4c640 1 --2- 172.21.15.151:0/4202120247 >> v2:172.21.15.59:3300/0 conn(0x7fba6815cbf0 0x7fba680d29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:27.058 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.052+0000 7fba6cb4c640 1 -- 172.21.15.151:0/4202120247 >> 172.21.15.151:0/4202120247 conn(0x7fba68071900 msgr2=0x7fba68071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:27.058 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.052+0000 7fba6cb4c640 1 -- 172.21.15.151:0/4202120247 shutdown_connections 2023-10-16T14:25:27.059 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.052+0000 7fba6cb4c640 1 -- 172.21.15.151:0/4202120247 wait complete. 2023-10-16T14:25:27.059 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.053+0000 7fba6cb4c640 1 Processor -- start 2023-10-16T14:25:27.059 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.053+0000 7fba6cb4c640 1 -- start start 2023-10-16T14:25:27.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.054+0000 7fba6cb4c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba680b4410 0x7fba681f4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:27.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.054+0000 7fba6cb4c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba680b8400 0x7fba6815b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:27.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.054+0000 7fba6cb4c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba6815cbf0 0x7fba6815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:27.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.054+0000 7fba6cb4c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba681e73a0 con 0x7fba680b4410 2023-10-16T14:25:27.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.054+0000 7fba6cb4c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6815d580 con 0x7fba6815cbf0 2023-10-16T14:25:27.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.054+0000 7fba6cb4c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6815fed0 con 0x7fba680b8400 2023-10-16T14:25:27.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.055+0000 7fba65d9b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba680b8400 0x7fba6815b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:27.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.055+0000 7fba65d9b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba680b8400 0x7fba6815b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:33780/0 (socket says 172.21.15.151:33780) 2023-10-16T14:25:27.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.055+0000 7fba65d9b640 1 -- 172.21.15.151:0/1771779380 learned_addr learned my addr 172.21.15.151:0/1771779380 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-16T14:25:27.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.055+0000 7fba66d9d640 1 --2- 172.21.15.151:0/1771779380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba6815cbf0 0x7fba6815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:27.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.055+0000 7fba6659c640 1 --2- 172.21.15.151:0/1771779380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba680b4410 0x7fba681f4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:27.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.055+0000 7fba65d9b640 1 -- 172.21.15.151:0/1771779380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba6815cbf0 msgr2=0x7fba6815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:27.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.055+0000 7fba65d9b640 1 --2- 172.21.15.151:0/1771779380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba6815cbf0 0x7fba6815b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:27.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.055+0000 7fba65d9b640 1 -- 172.21.15.151:0/1771779380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba680b4410 msgr2=0x7fba681f4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:27.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.055+0000 7fba65d9b640 1 --2- 172.21.15.151:0/1771779380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba680b4410 0x7fba681f4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:27.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.055+0000 7fba65d9b640 1 -- 172.21.15.151:0/1771779380 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c0094d0 con 0x7fba680b8400 2023-10-16T14:25:27.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.055+0000 7fba65d9b640 1 --2- 172.21.15.151:0/1771779380 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba680b8400 0x7fba6815b490 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fba5c000c00 tx=0x7fba5c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:27.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.056+0000 7fba56ffd640 1 -- 172.21.15.151:0/1771779380 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c03a930 con 0x7fba680b8400 2023-10-16T14:25:27.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.056+0000 7fba56ffd640 1 -- 172.21.15.151:0/1771779380 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c03aa90 con 0x7fba680b8400 2023-10-16T14:25:27.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.056+0000 7fba6cb4c640 1 -- 172.21.15.151:0/1771779380 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba681f5320 con 0x7fba680b8400 2023-10-16T14:25:27.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.056+0000 7fba56ffd640 1 -- 172.21.15.151:0/1771779380 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c03ae40 con 0x7fba680b8400 2023-10-16T14:25:27.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.056+0000 7fba6cb4c640 1 -- 172.21.15.151:0/1771779380 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba681e6a00 con 0x7fba680b8400 2023-10-16T14:25:27.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.056+0000 7fba56ffd640 1 -- 172.21.15.151:0/1771779380 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fba5c02f050 con 0x7fba680b8400 2023-10-16T14:25:27.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.056+0000 7fba56ffd640 1 -- 172.21.15.151:0/1771779380 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fba5c044b40 con 0x7fba680b8400 2023-10-16T14:25:27.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.057+0000 7fba6cb4c640 1 -- 172.21.15.151:0/1771779380 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba68073ef0 con 0x7fba680b8400 2023-10-16T14:25:27.068 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.060+0000 7fba56ffd640 1 -- 172.21.15.151:0/1771779380 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fba5c035020 con 0x7fba680b8400 2023-10-16T14:25:27.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.137+0000 7fba6cb4c640 1 -- 172.21.15.151:0/1771779380 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "08a304fa-295c-480a-bb67-9e263e07760b", "id": 7} v 0) v1 -- 0x7fba680b7b40 con 0x7fba680b8400 2023-10-16T14:25:27.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.146+0000 7fba56ffd640 1 -- 172.21.15.151:0/1771779380 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "08a304fa-295c-480a-bb67-9e263e07760b", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fba5c02d040 con 0x7fba680b8400 2023-10-16T14:25:27.149 INFO:teuthology.orchestra.run.smithi151.stdout:7 2023-10-16T14:25:27.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.148+0000 7fba6cb4c640 1 -- 172.21.15.151:0/1771779380 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba680b8400 msgr2=0x7fba6815b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:27.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.148+0000 7fba6cb4c640 1 --2- 172.21.15.151:0/1771779380 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba680b8400 0x7fba6815b490 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fba5c000c00 tx=0x7fba5c0046c0 comp rx=0 tx=0).stop 2023-10-16T14:25:27.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.148+0000 7fba6cb4c640 1 -- 172.21.15.151:0/1771779380 shutdown_connections 2023-10-16T14:25:27.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.148+0000 7fba6cb4c640 1 --2- 172.21.15.151:0/1771779380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba6815cbf0 0x7fba6815b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:27.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.148+0000 7fba6cb4c640 1 --2- 172.21.15.151:0/1771779380 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba680b8400 0x7fba6815b490 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:27.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.148+0000 7fba6cb4c640 1 --2- 172.21.15.151:0/1771779380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba680b4410 0x7fba681f4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:27.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.148+0000 7fba6cb4c640 1 -- 172.21.15.151:0/1771779380 >> 172.21.15.151:0/1771779380 conn(0x7fba68071900 msgr2=0x7fba68071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:27.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.148+0000 7fba6cb4c640 1 -- 172.21.15.151:0/1771779380 shutdown_connections 2023-10-16T14:25:27.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:25:27.148+0000 7fba6cb4c640 1 -- 172.21.15.151:0/1771779380 wait complete. 2023-10-16T14:25:27.173 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-16T14:25:27.173 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-16T14:25:27.179 INFO:tasks.ceph.osd.0:Started 2023-10-16T14:25:27.179 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-16T14:25:27.180 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-16T14:25:27.185 INFO:tasks.ceph.osd.1:Started 2023-10-16T14:25:27.186 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-16T14:25:27.186 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-16T14:25:27.192 INFO:tasks.ceph.osd.2:Started 2023-10-16T14:25:27.192 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-16T14:25:27.192 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-16T14:25:27.199 INFO:tasks.ceph.osd.3:Started 2023-10-16T14:25:27.200 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-16T14:25:27.200 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-16T14:25:27.208 INFO:tasks.ceph.osd.4:Started 2023-10-16T14:25:27.209 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-16T14:25:27.209 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-16T14:25:27.217 INFO:tasks.ceph.osd.5:Started 2023-10-16T14:25:27.218 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-16T14:25:27.218 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-16T14:25:27.225 INFO:tasks.ceph.osd.6:Started 2023-10-16T14:25:27.225 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-16T14:25:27.226 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-16T14:25:27.231 INFO:tasks.ceph.osd.7:Started 2023-10-16T14:25:27.231 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:25:27.308 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:27.306+0000 7feb9b82f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T14:25:27.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.449+0000 7fc2f96c3640 1 Processor -- start 2023-10-16T14:25:27.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.450+0000 7fc2f96c3640 1 -- start start 2023-10-16T14:25:27.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.451+0000 7fc2f96c3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2f415a8d0 0x7fc2f40cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:27.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.451+0000 7fc2f96c3640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f415acb0 con 0x7fc2f40ca660 2023-10-16T14:25:27.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.451+0000 7fc2f96c3640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f40c1c60 con 0x7fc2f406ff40 2023-10-16T14:25:27.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.451+0000 7fc2f96c3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f406cd50 con 0x7fc2f415a8d0 2023-10-16T14:25:27.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.451+0000 7fc2ebfff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc2f40ca660 0x7fc2f406bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41886/0 (socket says 172.21.15.59:41886) 2023-10-16T14:25:27.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.451+0000 7fc2ebfff640 1 -- 172.21.15.59:0/1528719176 learned_addr learned my addr 172.21.15.59:0/1528719176 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:25:27.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.451+0000 7fc2f3fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2f415a8d0 0x7fc2f40cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:27.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.452+0000 7fc2f37fe640 1 -- 172.21.15.59:0/1528719176 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2088895479 0 0) 0x7fc2dc001110 con 0x7fc2f40ca660 2023-10-16T14:25:27.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.452+0000 7fc2f37fe640 1 -- 172.21.15.59:0/1528719176 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2e0003520 con 0x7fc2f40ca660 2023-10-16T14:25:27.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.452+0000 7fc2f37fe640 1 -- 172.21.15.59:0/1528719176 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555380846 0 0) 0x7fc2f40c1c60 con 0x7fc2f406ff40 2023-10-16T14:25:27.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.452+0000 7fc2f37fe640 1 -- 172.21.15.59:0/1528719176 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2dc001110 con 0x7fc2f406ff40 2023-10-16T14:25:27.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.452+0000 7fc2f3fff640 1 -- 172.21.15.59:0/1528719176 >> v1:172.21.15.151:6789/0 conn(0x7fc2f406ff40 legacy=0x7fc2f406c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:27.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.452+0000 7fc2f3fff640 1 -- 172.21.15.59:0/1528719176 >> v1:172.21.15.59:6789/0 conn(0x7fc2f40ca660 legacy=0x7fc2f406bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:27.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.452+0000 7fc2f3fff640 1 -- 172.21.15.59:0/1528719176 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f415e350 con 0x7fc2f415a8d0 2023-10-16T14:25:27.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.453+0000 7fc2f3fff640 1 --2- 172.21.15.59:0/1528719176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2f415a8d0 0x7fc2f40cab40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40097c0 tx=0x7fc2e402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7b196b4d977ad78 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:27.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.453+0000 7fc2f37fe640 1 -- 172.21.15.59:0/1528719176 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4031890 con 0x7fc2f415a8d0 2023-10-16T14:25:27.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.453+0000 7fc2f37fe640 1 -- 172.21.15.59:0/1528719176 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e40319f0 con 0x7fc2f415a8d0 2023-10-16T14:25:27.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.453+0000 7fc2f37fe640 1 -- 172.21.15.59:0/1528719176 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4031d80 con 0x7fc2f415a8d0 2023-10-16T14:25:27.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.454+0000 7fc2f96c3640 1 -- 172.21.15.59:0/1528719176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2f415a8d0 msgr2=0x7fc2f40cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:27.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.454+0000 7fc2f96c3640 1 --2- 172.21.15.59:0/1528719176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2f415a8d0 0x7fc2f40cab40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40097c0 tx=0x7fc2e402b930 comp rx=0 tx=0).stop 2023-10-16T14:25:27.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.454+0000 7fc2f96c3640 1 -- 172.21.15.59:0/1528719176 shutdown_connections 2023-10-16T14:25:27.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.454+0000 7fc2f96c3640 1 --2- 172.21.15.59:0/1528719176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2f415a8d0 0x7fc2f40cab40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:27.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.454+0000 7fc2f96c3640 1 -- 172.21.15.59:0/1528719176 >> 172.21.15.59:0/1528719176 conn(0x7fc2f406a470 msgr2=0x7fc2f40afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:27.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.454+0000 7fc2f96c3640 1 -- 172.21.15.59:0/1528719176 shutdown_connections 2023-10-16T14:25:27.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.454+0000 7fc2f96c3640 1 -- 172.21.15.59:0/1528719176 wait complete. 2023-10-16T14:25:27.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.456+0000 7fc2f96c3640 1 Processor -- start 2023-10-16T14:25:27.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.456+0000 7fc2f96c3640 1 -- start start 2023-10-16T14:25:27.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.457+0000 7fc2f96c3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2f406ff40 0x7fc2f40c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:27.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.457+0000 7fc2f96c3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2f40ca660 0x7fc2f415d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:27.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.457+0000 7fc2f96c3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2f415a8d0 0x7fc2f40cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:27.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.457+0000 7fc2f96c3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f415ddc0 con 0x7fc2f406ff40 2023-10-16T14:25:27.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.457+0000 7fc2f96c3640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f40c5f10 con 0x7fc2f40ca660 2023-10-16T14:25:27.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.457+0000 7fc2f96c3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f41edb50 con 0x7fc2f415a8d0 2023-10-16T14:25:27.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.457+0000 7fc2f3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2f406ff40 0x7fc2f40c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:27.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.457+0000 7fc2f3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2f406ff40 0x7fc2f40c7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48416/0 (socket says 172.21.15.59:48416) 2023-10-16T14:25:27.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.457+0000 7fc2f3fff640 1 -- 172.21.15.59:0/4233017738 learned_addr learned my addr 172.21.15.59:0/4233017738 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:27.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.457+0000 7fc2f8ec2640 1 --2- 172.21.15.59:0/4233017738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2f415a8d0 0x7fc2f40cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:27.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.457+0000 7fc2ebfff640 1 --2- 172.21.15.59:0/4233017738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2f40ca660 0x7fc2f415d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:27.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.457+0000 7fc2f3fff640 1 -- 172.21.15.59:0/4233017738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2f415a8d0 msgr2=0x7fc2f40cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:27.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.457+0000 7fc2f3fff640 1 --2- 172.21.15.59:0/4233017738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2f415a8d0 0x7fc2f40cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:27.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.457+0000 7fc2f3fff640 1 -- 172.21.15.59:0/4233017738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2f40ca660 msgr2=0x7fc2f415d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:27.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.457+0000 7fc2f3fff640 1 --2- 172.21.15.59:0/4233017738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2f40ca660 0x7fc2f415d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:27.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.457+0000 7fc2f3fff640 1 -- 172.21.15.59:0/4233017738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e40093a0 con 0x7fc2f406ff40 2023-10-16T14:25:27.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.458+0000 7fc2f3fff640 1 --2- 172.21.15.59:0/4233017738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2f406ff40 0x7fc2f40c7d10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40098e0 tx=0x7fc2e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:27.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.458+0000 7fc2f17fa640 1 -- 172.21.15.59:0/4233017738 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e403bbf0 con 0x7fc2f406ff40 2023-10-16T14:25:27.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.458+0000 7fc2f17fa640 1 -- 172.21.15.59:0/4233017738 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e403bd50 con 0x7fc2f406ff40 2023-10-16T14:25:27.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.458+0000 7fc2f17fa640 1 -- 172.21.15.59:0/4233017738 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4045630 con 0x7fc2f406ff40 2023-10-16T14:25:27.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.458+0000 7fc2f96c3640 1 -- 172.21.15.59:0/4233017738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f40c8250 con 0x7fc2f406ff40 2023-10-16T14:25:27.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.458+0000 7fc2f96c3640 1 -- 172.21.15.59:0/4233017738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f40c58c0 con 0x7fc2f406ff40 2023-10-16T14:25:27.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.459+0000 7fc2f17fa640 1 -- 172.21.15.59:0/4233017738 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc2e4045a90 con 0x7fc2f406ff40 2023-10-16T14:25:27.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.459+0000 7fc2f17fa640 1 -- 172.21.15.59:0/4233017738 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc2e4030ab0 con 0x7fc2f406ff40 2023-10-16T14:25:27.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.460+0000 7fc2f96c3640 1 -- 172.21.15.59:0/4233017738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f404e9b0 con 0x7fc2f406ff40 2023-10-16T14:25:27.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.462+0000 7fc2f17fa640 1 -- 172.21.15.59:0/4233017738 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fc2e4035020 con 0x7fc2f406ff40 2023-10-16T14:25:27.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.527+0000 7fc2f96c3640 1 -- 172.21.15.59:0/4233017738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2f40b0d70 con 0x7fc2f406ff40 2023-10-16T14:25:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.528+0000 7fc2f17fa640 1 -- 172.21.15.59:0/4233017738 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc2e4030cc0 con 0x7fc2f406ff40 2023-10-16T14:25:27.531 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:25:27.531 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":10,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:25:27.139559+0000","last_up_change":"0.000000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:25:27.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.529+0000 7fc2f96c3640 1 -- 172.21.15.59:0/4233017738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2f406ff40 msgr2=0x7fc2f40c7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:27.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.529+0000 7fc2f96c3640 1 --2- 172.21.15.59:0/4233017738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2f406ff40 0x7fc2f40c7d10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40098e0 tx=0x7fc2e40046c0 comp rx=0 tx=0).stop 2023-10-16T14:25:27.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.529+0000 7fc2f96c3640 1 -- 172.21.15.59:0/4233017738 shutdown_connections 2023-10-16T14:25:27.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.529+0000 7fc2f96c3640 1 --2- 172.21.15.59:0/4233017738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2f415a8d0 0x7fc2f40cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:27.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.529+0000 7fc2f96c3640 1 --2- 172.21.15.59:0/4233017738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2f40ca660 0x7fc2f415d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:27.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.529+0000 7fc2f96c3640 1 --2- 172.21.15.59:0/4233017738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2f406ff40 0x7fc2f40c7d10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:27.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.529+0000 7fc2f96c3640 1 -- 172.21.15.59:0/4233017738 >> 172.21.15.59:0/4233017738 conn(0x7fc2f406a470 msgr2=0x7fc2f40cbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:27.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.529+0000 7fc2f96c3640 1 -- 172.21.15.59:0/4233017738 shutdown_connections 2023-10-16T14:25:27.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:27.529+0000 7fc2f96c3640 1 -- 172.21.15.59:0/4233017738 wait complete. 2023-10-16T14:25:27.542 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:27.540+0000 7fcae1445040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-16T14:25:27.547 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-16T14:25:27.548 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-16T14:25:27.664 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:27.662+0000 7feb9b82f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T14:25:27.725 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:27.723+0000 7feb9b82f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T14:25:27.838 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:27.835+0000 7feb9b82f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T14:25:27.863 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:27.861+0000 7fcae1445040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-16T14:25:27.903 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-10-16T14:25:27.901+0000 7f910871e500 -1 Falling back to public interface 2023-10-16T14:25:27.906 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-10-16T14:25:27.904+0000 7efc1df39500 -1 Falling back to public interface 2023-10-16T14:25:27.909 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-10-16T14:25:27.907+0000 7f90646a3500 -1 Falling back to public interface 2023-10-16T14:25:27.919 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-10-16T14:25:27.917+0000 7f9887146500 -1 Falling back to public interface 2023-10-16T14:25:27.921 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-10-16T14:25:27.918+0000 7f33bdbfe500 -1 Falling back to public interface 2023-10-16T14:25:27.928 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-10-16T14:25:27.926+0000 7f5957038500 -1 Falling back to public interface 2023-10-16T14:25:27.936 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:27.934+0000 7fcae1445040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-16T14:25:27.940 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-10-16T14:25:27.938+0000 7f9781f90500 -1 Falling back to public interface 2023-10-16T14:25:27.948 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-10-16T14:25:27.946+0000 7f104fc14500 -1 Falling back to public interface 2023-10-16T14:25:28.056 INFO:tasks.ceph.mgr.y.smithi059.stderr:2023-10-16T14:25:28.053+0000 7fcae1445040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-16T14:25:28.353 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T14:25:28.540 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.537+0000 7f345633e640 1 Processor -- start 2023-10-16T14:25:28.540 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.538+0000 7f345633e640 1 -- start start 2023-10-16T14:25:28.542 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.539+0000 7f345633e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f345015d300 0x7f34500ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:28.543 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.539+0000 7f345633e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f34500ad750 0x7f34500cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:28.543 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.539+0000 7f345633e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34500ca8c0 con 0x7f34500c20f0 2023-10-16T14:25:28.543 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.539+0000 7f345633e640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345006da40 con 0x7f345015d300 2023-10-16T14:25:28.543 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.539+0000 7f345633e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34500cd210 con 0x7f34500ad750 2023-10-16T14:25:28.544 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.539+0000 7f344ffff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f345015d300 0x7f34500ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:28.544 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.539+0000 7f34548db640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f34500c20f0 0x7f34500cad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41890/0 (socket says 172.21.15.59:41890) 2023-10-16T14:25:28.544 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.539+0000 7f344ffff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f345015d300 0x7f34500ccb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48424/0 (socket says 172.21.15.59:48424) 2023-10-16T14:25:28.544 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.539+0000 7f34548db640 1 -- 172.21.15.59:0/3425896713 learned_addr learned my addr 172.21.15.59:0/3425896713 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:25:28.545 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.539+0000 7f344f7fe640 1 --2- 172.21.15.59:0/3425896713 >> v2:172.21.15.151:3300/0 conn(0x7f34500ad750 0x7f34500cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:28.545 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.540+0000 7f344ffff640 1 -- 172.21.15.59:0/3425896713 >> v2:172.21.15.151:3300/0 conn(0x7f34500ad750 msgr2=0x7f34500cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:28.545 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.540+0000 7f344ffff640 1 --2- 172.21.15.59:0/3425896713 >> v2:172.21.15.151:3300/0 conn(0x7f34500ad750 0x7f34500cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:28.545 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.540+0000 7f344ffff640 1 -- 172.21.15.59:0/3425896713 >> v1:172.21.15.59:6789/0 conn(0x7f34500c20f0 legacy=0x7f34500cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:28.546 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.540+0000 7f344ffff640 1 -- 172.21.15.59:0/3425896713 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34500cd4f0 con 0x7f345015d300 2023-10-16T14:25:28.549 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.541+0000 7f344ffff640 1 --2- 172.21.15.59:0/3425896713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f345015d300 0x7f34500ccb80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f34500701f0 tx=0x7f344002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b107adb81a2021f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:28.549 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.541+0000 7f344effd640 1 -- 172.21.15.59:0/3425896713 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440030610 con 0x7f345015d300 2023-10-16T14:25:28.549 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.541+0000 7f344effd640 1 -- 172.21.15.59:0/3425896713 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3440030770 con 0x7f345015d300 2023-10-16T14:25:28.549 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.541+0000 7f344effd640 1 -- 172.21.15.59:0/3425896713 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440030b00 con 0x7f345015d300 2023-10-16T14:25:28.550 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.541+0000 7f345633e640 1 -- 172.21.15.59:0/3425896713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f345015d300 msgr2=0x7f34500ccb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:28.550 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.541+0000 7f345633e640 1 --2- 172.21.15.59:0/3425896713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f345015d300 0x7f34500ccb80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f34500701f0 tx=0x7f344002b960 comp rx=0 tx=0).stop 2023-10-16T14:25:28.550 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.542+0000 7f345633e640 1 -- 172.21.15.59:0/3425896713 shutdown_connections 2023-10-16T14:25:28.551 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.542+0000 7f345633e640 1 --2- 172.21.15.59:0/3425896713 >> v2:172.21.15.151:3300/0 conn(0x7f34500ad750 0x7f34500cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:28.551 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.542+0000 7f345633e640 1 --2- 172.21.15.59:0/3425896713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f345015d300 0x7f34500ccb80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:28.551 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.542+0000 7f345633e640 1 -- 172.21.15.59:0/3425896713 >> 172.21.15.59:0/3425896713 conn(0x7f34500b0110 msgr2=0x7f34500b04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:28.551 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.542+0000 7f345633e640 1 -- 172.21.15.59:0/3425896713 shutdown_connections 2023-10-16T14:25:28.552 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.542+0000 7f345633e640 1 -- 172.21.15.59:0/3425896713 wait complete. 2023-10-16T14:25:28.552 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.543+0000 7f345633e640 1 Processor -- start 2023-10-16T14:25:28.552 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.544+0000 7f345633e640 1 -- start start 2023-10-16T14:25:28.552 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.544+0000 7f345633e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34500ad750 0x7f345014fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:28.552 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.544+0000 7f345633e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34500c20f0 0x7f34500ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:28.553 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.545+0000 7f345633e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f345015d300 0x7f345014ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:28.553 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.545+0000 7f345633e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34500c5670 con 0x7f345015d300 2023-10-16T14:25:28.553 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.545+0000 7f345633e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34500c63a0 con 0x7f34500c20f0 2023-10-16T14:25:28.553 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.545+0000 7f345633e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34500c4530 con 0x7f34500ad750 2023-10-16T14:25:28.553 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.545+0000 7f34548db640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f345015d300 0x7f345014ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:28.554 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.545+0000 7f34548db640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f345015d300 0x7f345014ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48436/0 (socket says 172.21.15.59:48436) 2023-10-16T14:25:28.554 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.545+0000 7f34548db640 1 -- 172.21.15.59:0/2313306028 learned_addr learned my addr 172.21.15.59:0/2313306028 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:28.554 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.545+0000 7f344ffff640 1 --2- 172.21.15.59:0/2313306028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34500ad750 0x7f345014fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:28.554 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.545+0000 7f344f7fe640 1 --2- 172.21.15.59:0/2313306028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34500c20f0 0x7f34500ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:28.554 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.545+0000 7f34548db640 1 -- 172.21.15.59:0/2313306028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34500ad750 msgr2=0x7f345014fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:28.554 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.545+0000 7f34548db640 1 --2- 172.21.15.59:0/2313306028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34500ad750 0x7f345014fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:28.555 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.545+0000 7f34548db640 1 -- 172.21.15.59:0/2313306028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34500c20f0 msgr2=0x7f34500ae3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:28.555 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.545+0000 7f34548db640 1 --2- 172.21.15.59:0/2313306028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34500c20f0 0x7f34500ae3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:28.555 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.545+0000 7f34548db640 1 -- 172.21.15.59:0/2313306028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3440009400 con 0x7f345015d300 2023-10-16T14:25:28.555 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.545+0000 7f344f7fe640 1 --2- 172.21.15.59:0/2313306028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34500c20f0 0x7f34500ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:25:28.555 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.546+0000 7f34548db640 1 --2- 172.21.15.59:0/2313306028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f345015d300 0x7f345014ed90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f344800cbc0 tx=0x7f344800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:28.556 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.546+0000 7f344cff9640 1 -- 172.21.15.59:0/2313306028 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344800ad40 con 0x7f345015d300 2023-10-16T14:25:28.556 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.546+0000 7f344cff9640 1 -- 172.21.15.59:0/2313306028 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3448012400 con 0x7f345015d300 2023-10-16T14:25:28.556 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.546+0000 7f345633e640 1 -- 172.21.15.59:0/2313306028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34500c58c0 con 0x7f345015d300 2023-10-16T14:25:28.556 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.546+0000 7f344cff9640 1 -- 172.21.15.59:0/2313306028 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344800aea0 con 0x7f345015d300 2023-10-16T14:25:28.556 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.546+0000 7f345633e640 1 -- 172.21.15.59:0/2313306028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34500c5e80 con 0x7f345015d300 2023-10-16T14:25:28.557 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.547+0000 7f345633e640 1 -- 172.21.15.59:0/2313306028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345004e160 con 0x7f345015d300 2023-10-16T14:25:28.557 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.547+0000 7f344cff9640 1 -- 172.21.15.59:0/2313306028 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 2) v1 ==== 44566+0+0 (secure 0 0 0) 0x7f3448007070 con 0x7f345015d300 2023-10-16T14:25:28.558 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.548+0000 7f344cff9640 1 -- 172.21.15.59:0/2313306028 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3448049490 con 0x7f345015d300 2023-10-16T14:25:28.558 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.550+0000 7f344cff9640 1 -- 172.21.15.59:0/2313306028 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f34480192c0 con 0x7f345015d300 2023-10-16T14:25:28.619 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.617+0000 7f345633e640 1 -- 172.21.15.59:0/2313306028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34500c6040 con 0x7f345015d300 2023-10-16T14:25:28.620 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.618+0000 7f344cff9640 1 -- 172.21.15.59:0/2313306028 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3448010a60 con 0x7f345015d300 2023-10-16T14:25:28.621 INFO:teuthology.misc.health.smithi059.stdout: 2023-10-16T14:25:28.621 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":10,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:25:27.139559+0000","last_up_change":"0.000000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:25:28.621 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.619+0000 7f345633e640 1 -- 172.21.15.59:0/2313306028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f345015d300 msgr2=0x7f345014ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:28.622 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.619+0000 7f345633e640 1 --2- 172.21.15.59:0/2313306028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f345015d300 0x7f345014ed90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f344800cbc0 tx=0x7f344800a430 comp rx=0 tx=0).stop 2023-10-16T14:25:28.622 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.619+0000 7f345633e640 1 -- 172.21.15.59:0/2313306028 shutdown_connections 2023-10-16T14:25:28.623 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.619+0000 7f345633e640 1 --2- 172.21.15.59:0/2313306028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f345015d300 0x7f345014ed90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:28.623 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.619+0000 7f345633e640 1 --2- 172.21.15.59:0/2313306028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34500c20f0 0x7f34500ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:28.623 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.619+0000 7f345633e640 1 --2- 172.21.15.59:0/2313306028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34500ad750 0x7f345014fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:28.623 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.619+0000 7f345633e640 1 -- 172.21.15.59:0/2313306028 >> 172.21.15.59:0/2313306028 conn(0x7f34500b0110 msgr2=0x7f34500caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:28.623 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.620+0000 7f345633e640 1 -- 172.21.15.59:0/2313306028 shutdown_connections 2023-10-16T14:25:28.624 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:28.620+0000 7f345633e640 1 -- 172.21.15.59:0/2313306028 wait complete. 2023-10-16T14:25:28.635 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-16T14:25:28.890 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:28.887+0000 7feb3c33d640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-16T14:25:28.891 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-16T14:25:28.889+0000 7feb3c33d640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-16T14:25:30.955 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-10-16T14:25:30.952+0000 7efc1df39500 -1 osd.5 0 log_to_monitors true 2023-10-16T14:25:31.061 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:25:31.070 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:25:31.281 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-10-16T14:25:31.279+0000 7f910871e500 -1 osd.1 0 log_to_monitors true 2023-10-16T14:25:31.471 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-10-16T14:25:31.469+0000 7f9887146500 -1 osd.3 0 log_to_monitors true 2023-10-16T14:25:31.472 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-10-16T14:25:31.470+0000 7f90646a3500 -1 osd.6 0 log_to_monitors true 2023-10-16T14:25:31.501 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-10-16T14:25:31.499+0000 7f33bdbfe500 -1 osd.2 0 log_to_monitors true 2023-10-16T14:25:31.508 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-10-16T14:25:31.506+0000 7f104fc14500 -1 osd.4 0 log_to_monitors true 2023-10-16T14:25:31.513 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-10-16T14:25:31.511+0000 7f9781f90500 -1 osd.7 0 log_to_monitors true 2023-10-16T14:25:31.545 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-10-16T14:25:31.543+0000 7f5957038500 -1 osd.0 0 log_to_monitors true 2023-10-16T14:25:33.358 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-10-16T14:25:33.356+0000 7efc19ec7640 -1 osd.5 0 waiting for initial osdmap 2023-10-16T14:25:33.474 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-10-16T14:25:33.472+0000 7efc11ce7640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T14:25:35.006 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-10-16T14:25:35.004+0000 7f9060e45640 -1 osd.6 0 waiting for initial osdmap 2023-10-16T14:25:35.022 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-10-16T14:25:35.020+0000 7f977df1c640 -1 osd.7 0 waiting for initial osdmap 2023-10-16T14:25:35.023 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-10-16T14:25:35.020+0000 7f905844f640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T14:25:35.033 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-10-16T14:25:35.031+0000 7f104b575640 -1 osd.4 0 waiting for initial osdmap 2023-10-16T14:25:35.034 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-10-16T14:25:35.032+0000 7f9775d3c640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T14:25:35.050 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-10-16T14:25:35.048+0000 7f1043395640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T14:25:35.429 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-10-16T14:25:35.426+0000 7f5952fc6640 -1 osd.0 0 waiting for initial osdmap 2023-10-16T14:25:35.442 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T14:25:35.449 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-10-16T14:25:35.447+0000 7f594ade6640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T14:25:35.475 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-10-16T14:25:35.471+0000 7f91046aa640 -1 osd.1 0 waiting for initial osdmap 2023-10-16T14:25:35.487 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-10-16T14:25:35.484+0000 7f98830d2640 -1 osd.3 0 waiting for initial osdmap 2023-10-16T14:25:35.488 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-10-16T14:25:35.486+0000 7f90fc4ca640 -1 osd.1 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T14:25:35.507 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-10-16T14:25:35.505+0000 7f987aef2640 -1 osd.3 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T14:25:35.513 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-10-16T14:25:35.511+0000 7f33b9b8a640 -1 osd.2 0 waiting for initial osdmap 2023-10-16T14:25:35.541 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-10-16T14:25:35.539+0000 7f33b19aa640 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-16T14:25:35.617 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.615+0000 7ff5df59e640 1 Processor -- start 2023-10-16T14:25:35.618 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.615+0000 7ff5df59e640 1 -- start start 2023-10-16T14:25:35.620 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.616+0000 7ff5df59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e00c9420 0x7ff5e00ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:35.620 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.617+0000 7ff5df59e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff5e00c9800 0x7ff5e00cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:35.620 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.617+0000 7ff5df59e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff5e00ad310 0x7ff5e00cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:35.620 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.617+0000 7ff5df59e640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e0071790 con 0x7ff5e00ad310 2023-10-16T14:25:35.621 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.617+0000 7ff5df59e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e0071a70 con 0x7ff5e00c9800 2023-10-16T14:25:35.621 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.617+0000 7ff5df59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e0071d50 con 0x7ff5e00c9420 2023-10-16T14:25:35.621 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.617+0000 7ff5ded9d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff5e00ad310 0x7ff5e00cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:35.621 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.617+0000 7ff5ded9d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff5e00ad310 0x7ff5e00cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43244/0 (socket says 172.21.15.59:43244) 2023-10-16T14:25:35.622 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.617+0000 7ff5ded9d640 1 -- 172.21.15.59:0/3565660384 learned_addr learned my addr 172.21.15.59:0/3565660384 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:35.622 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.617+0000 7ff5de59c640 1 --2- 172.21.15.59:0/3565660384 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e00c9420 0x7ff5e00ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:35.622 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.617+0000 7ff5d7fff640 1 --2- 172.21.15.59:0/3565660384 >> v2:172.21.15.151:3300/0 conn(0x7ff5e00c9800 0x7ff5e00cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:35.622 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.617+0000 7ff5ded9d640 1 -- 172.21.15.59:0/3565660384 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e00c9420 msgr2=0x7ff5e00ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:35.622 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.617+0000 7ff5ded9d640 1 --2- 172.21.15.59:0/3565660384 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e00c9420 0x7ff5e00ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:35.623 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.617+0000 7ff5ded9d640 1 -- 172.21.15.59:0/3565660384 >> v2:172.21.15.151:3300/0 conn(0x7ff5e00c9800 msgr2=0x7ff5e00cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:35.623 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.617+0000 7ff5ded9d640 1 --2- 172.21.15.59:0/3565660384 >> v2:172.21.15.151:3300/0 conn(0x7ff5e00c9800 0x7ff5e00cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:35.623 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.617+0000 7ff5ded9d640 1 -- 172.21.15.59:0/3565660384 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e0072030 con 0x7ff5e00ad310 2023-10-16T14:25:35.623 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.617+0000 7ff5de59c640 1 --2- 172.21.15.59:0/3565660384 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e00c9420 0x7ff5e00ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:25:35.623 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.617+0000 7ff5d7fff640 1 --2- 172.21.15.59:0/3565660384 >> v2:172.21.15.151:3300/0 conn(0x7ff5e00c9800 0x7ff5e00cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:25:35.626 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.618+0000 7ff5ded9d640 1 --2- 172.21.15.59:0/3565660384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e00ad310 0x7ff5e00cb330 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00ce2d0 tx=0x7ff5d802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e375d65b8cc48467 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:35.626 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.619+0000 7ff5ddd9b640 1 -- 172.21.15.59:0/3565660384 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d802ca80 con 0x7ff5e00ad310 2023-10-16T14:25:35.627 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.619+0000 7ff5ddd9b640 1 -- 172.21.15.59:0/3565660384 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d802cbe0 con 0x7ff5e00ad310 2023-10-16T14:25:35.627 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.619+0000 7ff5ddd9b640 1 -- 172.21.15.59:0/3565660384 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80343f0 con 0x7ff5e00ad310 2023-10-16T14:25:35.627 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.619+0000 7ff5df59e640 1 -- 172.21.15.59:0/3565660384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e00ad310 msgr2=0x7ff5e00cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:35.627 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.619+0000 7ff5df59e640 1 --2- 172.21.15.59:0/3565660384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e00ad310 0x7ff5e00cb330 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00ce2d0 tx=0x7ff5d802bee0 comp rx=0 tx=0).stop 2023-10-16T14:25:35.628 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.619+0000 7ff5df59e640 1 -- 172.21.15.59:0/3565660384 shutdown_connections 2023-10-16T14:25:35.628 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.619+0000 7ff5df59e640 1 --2- 172.21.15.59:0/3565660384 >> v2:172.21.15.151:3300/0 conn(0x7ff5e00c9800 0x7ff5e00cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:35.628 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.619+0000 7ff5df59e640 1 --2- 172.21.15.59:0/3565660384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e00ad310 0x7ff5e00cb330 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:35.628 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.619+0000 7ff5df59e640 1 --2- 172.21.15.59:0/3565660384 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e00c9420 0x7ff5e00ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:35.628 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.619+0000 7ff5df59e640 1 -- 172.21.15.59:0/3565660384 >> 172.21.15.59:0/3565660384 conn(0x7ff5e00ce3e0 msgr2=0x7ff5e00ce7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:35.629 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.620+0000 7ff5df59e640 1 -- 172.21.15.59:0/3565660384 shutdown_connections 2023-10-16T14:25:35.629 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.620+0000 7ff5df59e640 1 -- 172.21.15.59:0/3565660384 wait complete. 2023-10-16T14:25:35.629 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.621+0000 7ff5df59e640 1 Processor -- start 2023-10-16T14:25:35.629 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.621+0000 7ff5df59e640 1 -- start start 2023-10-16T14:25:35.630 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.622+0000 7ff5df59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5e00ad310 0x7ff5e0099680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:35.630 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.622+0000 7ff5df59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e00c9420 0x7ff5e00cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:35.630 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.622+0000 7ff5df59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e00c9800 0x7ff5e00cda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:35.630 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.622+0000 7ff5df59e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e0099bc0 con 0x7ff5e00c9800 2023-10-16T14:25:35.630 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.622+0000 7ff5df59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e01f2dc0 con 0x7ff5e00ad310 2023-10-16T14:25:35.631 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.622+0000 7ff5df59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e009b3b0 con 0x7ff5e00c9420 2023-10-16T14:25:35.631 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.622+0000 7ff5ded9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e00c9800 0x7ff5e00cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:35.631 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.622+0000 7ff5ded9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e00c9800 0x7ff5e00cda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43246/0 (socket says 172.21.15.59:43246) 2023-10-16T14:25:35.631 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.622+0000 7ff5ded9d640 1 -- 172.21.15.59:0/2466704 learned_addr learned my addr 172.21.15.59:0/2466704 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:35.632 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.623+0000 7ff5d7fff640 1 --2- 172.21.15.59:0/2466704 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e00c9420 0x7ff5e00cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:35.632 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.623+0000 7ff5de59c640 1 --2- 172.21.15.59:0/2466704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5e00ad310 0x7ff5e0099680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:35.632 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.623+0000 7ff5ded9d640 1 -- 172.21.15.59:0/2466704 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e00c9420 msgr2=0x7ff5e00cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:35.632 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.623+0000 7ff5ded9d640 1 --2- 172.21.15.59:0/2466704 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e00c9420 0x7ff5e00cd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:35.632 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.623+0000 7ff5ded9d640 1 -- 172.21.15.59:0/2466704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5e00ad310 msgr2=0x7ff5e0099680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:35.633 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.623+0000 7ff5ded9d640 1 --2- 172.21.15.59:0/2466704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5e00ad310 0x7ff5e0099680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:35.633 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.623+0000 7ff5ded9d640 1 -- 172.21.15.59:0/2466704 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d8009b30 con 0x7ff5e00c9800 2023-10-16T14:25:35.633 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.623+0000 7ff5ded9d640 1 --2- 172.21.15.59:0/2466704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e00c9800 0x7ff5e00cda10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009f40 tx=0x7ff5d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:35.633 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.623+0000 7ff5d6ffd640 1 -- 172.21.15.59:0/2466704 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d803e450 con 0x7ff5e00c9800 2023-10-16T14:25:35.633 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.623+0000 7ff5d6ffd640 1 -- 172.21.15.59:0/2466704 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d803e5b0 con 0x7ff5e00c9800 2023-10-16T14:25:35.634 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.623+0000 7ff5d6ffd640 1 -- 172.21.15.59:0/2466704 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d803e960 con 0x7ff5e00c9800 2023-10-16T14:25:35.634 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.623+0000 7ff5df59e640 1 -- 172.21.15.59:0/2466704 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e00c8bb0 con 0x7ff5e00c9800 2023-10-16T14:25:35.634 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.624+0000 7ff5df59e640 1 -- 172.21.15.59:0/2466704 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e009b970 con 0x7ff5e00c9800 2023-10-16T14:25:35.635 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.625+0000 7ff5df59e640 1 -- 172.21.15.59:0/2466704 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e0073f00 con 0x7ff5e00c9800 2023-10-16T14:25:35.635 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.625+0000 7ff5d6ffd640 1 -- 172.21.15.59:0/2466704 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7ff5d802cd50 con 0x7ff5e00c9800 2023-10-16T14:25:35.636 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.627+0000 7ff5d6ffd640 1 --2- 172.21.15.59:0/2466704 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff5c006ade0 0x7ff5c006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:35.636 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.627+0000 7ff5d6ffd640 1 -- 172.21.15.59:0/2466704 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3351+0+0 (secure 0 0 0) 0x7ff5d80ab960 con 0x7ff5e00c9800 2023-10-16T14:25:35.636 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.627+0000 7ff5de59c640 1 --2- 172.21.15.59:0/2466704 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff5c006ade0 0x7ff5c006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:35.636 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.628+0000 7ff5de59c640 1 --2- 172.21.15.59:0/2466704 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff5c006ade0 0x7ff5c006d2a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0006fd0 tx=0x7ff5d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:35.636 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.632+0000 7ff5d6ffd640 1 -- 172.21.15.59:0/2466704 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff5d8077380 con 0x7ff5e00c9800 2023-10-16T14:25:35.821 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.819+0000 7ff5df59e640 1 -- 172.21.15.59:0/2466704 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5e006cc90 con 0x7ff5e00c9800 2023-10-16T14:25:35.822 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.820+0000 7ff5d6ffd640 1 -- 172.21.15.59:0/2466704 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+9047 (secure 0 0 0) 0x7ff5d807a9a0 con 0x7ff5e00c9800 2023-10-16T14:25:35.823 INFO:teuthology.misc.health.smithi059.stdout: 2023-10-16T14:25:35.823 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":15,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:25:35.445679+0000","last_up_change":"2023-10-16T14:25:35.445679+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:25:35.825 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.822+0000 7ff5df59e640 1 -- 172.21.15.59:0/2466704 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff5c006ade0 msgr2=0x7ff5c006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:35.825 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.822+0000 7ff5df59e640 1 --2- 172.21.15.59:0/2466704 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff5c006ade0 0x7ff5c006d2a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0006fd0 tx=0x7ff5d0008040 comp rx=0 tx=0).stop 2023-10-16T14:25:35.826 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.822+0000 7ff5df59e640 1 -- 172.21.15.59:0/2466704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e00c9800 msgr2=0x7ff5e00cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:35.826 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.822+0000 7ff5df59e640 1 --2- 172.21.15.59:0/2466704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e00c9800 0x7ff5e00cda10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009f40 tx=0x7ff5d8004a40 comp rx=0 tx=0).stop 2023-10-16T14:25:35.826 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.822+0000 7ff5df59e640 1 -- 172.21.15.59:0/2466704 shutdown_connections 2023-10-16T14:25:35.826 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.822+0000 7ff5df59e640 1 --2- 172.21.15.59:0/2466704 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff5c006ade0 0x7ff5c006d2a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:35.826 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.822+0000 7ff5df59e640 1 --2- 172.21.15.59:0/2466704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e00c9800 0x7ff5e00cda10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:35.827 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.822+0000 7ff5df59e640 1 --2- 172.21.15.59:0/2466704 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e00c9420 0x7ff5e00cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:35.827 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.822+0000 7ff5df59e640 1 --2- 172.21.15.59:0/2466704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5e00ad310 0x7ff5e0099680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:35.827 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.822+0000 7ff5df59e640 1 -- 172.21.15.59:0/2466704 >> 172.21.15.59:0/2466704 conn(0x7ff5e00ce3e0 msgr2=0x7ff5e00ac770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:35.827 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.823+0000 7ff5df59e640 1 -- 172.21.15.59:0/2466704 shutdown_connections 2023-10-16T14:25:35.828 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:35.823+0000 7ff5df59e640 1 -- 172.21.15.59:0/2466704 wait complete. 2023-10-16T14:25:35.839 DEBUG:teuthology.misc:4 of 8 OSDs are up 2023-10-16T14:25:42.645 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-16T14:25:42.843 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.839+0000 7f66763ff640 1 Processor -- start 2023-10-16T14:25:42.843 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.840+0000 7f66763ff640 1 -- start start 2023-10-16T14:25:42.845 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.841+0000 7f66763ff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f66700c9420 0x7f66700ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:42.845 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.841+0000 7f66763ff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f66700cb500 0x7f667006bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:42.845 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.841+0000 7f66763ff640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6670071790 con 0x7f66700c9800 2023-10-16T14:25:42.845 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.841+0000 7f66763ff640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6670071a70 con 0x7f66700cb500 2023-10-16T14:25:42.845 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.841+0000 7f66763ff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6670071d50 con 0x7f66700c9420 2023-10-16T14:25:42.846 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.841+0000 7f6675bfe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f66700cb500 0x7f667006bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:42.846 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.841+0000 7f6674bfc640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f66700c9800 0x7f66700cadf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35122/0 (socket says 172.21.15.59:35122) 2023-10-16T14:25:42.846 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.841+0000 7f6674bfc640 1 -- 172.21.15.59:0/2964921848 learned_addr learned my addr 172.21.15.59:0/2964921848 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:25:42.848 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.842+0000 7f66753fd640 1 --2- 172.21.15.59:0/2964921848 >> v2:172.21.15.151:3300/0 conn(0x7f66700c9420 0x7f66700ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:42.848 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.842+0000 7f6675bfe640 1 -- 172.21.15.59:0/2964921848 >> v2:172.21.15.151:3300/0 conn(0x7f66700c9420 msgr2=0x7f66700ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:42.848 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.842+0000 7f6675bfe640 1 --2- 172.21.15.59:0/2964921848 >> v2:172.21.15.151:3300/0 conn(0x7f66700c9420 0x7f66700ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:42.848 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.842+0000 7f6675bfe640 1 -- 172.21.15.59:0/2964921848 >> v1:172.21.15.59:6789/0 conn(0x7f66700c9800 legacy=0x7f66700cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:42.849 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.842+0000 7f6675bfe640 1 -- 172.21.15.59:0/2964921848 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6670072030 con 0x7f66700cb500 2023-10-16T14:25:42.849 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.843+0000 7f6675bfe640 1 --2- 172.21.15.59:0/2964921848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66700cb500 0x7f667006bb40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f66700ce250 tx=0x7f666802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b54241874f108a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:42.849 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.843+0000 7f6667fff640 1 -- 172.21.15.59:0/2964921848 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666802e070 con 0x7f66700cb500 2023-10-16T14:25:42.849 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.843+0000 7f6667fff640 1 -- 172.21.15.59:0/2964921848 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66680315a0 con 0x7f66700cb500 2023-10-16T14:25:42.849 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.843+0000 7f6667fff640 1 -- 172.21.15.59:0/2964921848 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668031930 con 0x7f66700cb500 2023-10-16T14:25:42.850 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.844+0000 7f66763ff640 1 -- 172.21.15.59:0/2964921848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66700cb500 msgr2=0x7f667006bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:42.850 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.844+0000 7f66763ff640 1 --2- 172.21.15.59:0/2964921848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66700cb500 0x7f667006bb40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f66700ce250 tx=0x7f666802b840 comp rx=0 tx=0).stop 2023-10-16T14:25:42.850 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.844+0000 7f66763ff640 1 -- 172.21.15.59:0/2964921848 shutdown_connections 2023-10-16T14:25:42.850 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.844+0000 7f66763ff640 1 --2- 172.21.15.59:0/2964921848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66700cb500 0x7f667006bb40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:42.850 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.844+0000 7f66763ff640 1 --2- 172.21.15.59:0/2964921848 >> v2:172.21.15.151:3300/0 conn(0x7f66700c9420 0x7f66700ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:42.850 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.844+0000 7f66763ff640 1 -- 172.21.15.59:0/2964921848 >> 172.21.15.59:0/2964921848 conn(0x7f66700ce3e0 msgr2=0x7f66700ce7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:42.851 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.844+0000 7f66763ff640 1 -- 172.21.15.59:0/2964921848 shutdown_connections 2023-10-16T14:25:42.851 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.844+0000 7f66763ff640 1 -- 172.21.15.59:0/2964921848 wait complete. 2023-10-16T14:25:42.853 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.846+0000 7f66763ff640 1 Processor -- start 2023-10-16T14:25:42.853 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.846+0000 7f66763ff640 1 -- start start 2023-10-16T14:25:42.853 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.847+0000 7f66763ff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66700c9420 0x7f66701597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:42.853 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.847+0000 7f66763ff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66700c9800 0x7f66700c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:42.854 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.847+0000 7f66763ff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66700cb500 0x7f66700c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:42.854 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.847+0000 7f66763ff640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66700c6360 con 0x7f66700cb500 2023-10-16T14:25:42.854 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.847+0000 7f66763ff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66700c54b0 con 0x7f66700c9800 2023-10-16T14:25:42.854 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.847+0000 7f66763ff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66700c5750 con 0x7f66700c9420 2023-10-16T14:25:42.854 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.847+0000 7f6675bfe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66700cb500 0x7f66700c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:42.855 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.848+0000 7f6675bfe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66700cb500 0x7f66700c7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55446/0 (socket says 172.21.15.59:55446) 2023-10-16T14:25:42.855 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.848+0000 7f6675bfe640 1 -- 172.21.15.59:0/3528749824 learned_addr learned my addr 172.21.15.59:0/3528749824 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:42.855 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.848+0000 7f6674bfc640 1 --2- 172.21.15.59:0/3528749824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66700c9800 0x7f66700c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:42.855 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.848+0000 7f66753fd640 1 --2- 172.21.15.59:0/3528749824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66700c9420 0x7f66701597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:42.855 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.848+0000 7f6675bfe640 1 -- 172.21.15.59:0/3528749824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66700c9420 msgr2=0x7f66701597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:42.855 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.848+0000 7f6675bfe640 1 --2- 172.21.15.59:0/3528749824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66700c9420 0x7f66701597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:42.856 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.848+0000 7f6675bfe640 1 -- 172.21.15.59:0/3528749824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66700c9800 msgr2=0x7f66700c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:42.856 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.848+0000 7f6675bfe640 1 --2- 172.21.15.59:0/3528749824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66700c9800 0x7f66700c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:42.856 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.848+0000 7f6675bfe640 1 -- 172.21.15.59:0/3528749824 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6668009400 con 0x7f66700cb500 2023-10-16T14:25:42.856 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.848+0000 7f6675bfe640 1 --2- 172.21.15.59:0/3528749824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66700cb500 0x7f66700c7830 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6668009890 tx=0x7f66680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:42.856 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.849+0000 7f6665ffb640 1 -- 172.21.15.59:0/3528749824 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668032840 con 0x7f66700cb500 2023-10-16T14:25:42.857 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.849+0000 7f6665ffb640 1 -- 172.21.15.59:0/3528749824 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66680329a0 con 0x7f66700cb500 2023-10-16T14:25:42.857 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.849+0000 7f6665ffb640 1 -- 172.21.15.59:0/3528749824 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668032d30 con 0x7f66700cb500 2023-10-16T14:25:42.857 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.849+0000 7f66763ff640 1 -- 172.21.15.59:0/3528749824 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66700c8bb0 con 0x7f66700cb500 2023-10-16T14:25:42.857 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.849+0000 7f66763ff640 1 -- 172.21.15.59:0/3528749824 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66700c5d10 con 0x7f66700cb500 2023-10-16T14:25:42.858 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.850+0000 7f66763ff640 1 -- 172.21.15.59:0/3528749824 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66700c64d0 con 0x7f66700cb500 2023-10-16T14:25:42.858 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.851+0000 7f6665ffb640 1 -- 172.21.15.59:0/3528749824 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f666804e430 con 0x7f66700cb500 2023-10-16T14:25:42.859 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.852+0000 7f6665ffb640 1 --2- 172.21.15.59:0/3528749824 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f665406ae70 0x7f665406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:42.859 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.853+0000 7f6665ffb640 1 -- 172.21.15.59:0/3528749824 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f66680ab380 con 0x7f66700cb500 2023-10-16T14:25:42.859 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.853+0000 7f66753fd640 1 --2- 172.21.15.59:0/3528749824 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f665406ae70 0x7f665406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:42.860 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.854+0000 7f66753fd640 1 --2- 172.21.15.59:0/3528749824 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f665406ae70 0x7f665406d330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f666c009ab0 tx=0x7f666c003990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:42.861 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:42.858+0000 7f6665ffb640 1 -- 172.21.15.59:0/3528749824 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f66680766e0 con 0x7f66700cb500 2023-10-16T14:25:43.054 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:43.051+0000 7f66763ff640 1 -- 172.21.15.59:0/3528749824 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6670073f00 con 0x7f66700cb500 2023-10-16T14:25:43.056 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:43.053+0000 7f6665ffb640 1 -- 172.21.15.59:0/3528749824 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f6668079d00 con 0x7f66700cb500 2023-10-16T14:25:43.056 INFO:teuthology.misc.health.smithi059.stdout: 2023-10-16T14:25:43.057 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":18,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:25:38.603746+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:25:43.059 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:43.055+0000 7f66763ff640 1 -- 172.21.15.59:0/3528749824 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f665406ae70 msgr2=0x7f665406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:43.059 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:43.055+0000 7f66763ff640 1 --2- 172.21.15.59:0/3528749824 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f665406ae70 0x7f665406d330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f666c009ab0 tx=0x7f666c003990 comp rx=0 tx=0).stop 2023-10-16T14:25:43.059 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:43.055+0000 7f66763ff640 1 -- 172.21.15.59:0/3528749824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66700cb500 msgr2=0x7f66700c7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:43.060 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:43.055+0000 7f66763ff640 1 --2- 172.21.15.59:0/3528749824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66700cb500 0x7f66700c7830 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6668009890 tx=0x7f66680046c0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.060 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:43.055+0000 7f66763ff640 1 -- 172.21.15.59:0/3528749824 shutdown_connections 2023-10-16T14:25:43.060 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:43.055+0000 7f66763ff640 1 --2- 172.21.15.59:0/3528749824 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f665406ae70 0x7f665406d330 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.060 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:43.055+0000 7f66763ff640 1 --2- 172.21.15.59:0/3528749824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66700cb500 0x7f66700c7830 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.060 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:43.055+0000 7f66763ff640 1 --2- 172.21.15.59:0/3528749824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66700c9800 0x7f66700c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.061 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:43.055+0000 7f66763ff640 1 --2- 172.21.15.59:0/3528749824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66700c9420 0x7f66701597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.061 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:43.055+0000 7f66763ff640 1 -- 172.21.15.59:0/3528749824 >> 172.21.15.59:0/3528749824 conn(0x7f66700ce3e0 msgr2=0x7f66700cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:43.061 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:43.056+0000 7f66763ff640 1 -- 172.21.15.59:0/3528749824 shutdown_connections 2023-10-16T14:25:43.061 INFO:teuthology.misc.health.smithi059.stderr:2023-10-16T14:25:43.056+0000 7f66763ff640 1 -- 172.21.15.59:0/3528749824 wait complete. 2023-10-16T14:25:43.074 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-16T14:25:43.074 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-16T14:25:43.075 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T14:25:43.075 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T14:25:43.084 INFO:tasks.ceph.mds.a:Started 2023-10-16T14:25:43.084 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T14:25:43.085 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T14:25:43.093 INFO:tasks.ceph.mds.c:Started 2023-10-16T14:25:43.094 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T14:25:43.094 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T14:25:43.103 INFO:tasks.ceph.mds.b:Started 2023-10-16T14:25:43.103 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T14:25:43.104 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T14:25:43.112 INFO:tasks.ceph.mds.d:Started 2023-10-16T14:25:43.113 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-16T14:25:43.113 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:25:43.247 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2023-10-16T14:25:43.249 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2023-10-16T14:25:43.270 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-10-16T14:25:43.278 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-10-16T14:25:43.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.305+0000 7fd2368bb640 1 Processor -- start 2023-10-16T14:25:43.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.305+0000 7fd2368bb640 1 -- start start 2023-10-16T14:25:43.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.306+0000 7fd2368bb640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd23015c9d0 0x7fd2300cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:43.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.306+0000 7fd2368bb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2300cf850 0x7fd2300b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:43.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.306+0000 7fd2368bb640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2300d0320 con 0x7fd2300d16a0 2023-10-16T14:25:43.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.306+0000 7fd2368bb640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2300d0600 con 0x7fd23015c9d0 2023-10-16T14:25:43.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.306+0000 7fd2368bb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2300d08e0 con 0x7fd2300cf850 2023-10-16T14:25:43.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.307+0000 7fd2350b8640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd2300d16a0 0x7fd2300cf140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35136/0 (socket says 172.21.15.59:35136) 2023-10-16T14:25:43.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.307+0000 7fd2350b8640 1 -- 172.21.15.59:0/3662578589 learned_addr learned my addr 172.21.15.59:0/3662578589 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:25:43.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.307+0000 7fd2358b9640 1 --2- 172.21.15.59:0/3662578589 >> v2:172.21.15.151:3300/0 conn(0x7fd23015c9d0 0x7fd2300cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:43.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.307+0000 7fd2360ba640 1 --2- 172.21.15.59:0/3662578589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2300cf850 0x7fd2300b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:43.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.307+0000 7fd2348b7640 1 -- 172.21.15.59:0/3662578589 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435111475 0 0) 0x7fd2300d0320 con 0x7fd2300d16a0 2023-10-16T14:25:43.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.307+0000 7fd2348b7640 1 -- 172.21.15.59:0/3662578589 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd21c003520 con 0x7fd2300d16a0 2023-10-16T14:25:43.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.307+0000 7fd2360ba640 1 -- 172.21.15.59:0/3662578589 >> v2:172.21.15.151:3300/0 conn(0x7fd23015c9d0 msgr2=0x7fd2300cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:43.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.307+0000 7fd2360ba640 1 --2- 172.21.15.59:0/3662578589 >> v2:172.21.15.151:3300/0 conn(0x7fd23015c9d0 0x7fd2300cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.307+0000 7fd2360ba640 1 -- 172.21.15.59:0/3662578589 >> v1:172.21.15.59:6789/0 conn(0x7fd2300d16a0 legacy=0x7fd2300cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:43.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.307+0000 7fd2360ba640 1 -- 172.21.15.59:0/3662578589 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2300d0bc0 con 0x7fd2300cf850 2023-10-16T14:25:43.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.307+0000 7fd2358b9640 1 --2- 172.21.15.59:0/3662578589 >> v2:172.21.15.151:3300/0 conn(0x7fd23015c9d0 0x7fd2300cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:25:43.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.308+0000 7fd2360ba640 1 --2- 172.21.15.59:0/3662578589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2300cf850 0x7fd2300b1f80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd228009d90 tx=0x7fd22802beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2555cb4bb1d50feb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:43.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.309+0000 7fd2348b7640 1 -- 172.21.15.59:0/3662578589 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22802cc60 con 0x7fd2300cf850 2023-10-16T14:25:43.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.309+0000 7fd2348b7640 1 -- 172.21.15.59:0/3662578589 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22802cdc0 con 0x7fd2300cf850 2023-10-16T14:25:43.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.309+0000 7fd2348b7640 1 -- 172.21.15.59:0/3662578589 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd228034660 con 0x7fd2300cf850 2023-10-16T14:25:43.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.310+0000 7fd2368bb640 1 -- 172.21.15.59:0/3662578589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2300cf850 msgr2=0x7fd2300b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:43.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.310+0000 7fd2368bb640 1 --2- 172.21.15.59:0/3662578589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2300cf850 0x7fd2300b1f80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd228009d90 tx=0x7fd22802beb0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.310+0000 7fd2368bb640 1 -- 172.21.15.59:0/3662578589 shutdown_connections 2023-10-16T14:25:43.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.310+0000 7fd2368bb640 1 --2- 172.21.15.59:0/3662578589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2300cf850 0x7fd2300b1f80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.310+0000 7fd2368bb640 1 --2- 172.21.15.59:0/3662578589 >> v2:172.21.15.151:3300/0 conn(0x7fd23015c9d0 0x7fd2300cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.310+0000 7fd2368bb640 1 -- 172.21.15.59:0/3662578589 >> 172.21.15.59:0/3662578589 conn(0x7fd23009bad0 msgr2=0x7fd2300d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.310+0000 7fd2368bb640 1 -- 172.21.15.59:0/3662578589 shutdown_connections 2023-10-16T14:25:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.310+0000 7fd2368bb640 1 -- 172.21.15.59:0/3662578589 wait complete. 2023-10-16T14:25:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.312+0000 7fd2368bb640 1 Processor -- start 2023-10-16T14:25:43.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.312+0000 7fd2368bb640 1 -- start start 2023-10-16T14:25:43.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.313+0000 7fd2368bb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2300cf850 0x7fd2301540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:43.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.313+0000 7fd2368bb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2300d16a0 0x7fd2300b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:43.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.313+0000 7fd2368bb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd23015c9d0 0x7fd2300b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:43.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.313+0000 7fd2368bb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2300b68d0 con 0x7fd2300cf850 2023-10-16T14:25:43.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.313+0000 7fd2368bb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2300b5e30 con 0x7fd2300d16a0 2023-10-16T14:25:43.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.313+0000 7fd2368bb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2300b6110 con 0x7fd23015c9d0 2023-10-16T14:25:43.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.313+0000 7fd2358b9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2300cf850 0x7fd2301540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:43.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.313+0000 7fd2358b9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2300cf850 0x7fd2301540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55474/0 (socket says 172.21.15.59:55474) 2023-10-16T14:25:43.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.313+0000 7fd2358b9640 1 -- 172.21.15.59:0/633002030 learned_addr learned my addr 172.21.15.59:0/633002030 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:43.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.313+0000 7fd2350b8640 1 --2- 172.21.15.59:0/633002030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2300d16a0 0x7fd2300b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:43.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.313+0000 7fd2360ba640 1 --2- 172.21.15.59:0/633002030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd23015c9d0 0x7fd2300b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:43.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.314+0000 7fd2358b9640 1 -- 172.21.15.59:0/633002030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd23015c9d0 msgr2=0x7fd2300b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:43.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.314+0000 7fd2358b9640 1 --2- 172.21.15.59:0/633002030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd23015c9d0 0x7fd2300b0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.314+0000 7fd2358b9640 1 -- 172.21.15.59:0/633002030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2300d16a0 msgr2=0x7fd2300b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:43.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.314+0000 7fd2358b9640 1 --2- 172.21.15.59:0/633002030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2300d16a0 0x7fd2300b5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.314+0000 7fd2358b9640 1 -- 172.21.15.59:0/633002030 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c009400 con 0x7fd2300cf850 2023-10-16T14:25:43.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.314+0000 7fd2350b8640 1 --2- 172.21.15.59:0/633002030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2300d16a0 0x7fd2300b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:25:43.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.314+0000 7fd2358b9640 1 --2- 172.21.15.59:0/633002030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2300cf850 0x7fd2301540c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00e960 tx=0x7fd22c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:43.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.314+0000 7fd2267fc640 1 -- 172.21.15.59:0/633002030 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c00ca00 con 0x7fd2300cf850 2023-10-16T14:25:43.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.314+0000 7fd2267fc640 1 -- 172.21.15.59:0/633002030 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c00cb60 con 0x7fd2300cf850 2023-10-16T14:25:43.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.314+0000 7fd2267fc640 1 -- 172.21.15.59:0/633002030 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c013470 con 0x7fd2300cf850 2023-10-16T14:25:43.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.314+0000 7fd2368bb640 1 -- 172.21.15.59:0/633002030 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd228009a70 con 0x7fd2300cf850 2023-10-16T14:25:43.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.314+0000 7fd2368bb640 1 -- 172.21.15.59:0/633002030 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2300c9130 con 0x7fd2300cf850 2023-10-16T14:25:43.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.315+0000 7fd2368bb640 1 -- 172.21.15.59:0/633002030 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23004e9b0 con 0x7fd2300cf850 2023-10-16T14:25:43.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.317+0000 7fd2267fc640 1 -- 172.21.15.59:0/633002030 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd22c0135d0 con 0x7fd2300cf850 2023-10-16T14:25:43.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.317+0000 7fd2267fc640 1 --2- 172.21.15.59:0/633002030 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd21406ae70 0x7fd21406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:43.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.318+0000 7fd2267fc640 1 -- 172.21.15.59:0/633002030 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd22c089540 con 0x7fd2300cf850 2023-10-16T14:25:43.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.318+0000 7fd2350b8640 1 --2- 172.21.15.59:0/633002030 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd21406ae70 0x7fd21406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:43.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.319+0000 7fd2350b8640 1 --2- 172.21.15.59:0/633002030 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd21406ae70 0x7fd21406d330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd2300b0df0 tx=0x7fd220009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:43.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.322+0000 7fd2267fc640 1 -- 172.21.15.59:0/633002030 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd22c054930 con 0x7fd2300cf850 2023-10-16T14:25:43.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.513+0000 7fd2368bb640 1 -- 172.21.15.59:0/633002030 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2300d3320 con 0x7fd2300cf850 2023-10-16T14:25:43.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.515+0000 7fd2267fc640 1 -- 172.21.15.59:0/633002030 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12850 (secure 0 0 0) 0x7fd22c057f50 con 0x7fd2300cf850 2023-10-16T14:25:43.519 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:25:43.519 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":18,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:25:38.603746+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:25:43.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.517+0000 7fd2368bb640 1 -- 172.21.15.59:0/633002030 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd21406ae70 msgr2=0x7fd21406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:43.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.517+0000 7fd2368bb640 1 --2- 172.21.15.59:0/633002030 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd21406ae70 0x7fd21406d330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd2300b0df0 tx=0x7fd220009040 comp rx=0 tx=0).stop 2023-10-16T14:25:43.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.517+0000 7fd2368bb640 1 -- 172.21.15.59:0/633002030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2300cf850 msgr2=0x7fd2301540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:43.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.517+0000 7fd2368bb640 1 --2- 172.21.15.59:0/633002030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2300cf850 0x7fd2301540c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd22c00e960 tx=0x7fd22c00ee20 comp rx=0 tx=0).stop 2023-10-16T14:25:43.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.517+0000 7fd2368bb640 1 -- 172.21.15.59:0/633002030 shutdown_connections 2023-10-16T14:25:43.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.517+0000 7fd2368bb640 1 --2- 172.21.15.59:0/633002030 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd21406ae70 0x7fd21406d330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.517+0000 7fd2368bb640 1 --2- 172.21.15.59:0/633002030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd23015c9d0 0x7fd2300b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.517+0000 7fd2368bb640 1 --2- 172.21.15.59:0/633002030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2300d16a0 0x7fd2300b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.517+0000 7fd2368bb640 1 --2- 172.21.15.59:0/633002030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2300cf850 0x7fd2301540c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.518+0000 7fd2368bb640 1 -- 172.21.15.59:0/633002030 >> 172.21.15.59:0/633002030 conn(0x7fd23009bad0 msgr2=0x7fd23006aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:43.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.518+0000 7fd2368bb640 1 -- 172.21.15.59:0/633002030 shutdown_connections 2023-10-16T14:25:43.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.518+0000 7fd2368bb640 1 -- 172.21.15.59:0/633002030 wait complete. 2023-10-16T14:25:43.540 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T14:25:43.540 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:25:43.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.767+0000 7fc756c39640 1 Processor -- start 2023-10-16T14:25:43.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.767+0000 7fc756c39640 1 -- start start 2023-10-16T14:25:43.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.769+0000 7fc756c39640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc750070400 0x7fc75015e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:43.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.769+0000 7fc756c39640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7500c8930 0x7fc7500707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:43.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.769+0000 7fc756c39640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7500c8e40 con 0x7fc7500ca640 2023-10-16T14:25:43.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.769+0000 7fc756c39640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7500c9090 con 0x7fc750070400 2023-10-16T14:25:43.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.769+0000 7fc756c39640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500c9370 con 0x7fc7500c8930 2023-10-16T14:25:43.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.769+0000 7fc755c37640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc750070400 0x7fc75015e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:43.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.769+0000 7fc755c37640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc750070400 0x7fc75015e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55486/0 (socket says 172.21.15.59:55486) 2023-10-16T14:25:43.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.769+0000 7fc755c37640 1 -- 172.21.15.59:0/3913112043 learned_addr learned my addr 172.21.15.59:0/3913112043 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:43.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.770+0000 7fc755c37640 1 -- 172.21.15.59:0/3913112043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7500c8930 msgr2=0x7fc7500707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:43.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.770+0000 7fc755436640 1 --2- 172.21.15.59:0/3913112043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7500c8930 0x7fc7500707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:43.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.770+0000 7fc755c37640 1 --2- 172.21.15.59:0/3913112043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7500c8930 0x7fc7500707e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.770+0000 7fc755c37640 1 -- 172.21.15.59:0/3913112043 >> v1:172.21.15.151:6789/0 conn(0x7fc7500ca640 legacy=0x7fc7500cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:43.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.770+0000 7fc755c37640 1 -- 172.21.15.59:0/3913112043 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7500c9650 con 0x7fc750070400 2023-10-16T14:25:43.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.771+0000 7fc755c37640 1 --2- 172.21.15.59:0/3913112043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc750070400 0x7fc75015e210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009870 tx=0x7fc74c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5c1ab25e4ce51e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:43.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.771+0000 7fc754c35640 1 -- 172.21.15.59:0/3913112043 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c031640 con 0x7fc750070400 2023-10-16T14:25:43.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.771+0000 7fc754c35640 1 -- 172.21.15.59:0/3913112043 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c0317a0 con 0x7fc750070400 2023-10-16T14:25:43.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.771+0000 7fc754c35640 1 -- 172.21.15.59:0/3913112043 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c031b30 con 0x7fc750070400 2023-10-16T14:25:43.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.772+0000 7fc756c39640 1 -- 172.21.15.59:0/3913112043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc750070400 msgr2=0x7fc75015e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:43.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.772+0000 7fc756c39640 1 --2- 172.21.15.59:0/3913112043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc750070400 0x7fc75015e210 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009870 tx=0x7fc74c02b8f0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.772+0000 7fc756c39640 1 -- 172.21.15.59:0/3913112043 shutdown_connections 2023-10-16T14:25:43.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.772+0000 7fc756c39640 1 --2- 172.21.15.59:0/3913112043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7500c8930 0x7fc7500707e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.772+0000 7fc756c39640 1 --2- 172.21.15.59:0/3913112043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc750070400 0x7fc75015e210 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.772+0000 7fc756c39640 1 -- 172.21.15.59:0/3913112043 >> 172.21.15.59:0/3913112043 conn(0x7fc75006a470 msgr2=0x7fc7500afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:43.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.772+0000 7fc756c39640 1 -- 172.21.15.59:0/3913112043 shutdown_connections 2023-10-16T14:25:43.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.772+0000 7fc756c39640 1 -- 172.21.15.59:0/3913112043 wait complete. 2023-10-16T14:25:43.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.774+0000 7fc756c39640 1 Processor -- start 2023-10-16T14:25:43.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.774+0000 7fc756c39640 1 -- start start 2023-10-16T14:25:43.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.775+0000 7fc756c39640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc750070400 0x7fc75014d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:43.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.775+0000 7fc756c39640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7500c8930 0x7fc7500c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:43.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.775+0000 7fc756c39640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7500ca640 0x7fc7501594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:43.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.775+0000 7fc756c39640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500c8480 con 0x7fc7500c8930 2023-10-16T14:25:43.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.775+0000 7fc756c39640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500c3f20 con 0x7fc7500ca640 2023-10-16T14:25:43.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.775+0000 7fc756c39640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500c4450 con 0x7fc750070400 2023-10-16T14:25:43.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.775+0000 7fc755436640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7500c8930 0x7fc7500c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:43.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.775+0000 7fc755436640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7500c8930 0x7fc7500c53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55492/0 (socket says 172.21.15.59:55492) 2023-10-16T14:25:43.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.775+0000 7fc755436640 1 -- 172.21.15.59:0/1604261470 learned_addr learned my addr 172.21.15.59:0/1604261470 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:43.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.776+0000 7fc755436640 1 -- 172.21.15.59:0/1604261470 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc750070400 msgr2=0x7fc75014d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:43.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.776+0000 7fc755436640 1 --2- 172.21.15.59:0/1604261470 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc750070400 0x7fc75014d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.776+0000 7fc755436640 1 -- 172.21.15.59:0/1604261470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7500ca640 msgr2=0x7fc7501594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:43.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.776+0000 7fc755436640 1 --2- 172.21.15.59:0/1604261470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7500ca640 0x7fc7501594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.776+0000 7fc755436640 1 -- 172.21.15.59:0/1604261470 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74c0094d0 con 0x7fc7500c8930 2023-10-16T14:25:43.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.776+0000 7fc755436640 1 --2- 172.21.15.59:0/1604261470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7500c8930 0x7fc7500c53b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc74000c820 tx=0x7fc74000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:43.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.776+0000 7fc7467fc640 1 -- 172.21.15.59:0/1604261470 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740004220 con 0x7fc7500c8930 2023-10-16T14:25:43.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.776+0000 7fc7467fc640 1 -- 172.21.15.59:0/1604261470 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc740004380 con 0x7fc7500c8930 2023-10-16T14:25:43.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.776+0000 7fc756c39640 1 -- 172.21.15.59:0/1604261470 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7500c7ff0 con 0x7fc7500c8930 2023-10-16T14:25:43.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.776+0000 7fc7467fc640 1 -- 172.21.15.59:0/1604261470 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc740007a70 con 0x7fc7500c8930 2023-10-16T14:25:43.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.776+0000 7fc756c39640 1 -- 172.21.15.59:0/1604261470 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7500c4170 con 0x7fc7500c8930 2023-10-16T14:25:43.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.778+0000 7fc756c39640 1 -- 172.21.15.59:0/1604261470 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75004e9b0 con 0x7fc7500c8930 2023-10-16T14:25:43.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.779+0000 7fc7467fc640 1 -- 172.21.15.59:0/1604261470 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc740007bd0 con 0x7fc7500c8930 2023-10-16T14:25:43.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.780+0000 7fc7467fc640 1 --2- 172.21.15.59:0/1604261470 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc73406ae70 0x7fc73406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:43.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.780+0000 7fc7467fc640 1 -- 172.21.15.59:0/1604261470 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc740088f30 con 0x7fc7500c8930 2023-10-16T14:25:43.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.780+0000 7fc755c37640 1 --2- 172.21.15.59:0/1604261470 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc73406ae70 0x7fc73406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:43.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.782+0000 7fc755c37640 1 --2- 172.21.15.59:0/1604261470 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc73406ae70 0x7fc73406d330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc74c036000 tx=0x7fc74c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:43.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.784+0000 7fc7467fc640 1 -- 172.21.15.59:0/1604261470 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc7400543c0 con 0x7fc7500c8930 2023-10-16T14:25:43.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.976+0000 7fc756c39640 1 -- 172.21.15.59:0/1604261470 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7500c8180 con 0x7fc7500c8930 2023-10-16T14:25:43.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.977+0000 7fc7467fc640 1 -- 172.21.15.59:0/1604261470 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc74001e0a0 con 0x7fc7500c8930 2023-10-16T14:25:43.981 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:25:43.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.979+0000 7fc756c39640 1 -- 172.21.15.59:0/1604261470 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc73406ae70 msgr2=0x7fc73406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:43.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.979+0000 7fc756c39640 1 --2- 172.21.15.59:0/1604261470 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc73406ae70 0x7fc73406d330 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc74c036000 tx=0x7fc74c030000 comp rx=0 tx=0).stop 2023-10-16T14:25:43.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.979+0000 7fc756c39640 1 -- 172.21.15.59:0/1604261470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7500c8930 msgr2=0x7fc7500c53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:43.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.979+0000 7fc756c39640 1 --2- 172.21.15.59:0/1604261470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7500c8930 0x7fc7500c53b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc74000c820 tx=0x7fc74000cce0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.980+0000 7fc756c39640 1 -- 172.21.15.59:0/1604261470 shutdown_connections 2023-10-16T14:25:43.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.980+0000 7fc756c39640 1 --2- 172.21.15.59:0/1604261470 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc73406ae70 0x7fc73406d330 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.980+0000 7fc756c39640 1 --2- 172.21.15.59:0/1604261470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7500ca640 0x7fc7501594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.980+0000 7fc756c39640 1 --2- 172.21.15.59:0/1604261470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7500c8930 0x7fc7500c53b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.980+0000 7fc756c39640 1 --2- 172.21.15.59:0/1604261470 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc750070400 0x7fc75014d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.980+0000 7fc756c39640 1 -- 172.21.15.59:0/1604261470 >> 172.21.15.59:0/1604261470 conn(0x7fc75006a470 msgr2=0x7fc75015e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.980+0000 7fc756c39640 1 -- 172.21.15.59:0/1604261470 shutdown_connections 2023-10-16T14:25:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:43.980+0000 7fc756c39640 1 -- 172.21.15.59:0/1604261470 wait complete. 2023-10-16T14:25:44.002 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T14:25:44.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.219+0000 7f197930f640 1 Processor -- start 2023-10-16T14:25:44.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.220+0000 7f197930f640 1 -- start start 2023-10-16T14:25:44.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.221+0000 7f197930f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19740b0010 0x7f19740701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:44.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.221+0000 7f197930f640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f197415f040 0x7f197415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:44.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.221+0000 7f197930f640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19740707f0 con 0x7f197415ad00 2023-10-16T14:25:44.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.221+0000 7f197930f640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1974070ad0 con 0x7f197415f040 2023-10-16T14:25:44.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.221+0000 7f197930f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197415b1d0 con 0x7f19740b0010 2023-10-16T14:25:44.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.222+0000 7f19737fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f197415f040 0x7f197415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:44.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.222+0000 7f19727fc640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f197415ad00 0x7f19740b03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35152/0 (socket says 172.21.15.59:35152) 2023-10-16T14:25:44.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.222+0000 7f19727fc640 1 -- 172.21.15.59:0/1192310514 learned_addr learned my addr 172.21.15.59:0/1192310514 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:25:44.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.222+0000 7f1972ffd640 1 --2- 172.21.15.59:0/1192310514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19740b0010 0x7f19740701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:44.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.222+0000 7f1971ffb640 1 -- 172.21.15.59:0/1192310514 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973615616 0 0) 0x7f19740707f0 con 0x7f197415ad00 2023-10-16T14:25:44.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.222+0000 7f1971ffb640 1 -- 172.21.15.59:0/1192310514 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1960003520 con 0x7f197415ad00 2023-10-16T14:25:44.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.222+0000 7f19737fe640 1 -- 172.21.15.59:0/1192310514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19740b0010 msgr2=0x7f19740701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:44.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.222+0000 7f19737fe640 1 --2- 172.21.15.59:0/1192310514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19740b0010 0x7f19740701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:44.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.222+0000 7f19737fe640 1 -- 172.21.15.59:0/1192310514 >> v1:172.21.15.59:6789/0 conn(0x7f197415ad00 legacy=0x7f19740b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:44.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.222+0000 7f19737fe640 1 -- 172.21.15.59:0/1192310514 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197415b4b0 con 0x7f197415f040 2023-10-16T14:25:44.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.222+0000 7f1972ffd640 1 --2- 172.21.15.59:0/1192310514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19740b0010 0x7f19740701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:25:44.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.223+0000 7f19737fe640 1 --2- 172.21.15.59:0/1192310514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f197415f040 0x7f197415b9d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f196c0097a0 tx=0x7f196c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8374e918d34fb4d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:44.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.224+0000 7f1971ffb640 1 -- 172.21.15.59:0/1192310514 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c02d040 con 0x7f197415f040 2023-10-16T14:25:44.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.224+0000 7f1971ffb640 1 -- 172.21.15.59:0/1192310514 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196c031810 con 0x7f197415f040 2023-10-16T14:25:44.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.224+0000 7f1971ffb640 1 -- 172.21.15.59:0/1192310514 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c031b80 con 0x7f197415f040 2023-10-16T14:25:44.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.224+0000 7f197930f640 1 -- 172.21.15.59:0/1192310514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f197415f040 msgr2=0x7f197415b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:44.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.224+0000 7f197930f640 1 --2- 172.21.15.59:0/1192310514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f197415f040 0x7f197415b9d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f196c0097a0 tx=0x7f196c02b8b0 comp rx=0 tx=0).stop 2023-10-16T14:25:44.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.224+0000 7f197930f640 1 -- 172.21.15.59:0/1192310514 shutdown_connections 2023-10-16T14:25:44.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.224+0000 7f197930f640 1 --2- 172.21.15.59:0/1192310514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f197415f040 0x7f197415b9d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:44.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.224+0000 7f197930f640 1 --2- 172.21.15.59:0/1192310514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19740b0010 0x7f19740701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:44.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.224+0000 7f197930f640 1 -- 172.21.15.59:0/1192310514 >> 172.21.15.59:0/1192310514 conn(0x7f197406c1c0 msgr2=0x7f197406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:44.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.224+0000 7f197930f640 1 -- 172.21.15.59:0/1192310514 shutdown_connections 2023-10-16T14:25:44.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.225+0000 7f197930f640 1 -- 172.21.15.59:0/1192310514 wait complete. 2023-10-16T14:25:44.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.226+0000 7f197930f640 1 Processor -- start 2023-10-16T14:25:44.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.226+0000 7f197930f640 1 -- start start 2023-10-16T14:25:44.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.227+0000 7f197930f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19740b0010 0x7f19740c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:44.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.227+0000 7f197930f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f197415ad00 0x7f1974147b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:44.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.227+0000 7f197930f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f197415f040 0x7f19740c2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:44.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.227+0000 7f197930f640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197415e2a0 con 0x7f197415f040 2023-10-16T14:25:44.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.227+0000 7f197930f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19740c69b0 con 0x7f19740b0010 2023-10-16T14:25:44.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.227+0000 7f197930f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19740c5d40 con 0x7f197415ad00 2023-10-16T14:25:44.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.228+0000 7f19737fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f197415f040 0x7f19740c2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:44.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.228+0000 7f19737fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f197415f040 0x7f19740c2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55522/0 (socket says 172.21.15.59:55522) 2023-10-16T14:25:44.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.228+0000 7f19737fe640 1 -- 172.21.15.59:0/3336896979 learned_addr learned my addr 172.21.15.59:0/3336896979 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:44.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.228+0000 7f1972ffd640 1 --2- 172.21.15.59:0/3336896979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19740b0010 0x7f19740c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:44.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.228+0000 7f19727fc640 1 --2- 172.21.15.59:0/3336896979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f197415ad00 0x7f1974147b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:44.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.228+0000 7f19737fe640 1 -- 172.21.15.59:0/3336896979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f197415ad00 msgr2=0x7f1974147b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:44.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.228+0000 7f19737fe640 1 --2- 172.21.15.59:0/3336896979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f197415ad00 0x7f1974147b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:44.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.228+0000 7f19737fe640 1 -- 172.21.15.59:0/3336896979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19740b0010 msgr2=0x7f19740c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:44.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.228+0000 7f19737fe640 1 --2- 172.21.15.59:0/3336896979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19740b0010 0x7f19740c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:44.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.228+0000 7f19737fe640 1 -- 172.21.15.59:0/3336896979 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c009400 con 0x7f197415f040 2023-10-16T14:25:44.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.228+0000 7f1972ffd640 1 --2- 172.21.15.59:0/3336896979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19740b0010 0x7f19740c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:25:44.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.229+0000 7f19737fe640 1 --2- 172.21.15.59:0/3336896979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f197415f040 0x7f19740c2840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f196c02b8f0 tx=0x7f196c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:44.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.229+0000 7f196b7fe640 1 -- 172.21.15.59:0/3336896979 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c006e10 con 0x7f197415f040 2023-10-16T14:25:44.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.229+0000 7f196b7fe640 1 -- 172.21.15.59:0/3336896979 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196c03ad60 con 0x7f197415f040 2023-10-16T14:25:44.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.229+0000 7f196b7fe640 1 -- 172.21.15.59:0/3336896979 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c042630 con 0x7f197415f040 2023-10-16T14:25:44.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.229+0000 7f197930f640 1 -- 172.21.15.59:0/3336896979 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19740c6020 con 0x7f197415f040 2023-10-16T14:25:44.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.229+0000 7f197930f640 1 -- 172.21.15.59:0/3336896979 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19740c65e0 con 0x7f197415f040 2023-10-16T14:25:44.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.230+0000 7f197930f640 1 -- 172.21.15.59:0/3336896979 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197415b8d0 con 0x7f197415f040 2023-10-16T14:25:44.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.231+0000 7f196b7fe640 1 -- 172.21.15.59:0/3336896979 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f196c042790 con 0x7f197415f040 2023-10-16T14:25:44.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.232+0000 7f196b7fe640 1 --2- 172.21.15.59:0/3336896979 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f195406ae70 0x7f195406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:44.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.232+0000 7f196b7fe640 1 -- 172.21.15.59:0/3336896979 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f196c0ab1a0 con 0x7f197415f040 2023-10-16T14:25:44.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.233+0000 7f1972ffd640 1 --2- 172.21.15.59:0/3336896979 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f195406ae70 0x7f195406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:44.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.234+0000 7f1972ffd640 1 --2- 172.21.15.59:0/3336896979 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f195406ae70 0x7f195406d330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1964009b40 tx=0x7f1964003a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:44.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.236+0000 7f196b7fe640 1 -- 172.21.15.59:0/3336896979 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f196c076590 con 0x7f197415f040 2023-10-16T14:25:44.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.474+0000 7f197930f640 1 -- 172.21.15.59:0/3336896979 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1974073ef0 con 0x7f197415f040 2023-10-16T14:25:44.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.476+0000 7f196b7fe640 1 -- 172.21.15.59:0/3336896979 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3697 (secure 0 0 0) 0x7f196c079bb0 con 0x7f197415f040 2023-10-16T14:25:44.479 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:25:44.480 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3959035293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3959035293},{"type":"v1","addr":"172.21.15.59:6834","nonce":3959035293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1298271347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1298271347},{"type":"v1","addr":"172.21.15.151:6835","nonce":1298271347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/249904108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":249904108},{"type":"v1","addr":"172.21.15.59:6835","nonce":249904108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/4004038733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4004038733},{"type":"v1","addr":"172.21.15.151:6837","nonce":4004038733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-16T14:25:44.480 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 3 2023-10-16T14:25:44.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.478+0000 7f197930f640 1 -- 172.21.15.59:0/3336896979 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f195406ae70 msgr2=0x7f195406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:44.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.478+0000 7f197930f640 1 --2- 172.21.15.59:0/3336896979 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f195406ae70 0x7f195406d330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1964009b40 tx=0x7f1964003a30 comp rx=0 tx=0).stop 2023-10-16T14:25:44.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.478+0000 7f197930f640 1 -- 172.21.15.59:0/3336896979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f197415f040 msgr2=0x7f19740c2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:44.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.478+0000 7f197930f640 1 --2- 172.21.15.59:0/3336896979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f197415f040 0x7f19740c2840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f196c02b8f0 tx=0x7f196c0046c0 comp rx=0 tx=0).stop 2023-10-16T14:25:44.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.478+0000 7f197930f640 1 -- 172.21.15.59:0/3336896979 shutdown_connections 2023-10-16T14:25:44.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.478+0000 7f197930f640 1 --2- 172.21.15.59:0/3336896979 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f195406ae70 0x7f195406d330 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:44.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.478+0000 7f197930f640 1 --2- 172.21.15.59:0/3336896979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f197415f040 0x7f19740c2840 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:44.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.478+0000 7f197930f640 1 --2- 172.21.15.59:0/3336896979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f197415ad00 0x7f1974147b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:44.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.478+0000 7f197930f640 1 --2- 172.21.15.59:0/3336896979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19740b0010 0x7f19740c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:44.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.478+0000 7f197930f640 1 -- 172.21.15.59:0/3336896979 >> 172.21.15.59:0/3336896979 conn(0x7f197406c1c0 msgr2=0x7f19740adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:44.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.479+0000 7f197930f640 1 -- 172.21.15.59:0/3336896979 shutdown_connections 2023-10-16T14:25:44.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.479+0000 7f197930f640 1 -- 172.21.15.59:0/3336896979 wait complete. 2023-10-16T14:25:44.500 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:25:44.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.714+0000 7fc8d759e640 1 Processor -- start 2023-10-16T14:25:44.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.714+0000 7fc8d759e640 1 -- start start 2023-10-16T14:25:44.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.716+0000 7fc8d759e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc8d80cb250 0x7fc8d80c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:44.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.716+0000 7fc8d759e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d815acb0 con 0x7fc8d80ca660 2023-10-16T14:25:44.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.716+0000 7fc8d759e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d80c1c60 con 0x7fc8d815a8d0 2023-10-16T14:25:44.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.716+0000 7fc8d759e640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d815e350 con 0x7fc8d80cb250 2023-10-16T14:25:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.716+0000 7fc8d5d9b640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc8d80cb250 0x7fc8d80c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.716+0000 7fc8d6d9d640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc8d80ca660 0x7fc8d80c9350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35156/0 (socket says 172.21.15.59:35156) 2023-10-16T14:25:44.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.716+0000 7fc8d6d9d640 1 -- 172.21.15.59:0/4034867190 learned_addr learned my addr 172.21.15.59:0/4034867190 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:25:44.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.717+0000 7fc8d5d9b640 1 -- 172.21.15.59:0/4034867190 >> v1:172.21.15.151:6789/0 conn(0x7fc8d815a8d0 legacy=0x7fc8d80cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:44.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.717+0000 7fc8d5d9b640 1 -- 172.21.15.59:0/4034867190 >> v1:172.21.15.59:6789/0 conn(0x7fc8d80ca660 legacy=0x7fc8d80c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:44.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.717+0000 7fc8d5d9b640 1 -- 172.21.15.59:0/4034867190 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d815e630 con 0x7fc8d80cb250 2023-10-16T14:25:44.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.717+0000 7fc8d559a640 1 -- 172.21.15.59:0/4034867190 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 849805763 0 0) 0x7fc8d0001110 con 0x7fc8d80ca660 2023-10-16T14:25:44.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.718+0000 7fc8d5d9b640 1 --2- 172.21.15.59:0/4034867190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8d80cb250 0x7fc8d80c8e10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80c1df0 tx=0x7fc8c002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbed8189dbf4e471 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:44.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.718+0000 7fc8d559a640 1 -- 172.21.15.59:0/4034867190 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c002cc50 con 0x7fc8d80cb250 2023-10-16T14:25:44.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.719+0000 7fc8d559a640 1 -- 172.21.15.59:0/4034867190 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c002cdb0 con 0x7fc8d80cb250 2023-10-16T14:25:44.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.719+0000 7fc8d559a640 1 -- 172.21.15.59:0/4034867190 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0034660 con 0x7fc8d80cb250 2023-10-16T14:25:44.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.719+0000 7fc8d759e640 1 -- 172.21.15.59:0/4034867190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8d80cb250 msgr2=0x7fc8d80c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:44.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.719+0000 7fc8d759e640 1 --2- 172.21.15.59:0/4034867190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8d80cb250 0x7fc8d80c8e10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80c1df0 tx=0x7fc8c002bea0 comp rx=0 tx=0).stop 2023-10-16T14:25:44.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.719+0000 7fc8d759e640 1 -- 172.21.15.59:0/4034867190 shutdown_connections 2023-10-16T14:25:44.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.719+0000 7fc8d759e640 1 --2- 172.21.15.59:0/4034867190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8d80cb250 0x7fc8d80c8e10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:44.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.719+0000 7fc8d759e640 1 -- 172.21.15.59:0/4034867190 >> 172.21.15.59:0/4034867190 conn(0x7fc8d806a470 msgr2=0x7fc8d80afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:44.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.719+0000 7fc8d759e640 1 -- 172.21.15.59:0/4034867190 shutdown_connections 2023-10-16T14:25:44.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.719+0000 7fc8d759e640 1 -- 172.21.15.59:0/4034867190 wait complete. 2023-10-16T14:25:44.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.721+0000 7fc8d759e640 1 Processor -- start 2023-10-16T14:25:44.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.721+0000 7fc8d759e640 1 -- start start 2023-10-16T14:25:44.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.722+0000 7fc8d759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8d80ca660 0x7fc8d80cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:44.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.722+0000 7fc8d759e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8d80cb250 0x7fc8d814fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:44.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.722+0000 7fc8d759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8d815a8d0 0x7fc8d80c2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.722+0000 7fc8d759e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d80cda30 con 0x7fc8d80cb250 2023-10-16T14:25:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.722+0000 7fc8d759e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d80ac220 con 0x7fc8d815a8d0 2023-10-16T14:25:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.722+0000 7fc8d759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d80ad1d0 con 0x7fc8d80ca660 2023-10-16T14:25:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.722+0000 7fc8d5d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8d80cb250 0x7fc8d814fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:44.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.722+0000 7fc8d5d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8d80cb250 0x7fc8d814fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55538/0 (socket says 172.21.15.59:55538) 2023-10-16T14:25:44.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.722+0000 7fc8d5d9b640 1 -- 172.21.15.59:0/52469895 learned_addr learned my addr 172.21.15.59:0/52469895 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:44.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.723+0000 7fc8d6d9d640 1 --2- 172.21.15.59:0/52469895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8d815a8d0 0x7fc8d80c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:44.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.723+0000 7fc8d5d9b640 1 -- 172.21.15.59:0/52469895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8d80ca660 msgr2=0x7fc8d80cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:44.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.723+0000 7fc8d5d9b640 1 --2- 172.21.15.59:0/52469895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8d80ca660 0x7fc8d80cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:44.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.723+0000 7fc8d5d9b640 1 -- 172.21.15.59:0/52469895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8d815a8d0 msgr2=0x7fc8d80c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:44.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.723+0000 7fc8d5d9b640 1 --2- 172.21.15.59:0/52469895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8d815a8d0 0x7fc8d80c2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:44.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.723+0000 7fc8d5d9b640 1 -- 172.21.15.59:0/52469895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c0009a70 con 0x7fc8d80cb250 2023-10-16T14:25:44.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.723+0000 7fc8d6d9d640 1 --2- 172.21.15.59:0/52469895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8d815a8d0 0x7fc8d80c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:25:44.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.723+0000 7fc8d5d9b640 1 --2- 172.21.15.59:0/52469895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8d80cb250 0x7fc8d814fbb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009e80 tx=0x7fc8c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:44.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.723+0000 7fc8ceffd640 1 -- 172.21.15.59:0/52469895 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c003e610 con 0x7fc8d80cb250 2023-10-16T14:25:44.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.723+0000 7fc8ceffd640 1 -- 172.21.15.59:0/52469895 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c003e770 con 0x7fc8d80cb250 2023-10-16T14:25:44.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.723+0000 7fc8ceffd640 1 -- 172.21.15.59:0/52469895 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c003eb20 con 0x7fc8d80cb250 2023-10-16T14:25:44.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.723+0000 7fc8d759e640 1 -- 172.21.15.59:0/52469895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d80acd40 con 0x7fc8d80cb250 2023-10-16T14:25:44.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.724+0000 7fc8d759e640 1 -- 172.21.15.59:0/52469895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d81500f0 con 0x7fc8d80cb250 2023-10-16T14:25:44.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.725+0000 7fc8d759e640 1 -- 172.21.15.59:0/52469895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d804e9b0 con 0x7fc8d80cb250 2023-10-16T14:25:44.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.726+0000 7fc8ceffd640 1 -- 172.21.15.59:0/52469895 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc8c003b050 con 0x7fc8d80cb250 2023-10-16T14:25:44.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.727+0000 7fc8ceffd640 1 --2- 172.21.15.59:0/52469895 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc8b806ae70 0x7fc8b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:44.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.727+0000 7fc8ceffd640 1 -- 172.21.15.59:0/52469895 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc8c00abc60 con 0x7fc8d80cb250 2023-10-16T14:25:44.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.727+0000 7fc8d659c640 1 --2- 172.21.15.59:0/52469895 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc8b806ae70 0x7fc8b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:44.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.728+0000 7fc8d659c640 1 --2- 172.21.15.59:0/52469895 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc8b806ae70 0x7fc8b806d330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8009650 tx=0x7fc8c8006bb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:44.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.732+0000 7fc8ceffd640 1 -- 172.21.15.59:0/52469895 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc8c0077050 con 0x7fc8d80cb250 2023-10-16T14:25:44.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.927+0000 7fc8d759e640 1 -- 172.21.15.59:0/52469895 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8d80b0d70 con 0x7fc8d80cb250 2023-10-16T14:25:44.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.928+0000 7fc8ceffd640 1 -- 172.21.15.59:0/52469895 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12850 (secure 0 0 0) 0x7fc8c0039090 con 0x7fc8d80cb250 2023-10-16T14:25:44.932 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:25:44.932 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":18,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:25:38.603746+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:25:44.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.931+0000 7fc8d759e640 1 -- 172.21.15.59:0/52469895 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc8b806ae70 msgr2=0x7fc8b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:44.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.931+0000 7fc8d759e640 1 --2- 172.21.15.59:0/52469895 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc8b806ae70 0x7fc8b806d330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8009650 tx=0x7fc8c8006bb0 comp rx=0 tx=0).stop 2023-10-16T14:25:44.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.931+0000 7fc8d759e640 1 -- 172.21.15.59:0/52469895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8d80cb250 msgr2=0x7fc8d814fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:44.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.931+0000 7fc8d759e640 1 --2- 172.21.15.59:0/52469895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8d80cb250 0x7fc8d814fbb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009e80 tx=0x7fc8c0004a40 comp rx=0 tx=0).stop 2023-10-16T14:25:44.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.931+0000 7fc8d759e640 1 -- 172.21.15.59:0/52469895 shutdown_connections 2023-10-16T14:25:44.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.931+0000 7fc8d759e640 1 --2- 172.21.15.59:0/52469895 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc8b806ae70 0x7fc8b806d330 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:44.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.931+0000 7fc8d759e640 1 --2- 172.21.15.59:0/52469895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8d815a8d0 0x7fc8d80c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:44.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.931+0000 7fc8d759e640 1 --2- 172.21.15.59:0/52469895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8d80cb250 0x7fc8d814fbb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:44.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.931+0000 7fc8d759e640 1 --2- 172.21.15.59:0/52469895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8d80ca660 0x7fc8d80cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:44.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.931+0000 7fc8d759e640 1 -- 172.21.15.59:0/52469895 >> 172.21.15.59:0/52469895 conn(0x7fc8d806a470 msgr2=0x7fc8d8158710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:44.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.931+0000 7fc8d759e640 1 -- 172.21.15.59:0/52469895 shutdown_connections 2023-10-16T14:25:44.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:44.931+0000 7fc8d759e640 1 -- 172.21.15.59:0/52469895 wait complete. 2023-10-16T14:25:44.954 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T14:25:44.955 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:25:45.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.182+0000 7fe820c02640 1 Processor -- start 2023-10-16T14:25:45.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.182+0000 7fe820c02640 1 -- start start 2023-10-16T14:25:45.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.184+0000 7fe820c02640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe81c06b570 0x7fe81c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:45.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.184+0000 7fe820c02640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c0ce690 con 0x7fe81c0b1a30 2023-10-16T14:25:45.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.184+0000 7fe820c02640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c06bf20 con 0x7fe81c0d0cd0 2023-10-16T14:25:45.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.184+0000 7fe820c02640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81c0cfc20 con 0x7fe81c06b570 2023-10-16T14:25:45.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.184+0000 7fe81b7fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe81c0b1a30 0x7fe81c0cdf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35170/0 (socket says 172.21.15.59:35170) 2023-10-16T14:25:45.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.184+0000 7fe81b7fe640 1 -- 172.21.15.59:0/804539481 learned_addr learned my addr 172.21.15.59:0/804539481 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:25:45.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.185+0000 7fe81affd640 1 -- 172.21.15.59:0/804539481 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2451745260 0 0) 0x7fe81c0ce690 con 0x7fe81c0b1a30 2023-10-16T14:25:45.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.185+0000 7fe81affd640 1 -- 172.21.15.59:0/804539481 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe808003520 con 0x7fe81c0b1a30 2023-10-16T14:25:45.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.185+0000 7fe81bfff640 1 --2- 172.21.15.59:0/804539481 >> v2:172.21.15.151:3300/0 conn(0x7fe81c06b570 0x7fe81c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:45.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.185+0000 7fe81affd640 1 -- 172.21.15.59:0/804539481 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 658418898 0 0) 0x7fe808003520 con 0x7fe81c0b1a30 2023-10-16T14:25:45.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.185+0000 7fe81affd640 1 -- 172.21.15.59:0/804539481 >> v2:172.21.15.151:3300/0 conn(0x7fe81c06b570 msgr2=0x7fe81c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:45.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.185+0000 7fe81affd640 1 --2- 172.21.15.59:0/804539481 >> v2:172.21.15.151:3300/0 conn(0x7fe81c06b570 0x7fe81c06b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.185+0000 7fe81affd640 1 -- 172.21.15.59:0/804539481 >> v1:172.21.15.151:6789/0 conn(0x7fe81c0d0cd0 legacy=0x7fe81c0d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:45.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.185+0000 7fe81affd640 1 -- 172.21.15.59:0/804539481 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c0cd4a0 con 0x7fe81c0b1a30 2023-10-16T14:25:45.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.185+0000 7fe81affd640 1 -- 172.21.15.59:0/804539481 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7fe80c001670 con 0x7fe81c0b1a30 2023-10-16T14:25:45.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.185+0000 7fe81bfff640 1 --2- 172.21.15.59:0/804539481 >> v2:172.21.15.151:3300/0 conn(0x7fe81c06b570 0x7fe81c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:25:45.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.185+0000 7fe81affd640 1 -- 172.21.15.59:0/804539481 >> v1:172.21.15.59:6789/0 conn(0x7fe81c0b1a30 legacy=0x7fe81c0cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:45.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.185+0000 7fe81affd640 1 --2- 172.21.15.59:0/804539481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe808003970 0x7fe808003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:45.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.185+0000 7fe81affd640 1 --2- 172.21.15.59:0/804539481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8080047c0 0x7fe808004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:45.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.185+0000 7fe81affd640 1 --2- 172.21.15.59:0/804539481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe808005180 0x7fe80800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:45.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.185+0000 7fe81affd640 1 -- 172.21.15.59:0/804539481 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0cfc20 con 0x7fe808005180 2023-10-16T14:25:45.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.185+0000 7fe81affd640 1 -- 172.21.15.59:0/804539481 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80800c0d0 con 0x7fe808003970 2023-10-16T14:25:45.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.185+0000 7fe81affd640 1 -- 172.21.15.59:0/804539481 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80800c290 con 0x7fe8080047c0 2023-10-16T14:25:45.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.186+0000 7fe81bfff640 1 --2- 172.21.15.59:0/804539481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe808005180 0x7fe80800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:45.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.186+0000 7fe81b7fe640 1 --2- 172.21.15.59:0/804539481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe808003970 0x7fe808003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:45.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.186+0000 7fe813fff640 1 --2- 172.21.15.59:0/804539481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8080047c0 0x7fe808004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:45.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.186+0000 7fe81bfff640 1 -- 172.21.15.59:0/804539481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8080047c0 msgr2=0x7fe808004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:45.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.186+0000 7fe81bfff640 1 --2- 172.21.15.59:0/804539481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8080047c0 0x7fe808004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.186+0000 7fe81bfff640 1 -- 172.21.15.59:0/804539481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe808003970 msgr2=0x7fe808003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:45.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.186+0000 7fe81bfff640 1 --2- 172.21.15.59:0/804539481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe808003970 0x7fe808003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.186+0000 7fe81bfff640 1 -- 172.21.15.59:0/804539481 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe808003520 con 0x7fe808005180 2023-10-16T14:25:45.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.186+0000 7fe813fff640 1 --2- 172.21.15.59:0/804539481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8080047c0 0x7fe808004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:25:45.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.187+0000 7fe81bfff640 1 -- 172.21.15.59:0/804539481 reap_dead start 2023-10-16T14:25:45.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.187+0000 7fe81bfff640 1 --2- 172.21.15.59:0/804539481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe808005180 0x7fe80800b980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe8140073e0 tx=0x7fe8080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3ff72999f967d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:45.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.188+0000 7fe81affd640 1 -- 172.21.15.59:0/804539481 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81402cdc0 con 0x7fe808005180 2023-10-16T14:25:45.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.188+0000 7fe81affd640 1 -- 172.21.15.59:0/804539481 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe814034440 con 0x7fe808005180 2023-10-16T14:25:45.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.188+0000 7fe81affd640 1 -- 172.21.15.59:0/804539481 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8140347f0 con 0x7fe808005180 2023-10-16T14:25:45.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.188+0000 7fe820c02640 1 -- 172.21.15.59:0/804539481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe808005180 msgr2=0x7fe80800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:45.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.188+0000 7fe820c02640 1 --2- 172.21.15.59:0/804539481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe808005180 0x7fe80800b980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe8140073e0 tx=0x7fe8080057f0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.188+0000 7fe820c02640 1 -- 172.21.15.59:0/804539481 shutdown_connections 2023-10-16T14:25:45.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.188+0000 7fe820c02640 1 --2- 172.21.15.59:0/804539481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe808005180 0x7fe80800b980 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.188+0000 7fe820c02640 1 -- 172.21.15.59:0/804539481 >> 172.21.15.59:0/804539481 conn(0x7fe81c08c140 msgr2=0x7fe81c09ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:45.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.188+0000 7fe820c02640 1 -- 172.21.15.59:0/804539481 shutdown_connections 2023-10-16T14:25:45.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.188+0000 7fe820c02640 1 -- 172.21.15.59:0/804539481 wait complete. 2023-10-16T14:25:45.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.190+0000 7fe820c02640 1 Processor -- start 2023-10-16T14:25:45.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.190+0000 7fe820c02640 1 -- start start 2023-10-16T14:25:45.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.191+0000 7fe820c02640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe808005180 0x7fe81c0b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:45.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.191+0000 7fe820c02640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe81c153ca0 0x7fe81c0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:45.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.191+0000 7fe820c02640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe81c1f2490 0x7fe81c0c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:45.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.191+0000 7fe820c02640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0b7460 con 0x7fe81c153ca0 2023-10-16T14:25:45.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.191+0000 7fe820c02640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0ce6b0 con 0x7fe808005180 2023-10-16T14:25:45.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.191+0000 7fe820c02640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0b6e10 con 0x7fe81c1f2490 2023-10-16T14:25:45.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.192+0000 7fe813fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe81c153ca0 0x7fe81c0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:45.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.192+0000 7fe813fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe81c153ca0 0x7fe81c0cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55560/0 (socket says 172.21.15.59:55560) 2023-10-16T14:25:45.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.192+0000 7fe813fff640 1 -- 172.21.15.59:0/478135272 learned_addr learned my addr 172.21.15.59:0/478135272 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:45.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.192+0000 7fe81b7fe640 1 --2- 172.21.15.59:0/478135272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe808005180 0x7fe81c0b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:45.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.192+0000 7fe81bfff640 1 --2- 172.21.15.59:0/478135272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe81c1f2490 0x7fe81c0c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:45.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.192+0000 7fe813fff640 1 -- 172.21.15.59:0/478135272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe81c1f2490 msgr2=0x7fe81c0c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:45.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.192+0000 7fe813fff640 1 --2- 172.21.15.59:0/478135272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe81c1f2490 0x7fe81c0c6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.192+0000 7fe813fff640 1 -- 172.21.15.59:0/478135272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe808005180 msgr2=0x7fe81c0b67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:45.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.192+0000 7fe813fff640 1 --2- 172.21.15.59:0/478135272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe808005180 0x7fe81c0b67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.192+0000 7fe813fff640 1 -- 172.21.15.59:0/478135272 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c0b70f0 con 0x7fe81c153ca0 2023-10-16T14:25:45.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.192+0000 7fe81b7fe640 1 --2- 172.21.15.59:0/478135272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe808005180 0x7fe81c0b67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:25:45.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.192+0000 7fe813fff640 1 --2- 172.21.15.59:0/478135272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe81c153ca0 0x7fe81c0cde80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe804000f60 tx=0x7fe80400d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:45.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.193+0000 7fe818ff9640 1 -- 172.21.15.59:0/478135272 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804005480 con 0x7fe81c153ca0 2023-10-16T14:25:45.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.193+0000 7fe818ff9640 1 -- 172.21.15.59:0/478135272 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe804003610 con 0x7fe81c153ca0 2023-10-16T14:25:45.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.193+0000 7fe818ff9640 1 -- 172.21.15.59:0/478135272 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8040039c0 con 0x7fe81c153ca0 2023-10-16T14:25:45.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.193+0000 7fe820c02640 1 -- 172.21.15.59:0/478135272 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81c0ce3c0 con 0x7fe81c153ca0 2023-10-16T14:25:45.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.193+0000 7fe820c02640 1 -- 172.21.15.59:0/478135272 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81c154120 con 0x7fe81c153ca0 2023-10-16T14:25:45.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.194+0000 7fe820c02640 1 -- 172.21.15.59:0/478135272 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81c0b75d0 con 0x7fe81c153ca0 2023-10-16T14:25:45.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.195+0000 7fe818ff9640 1 -- 172.21.15.59:0/478135272 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe804003b20 con 0x7fe81c153ca0 2023-10-16T14:25:45.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.196+0000 7fe818ff9640 1 --2- 172.21.15.59:0/478135272 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe7fc06aef0 0x7fe7fc06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:45.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.196+0000 7fe818ff9640 1 -- 172.21.15.59:0/478135272 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe804089090 con 0x7fe81c153ca0 2023-10-16T14:25:45.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.197+0000 7fe81b7fe640 1 --2- 172.21.15.59:0/478135272 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe7fc06aef0 0x7fe7fc06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:45.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.198+0000 7fe81b7fe640 1 --2- 172.21.15.59:0/478135272 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe7fc06aef0 0x7fe7fc06d3b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe80c001200 tx=0x7fe80c001130 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:45.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.200+0000 7fe818ff9640 1 -- 172.21.15.59:0/478135272 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe804054620 con 0x7fe81c153ca0 2023-10-16T14:25:45.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.391+0000 7fe820c02640 1 -- 172.21.15.59:0/478135272 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe81c04e9b0 con 0x7fe81c153ca0 2023-10-16T14:25:45.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.393+0000 7fe818ff9640 1 -- 172.21.15.59:0/478135272 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe804001230 con 0x7fe81c153ca0 2023-10-16T14:25:45.396 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:25:45.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.395+0000 7fe820c02640 1 -- 172.21.15.59:0/478135272 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe7fc06aef0 msgr2=0x7fe7fc06d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:45.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.395+0000 7fe820c02640 1 --2- 172.21.15.59:0/478135272 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe7fc06aef0 0x7fe7fc06d3b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe80c001200 tx=0x7fe80c001130 comp rx=0 tx=0).stop 2023-10-16T14:25:45.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.395+0000 7fe820c02640 1 -- 172.21.15.59:0/478135272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe81c153ca0 msgr2=0x7fe81c0cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:45.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.395+0000 7fe820c02640 1 --2- 172.21.15.59:0/478135272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe81c153ca0 0x7fe81c0cde80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe804000f60 tx=0x7fe80400d9f0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.396+0000 7fe820c02640 1 -- 172.21.15.59:0/478135272 shutdown_connections 2023-10-16T14:25:45.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.396+0000 7fe820c02640 1 --2- 172.21.15.59:0/478135272 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe7fc06aef0 0x7fe7fc06d3b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.396+0000 7fe820c02640 1 --2- 172.21.15.59:0/478135272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe81c1f2490 0x7fe81c0c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.396+0000 7fe820c02640 1 --2- 172.21.15.59:0/478135272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe81c153ca0 0x7fe81c0cde80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.396+0000 7fe820c02640 1 --2- 172.21.15.59:0/478135272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe808005180 0x7fe81c0b67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.396+0000 7fe820c02640 1 -- 172.21.15.59:0/478135272 >> 172.21.15.59:0/478135272 conn(0x7fe81c08c140 msgr2=0x7fe81c0b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:45.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.396+0000 7fe820c02640 1 -- 172.21.15.59:0/478135272 shutdown_connections 2023-10-16T14:25:45.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.396+0000 7fe820c02640 1 -- 172.21.15.59:0/478135272 wait complete. 2023-10-16T14:25:45.417 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T14:25:45.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.638+0000 7fab93bce640 1 Processor -- start 2023-10-16T14:25:45.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.638+0000 7fab93bce640 1 -- start start 2023-10-16T14:25:45.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.639+0000 7fab93bce640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fab8c0c20e0 0x7fab8c0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:45.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.639+0000 7fab93bce640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab8c071630 0x7fab8c0cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:45.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.640+0000 7fab93bce640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8c0c2570 con 0x7fab8c0c9e00 2023-10-16T14:25:45.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.640+0000 7fab93bce640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8c0cde00 con 0x7fab8c071630 2023-10-16T14:25:45.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.640+0000 7fab93bce640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8c071e40 con 0x7fab8c0c20e0 2023-10-16T14:25:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.640+0000 7fab9216b640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab8c071630 0x7fab8c0cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.640+0000 7fab9216b640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab8c071630 0x7fab8c0cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55570/0 (socket says 172.21.15.59:55570) 2023-10-16T14:25:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.640+0000 7fab9216b640 1 -- 172.21.15.59:0/1481237105 learned_addr learned my addr 172.21.15.59:0/1481237105 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.640+0000 7fab91169640 1 --2- 172.21.15.59:0/1481237105 >> v2:172.21.15.151:3300/0 conn(0x7fab8c0c20e0 0x7fab8c0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:45.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.640+0000 7fab9216b640 1 -- 172.21.15.59:0/1481237105 >> v2:172.21.15.151:3300/0 conn(0x7fab8c0c20e0 msgr2=0x7fab8c0710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.640+0000 7fab9216b640 1 --2- 172.21.15.59:0/1481237105 >> v2:172.21.15.151:3300/0 conn(0x7fab8c0c20e0 0x7fab8c0710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.640+0000 7fab9216b640 1 -- 172.21.15.59:0/1481237105 >> v1:172.21.15.151:6789/0 conn(0x7fab8c0c9e00 legacy=0x7fab8c0ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:45.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.640+0000 7fab9216b640 1 -- 172.21.15.59:0/1481237105 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c072120 con 0x7fab8c071630 2023-10-16T14:25:45.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.641+0000 7fab9216b640 1 --2- 172.21.15.59:0/1481237105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab8c071630 0x7fab8c0cca00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0c55f0 tx=0x7fab8402e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba30dc28d2d31c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:45.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.642+0000 7fab90968640 1 -- 172.21.15.59:0/1481237105 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8402ea90 con 0x7fab8c071630 2023-10-16T14:25:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.642+0000 7fab90968640 1 -- 172.21.15.59:0/1481237105 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8402ebf0 con 0x7fab8c071630 2023-10-16T14:25:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.642+0000 7fab90968640 1 -- 172.21.15.59:0/1481237105 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab84009600 con 0x7fab8c071630 2023-10-16T14:25:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.642+0000 7fab93bce640 1 -- 172.21.15.59:0/1481237105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab8c071630 msgr2=0x7fab8c0cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.642+0000 7fab93bce640 1 --2- 172.21.15.59:0/1481237105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab8c071630 0x7fab8c0cca00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0c55f0 tx=0x7fab8402e0f0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.642+0000 7fab93bce640 1 -- 172.21.15.59:0/1481237105 shutdown_connections 2023-10-16T14:25:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.642+0000 7fab93bce640 1 --2- 172.21.15.59:0/1481237105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab8c071630 0x7fab8c0cca00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.642+0000 7fab93bce640 1 --2- 172.21.15.59:0/1481237105 >> v2:172.21.15.151:3300/0 conn(0x7fab8c0c20e0 0x7fab8c0710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.642+0000 7fab93bce640 1 -- 172.21.15.59:0/1481237105 >> 172.21.15.59:0/1481237105 conn(0x7fab8c06c1c0 msgr2=0x7fab8c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.643+0000 7fab93bce640 1 -- 172.21.15.59:0/1481237105 shutdown_connections 2023-10-16T14:25:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.643+0000 7fab93bce640 1 -- 172.21.15.59:0/1481237105 wait complete. 2023-10-16T14:25:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.644+0000 7fab93bce640 1 Processor -- start 2023-10-16T14:25:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.645+0000 7fab93bce640 1 -- start start 2023-10-16T14:25:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.645+0000 7fab93bce640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab8c071630 0x7fab8c1522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.645+0000 7fab93bce640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab8c0c20e0 0x7fab8c14dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.646+0000 7fab93bce640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab8c0c9e00 0x7fab8c0c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.646+0000 7fab93bce640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c0cd620 con 0x7fab8c071630 2023-10-16T14:25:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.646+0000 7fab93bce640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c1527e0 con 0x7fab8c0c20e0 2023-10-16T14:25:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.646+0000 7fab93bce640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c0cc9a0 con 0x7fab8c0c9e00 2023-10-16T14:25:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.646+0000 7fab9196a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab8c071630 0x7fab8c1522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.646+0000 7fab9196a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab8c071630 0x7fab8c1522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55586/0 (socket says 172.21.15.59:55586) 2023-10-16T14:25:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.646+0000 7fab9196a640 1 -- 172.21.15.59:0/1404193530 learned_addr learned my addr 172.21.15.59:0/1404193530 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.646+0000 7fab9196a640 1 -- 172.21.15.59:0/1404193530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab8c0c9e00 msgr2=0x7fab8c0c2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.646+0000 7fab9216b640 1 --2- 172.21.15.59:0/1404193530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab8c0c9e00 0x7fab8c0c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.646+0000 7fab91169640 1 --2- 172.21.15.59:0/1404193530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab8c0c20e0 0x7fab8c14dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.646+0000 7fab9196a640 1 --2- 172.21.15.59:0/1404193530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab8c0c9e00 0x7fab8c0c2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.646+0000 7fab9196a640 1 -- 172.21.15.59:0/1404193530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab8c0c20e0 msgr2=0x7fab8c14dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.646+0000 7fab9196a640 1 --2- 172.21.15.59:0/1404193530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab8c0c20e0 0x7fab8c14dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.646+0000 7fab9196a640 1 -- 172.21.15.59:0/1404193530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8400bd40 con 0x7fab8c071630 2023-10-16T14:25:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.646+0000 7fab91169640 1 --2- 172.21.15.59:0/1404193530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab8c0c20e0 0x7fab8c14dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:25:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.647+0000 7fab9196a640 1 --2- 172.21.15.59:0/1404193530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab8c071630 0x7fab8c1522a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fab8800c430 tx=0x7fab8800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.647+0000 7fab827fc640 1 -- 172.21.15.59:0/1404193530 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88011790 con 0x7fab8c071630 2023-10-16T14:25:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.647+0000 7fab827fc640 1 -- 172.21.15.59:0/1404193530 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab880118f0 con 0x7fab8c071630 2023-10-16T14:25:45.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.647+0000 7fab827fc640 1 -- 172.21.15.59:0/1404193530 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88011ce0 con 0x7fab8c071630 2023-10-16T14:25:45.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.647+0000 7fab93bce640 1 -- 172.21.15.59:0/1404193530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8c0ccc80 con 0x7fab8c071630 2023-10-16T14:25:45.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.647+0000 7fab93bce640 1 -- 172.21.15.59:0/1404193530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8c0cd240 con 0x7fab8c071630 2023-10-16T14:25:45.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.648+0000 7fab93bce640 1 -- 172.21.15.59:0/1404193530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8c0cd760 con 0x7fab8c071630 2023-10-16T14:25:45.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.649+0000 7fab827fc640 1 -- 172.21.15.59:0/1404193530 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fab8801c460 con 0x7fab8c071630 2023-10-16T14:25:45.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.650+0000 7fab827fc640 1 --2- 172.21.15.59:0/1404193530 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fab7006ae70 0x7fab7006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:45.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.650+0000 7fab827fc640 1 -- 172.21.15.59:0/1404193530 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fab880892d0 con 0x7fab8c071630 2023-10-16T14:25:45.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.651+0000 7fab91169640 1 --2- 172.21.15.59:0/1404193530 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fab7006ae70 0x7fab7006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:45.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.652+0000 7fab91169640 1 --2- 172.21.15.59:0/1404193530 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fab7006ae70 0x7fab7006d330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fab8c157b40 tx=0x7fab7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:45.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.654+0000 7fab827fc640 1 -- 172.21.15.59:0/1404193530 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fab88054630 con 0x7fab8c071630 2023-10-16T14:25:45.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.849+0000 7fab93bce640 1 -- 172.21.15.59:0/1404193530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fab8c073ef0 con 0x7fab8c071630 2023-10-16T14:25:45.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.849+0000 7fab827fc640 1 -- 172.21.15.59:0/1404193530 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7fab88057c50 con 0x7fab8c071630 2023-10-16T14:25:45.853 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:25:45.853 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2023-10-16T14:25:45.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:25:45.854 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2023-10-16T14:25:45.854 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2023-10-16T14:25:45.854 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:25:45.855 INFO:teuthology.orchestra.run.smithi059.stdout:] 2023-10-16T14:25:45.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.852+0000 7fab93bce640 1 -- 172.21.15.59:0/1404193530 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fab7006ae70 msgr2=0x7fab7006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:45.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.852+0000 7fab93bce640 1 --2- 172.21.15.59:0/1404193530 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fab7006ae70 0x7fab7006d330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fab8c157b40 tx=0x7fab7c008040 comp rx=0 tx=0).stop 2023-10-16T14:25:45.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.852+0000 7fab93bce640 1 -- 172.21.15.59:0/1404193530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab8c071630 msgr2=0x7fab8c1522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:45.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.852+0000 7fab93bce640 1 --2- 172.21.15.59:0/1404193530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab8c071630 0x7fab8c1522a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fab8800c430 tx=0x7fab8800c8f0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.852+0000 7fab93bce640 1 -- 172.21.15.59:0/1404193530 shutdown_connections 2023-10-16T14:25:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.852+0000 7fab93bce640 1 --2- 172.21.15.59:0/1404193530 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fab7006ae70 0x7fab7006d330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.852+0000 7fab93bce640 1 --2- 172.21.15.59:0/1404193530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab8c0c9e00 0x7fab8c0c2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.852+0000 7fab93bce640 1 --2- 172.21.15.59:0/1404193530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab8c0c20e0 0x7fab8c14dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.852+0000 7fab93bce640 1 --2- 172.21.15.59:0/1404193530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab8c071630 0x7fab8c1522a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:45.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.852+0000 7fab93bce640 1 -- 172.21.15.59:0/1404193530 >> 172.21.15.59:0/1404193530 conn(0x7fab8c06c1c0 msgr2=0x7fab8c157db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:45.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.852+0000 7fab93bce640 1 -- 172.21.15.59:0/1404193530 shutdown_connections 2023-10-16T14:25:45.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:45.852+0000 7fab93bce640 1 -- 172.21.15.59:0/1404193530 wait complete. 2023-10-16T14:25:45.874 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-16T14:25:45.875 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-16T14:25:46.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.100+0000 7f5212dae640 1 Processor -- start 2023-10-16T14:25:46.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.101+0000 7f5212dae640 1 -- start start 2023-10-16T14:25:46.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.102+0000 7f5212dae640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f520c0cb400 0x7f520c15e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.102+0000 7f5212dae640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f520c0c8930 0x7f520c0707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.102+0000 7f5212dae640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520c0c8e40 con 0x7f520c070400 2023-10-16T14:25:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.102+0000 7f5212dae640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c0c9090 con 0x7f520c0c8930 2023-10-16T14:25:46.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.102+0000 7f5212dae640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c0c9370 con 0x7f520c0cb400 2023-10-16T14:25:46.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.102+0000 7f5211dac640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f520c070400 0x7f520c0cacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35180/0 (socket says 172.21.15.59:35180) 2023-10-16T14:25:46.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.102+0000 7f5211dac640 1 -- 172.21.15.59:0/2791193119 learned_addr learned my addr 172.21.15.59:0/2791193119 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:25:46.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.103+0000 7f52125ad640 1 --2- 172.21.15.59:0/2791193119 >> v2:172.21.15.59:3300/0 conn(0x7f520c0c8930 0x7f520c0707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:46.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.103+0000 7f52115ab640 1 --2- 172.21.15.59:0/2791193119 >> v2:172.21.15.151:3300/0 conn(0x7f520c0cb400 0x7f520c15e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:46.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.103+0000 7f5210daa640 1 -- 172.21.15.59:0/2791193119 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1688104540 0 0) 0x7f520c0c8e40 con 0x7f520c070400 2023-10-16T14:25:46.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.103+0000 7f5210daa640 1 -- 172.21.15.59:0/2791193119 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f8003520 con 0x7f520c070400 2023-10-16T14:25:46.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.103+0000 7f52125ad640 1 -- 172.21.15.59:0/2791193119 >> v2:172.21.15.151:3300/0 conn(0x7f520c0cb400 msgr2=0x7f520c15e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:46.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.103+0000 7f52125ad640 1 --2- 172.21.15.59:0/2791193119 >> v2:172.21.15.151:3300/0 conn(0x7f520c0cb400 0x7f520c15e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:46.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.103+0000 7f52125ad640 1 -- 172.21.15.59:0/2791193119 >> v1:172.21.15.59:6789/0 conn(0x7f520c070400 legacy=0x7f520c0cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:46.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.103+0000 7f52125ad640 1 -- 172.21.15.59:0/2791193119 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c0c9650 con 0x7f520c0c8930 2023-10-16T14:25:46.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.103+0000 7f52115ab640 1 --2- 172.21.15.59:0/2791193119 >> v2:172.21.15.151:3300/0 conn(0x7f520c0cb400 0x7f520c15e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:25:46.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.104+0000 7f52125ad640 1 --2- 172.21.15.59:0/2791193119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c0c8930 0x7f520c0707e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f520c0cb8d0 tx=0x7f520402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa0a1b0772cc2ac server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:46.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.105+0000 7f5210daa640 1 -- 172.21.15.59:0/2791193119 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520402cc80 con 0x7f520c0c8930 2023-10-16T14:25:46.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.105+0000 7f5210daa640 1 -- 172.21.15.59:0/2791193119 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520402cde0 con 0x7f520c0c8930 2023-10-16T14:25:46.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.105+0000 7f5210daa640 1 -- 172.21.15.59:0/2791193119 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204034660 con 0x7f520c0c8930 2023-10-16T14:25:46.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.105+0000 7f5212dae640 1 -- 172.21.15.59:0/2791193119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c0c8930 msgr2=0x7f520c0707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:46.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.105+0000 7f5212dae640 1 --2- 172.21.15.59:0/2791193119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c0c8930 0x7f520c0707e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f520c0cb8d0 tx=0x7f520402bed0 comp rx=0 tx=0).stop 2023-10-16T14:25:46.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.105+0000 7f5212dae640 1 -- 172.21.15.59:0/2791193119 shutdown_connections 2023-10-16T14:25:46.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.105+0000 7f5212dae640 1 --2- 172.21.15.59:0/2791193119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c0c8930 0x7f520c0707e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:46.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.105+0000 7f5212dae640 1 --2- 172.21.15.59:0/2791193119 >> v2:172.21.15.151:3300/0 conn(0x7f520c0cb400 0x7f520c15e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:46.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.105+0000 7f5212dae640 1 -- 172.21.15.59:0/2791193119 >> 172.21.15.59:0/2791193119 conn(0x7f520c06a4a0 msgr2=0x7f520c0afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:46.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.105+0000 7f5212dae640 1 -- 172.21.15.59:0/2791193119 shutdown_connections 2023-10-16T14:25:46.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.106+0000 7f5212dae640 1 -- 172.21.15.59:0/2791193119 wait complete. 2023-10-16T14:25:46.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.107+0000 7f5212dae640 1 Processor -- start 2023-10-16T14:25:46.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.107+0000 7f5212dae640 1 -- start start 2023-10-16T14:25:46.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.108+0000 7f5212dae640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f520c070400 0x7f520c1485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:46.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.108+0000 7f5212dae640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c0c8930 0x7f520c0c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:46.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.108+0000 7f5212dae640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f520c0cb400 0x7f520c1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:46.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.108+0000 7f5212dae640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0cce80 con 0x7f520c0c8930 2023-10-16T14:25:46.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.108+0000 7f5212dae640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0cc270 con 0x7f520c070400 2023-10-16T14:25:46.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.108+0000 7f5212dae640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0cc550 con 0x7f520c0cb400 2023-10-16T14:25:46.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.109+0000 7f52115ab640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c0c8930 0x7f520c0c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:46.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.109+0000 7f52115ab640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c0c8930 0x7f520c0c73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55604/0 (socket says 172.21.15.59:55604) 2023-10-16T14:25:46.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.109+0000 7f52115ab640 1 -- 172.21.15.59:0/1506067801 learned_addr learned my addr 172.21.15.59:0/1506067801 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:46.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.109+0000 7f52115ab640 1 -- 172.21.15.59:0/1506067801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f520c0cb400 msgr2=0x7f520c1594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:46.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.109+0000 7f52125ad640 1 --2- 172.21.15.59:0/1506067801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f520c0cb400 0x7f520c1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:46.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.109+0000 7f52115ab640 1 --2- 172.21.15.59:0/1506067801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f520c0cb400 0x7f520c1594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:46.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.109+0000 7f52115ab640 1 -- 172.21.15.59:0/1506067801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f520c070400 msgr2=0x7f520c1485f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:46.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.109+0000 7f52115ab640 1 --2- 172.21.15.59:0/1506067801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f520c070400 0x7f520c1485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:46.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.109+0000 7f52115ab640 1 -- 172.21.15.59:0/1506067801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5204009a70 con 0x7f520c0c8930 2023-10-16T14:25:46.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.110+0000 7f52115ab640 1 --2- 172.21.15.59:0/1506067801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c0c8930 0x7f520c0c73c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00d7d0 tx=0x7f51fc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:46.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.110+0000 7f52027fc640 1 -- 172.21.15.59:0/1506067801 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc004030 con 0x7f520c0c8930 2023-10-16T14:25:46.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.110+0000 7f52027fc640 1 -- 172.21.15.59:0/1506067801 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc004190 con 0x7f520c0c8930 2023-10-16T14:25:46.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.110+0000 7f52027fc640 1 -- 172.21.15.59:0/1506067801 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc004520 con 0x7f520c0c8930 2023-10-16T14:25:46.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.110+0000 7f5212dae640 1 -- 172.21.15.59:0/1506067801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c0cc830 con 0x7f520c0c8930 2023-10-16T14:25:46.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.110+0000 7f5212dae640 1 -- 172.21.15.59:0/1506067801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c148b30 con 0x7f520c0c8930 2023-10-16T14:25:46.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.111+0000 7f5212dae640 1 -- 172.21.15.59:0/1506067801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520c0c5390 con 0x7f520c0c8930 2023-10-16T14:25:46.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.112+0000 7f52027fc640 1 -- 172.21.15.59:0/1506067801 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f51fc0096a0 con 0x7f520c0c8930 2023-10-16T14:25:46.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.114+0000 7f52027fc640 1 --2- 172.21.15.59:0/1506067801 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f51f006ae70 0x7f51f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:46.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.114+0000 7f52027fc640 1 -- 172.21.15.59:0/1506067801 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f51fc089510 con 0x7f520c0c8930 2023-10-16T14:25:46.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.114+0000 7f5211dac640 1 --2- 172.21.15.59:0/1506067801 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f51f006ae70 0x7f51f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:46.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.115+0000 7f5211dac640 1 --2- 172.21.15.59:0/1506067801 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f51f006ae70 0x7f51f006d330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5208001610 tx=0x7f5208007930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:46.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.118+0000 7f52027fc640 1 -- 172.21.15.59:0/1506067801 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f51fc054870 con 0x7f520c0c8930 2023-10-16T14:25:46.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.314+0000 7f5212dae640 1 -- 172.21.15.59:0/1506067801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f520c04e9b0 con 0x7f520c0c8930 2023-10-16T14:25:46.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.635+0000 7f52027fc640 1 -- 172.21.15.59:0/1506067801 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f51fc057e90 con 0x7f520c0c8930 2023-10-16T14:25:46.639 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2023-10-16T14:25:46.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.639+0000 7f5212dae640 1 -- 172.21.15.59:0/1506067801 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f51f006ae70 msgr2=0x7f51f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:46.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.639+0000 7f5212dae640 1 --2- 172.21.15.59:0/1506067801 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f51f006ae70 0x7f51f006d330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5208001610 tx=0x7f5208007930 comp rx=0 tx=0).stop 2023-10-16T14:25:46.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.639+0000 7f5212dae640 1 -- 172.21.15.59:0/1506067801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c0c8930 msgr2=0x7f520c0c73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:46.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.639+0000 7f5212dae640 1 --2- 172.21.15.59:0/1506067801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c0c8930 0x7f520c0c73c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00d7d0 tx=0x7f51fc00dc90 comp rx=0 tx=0).stop 2023-10-16T14:25:46.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.639+0000 7f5212dae640 1 -- 172.21.15.59:0/1506067801 shutdown_connections 2023-10-16T14:25:46.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.639+0000 7f5212dae640 1 --2- 172.21.15.59:0/1506067801 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f51f006ae70 0x7f51f006d330 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:46.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.639+0000 7f5212dae640 1 --2- 172.21.15.59:0/1506067801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f520c0cb400 0x7f520c1594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:46.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.639+0000 7f5212dae640 1 --2- 172.21.15.59:0/1506067801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f520c0c8930 0x7f520c0c73c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:46.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.639+0000 7f5212dae640 1 --2- 172.21.15.59:0/1506067801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f520c070400 0x7f520c1485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:46.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.639+0000 7f5212dae640 1 -- 172.21.15.59:0/1506067801 >> 172.21.15.59:0/1506067801 conn(0x7f520c06a4a0 msgr2=0x7f520c0adcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:46.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.639+0000 7f5212dae640 1 -- 172.21.15.59:0/1506067801 shutdown_connections 2023-10-16T14:25:46.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.640+0000 7f5212dae640 1 -- 172.21.15.59:0/1506067801 wait complete. 2023-10-16T14:25:46.671 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-16T14:25:46.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.873+0000 7fada229a640 1 Processor -- start 2023-10-16T14:25:46.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.874+0000 7fada229a640 1 -- start start 2023-10-16T14:25:46.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.875+0000 7fada229a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fad9c0ced90 0x7fad9c0cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:46.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.875+0000 7fada229a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad9c06bf40 0x7fad9c0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:46.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.875+0000 7fada229a640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9c15bbf0 con 0x7fad9c158390 2023-10-16T14:25:46.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.875+0000 7fada229a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad9c15b020 con 0x7fad9c0ced90 2023-10-16T14:25:46.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.875+0000 7fada229a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c15b2c0 con 0x7fad9c06bf40 2023-10-16T14:25:46.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.875+0000 7fada1298640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fad9c158390 0x7fad9c0ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35182/0 (socket says 172.21.15.59:35182) 2023-10-16T14:25:46.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.875+0000 7fada1298640 1 -- 172.21.15.59:0/1476986605 learned_addr learned my addr 172.21.15.59:0/1476986605 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:25:46.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.876+0000 7fada0a97640 1 --2- 172.21.15.59:0/1476986605 >> v2:172.21.15.151:3300/0 conn(0x7fad9c0ced90 0x7fad9c0cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:46.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.876+0000 7fada1a99640 1 --2- 172.21.15.59:0/1476986605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad9c06bf40 0x7fad9c0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:46.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.876+0000 7fad93fff640 1 -- 172.21.15.59:0/1476986605 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923148356 0 0) 0x7fad9c15bbf0 con 0x7fad9c158390 2023-10-16T14:25:46.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.876+0000 7fad93fff640 1 -- 172.21.15.59:0/1476986605 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad88003520 con 0x7fad9c158390 2023-10-16T14:25:46.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.876+0000 7fad93fff640 1 -- 172.21.15.59:0/1476986605 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2263020951 0 0) 0x7fad88003520 con 0x7fad9c158390 2023-10-16T14:25:46.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.876+0000 7fad93fff640 1 -- 172.21.15.59:0/1476986605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad9c06bf40 msgr2=0x7fad9c0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:46.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.876+0000 7fad93fff640 1 --2- 172.21.15.59:0/1476986605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad9c06bf40 0x7fad9c0cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:46.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.876+0000 7fad93fff640 1 -- 172.21.15.59:0/1476986605 >> v2:172.21.15.151:3300/0 conn(0x7fad9c0ced90 msgr2=0x7fad9c0cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:46.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.876+0000 7fad93fff640 1 --2- 172.21.15.59:0/1476986605 >> v2:172.21.15.151:3300/0 conn(0x7fad9c0ced90 0x7fad9c0cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:46.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.876+0000 7fad93fff640 1 -- 172.21.15.59:0/1476986605 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c15b5a0 con 0x7fad9c158390 2023-10-16T14:25:46.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.876+0000 7fad93fff640 1 -- 172.21.15.59:0/1476986605 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7fad980017f0 con 0x7fad9c158390 2023-10-16T14:25:46.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.876+0000 7fad93fff640 1 -- 172.21.15.59:0/1476986605 >> v1:172.21.15.59:6789/0 conn(0x7fad9c158390 legacy=0x7fad9c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:46.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.876+0000 7fad93fff640 1 --2- 172.21.15.59:0/1476986605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad88003970 0x7fad88003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:46.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.876+0000 7fad93fff640 1 --2- 172.21.15.59:0/1476986605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad9c06bf40 0x7fad880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:46.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.876+0000 7fad93fff640 1 --2- 172.21.15.59:0/1476986605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad88004d00 0x7fad88005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:46.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.877+0000 7fad93fff640 1 -- 172.21.15.59:0/1476986605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c15b020 con 0x7fad88004d00 2023-10-16T14:25:46.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.877+0000 7fad93fff640 1 -- 172.21.15.59:0/1476986605 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c15b2c0 con 0x7fad88003970 2023-10-16T14:25:46.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.877+0000 7fad93fff640 1 -- 172.21.15.59:0/1476986605 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8800ba30 con 0x7fad9c06bf40 2023-10-16T14:25:46.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.877+0000 7fada1a99640 1 --2- 172.21.15.59:0/1476986605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad88004d00 0x7fad88005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:46.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.877+0000 7fada1298640 1 --2- 172.21.15.59:0/1476986605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad88003970 0x7fad88003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:46.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.877+0000 7fada0a97640 1 --2- 172.21.15.59:0/1476986605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad9c06bf40 0x7fad880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:46.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.877+0000 7fada1a99640 1 -- 172.21.15.59:0/1476986605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad9c06bf40 msgr2=0x7fad880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:46.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.877+0000 7fada1a99640 1 --2- 172.21.15.59:0/1476986605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad9c06bf40 0x7fad880047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:46.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.877+0000 7fada1a99640 1 -- 172.21.15.59:0/1476986605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad88003970 msgr2=0x7fad88003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:46.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.877+0000 7fada1a99640 1 --2- 172.21.15.59:0/1476986605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad88003970 0x7fad88003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:46.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.877+0000 7fada1a99640 1 -- 172.21.15.59:0/1476986605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad88003520 con 0x7fad88004d00 2023-10-16T14:25:46.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.879+0000 7fada1a99640 1 --2- 172.21.15.59:0/1476986605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad88004d00 0x7fad88005180 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fad94007390 tx=0x7fad880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9610cbadfcc223 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:46.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.879+0000 7fad93fff640 1 -- 172.21.15.59:0/1476986605 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9402ccb0 con 0x7fad88004d00 2023-10-16T14:25:46.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.879+0000 7fad93fff640 1 -- 172.21.15.59:0/1476986605 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9402ce10 con 0x7fad88004d00 2023-10-16T14:25:46.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.879+0000 7fad93fff640 1 -- 172.21.15.59:0/1476986605 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad94034660 con 0x7fad88004d00 2023-10-16T14:25:46.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.879+0000 7fada229a640 1 -- 172.21.15.59:0/1476986605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad88004d00 msgr2=0x7fad88005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:46.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.879+0000 7fada229a640 1 --2- 172.21.15.59:0/1476986605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad88004d00 0x7fad88005180 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fad94007390 tx=0x7fad880057f0 comp rx=0 tx=0).stop 2023-10-16T14:25:46.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.879+0000 7fada1a99640 1 -- 172.21.15.59:0/1476986605 reap_dead start 2023-10-16T14:25:46.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.880+0000 7fada229a640 1 -- 172.21.15.59:0/1476986605 shutdown_connections 2023-10-16T14:25:46.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.880+0000 7fada229a640 1 -- 172.21.15.59:0/1476986605 >> 172.21.15.59:0/1476986605 conn(0x7fad9c069fc0 msgr2=0x7fad9c06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:46.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.880+0000 7fada229a640 1 -- 172.21.15.59:0/1476986605 shutdown_connections 2023-10-16T14:25:46.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.880+0000 7fada229a640 1 -- 172.21.15.59:0/1476986605 wait complete. 2023-10-16T14:25:46.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.882+0000 7fada229a640 1 Processor -- start 2023-10-16T14:25:46.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.882+0000 7fada229a640 1 -- start start 2023-10-16T14:25:46.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.883+0000 7fada229a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad88004d00 0x7fad9c0b0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:46.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.883+0000 7fada229a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c1f6200 0x7fad9c099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:46.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.883+0000 7fada229a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9c0cb4d0 0x7fad9c156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:46.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.883+0000 7fada229a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c1f6680 con 0x7fad9c0cb4d0 2023-10-16T14:25:46.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.883+0000 7fada229a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c0adf80 con 0x7fad9c1f6200 2023-10-16T14:25:46.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.883+0000 7fada229a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c0ae260 con 0x7fad88004d00 2023-10-16T14:25:46.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.883+0000 7fada1a99640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9c0cb4d0 0x7fad9c156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:46.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.883+0000 7fada1a99640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9c0cb4d0 0x7fad9c156f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55624/0 (socket says 172.21.15.59:55624) 2023-10-16T14:25:46.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.883+0000 7fada1a99640 1 -- 172.21.15.59:0/3826574229 learned_addr learned my addr 172.21.15.59:0/3826574229 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:46.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.884+0000 7fada1298640 1 --2- 172.21.15.59:0/3826574229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad88004d00 0x7fad9c0b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:46.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.884+0000 7fada0a97640 1 --2- 172.21.15.59:0/3826574229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c1f6200 0x7fad9c099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:46.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.884+0000 7fada1a99640 1 -- 172.21.15.59:0/3826574229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad88004d00 msgr2=0x7fad9c0b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:46.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.884+0000 7fada1a99640 1 --2- 172.21.15.59:0/3826574229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad88004d00 0x7fad9c0b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:46.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.884+0000 7fada1a99640 1 -- 172.21.15.59:0/3826574229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c1f6200 msgr2=0x7fad9c099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:46.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.884+0000 7fada1a99640 1 --2- 172.21.15.59:0/3826574229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c1f6200 0x7fad9c099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:46.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.884+0000 7fada1a99640 1 -- 172.21.15.59:0/3826574229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c0ae540 con 0x7fad9c0cb4d0 2023-10-16T14:25:46.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.884+0000 7fada0a97640 1 --2- 172.21.15.59:0/3826574229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c1f6200 0x7fad9c099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:25:46.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.884+0000 7fada1a99640 1 --2- 172.21.15.59:0/3826574229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9c0cb4d0 0x7fad9c156f30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad94037040 tx=0x7fad94004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:46.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.884+0000 7fad91ffb640 1 -- 172.21.15.59:0/3826574229 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9403e600 con 0x7fad9c0cb4d0 2023-10-16T14:25:46.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.884+0000 7fad91ffb640 1 -- 172.21.15.59:0/3826574229 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9403e780 con 0x7fad9c0cb4d0 2023-10-16T14:25:46.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.884+0000 7fada229a640 1 -- 172.21.15.59:0/3826574229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9c0ae820 con 0x7fad9c0cb4d0 2023-10-16T14:25:46.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.885+0000 7fad91ffb640 1 -- 172.21.15.59:0/3826574229 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9403eb30 con 0x7fad9c0cb4d0 2023-10-16T14:25:46.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.885+0000 7fada229a640 1 -- 172.21.15.59:0/3826574229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9c0cb950 con 0x7fad9c0cb4d0 2023-10-16T14:25:46.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.886+0000 7fada229a640 1 -- 172.21.15.59:0/3826574229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9c0cbc00 con 0x7fad9c0cb4d0 2023-10-16T14:25:46.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.887+0000 7fad91ffb640 1 -- 172.21.15.59:0/3826574229 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fad9403ec90 con 0x7fad9c0cb4d0 2023-10-16T14:25:46.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.888+0000 7fad91ffb640 1 --2- 172.21.15.59:0/3826574229 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fad8006aea0 0x7fad8006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:46.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.888+0000 7fad91ffb640 1 -- 172.21.15.59:0/3826574229 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fad940ac0d0 con 0x7fad9c0cb4d0 2023-10-16T14:25:46.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.889+0000 7fada1298640 1 --2- 172.21.15.59:0/3826574229 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fad8006aea0 0x7fad8006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:46.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.890+0000 7fada1298640 1 --2- 172.21.15.59:0/3826574229 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fad8006aea0 0x7fad8006d360 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad98000ef0 tx=0x7fad98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:46.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:46.892+0000 7fad91ffb640 1 -- 172.21.15.59:0/3826574229 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fad940773f0 con 0x7fad9c0cb4d0 2023-10-16T14:25:47.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.087+0000 7fada229a640 1 -- 172.21.15.59:0/3826574229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fad9c066880 con 0x7fad9c0cb4d0 2023-10-16T14:25:47.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.642+0000 7fad91ffb640 1 -- 172.21.15.59:0/3826574229 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7fad9407aa10 con 0x7fad9c0cb4d0 2023-10-16T14:25:47.646 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2023-10-16T14:25:47.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.646+0000 7fada229a640 1 -- 172.21.15.59:0/3826574229 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fad8006aea0 msgr2=0x7fad8006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:47.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.646+0000 7fada229a640 1 --2- 172.21.15.59:0/3826574229 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fad8006aea0 0x7fad8006d360 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad98000ef0 tx=0x7fad98009040 comp rx=0 tx=0).stop 2023-10-16T14:25:47.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.646+0000 7fada229a640 1 -- 172.21.15.59:0/3826574229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9c0cb4d0 msgr2=0x7fad9c156f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:47.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.646+0000 7fada229a640 1 --2- 172.21.15.59:0/3826574229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9c0cb4d0 0x7fad9c156f30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad94037040 tx=0x7fad94004ab0 comp rx=0 tx=0).stop 2023-10-16T14:25:47.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.646+0000 7fada229a640 1 -- 172.21.15.59:0/3826574229 shutdown_connections 2023-10-16T14:25:47.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.646+0000 7fada229a640 1 --2- 172.21.15.59:0/3826574229 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fad8006aea0 0x7fad8006d360 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:47.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.646+0000 7fada229a640 1 --2- 172.21.15.59:0/3826574229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9c0cb4d0 0x7fad9c156f30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:47.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.646+0000 7fada229a640 1 --2- 172.21.15.59:0/3826574229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c1f6200 0x7fad9c099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:47.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.646+0000 7fada229a640 1 --2- 172.21.15.59:0/3826574229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad88004d00 0x7fad9c0b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:47.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.646+0000 7fada229a640 1 -- 172.21.15.59:0/3826574229 >> 172.21.15.59:0/3826574229 conn(0x7fad9c069fc0 msgr2=0x7fad9c15c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:47.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.646+0000 7fada229a640 1 -- 172.21.15.59:0/3826574229 shutdown_connections 2023-10-16T14:25:47.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.647+0000 7fada229a640 1 -- 172.21.15.59:0/3826574229 wait complete. 2023-10-16T14:25:47.688 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-16T14:25:47.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.880+0000 7fcae9a13640 1 Processor -- start 2023-10-16T14:25:47.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.880+0000 7fcae9a13640 1 -- start start 2023-10-16T14:25:47.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.882+0000 7fcae9a13640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcae4154d10 0x7fcae40ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:47.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.882+0000 7fcae9a13640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcae406d530 0x7fcae40ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:47.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.882+0000 7fcae9a13640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae41550f0 con 0x7fcae40cee60 2023-10-16T14:25:47.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.882+0000 7fcae9a13640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae40cf310 con 0x7fcae4154d10 2023-10-16T14:25:47.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.882+0000 7fcae9a13640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae406d940 con 0x7fcae406d530 2023-10-16T14:25:47.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.882+0000 7fcae8a11640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcae4154d10 0x7fcae40ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:47.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.882+0000 7fcae8a11640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcae4154d10 0x7fcae40ce920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55636/0 (socket says 172.21.15.59:55636) 2023-10-16T14:25:47.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.882+0000 7fcae8a11640 1 -- 172.21.15.59:0/4211524958 learned_addr learned my addr 172.21.15.59:0/4211524958 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:47.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.882+0000 7fcae9212640 1 --2- 172.21.15.59:0/4211524958 >> v2:172.21.15.151:3300/0 conn(0x7fcae406d530 0x7fcae40ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:47.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.883+0000 7fcae8a11640 1 -- 172.21.15.59:0/4211524958 >> v2:172.21.15.151:3300/0 conn(0x7fcae406d530 msgr2=0x7fcae40ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:47.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.883+0000 7fcae8a11640 1 --2- 172.21.15.59:0/4211524958 >> v2:172.21.15.151:3300/0 conn(0x7fcae406d530 0x7fcae40ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:47.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.883+0000 7fcae8a11640 1 -- 172.21.15.59:0/4211524958 >> v1:172.21.15.151:6789/0 conn(0x7fcae40cee60 legacy=0x7fcae406ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:47.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.883+0000 7fcae8a11640 1 -- 172.21.15.59:0/4211524958 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae406db50 con 0x7fcae4154d10 2023-10-16T14:25:47.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.884+0000 7fcae8a11640 1 --2- 172.21.15.59:0/4211524958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae4154d10 0x7fcae40ce920 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcae40c5560 tx=0x7fcad802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe20bbde359d00a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:47.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.884+0000 7fcae37fe640 1 -- 172.21.15.59:0/4211524958 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad8031870 con 0x7fcae4154d10 2023-10-16T14:25:47.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.884+0000 7fcae37fe640 1 -- 172.21.15.59:0/4211524958 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad80319d0 con 0x7fcae4154d10 2023-10-16T14:25:47.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.884+0000 7fcae37fe640 1 -- 172.21.15.59:0/4211524958 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad8031d60 con 0x7fcae4154d10 2023-10-16T14:25:47.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.885+0000 7fcae9a13640 1 -- 172.21.15.59:0/4211524958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae4154d10 msgr2=0x7fcae40ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:47.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.885+0000 7fcae9a13640 1 --2- 172.21.15.59:0/4211524958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae4154d10 0x7fcae40ce920 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcae40c5560 tx=0x7fcad802b910 comp rx=0 tx=0).stop 2023-10-16T14:25:47.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.885+0000 7fcae9a13640 1 -- 172.21.15.59:0/4211524958 shutdown_connections 2023-10-16T14:25:47.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.885+0000 7fcae9a13640 1 --2- 172.21.15.59:0/4211524958 >> v2:172.21.15.151:3300/0 conn(0x7fcae406d530 0x7fcae40ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:47.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.885+0000 7fcae9a13640 1 --2- 172.21.15.59:0/4211524958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae4154d10 0x7fcae40ce920 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:47.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.885+0000 7fcae9a13640 1 -- 172.21.15.59:0/4211524958 >> 172.21.15.59:0/4211524958 conn(0x7fcae406a200 msgr2=0x7fcae406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:47.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.885+0000 7fcae9a13640 1 -- 172.21.15.59:0/4211524958 shutdown_connections 2023-10-16T14:25:47.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.885+0000 7fcae9a13640 1 -- 172.21.15.59:0/4211524958 wait complete. 2023-10-16T14:25:47.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.887+0000 7fcae9a13640 1 Processor -- start 2023-10-16T14:25:47.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.887+0000 7fcae9a13640 1 -- start start 2023-10-16T14:25:47.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.888+0000 7fcae9a13640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcae406d530 0x7fcae41595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:47.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.888+0000 7fcae9a13640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae40cee60 0x7fcae415a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:47.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.888+0000 7fcae9a13640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcae4154d10 0x7fcae41f58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:47.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.888+0000 7fcae9a13640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae415abf0 con 0x7fcae40cee60 2023-10-16T14:25:47.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.888+0000 7fcae9a13640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae4159c30 con 0x7fcae4154d10 2023-10-16T14:25:47.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.888+0000 7fcae9a13640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae4155280 con 0x7fcae406d530 2023-10-16T14:25:47.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.888+0000 7fcae3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae40cee60 0x7fcae415a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:47.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.888+0000 7fcae3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae40cee60 0x7fcae415a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55648/0 (socket says 172.21.15.59:55648) 2023-10-16T14:25:47.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.888+0000 7fcae3fff640 1 -- 172.21.15.59:0/1095979530 learned_addr learned my addr 172.21.15.59:0/1095979530 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:47.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.888+0000 7fcae8a11640 1 --2- 172.21.15.59:0/1095979530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcae406d530 0x7fcae41595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:47.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.888+0000 7fcae9212640 1 --2- 172.21.15.59:0/1095979530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcae4154d10 0x7fcae41f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:47.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.889+0000 7fcae3fff640 1 -- 172.21.15.59:0/1095979530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcae406d530 msgr2=0x7fcae41595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:47.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.889+0000 7fcae3fff640 1 --2- 172.21.15.59:0/1095979530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcae406d530 0x7fcae41595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:47.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.889+0000 7fcae3fff640 1 -- 172.21.15.59:0/1095979530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcae4154d10 msgr2=0x7fcae41f58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:47.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.889+0000 7fcae3fff640 1 --2- 172.21.15.59:0/1095979530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcae4154d10 0x7fcae41f58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:47.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.889+0000 7fcae3fff640 1 -- 172.21.15.59:0/1095979530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad80094d0 con 0x7fcae40cee60 2023-10-16T14:25:47.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.889+0000 7fcae3fff640 1 --2- 172.21.15.59:0/1095979530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae40cee60 0x7fcae415a6b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcad000c430 tx=0x7fcad000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:47.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.889+0000 7fcae17fa640 1 -- 172.21.15.59:0/1095979530 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0011790 con 0x7fcae40cee60 2023-10-16T14:25:47.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.889+0000 7fcae17fa640 1 -- 172.21.15.59:0/1095979530 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad00118f0 con 0x7fcae40cee60 2023-10-16T14:25:47.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.889+0000 7fcae17fa640 1 -- 172.21.15.59:0/1095979530 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0011ce0 con 0x7fcae40cee60 2023-10-16T14:25:47.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.889+0000 7fcae9a13640 1 -- 172.21.15.59:0/1095979530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae4155560 con 0x7fcae40cee60 2023-10-16T14:25:47.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.889+0000 7fcae9a13640 1 -- 172.21.15.59:0/1095979530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae4155b20 con 0x7fcae40cee60 2023-10-16T14:25:47.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.891+0000 7fcae9a13640 1 -- 172.21.15.59:0/1095979530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae404e9b0 con 0x7fcae40cee60 2023-10-16T14:25:47.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.892+0000 7fcae17fa640 1 -- 172.21.15.59:0/1095979530 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcad001c460 con 0x7fcae40cee60 2023-10-16T14:25:47.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.892+0000 7fcae17fa640 1 --2- 172.21.15.59:0/1095979530 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fcac806ae70 0x7fcac806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:47.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.893+0000 7fcae17fa640 1 -- 172.21.15.59:0/1095979530 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fcad0089610 con 0x7fcae40cee60 2023-10-16T14:25:47.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.893+0000 7fcae8a11640 1 --2- 172.21.15.59:0/1095979530 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fcac806ae70 0x7fcac806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:47.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.894+0000 7fcae8a11640 1 --2- 172.21.15.59:0/1095979530 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fcac806ae70 0x7fcac806d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcad8036000 tx=0x7fcad803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:47.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:47.898+0000 7fcae17fa640 1 -- 172.21.15.59:0/1095979530 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcad0054680 con 0x7fcae40cee60 2023-10-16T14:25:48.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.128+0000 7fcae9a13640 1 -- 172.21.15.59:0/1095979530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcae40c5060 con 0x7fcae40cee60 2023-10-16T14:25:48.686 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 2 and data pool 3 2023-10-16T14:25:48.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.682+0000 7fcae17fa640 1 -- 172.21.15.59:0/1095979530 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fcad0057ca0 con 0x7fcae40cee60 2023-10-16T14:25:48.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.691+0000 7fcae9a13640 1 -- 172.21.15.59:0/1095979530 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fcac806ae70 msgr2=0x7fcac806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:48.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.691+0000 7fcae9a13640 1 --2- 172.21.15.59:0/1095979530 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fcac806ae70 0x7fcac806d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcad8036000 tx=0x7fcad803c040 comp rx=0 tx=0).stop 2023-10-16T14:25:48.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.691+0000 7fcae9a13640 1 -- 172.21.15.59:0/1095979530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae40cee60 msgr2=0x7fcae415a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:48.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.691+0000 7fcae9a13640 1 --2- 172.21.15.59:0/1095979530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae40cee60 0x7fcae415a6b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcad000c430 tx=0x7fcad000c8f0 comp rx=0 tx=0).stop 2023-10-16T14:25:48.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.692+0000 7fcae9a13640 1 -- 172.21.15.59:0/1095979530 shutdown_connections 2023-10-16T14:25:48.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.692+0000 7fcae9a13640 1 --2- 172.21.15.59:0/1095979530 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fcac806ae70 0x7fcac806d330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:48.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.692+0000 7fcae9a13640 1 --2- 172.21.15.59:0/1095979530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcae4154d10 0x7fcae41f58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.692+0000 7fcae9a13640 1 --2- 172.21.15.59:0/1095979530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcae40cee60 0x7fcae415a6b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.692+0000 7fcae9a13640 1 --2- 172.21.15.59:0/1095979530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcae406d530 0x7fcae41595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:48.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.692+0000 7fcae9a13640 1 -- 172.21.15.59:0/1095979530 >> 172.21.15.59:0/1095979530 conn(0x7fcae406a200 msgr2=0x7fcae406ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.693+0000 7fcae9a13640 1 -- 172.21.15.59:0/1095979530 shutdown_connections 2023-10-16T14:25:48.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.694+0000 7fcae9a13640 1 -- 172.21.15.59:0/1095979530 wait complete. 2023-10-16T14:25:48.734 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-16T14:25:48.734 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-16T14:25:48.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.924+0000 7f1cb618a640 1 Processor -- start 2023-10-16T14:25:48.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.925+0000 7f1cb618a640 1 -- start start 2023-10-16T14:25:48.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.926+0000 7f1cb618a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cb015cbb0 0x7f1cb00d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:48.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.926+0000 7f1cb618a640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1cb00cf230 0x7f1cb00d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:48.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.926+0000 7f1cb618a640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb00cf7a0 con 0x7f1cb00d1410 2023-10-16T14:25:48.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.926+0000 7f1cb618a640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb00d18a0 con 0x7f1cb00cf230 2023-10-16T14:25:48.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.926+0000 7f1cb618a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb00cfa80 con 0x7f1cb015cbb0 2023-10-16T14:25:48.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.926+0000 7f1caffff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1cb00d1410 0x7f1cb00cd3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35192/0 (socket says 172.21.15.59:35192) 2023-10-16T14:25:48.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.927+0000 7f1caffff640 1 -- 172.21.15.59:0/2281066754 learned_addr learned my addr 172.21.15.59:0/2281066754 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:25:48.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.927+0000 7f1ca7fff640 1 --2- 172.21.15.59:0/2281066754 >> v2:172.21.15.59:3300/0 conn(0x7f1cb00cf230 0x7f1cb00d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:48.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.927+0000 7f1caf7fe640 1 --2- 172.21.15.59:0/2281066754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cb015cbb0 0x7f1cb00d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:48.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.927+0000 7f1caeffd640 1 -- 172.21.15.59:0/2281066754 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1726854295 0 0) 0x7f1cb00cf7a0 con 0x7f1cb00d1410 2023-10-16T14:25:48.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.927+0000 7f1caeffd640 1 -- 172.21.15.59:0/2281066754 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c9c003520 con 0x7f1cb00d1410 2023-10-16T14:25:48.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.927+0000 7f1ca7fff640 1 -- 172.21.15.59:0/2281066754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cb015cbb0 msgr2=0x7f1cb00d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:48.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.927+0000 7f1ca7fff640 1 --2- 172.21.15.59:0/2281066754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cb015cbb0 0x7f1cb00d06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:48.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.927+0000 7f1ca7fff640 1 -- 172.21.15.59:0/2281066754 >> v1:172.21.15.59:6789/0 conn(0x7f1cb00d1410 legacy=0x7f1cb00cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:48.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.927+0000 7f1ca7fff640 1 -- 172.21.15.59:0/2281066754 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb00cfd60 con 0x7f1cb00cf230 2023-10-16T14:25:48.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.928+0000 7f1ca7fff640 1 --2- 172.21.15.59:0/2281066754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb00cf230 0x7f1cb00d0ed0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1c980097a0 tx=0x7f1c9802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52da19178e193b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:48.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.929+0000 7f1caeffd640 1 -- 172.21.15.59:0/2281066754 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9802d040 con 0x7f1cb00cf230 2023-10-16T14:25:48.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.929+0000 7f1caeffd640 1 -- 172.21.15.59:0/2281066754 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c98031810 con 0x7f1cb00cf230 2023-10-16T14:25:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.929+0000 7f1caeffd640 1 -- 172.21.15.59:0/2281066754 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c98031ba0 con 0x7f1cb00cf230 2023-10-16T14:25:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.929+0000 7f1cb618a640 1 -- 172.21.15.59:0/2281066754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb00cf230 msgr2=0x7f1cb00d0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.929+0000 7f1cb618a640 1 --2- 172.21.15.59:0/2281066754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb00cf230 0x7f1cb00d0ed0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1c980097a0 tx=0x7f1c9802b8b0 comp rx=0 tx=0).stop 2023-10-16T14:25:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.929+0000 7f1cb618a640 1 -- 172.21.15.59:0/2281066754 shutdown_connections 2023-10-16T14:25:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.929+0000 7f1cb618a640 1 --2- 172.21.15.59:0/2281066754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb00cf230 0x7f1cb00d0ed0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.929+0000 7f1cb618a640 1 --2- 172.21.15.59:0/2281066754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cb015cbb0 0x7f1cb00d06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.929+0000 7f1cb618a640 1 -- 172.21.15.59:0/2281066754 >> 172.21.15.59:0/2281066754 conn(0x7f1cb009bc60 msgr2=0x7f1cb00d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.929+0000 7f1cb618a640 1 -- 172.21.15.59:0/2281066754 shutdown_connections 2023-10-16T14:25:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.929+0000 7f1cb618a640 1 -- 172.21.15.59:0/2281066754 wait complete. 2023-10-16T14:25:48.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.931+0000 7f1cb618a640 1 Processor -- start 2023-10-16T14:25:48.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.931+0000 7f1cb618a640 1 -- start start 2023-10-16T14:25:48.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.932+0000 7f1cb618a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cb00cf230 0x7f1cb0152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:48.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.932+0000 7f1cb618a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cb00d1410 0x7f1cb0152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:48.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.932+0000 7f1cb618a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb015cbb0 0x7f1cb0154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:48.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.932+0000 7f1cb618a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb015f980 con 0x7f1cb015cbb0 2023-10-16T14:25:48.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.932+0000 7f1cb618a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb00c6c70 con 0x7f1cb00cf230 2023-10-16T14:25:48.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.932+0000 7f1cb618a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb00c6f50 con 0x7f1cb00d1410 2023-10-16T14:25:48.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.933+0000 7f1caffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb015cbb0 0x7f1cb0154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:48.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.933+0000 7f1caffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb015cbb0 0x7f1cb0154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55658/0 (socket says 172.21.15.59:55658) 2023-10-16T14:25:48.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.933+0000 7f1caffff640 1 -- 172.21.15.59:0/2824609606 learned_addr learned my addr 172.21.15.59:0/2824609606 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:48.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.933+0000 7f1ca7fff640 1 --2- 172.21.15.59:0/2824609606 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cb00d1410 0x7f1cb0152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:48.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.933+0000 7f1caf7fe640 1 --2- 172.21.15.59:0/2824609606 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cb00cf230 0x7f1cb0152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:48.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.933+0000 7f1caffff640 1 -- 172.21.15.59:0/2824609606 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cb00d1410 msgr2=0x7f1cb0152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:48.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.933+0000 7f1caffff640 1 --2- 172.21.15.59:0/2824609606 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cb00d1410 0x7f1cb0152cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:48.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.933+0000 7f1caffff640 1 -- 172.21.15.59:0/2824609606 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cb00cf230 msgr2=0x7f1cb0152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:48.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.933+0000 7f1caffff640 1 --2- 172.21.15.59:0/2824609606 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cb00cf230 0x7f1cb0152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:48.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.933+0000 7f1caffff640 1 -- 172.21.15.59:0/2824609606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c98009400 con 0x7f1cb015cbb0 2023-10-16T14:25:48.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.933+0000 7f1caffff640 1 --2- 172.21.15.59:0/2824609606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb015cbb0 0x7f1cb0154720 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ca800cb40 tx=0x7f1ca800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:48.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.934+0000 7f1cacff9640 1 -- 172.21.15.59:0/2824609606 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca800aca0 con 0x7f1cb015cbb0 2023-10-16T14:25:48.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.934+0000 7f1cacff9640 1 -- 172.21.15.59:0/2824609606 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca800ae00 con 0x7f1cb015cbb0 2023-10-16T14:25:48.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.934+0000 7f1cb618a640 1 -- 172.21.15.59:0/2824609606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb00c7230 con 0x7f1cb015cbb0 2023-10-16T14:25:48.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.934+0000 7f1cacff9640 1 -- 172.21.15.59:0/2824609606 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8012620 con 0x7f1cb015cbb0 2023-10-16T14:25:48.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.934+0000 7f1cb618a640 1 -- 172.21.15.59:0/2824609606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb0154c60 con 0x7f1cb015cbb0 2023-10-16T14:25:48.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.935+0000 7f1cb618a640 1 -- 172.21.15.59:0/2824609606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb0073ef0 con 0x7f1cb015cbb0 2023-10-16T14:25:48.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.936+0000 7f1cacff9640 1 -- 172.21.15.59:0/2824609606 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1ca8007070 con 0x7f1cb015cbb0 2023-10-16T14:25:48.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.937+0000 7f1cacff9640 1 --2- 172.21.15.59:0/2824609606 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f1c9006ae70 0x7f1c9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:48.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.937+0000 7f1cacff9640 1 -- 172.21.15.59:0/2824609606 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ca8089670 con 0x7f1cb015cbb0 2023-10-16T14:25:48.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.938+0000 7f1caf7fe640 1 --2- 172.21.15.59:0/2824609606 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f1c9006ae70 0x7f1c9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:48.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.939+0000 7f1caf7fe640 1 --2- 172.21.15.59:0/2824609606 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f1c9006ae70 0x7f1c9006d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0006fd0 tx=0x7f1ca0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:48.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:48.945+0000 7f1cacff9640 1 -- 172.21.15.59:0/2824609606 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1ca8054710 con 0x7f1cb015cbb0 2023-10-16T14:25:49.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.144+0000 7f1cb618a640 1 -- 172.21.15.59:0/2824609606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f1cb00cc300 con 0x7f1cb015cbb0 2023-10-16T14:25:49.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.690+0000 7f1cacff9640 1 -- 172.21.15.59:0/2824609606 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 157+0+0 (secure 0 0 0) 0x7f1ca8057d30 con 0x7f1cb015cbb0 2023-10-16T14:25:49.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.694+0000 7f1cb618a640 1 -- 172.21.15.59:0/2824609606 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f1c9006ae70 msgr2=0x7f1c9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:49.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.694+0000 7f1cb618a640 1 --2- 172.21.15.59:0/2824609606 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f1c9006ae70 0x7f1c9006d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0006fd0 tx=0x7f1ca0008040 comp rx=0 tx=0).stop 2023-10-16T14:25:49.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.694+0000 7f1cb618a640 1 -- 172.21.15.59:0/2824609606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb015cbb0 msgr2=0x7f1cb0154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:49.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.694+0000 7f1cb618a640 1 --2- 172.21.15.59:0/2824609606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb015cbb0 0x7f1cb0154720 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ca800cb40 tx=0x7f1ca800a060 comp rx=0 tx=0).stop 2023-10-16T14:25:49.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.694+0000 7f1cb618a640 1 -- 172.21.15.59:0/2824609606 shutdown_connections 2023-10-16T14:25:49.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.694+0000 7f1cb618a640 1 --2- 172.21.15.59:0/2824609606 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f1c9006ae70 0x7f1c9006d330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:49.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.694+0000 7f1cb618a640 1 --2- 172.21.15.59:0/2824609606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb015cbb0 0x7f1cb0154720 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:49.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.694+0000 7f1cb618a640 1 --2- 172.21.15.59:0/2824609606 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cb00d1410 0x7f1cb0152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:49.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.694+0000 7f1cb618a640 1 --2- 172.21.15.59:0/2824609606 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cb00cf230 0x7f1cb0152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:49.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.694+0000 7f1cb618a640 1 -- 172.21.15.59:0/2824609606 >> 172.21.15.59:0/2824609606 conn(0x7f1cb009bc60 msgr2=0x7f1cb00d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:49.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.695+0000 7f1cb618a640 1 -- 172.21.15.59:0/2824609606 shutdown_connections 2023-10-16T14:25:49.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.695+0000 7f1cb618a640 1 -- 172.21.15.59:0/2824609606 wait complete. 2023-10-16T14:25:49.718 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T14:25:49.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.944+0000 7fa348c26640 1 Processor -- start 2023-10-16T14:25:49.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.945+0000 7fa348c26640 1 -- start start 2023-10-16T14:25:49.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.947+0000 7fa348c26640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3440b14c0 0x7fa3440cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:49.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.947+0000 7fa348c26640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa3440cd7c0 0x7fa3440cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:49.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.947+0000 7fa348c26640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3440d1350 con 0x7fa34415ce90 2023-10-16T14:25:49.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.947+0000 7fa348c26640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3440cf610 con 0x7fa3440b14c0 2023-10-16T14:25:49.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.947+0000 7fa348c26640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3440d15a0 con 0x7fa3440cd7c0 2023-10-16T14:25:49.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.947+0000 7fa34259c640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa34415ce90 0x7fa3440cd0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35202/0 (socket says 172.21.15.59:35202) 2023-10-16T14:25:49.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.947+0000 7fa34259c640 1 -- 172.21.15.59:0/3209601760 learned_addr learned my addr 172.21.15.59:0/3209601760 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:25:49.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.947+0000 7fa33bfff640 1 --2- 172.21.15.59:0/3209601760 >> v2:172.21.15.59:3300/0 conn(0x7fa3440b14c0 0x7fa3440cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:49.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.947+0000 7fa341d9b640 1 -- 172.21.15.59:0/3209601760 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324664637 0 0) 0x7fa3440d1350 con 0x7fa34415ce90 2023-10-16T14:25:49.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.947+0000 7fa341d9b640 1 -- 172.21.15.59:0/3209601760 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa330003520 con 0x7fa34415ce90 2023-10-16T14:25:49.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.948+0000 7fa342d9d640 1 --2- 172.21.15.59:0/3209601760 >> v2:172.21.15.151:3300/0 conn(0x7fa3440cd7c0 0x7fa3440cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:49.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.948+0000 7fa33bfff640 1 -- 172.21.15.59:0/3209601760 >> v2:172.21.15.151:3300/0 conn(0x7fa3440cd7c0 msgr2=0x7fa3440cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:49.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.948+0000 7fa33bfff640 1 --2- 172.21.15.59:0/3209601760 >> v2:172.21.15.151:3300/0 conn(0x7fa3440cd7c0 0x7fa3440cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:49.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.948+0000 7fa341d9b640 1 -- 172.21.15.59:0/3209601760 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2460459975 0 0) 0x7fa330003520 con 0x7fa34415ce90 2023-10-16T14:25:49.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.948+0000 7fa33bfff640 1 -- 172.21.15.59:0/3209601760 >> v1:172.21.15.59:6789/0 conn(0x7fa34415ce90 legacy=0x7fa3440cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:49.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.948+0000 7fa33bfff640 1 -- 172.21.15.59:0/3209601760 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3440cf860 con 0x7fa3440b14c0 2023-10-16T14:25:49.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.949+0000 7fa33bfff640 1 --2- 172.21.15.59:0/3209601760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3440b14c0 0x7fa3440cae80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa34408afc0 tx=0x7fa32c02b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de1631bb8debcde server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:49.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.949+0000 7fa341d9b640 1 -- 172.21.15.59:0/3209601760 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3340017f0 con 0x7fa3440b14c0 2023-10-16T14:25:49.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.949+0000 7fa341d9b640 1 -- 172.21.15.59:0/3209601760 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c02e050 con 0x7fa3440b14c0 2023-10-16T14:25:49.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.949+0000 7fa341d9b640 1 -- 172.21.15.59:0/3209601760 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c030730 con 0x7fa3440b14c0 2023-10-16T14:25:49.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.950+0000 7fa348c26640 1 -- 172.21.15.59:0/3209601760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3440b14c0 msgr2=0x7fa3440cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:49.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.950+0000 7fa348c26640 1 --2- 172.21.15.59:0/3209601760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3440b14c0 0x7fa3440cae80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa34408afc0 tx=0x7fa32c02b710 comp rx=0 tx=0).stop 2023-10-16T14:25:49.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.950+0000 7fa348c26640 1 -- 172.21.15.59:0/3209601760 shutdown_connections 2023-10-16T14:25:49.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.950+0000 7fa348c26640 1 --2- 172.21.15.59:0/3209601760 >> v2:172.21.15.151:3300/0 conn(0x7fa3440cd7c0 0x7fa3440cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:49.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.950+0000 7fa348c26640 1 --2- 172.21.15.59:0/3209601760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3440b14c0 0x7fa3440cae80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:49.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.950+0000 7fa348c26640 1 -- 172.21.15.59:0/3209601760 >> 172.21.15.59:0/3209601760 conn(0x7fa3440d0830 msgr2=0x7fa3440d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:49.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.950+0000 7fa348c26640 1 -- 172.21.15.59:0/3209601760 shutdown_connections 2023-10-16T14:25:49.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.950+0000 7fa348c26640 1 -- 172.21.15.59:0/3209601760 wait complete. 2023-10-16T14:25:49.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.952+0000 7fa348c26640 1 Processor -- start 2023-10-16T14:25:49.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.952+0000 7fa348c26640 1 -- start start 2023-10-16T14:25:49.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.953+0000 7fa348c26640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3440cd7c0 0x7fa3440b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:49.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.953+0000 7fa348c26640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa34415ce90 0x7fa3441507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:49.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.953+0000 7fa348c26640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3440b3d90 0x7fa3440c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:49.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.953+0000 7fa348c26640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3440c5c60 con 0x7fa3440cd7c0 2023-10-16T14:25:49.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.953+0000 7fa348c26640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa344150d30 con 0x7fa3440b3d90 2023-10-16T14:25:49.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.953+0000 7fa348c26640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3440b45c0 con 0x7fa34415ce90 2023-10-16T14:25:49.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.953+0000 7fa34259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3440cd7c0 0x7fa3440b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:49.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.953+0000 7fa34259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3440cd7c0 0x7fa3440b60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55662/0 (socket says 172.21.15.59:55662) 2023-10-16T14:25:49.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.954+0000 7fa34259c640 1 -- 172.21.15.59:0/3540053518 learned_addr learned my addr 172.21.15.59:0/3540053518 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:49.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.954+0000 7fa34259c640 1 -- 172.21.15.59:0/3540053518 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa34415ce90 msgr2=0x7fa3441507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:49.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.954+0000 7fa34259c640 1 --2- 172.21.15.59:0/3540053518 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa34415ce90 0x7fa3441507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:49.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.954+0000 7fa342d9d640 1 --2- 172.21.15.59:0/3540053518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3440b3d90 0x7fa3440c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:49.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.954+0000 7fa34259c640 1 -- 172.21.15.59:0/3540053518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3440b3d90 msgr2=0x7fa3440c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:49.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.954+0000 7fa34259c640 1 --2- 172.21.15.59:0/3540053518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3440b3d90 0x7fa3440c7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:49.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.954+0000 7fa34259c640 1 -- 172.21.15.59:0/3540053518 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c009400 con 0x7fa3440cd7c0 2023-10-16T14:25:49.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.954+0000 7fa34259c640 1 --2- 172.21.15.59:0/3540053518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3440cd7c0 0x7fa3440b60b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa33400c750 tx=0x7fa33400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:49.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.954+0000 7fa33affd640 1 -- 172.21.15.59:0/3540053518 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa334007270 con 0x7fa3440cd7c0 2023-10-16T14:25:49.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.955+0000 7fa33affd640 1 -- 172.21.15.59:0/3540053518 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3340073d0 con 0x7fa3440cd7c0 2023-10-16T14:25:49.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.955+0000 7fa348c26640 1 -- 172.21.15.59:0/3540053518 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3440c5610 con 0x7fa3440cd7c0 2023-10-16T14:25:49.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.955+0000 7fa33affd640 1 -- 172.21.15.59:0/3540053518 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3340057a0 con 0x7fa3440cd7c0 2023-10-16T14:25:49.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.955+0000 7fa348c26640 1 -- 172.21.15.59:0/3540053518 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3440c7e40 con 0x7fa3440cd7c0 2023-10-16T14:25:49.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.956+0000 7fa348c26640 1 -- 172.21.15.59:0/3540053518 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3440c5470 con 0x7fa3440cd7c0 2023-10-16T14:25:49.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.957+0000 7fa33affd640 1 -- 172.21.15.59:0/3540053518 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa334005900 con 0x7fa3440cd7c0 2023-10-16T14:25:49.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.958+0000 7fa33affd640 1 --2- 172.21.15.59:0/3540053518 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa32406aea0 0x7fa32406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:49.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.958+0000 7fa33affd640 1 -- 172.21.15.59:0/3540053518 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fa3340893c0 con 0x7fa3440cd7c0 2023-10-16T14:25:49.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.958+0000 7fa33bfff640 1 --2- 172.21.15.59:0/3540053518 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa32406aea0 0x7fa32406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:49.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.959+0000 7fa33bfff640 1 --2- 172.21.15.59:0/3540053518 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa32406aea0 0x7fa32406d360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa32c034000 tx=0x7fa32c02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:49.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:49.962+0000 7fa33affd640 1 -- 172.21.15.59:0/3540053518 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa3440c5470 con 0x7fa3440cd7c0 2023-10-16T14:25:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:50.159+0000 7fa348c26640 1 -- 172.21.15.59:0/3540053518 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa3440c5470 con 0x7fa3440cd7c0 2023-10-16T14:25:51.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.700+0000 7fa33affd640 1 -- 172.21.15.59:0/3540053518 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) v1 ==== 228+0+0 (secure 0 0 0) 0x7fa3440c5470 con 0x7fa3440cd7c0 2023-10-16T14:25:51.705 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data_ec' created 2023-10-16T14:25:51.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.704+0000 7fa348c26640 1 -- 172.21.15.59:0/3540053518 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa32406aea0 msgr2=0x7fa32406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:51.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.704+0000 7fa348c26640 1 --2- 172.21.15.59:0/3540053518 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa32406aea0 0x7fa32406d360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa32c034000 tx=0x7fa32c02f000 comp rx=0 tx=0).stop 2023-10-16T14:25:51.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.704+0000 7fa348c26640 1 -- 172.21.15.59:0/3540053518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3440cd7c0 msgr2=0x7fa3440b60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:51.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.704+0000 7fa348c26640 1 --2- 172.21.15.59:0/3540053518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3440cd7c0 0x7fa3440b60b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa33400c750 tx=0x7fa33400cc10 comp rx=0 tx=0).stop 2023-10-16T14:25:51.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.704+0000 7fa348c26640 1 -- 172.21.15.59:0/3540053518 shutdown_connections 2023-10-16T14:25:51.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.705+0000 7fa348c26640 1 --2- 172.21.15.59:0/3540053518 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa32406aea0 0x7fa32406d360 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:51.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.705+0000 7fa348c26640 1 --2- 172.21.15.59:0/3540053518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3440b3d90 0x7fa3440c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:51.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.705+0000 7fa348c26640 1 --2- 172.21.15.59:0/3540053518 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa34415ce90 0x7fa3441507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:51.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.705+0000 7fa348c26640 1 --2- 172.21.15.59:0/3540053518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3440cd7c0 0x7fa3440b60b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:51.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.705+0000 7fa348c26640 1 -- 172.21.15.59:0/3540053518 >> 172.21.15.59:0/3540053518 conn(0x7fa3440d0830 msgr2=0x7fa3440b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:51.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.705+0000 7fa348c26640 1 -- 172.21.15.59:0/3540053518 shutdown_connections 2023-10-16T14:25:51.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.705+0000 7fa348c26640 1 -- 172.21.15.59:0/3540053518 wait complete. 2023-10-16T14:25:51.738 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-16T14:25:51.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.927+0000 7f4309683640 1 Processor -- start 2023-10-16T14:25:51.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.927+0000 7f4309683640 1 -- start start 2023-10-16T14:25:51.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.929+0000 7f4309683640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f430415a670 0x7f430415cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:51.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.929+0000 7f4309683640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43040cf010 0x7f43040d2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:51.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.929+0000 7f4309683640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43040d29c0 0x7f43040cda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:51.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.929+0000 7f4309683640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43040d0100 con 0x7f43040cf010 2023-10-16T14:25:51.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.929+0000 7f4309683640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43040cd5f0 con 0x7f430415a670 2023-10-16T14:25:51.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.929+0000 7f4309683640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43040cd2e0 con 0x7f43040d29c0 2023-10-16T14:25:51.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.929+0000 7f42fb7fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43040cf010 0x7f43040d2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:51.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.929+0000 7f42fb7fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43040cf010 0x7f43040d2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35598/0 (socket says 172.21.15.59:35598) 2023-10-16T14:25:51.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.929+0000 7f42fb7fe640 1 -- 172.21.15.59:0/3928221309 learned_addr learned my addr 172.21.15.59:0/3928221309 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.929+0000 7f4308e82640 1 --2- 172.21.15.59:0/3928221309 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43040d29c0 0x7f43040cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.929+0000 7f4303fff640 1 --2- 172.21.15.59:0/3928221309 >> v2:172.21.15.151:3300/0 conn(0x7f430415a670 0x7f430415cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.929+0000 7f42fb7fe640 1 -- 172.21.15.59:0/3928221309 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43040d29c0 msgr2=0x7f43040cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.930+0000 7f42fb7fe640 1 --2- 172.21.15.59:0/3928221309 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43040d29c0 0x7f43040cda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.930+0000 7f42fb7fe640 1 -- 172.21.15.59:0/3928221309 >> v2:172.21.15.151:3300/0 conn(0x7f430415a670 msgr2=0x7f430415cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.930+0000 7f42fb7fe640 1 --2- 172.21.15.59:0/3928221309 >> v2:172.21.15.151:3300/0 conn(0x7f430415a670 0x7f430415cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:51.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.930+0000 7f42fb7fe640 1 -- 172.21.15.59:0/3928221309 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43040d2e50 con 0x7f43040cf010 2023-10-16T14:25:51.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.930+0000 7f4303fff640 1 --2- 172.21.15.59:0/3928221309 >> v2:172.21.15.151:3300/0 conn(0x7f430415a670 0x7f430415cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:25:51.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.931+0000 7f42fb7fe640 1 --2- 172.21.15.59:0/3928221309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43040cf010 0x7f43040d2480 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f43040d02c0 tx=0x7f42ec02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a161aa59a0764de server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:51.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.931+0000 7f43037fe640 1 -- 172.21.15.59:0/3928221309 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec031860 con 0x7f43040cf010 2023-10-16T14:25:51.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.931+0000 7f43037fe640 1 -- 172.21.15.59:0/3928221309 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec0319c0 con 0x7f43040cf010 2023-10-16T14:25:51.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.931+0000 7f43037fe640 1 -- 172.21.15.59:0/3928221309 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec031d50 con 0x7f43040cf010 2023-10-16T14:25:51.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.931+0000 7f4309683640 1 -- 172.21.15.59:0/3928221309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43040cf010 msgr2=0x7f43040d2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:51.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.931+0000 7f4309683640 1 --2- 172.21.15.59:0/3928221309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43040cf010 0x7f43040d2480 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f43040d02c0 tx=0x7f42ec02b900 comp rx=0 tx=0).stop 2023-10-16T14:25:51.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.932+0000 7f4309683640 1 -- 172.21.15.59:0/3928221309 shutdown_connections 2023-10-16T14:25:51.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.932+0000 7f4309683640 1 --2- 172.21.15.59:0/3928221309 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43040d29c0 0x7f43040cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:51.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.932+0000 7f4309683640 1 --2- 172.21.15.59:0/3928221309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43040cf010 0x7f43040d2480 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:51.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.932+0000 7f4309683640 1 --2- 172.21.15.59:0/3928221309 >> v2:172.21.15.151:3300/0 conn(0x7f430415a670 0x7f430415cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:51.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.932+0000 7f4309683640 1 -- 172.21.15.59:0/3928221309 >> 172.21.15.59:0/3928221309 conn(0x7f430409bb50 msgr2=0x7f4304089f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:51.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.932+0000 7f4309683640 1 -- 172.21.15.59:0/3928221309 shutdown_connections 2023-10-16T14:25:51.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.932+0000 7f4309683640 1 -- 172.21.15.59:0/3928221309 wait complete. 2023-10-16T14:25:51.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.933+0000 7f4309683640 1 Processor -- start 2023-10-16T14:25:51.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.934+0000 7f4309683640 1 -- start start 2023-10-16T14:25:51.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.934+0000 7f4309683640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43040cf010 0x7f430414ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:51.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.934+0000 7f4309683640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43040d29c0 0x7f4304157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:51.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.935+0000 7f4309683640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f430415a670 0x7f43040b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:51.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.935+0000 7f4309683640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4304153f70 con 0x7f43040cf010 2023-10-16T14:25:51.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.935+0000 7f4309683640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43041604d0 con 0x7f43040d29c0 2023-10-16T14:25:51.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.935+0000 7f4309683640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43041607b0 con 0x7f430415a670 2023-10-16T14:25:51.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.935+0000 7f4303fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43040cf010 0x7f430414ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:51.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.935+0000 7f4303fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43040cf010 0x7f430414ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35608/0 (socket says 172.21.15.59:35608) 2023-10-16T14:25:51.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.935+0000 7f4303fff640 1 -- 172.21.15.59:0/1135335172 learned_addr learned my addr 172.21.15.59:0/1135335172 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:51.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.935+0000 7f42fb7fe640 1 --2- 172.21.15.59:0/1135335172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43040d29c0 0x7f4304157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:51.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.935+0000 7f4308e82640 1 --2- 172.21.15.59:0/1135335172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f430415a670 0x7f43040b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:51.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.935+0000 7f4303fff640 1 -- 172.21.15.59:0/1135335172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f430415a670 msgr2=0x7f43040b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:51.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.935+0000 7f4303fff640 1 --2- 172.21.15.59:0/1135335172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f430415a670 0x7f43040b0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:51.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.935+0000 7f4303fff640 1 -- 172.21.15.59:0/1135335172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43040d29c0 msgr2=0x7f4304157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:51.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.935+0000 7f4303fff640 1 --2- 172.21.15.59:0/1135335172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43040d29c0 0x7f4304157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:51.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.935+0000 7f4303fff640 1 -- 172.21.15.59:0/1135335172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec0094d0 con 0x7f43040cf010 2023-10-16T14:25:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.936+0000 7f4303fff640 1 --2- 172.21.15.59:0/1135335172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43040cf010 0x7f430414ffd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f42f400c7f0 tx=0x7f42f400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.936+0000 7f43017fa640 1 -- 172.21.15.59:0/1135335172 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f4007820 con 0x7f43040cf010 2023-10-16T14:25:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.936+0000 7f43017fa640 1 -- 172.21.15.59:0/1135335172 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f4007980 con 0x7f43040cf010 2023-10-16T14:25:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.936+0000 7f43017fa640 1 -- 172.21.15.59:0/1135335172 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f4007cf0 con 0x7f43040cf010 2023-10-16T14:25:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.936+0000 7f4309683640 1 -- 172.21.15.59:0/1135335172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4304160a90 con 0x7f43040cf010 2023-10-16T14:25:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.936+0000 7f4309683640 1 -- 172.21.15.59:0/1135335172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4304158060 con 0x7f43040cf010 2023-10-16T14:25:51.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.937+0000 7f4309683640 1 -- 172.21.15.59:0/1135335172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430404e9b0 con 0x7f43040cf010 2023-10-16T14:25:51.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.938+0000 7f43017fa640 1 -- 172.21.15.59:0/1135335172 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f42f40113f0 con 0x7f43040cf010 2023-10-16T14:25:51.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.939+0000 7f43017fa640 1 --2- 172.21.15.59:0/1135335172 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f42e406ae70 0x7f42e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:51.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.939+0000 7f43017fa640 1 -- 172.21.15.59:0/1135335172 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f42f4089cc0 con 0x7f43040cf010 2023-10-16T14:25:51.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.940+0000 7f42fb7fe640 1 --2- 172.21.15.59:0/1135335172 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f42e406ae70 0x7f42e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:51.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.941+0000 7f42fb7fe640 1 --2- 172.21.15.59:0/1135335172 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f42e406ae70 0x7f42e406d330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f42ec036000 tx=0x7f42ec03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:51.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:51.945+0000 7f43017fa640 1 -- 172.21.15.59:0/1135335172 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f42f4090080 con 0x7f43040cf010 2023-10-16T14:25:52.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.140+0000 7f4309683640 1 -- 172.21.15.59:0/1135335172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f430406b2b0 con 0x7f43040cf010 2023-10-16T14:25:52.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.716+0000 7f43017fa640 1 -- 172.21.15.59:0/1135335172 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f42f401f0c0 con 0x7f43040cf010 2023-10-16T14:25:52.720 INFO:teuthology.orchestra.run.smithi059.stderr:set pool 4 allow_ec_overwrites to true 2023-10-16T14:25:52.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.720+0000 7f4309683640 1 -- 172.21.15.59:0/1135335172 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f42e406ae70 msgr2=0x7f42e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:52.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.720+0000 7f4309683640 1 --2- 172.21.15.59:0/1135335172 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f42e406ae70 0x7f42e406d330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f42ec036000 tx=0x7f42ec03c040 comp rx=0 tx=0).stop 2023-10-16T14:25:52.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.720+0000 7f4309683640 1 -- 172.21.15.59:0/1135335172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43040cf010 msgr2=0x7f430414ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:52.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.720+0000 7f4309683640 1 --2- 172.21.15.59:0/1135335172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43040cf010 0x7f430414ffd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f42f400c7f0 tx=0x7f42f400ccb0 comp rx=0 tx=0).stop 2023-10-16T14:25:52.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.722+0000 7f4309683640 1 -- 172.21.15.59:0/1135335172 shutdown_connections 2023-10-16T14:25:52.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.722+0000 7f4309683640 1 --2- 172.21.15.59:0/1135335172 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f42e406ae70 0x7f42e406d330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:52.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.722+0000 7f4309683640 1 --2- 172.21.15.59:0/1135335172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f430415a670 0x7f43040b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:52.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.722+0000 7f4309683640 1 --2- 172.21.15.59:0/1135335172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43040d29c0 0x7f4304157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:52.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.722+0000 7f4309683640 1 --2- 172.21.15.59:0/1135335172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43040cf010 0x7f430414ffd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:52.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.722+0000 7f4309683640 1 -- 172.21.15.59:0/1135335172 >> 172.21.15.59:0/1135335172 conn(0x7f430409bb50 msgr2=0x7f43040b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:52.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.722+0000 7f4309683640 1 -- 172.21.15.59:0/1135335172 shutdown_connections 2023-10-16T14:25:52.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.723+0000 7f4309683640 1 -- 172.21.15.59:0/1135335172 wait complete. 2023-10-16T14:25:52.764 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-16T14:25:52.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.956+0000 7f10cc2a9640 1 Processor -- start 2023-10-16T14:25:52.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.956+0000 7f10cc2a9640 1 -- start start 2023-10-16T14:25:52.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.957+0000 7f10cc2a9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10c4070a30 0x7f10c40cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:52.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.957+0000 7f10cc2a9640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10c40ca550 0x7f10c40c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:52.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.957+0000 7f10cc2a9640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c40cf040 con 0x7f10c415a830 2023-10-16T14:25:52.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.957+0000 7f10cc2a9640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c40ca9e0 con 0x7f10c40ca550 2023-10-16T14:25:52.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.957+0000 7f10cc2a9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c40ce430 con 0x7f10c4070a30 2023-10-16T14:25:52.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.958+0000 7f10ca846640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10c40ca550 0x7f10c40c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:52.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.958+0000 7f10ca045640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f10c415a830 0x7f10c4070320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35390/0 (socket says 172.21.15.59:35390) 2023-10-16T14:25:52.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.958+0000 7f10ca045640 1 -- 172.21.15.59:0/1325531623 learned_addr learned my addr 172.21.15.59:0/1325531623 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:25:52.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.958+0000 7f10c9844640 1 --2- 172.21.15.59:0/1325531623 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10c4070a30 0x7f10c40cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:52.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.958+0000 7f10ca846640 1 -- 172.21.15.59:0/1325531623 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10c4070a30 msgr2=0x7f10c40cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:52.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.958+0000 7f10ca846640 1 --2- 172.21.15.59:0/1325531623 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10c4070a30 0x7f10c40cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:52.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.958+0000 7f10ca846640 1 -- 172.21.15.59:0/1325531623 >> v1:172.21.15.59:6789/0 conn(0x7f10c415a830 legacy=0x7f10c4070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:52.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.958+0000 7f10ca846640 1 -- 172.21.15.59:0/1325531623 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c40ce710 con 0x7f10c40ca550 2023-10-16T14:25:52.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.958+0000 7f10c9844640 1 --2- 172.21.15.59:0/1325531623 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10c4070a30 0x7f10c40cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:25:52.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.959+0000 7f10ca846640 1 --2- 172.21.15.59:0/1325531623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10c40ca550 0x7f10c40c8b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009d90 tx=0x7f10bc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163245a4a42ba778 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:52.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.960+0000 7f10c9043640 1 -- 172.21.15.59:0/1325531623 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc02cc60 con 0x7f10c40ca550 2023-10-16T14:25:52.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.960+0000 7f10c9043640 1 -- 172.21.15.59:0/1325531623 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10bc02cdc0 con 0x7f10c40ca550 2023-10-16T14:25:52.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.960+0000 7f10c9043640 1 -- 172.21.15.59:0/1325531623 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc034660 con 0x7f10c40ca550 2023-10-16T14:25:52.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.960+0000 7f10cc2a9640 1 -- 172.21.15.59:0/1325531623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10c40ca550 msgr2=0x7f10c40c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:52.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.960+0000 7f10cc2a9640 1 --2- 172.21.15.59:0/1325531623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10c40ca550 0x7f10c40c8b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009d90 tx=0x7f10bc02beb0 comp rx=0 tx=0).stop 2023-10-16T14:25:52.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.960+0000 7f10cc2a9640 1 -- 172.21.15.59:0/1325531623 shutdown_connections 2023-10-16T14:25:52.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.960+0000 7f10cc2a9640 1 --2- 172.21.15.59:0/1325531623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10c40ca550 0x7f10c40c8b50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:52.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.960+0000 7f10cc2a9640 1 --2- 172.21.15.59:0/1325531623 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10c4070a30 0x7f10c40cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:52.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.960+0000 7f10cc2a9640 1 -- 172.21.15.59:0/1325531623 >> 172.21.15.59:0/1325531623 conn(0x7f10c40b0030 msgr2=0x7f10c40b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:52.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.961+0000 7f10cc2a9640 1 -- 172.21.15.59:0/1325531623 shutdown_connections 2023-10-16T14:25:52.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.961+0000 7f10cc2a9640 1 -- 172.21.15.59:0/1325531623 wait complete. 2023-10-16T14:25:52.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.962+0000 7f10cc2a9640 1 Processor -- start 2023-10-16T14:25:52.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.963+0000 7f10cc2a9640 1 -- start start 2023-10-16T14:25:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.963+0000 7f10cc2a9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10c4070a30 0x7f10c4156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.963+0000 7f10cc2a9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10c40ca550 0x7f10c40c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.964+0000 7f10cc2a9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10c415a830 0x7f10c40c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:52.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.964+0000 7f10cc2a9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c40c88d0 con 0x7f10c40ca550 2023-10-16T14:25:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.964+0000 7f10cc2a9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c40c8b90 con 0x7f10c4070a30 2023-10-16T14:25:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.964+0000 7f10cc2a9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c40c8e70 con 0x7f10c415a830 2023-10-16T14:25:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.964+0000 7f10c9844640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10c40ca550 0x7f10c40c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.964+0000 7f10c9844640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10c40ca550 0x7f10c40c7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35624/0 (socket says 172.21.15.59:35624) 2023-10-16T14:25:52.971 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.964+0000 7f10c9844640 1 -- 172.21.15.59:0/3313542322 learned_addr learned my addr 172.21.15.59:0/3313542322 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:52.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.964+0000 7f10ca045640 1 --2- 172.21.15.59:0/3313542322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10c4070a30 0x7f10c4156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:52.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.964+0000 7f10ca846640 1 --2- 172.21.15.59:0/3313542322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10c415a830 0x7f10c40c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:52.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.964+0000 7f10c9844640 1 -- 172.21.15.59:0/3313542322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10c415a830 msgr2=0x7f10c40c3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:52.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.964+0000 7f10c9844640 1 --2- 172.21.15.59:0/3313542322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10c415a830 0x7f10c40c3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:52.972 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.964+0000 7f10c9844640 1 -- 172.21.15.59:0/3313542322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10c4070a30 msgr2=0x7f10c4156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:52.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.964+0000 7f10c9844640 1 --2- 172.21.15.59:0/3313542322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10c4070a30 0x7f10c4156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:52.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.964+0000 7f10c9844640 1 -- 172.21.15.59:0/3313542322 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc009a70 con 0x7f10c40ca550 2023-10-16T14:25:52.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.964+0000 7f10ca846640 1 --2- 172.21.15.59:0/3313542322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10c415a830 0x7f10c40c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:25:52.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.965+0000 7f10c9844640 1 --2- 172.21.15.59:0/3313542322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10c40ca550 0x7f10c40c7de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f10b400e730 tx=0x7f10b400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:52.973 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.965+0000 7f10baffd640 1 -- 172.21.15.59:0/3313542322 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4004230 con 0x7f10c40ca550 2023-10-16T14:25:52.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.965+0000 7f10baffd640 1 -- 172.21.15.59:0/3313542322 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b4004390 con 0x7f10c40ca550 2023-10-16T14:25:52.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.965+0000 7f10baffd640 1 -- 172.21.15.59:0/3313542322 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b400c8f0 con 0x7f10c40ca550 2023-10-16T14:25:52.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.965+0000 7f10cc2a9640 1 -- 172.21.15.59:0/3313542322 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c40c9150 con 0x7f10c40ca550 2023-10-16T14:25:52.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.965+0000 7f10cc2a9640 1 -- 172.21.15.59:0/3313542322 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c40c5790 con 0x7f10c40ca550 2023-10-16T14:25:52.974 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.966+0000 7f10cc2a9640 1 -- 172.21.15.59:0/3313542322 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c4073ef0 con 0x7f10c40ca550 2023-10-16T14:25:52.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.967+0000 7f10baffd640 1 -- 172.21.15.59:0/3313542322 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f10b400ca50 con 0x7f10c40ca550 2023-10-16T14:25:52.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.968+0000 7f10baffd640 1 --2- 172.21.15.59:0/3313542322 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f10a806ae70 0x7f10a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:52.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.968+0000 7f10baffd640 1 -- 172.21.15.59:0/3313542322 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f10b40895a0 con 0x7f10c40ca550 2023-10-16T14:25:52.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.969+0000 7f10ca045640 1 --2- 172.21.15.59:0/3313542322 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f10a806ae70 0x7f10a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:52.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.970+0000 7f10ca045640 1 --2- 172.21.15.59:0/3313542322 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f10a806ae70 0x7f10a806d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f10c0005880 tx=0x7f10c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:52.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:52.973+0000 7f10baffd640 1 -- 172.21.15.59:0/3313542322 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f10b40542e0 con 0x7f10c40ca550 2023-10-16T14:25:53.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.208+0000 7f10cc2a9640 1 -- 172.21.15.59:0/3313542322 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f10c4072de0 con 0x7f10c40ca550 2023-10-16T14:25:53.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.719+0000 7f10baffd640 1 -- 172.21.15.59:0/3313542322 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f10b4057900 con 0x7f10c40ca550 2023-10-16T14:25:53.723 INFO:teuthology.orchestra.run.smithi059.stderr:added data pool 4 to fsmap 2023-10-16T14:25:53.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.723+0000 7f10cc2a9640 1 -- 172.21.15.59:0/3313542322 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f10a806ae70 msgr2=0x7f10a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:53.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.723+0000 7f10cc2a9640 1 --2- 172.21.15.59:0/3313542322 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f10a806ae70 0x7f10a806d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f10c0005880 tx=0x7f10c0009040 comp rx=0 tx=0).stop 2023-10-16T14:25:53.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.723+0000 7f10cc2a9640 1 -- 172.21.15.59:0/3313542322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10c40ca550 msgr2=0x7f10c40c7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:53.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.723+0000 7f10cc2a9640 1 --2- 172.21.15.59:0/3313542322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10c40ca550 0x7f10c40c7de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f10b400e730 tx=0x7f10b400ebf0 comp rx=0 tx=0).stop 2023-10-16T14:25:53.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.723+0000 7f10cc2a9640 1 -- 172.21.15.59:0/3313542322 shutdown_connections 2023-10-16T14:25:53.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.723+0000 7f10cc2a9640 1 --2- 172.21.15.59:0/3313542322 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f10a806ae70 0x7f10a806d330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:53.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.723+0000 7f10cc2a9640 1 --2- 172.21.15.59:0/3313542322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f10c415a830 0x7f10c40c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:53.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.723+0000 7f10cc2a9640 1 --2- 172.21.15.59:0/3313542322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10c40ca550 0x7f10c40c7de0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:53.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.723+0000 7f10cc2a9640 1 --2- 172.21.15.59:0/3313542322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10c4070a30 0x7f10c4156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:53.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.723+0000 7f10cc2a9640 1 -- 172.21.15.59:0/3313542322 >> 172.21.15.59:0/3313542322 conn(0x7f10c40b0030 msgr2=0x7f10c40b15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:53.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.723+0000 7f10cc2a9640 1 -- 172.21.15.59:0/3313542322 shutdown_connections 2023-10-16T14:25:53.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.724+0000 7f10cc2a9640 1 -- 172.21.15.59:0/3313542322 wait complete. 2023-10-16T14:25:53.748 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T14:25:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.972+0000 7fefb6139640 1 Processor -- start 2023-10-16T14:25:53.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.972+0000 7fefb6139640 1 -- start start 2023-10-16T14:25:53.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.974+0000 7fefb6139640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fefb00b0010 0x7fefb00701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:53.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.974+0000 7fefb6139640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fefb015ad00 0x7fefb015f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.974+0000 7fefb6139640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fefb00b03f0 0x7fefb015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.974+0000 7fefb6139640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb015f580 con 0x7fefb00b03f0 2023-10-16T14:25:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.974+0000 7fefb6139640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb00707f0 con 0x7fefb015ad00 2023-10-16T14:25:53.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.974+0000 7fefb6139640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb0070ad0 con 0x7fefb00b0010 2023-10-16T14:25:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.974+0000 7fefaffff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fefb00b03f0 0x7fefb015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.974+0000 7fefaffff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fefb00b03f0 0x7fefb015b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35638/0 (socket says 172.21.15.59:35638) 2023-10-16T14:25:53.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.974+0000 7fefaffff640 1 -- 172.21.15.59:0/271365572 learned_addr learned my addr 172.21.15.59:0/271365572 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:53.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.975+0000 7fefaeffd640 1 --2- 172.21.15.59:0/271365572 >> v2:172.21.15.151:3300/0 conn(0x7fefb015ad00 0x7fefb015f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:53.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.975+0000 7fefaf7fe640 1 --2- 172.21.15.59:0/271365572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fefb00b0010 0x7fefb00701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:53.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.975+0000 7fefaffff640 1 -- 172.21.15.59:0/271365572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fefb00b0010 msgr2=0x7fefb00701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:53.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.975+0000 7fefaffff640 1 --2- 172.21.15.59:0/271365572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fefb00b0010 0x7fefb00701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.975+0000 7fefaffff640 1 -- 172.21.15.59:0/271365572 >> v2:172.21.15.151:3300/0 conn(0x7fefb015ad00 msgr2=0x7fefb015f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.975+0000 7fefaffff640 1 --2- 172.21.15.59:0/271365572 >> v2:172.21.15.151:3300/0 conn(0x7fefb015ad00 0x7fefb015f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.975+0000 7fefaffff640 1 -- 172.21.15.59:0/271365572 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb015b1d0 con 0x7fefb00b03f0 2023-10-16T14:25:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.975+0000 7fefaf7fe640 1 --2- 172.21.15.59:0/271365572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fefb00b0010 0x7fefb00701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:25:53.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.976+0000 7fefaffff640 1 --2- 172.21.15.59:0/271365572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb00b03f0 0x7fefb015b9d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fefb006dd80 tx=0x7fefa802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504ca64fef445c17 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:53.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.977+0000 7fefae7fc640 1 -- 172.21.15.59:0/271365572 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa802ca70 con 0x7fefb00b03f0 2023-10-16T14:25:53.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.977+0000 7fefae7fc640 1 -- 172.21.15.59:0/271365572 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa802cbd0 con 0x7fefb00b03f0 2023-10-16T14:25:53.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.977+0000 7fefae7fc640 1 -- 172.21.15.59:0/271365572 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa80343f0 con 0x7fefb00b03f0 2023-10-16T14:25:53.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.977+0000 7fefb6139640 1 -- 172.21.15.59:0/271365572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb00b03f0 msgr2=0x7fefb015b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:53.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.977+0000 7fefb6139640 1 --2- 172.21.15.59:0/271365572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb00b03f0 0x7fefb015b9d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fefb006dd80 tx=0x7fefa802bed0 comp rx=0 tx=0).stop 2023-10-16T14:25:53.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.977+0000 7fefb6139640 1 -- 172.21.15.59:0/271365572 shutdown_connections 2023-10-16T14:25:53.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.977+0000 7fefb6139640 1 --2- 172.21.15.59:0/271365572 >> v2:172.21.15.151:3300/0 conn(0x7fefb015ad00 0x7fefb015f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:53.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.977+0000 7fefb6139640 1 --2- 172.21.15.59:0/271365572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb00b03f0 0x7fefb015b9d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:53.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.977+0000 7fefb6139640 1 --2- 172.21.15.59:0/271365572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fefb00b0010 0x7fefb00701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:53.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.977+0000 7fefb6139640 1 -- 172.21.15.59:0/271365572 >> 172.21.15.59:0/271365572 conn(0x7fefb006c1c0 msgr2=0x7fefb006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:53.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.978+0000 7fefb6139640 1 -- 172.21.15.59:0/271365572 shutdown_connections 2023-10-16T14:25:53.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.978+0000 7fefb6139640 1 -- 172.21.15.59:0/271365572 wait complete. 2023-10-16T14:25:53.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.979+0000 7fefb6139640 1 Processor -- start 2023-10-16T14:25:53.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.979+0000 7fefb6139640 1 -- start start 2023-10-16T14:25:53.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.980+0000 7fefb6139640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb00b0010 0x7fefb00c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:53.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.980+0000 7fefb6139640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fefb00b03f0 0x7fefb015db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:53.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.980+0000 7fefb6139640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefb015ad00 0x7fefb015e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:53.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.980+0000 7fefb6139640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb00b2230 con 0x7fefb00b0010 2023-10-16T14:25:53.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.980+0000 7fefb6139640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb00c6b40 con 0x7fefb015ad00 2023-10-16T14:25:53.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.980+0000 7fefb6139640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb00c76c0 con 0x7fefb00b03f0 2023-10-16T14:25:53.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.981+0000 7fefaf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb00b0010 0x7fefb00c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:53.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.981+0000 7fefaf7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb00b0010 0x7fefb00c20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35650/0 (socket says 172.21.15.59:35650) 2023-10-16T14:25:53.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.981+0000 7fefaf7fe640 1 -- 172.21.15.59:0/1424321949 learned_addr learned my addr 172.21.15.59:0/1424321949 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:53.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.981+0000 7fefaffff640 1 --2- 172.21.15.59:0/1424321949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefb015ad00 0x7fefb015e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:53.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.981+0000 7fefaeffd640 1 --2- 172.21.15.59:0/1424321949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fefb00b03f0 0x7fefb015db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:53.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.981+0000 7fefaf7fe640 1 -- 172.21.15.59:0/1424321949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fefb00b03f0 msgr2=0x7fefb015db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:53.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.981+0000 7fefaf7fe640 1 --2- 172.21.15.59:0/1424321949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fefb00b03f0 0x7fefb015db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:53.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.981+0000 7fefaf7fe640 1 -- 172.21.15.59:0/1424321949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefb015ad00 msgr2=0x7fefb015e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:53.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.981+0000 7fefaf7fe640 1 --2- 172.21.15.59:0/1424321949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefb015ad00 0x7fefb015e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:53.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.981+0000 7fefaf7fe640 1 -- 172.21.15.59:0/1424321949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa8009b30 con 0x7fefb00b0010 2023-10-16T14:25:53.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.982+0000 7fefaf7fe640 1 --2- 172.21.15.59:0/1424321949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb00b0010 0x7fefb00c20c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fefa000e840 tx=0x7fefa000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:53.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.982+0000 7fef97fff640 1 -- 172.21.15.59:0/1424321949 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0004030 con 0x7fefb00b0010 2023-10-16T14:25:53.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.982+0000 7fef97fff640 1 -- 172.21.15.59:0/1424321949 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa0004190 con 0x7fefb00b0010 2023-10-16T14:25:53.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.982+0000 7fefb6139640 1 -- 172.21.15.59:0/1424321949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb00c6d90 con 0x7fefb00b0010 2023-10-16T14:25:53.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.982+0000 7fef97fff640 1 -- 172.21.15.59:0/1424321949 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0004520 con 0x7fefb00b0010 2023-10-16T14:25:53.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.982+0000 7fefb6139640 1 -- 172.21.15.59:0/1424321949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb00c7350 con 0x7fefb00b0010 2023-10-16T14:25:53.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.983+0000 7fefb6139640 1 -- 172.21.15.59:0/1424321949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb0073ef0 con 0x7fefb00b0010 2023-10-16T14:25:53.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.984+0000 7fef97fff640 1 -- 172.21.15.59:0/1424321949 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fefa000c6d0 con 0x7fefb00b0010 2023-10-16T14:25:53.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.985+0000 7fef97fff640 1 --2- 172.21.15.59:0/1424321949 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fef9c06ae70 0x7fef9c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.985+0000 7fef97fff640 1 -- 172.21.15.59:0/1424321949 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fefa0089570 con 0x7fefb00b0010 2023-10-16T14:25:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.986+0000 7fefaeffd640 1 --2- 172.21.15.59:0/1424321949 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fef9c06ae70 0x7fef9c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.987+0000 7fefaeffd640 1 --2- 172.21.15.59:0/1424321949 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fef9c06ae70 0x7fef9c06d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fefb015c130 tx=0x7fefa4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:53.989+0000 7fef97fff640 1 -- 172.21.15.59:0/1424321949 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fefa0054290 con 0x7fefb00b0010 2023-10-16T14:25:54.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.226+0000 7fefb6139640 1 -- 172.21.15.59:0/1424321949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fefb00c6920 con 0x7fefb00b0010 2023-10-16T14:25:54.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.227+0000 7fef97fff640 1 -- 172.21.15.59:0/1424321949 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fefa00578b0 con 0x7fefb00b0010 2023-10-16T14:25:54.231 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:25:54.231 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3959035293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3959035293},{"type":"v1","addr":"172.21.15.59:6834","nonce":3959035293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1298271347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1298271347},{"type":"v1","addr":"172.21.15.151:6835","nonce":1298271347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/249904108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":249904108},{"type":"v1","addr":"172.21.15.59:6835","nonce":249904108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T14:25:48.130662+0000","modified":"2023-10-16T14:25:53.210036+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6837/4004038733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4004038733},{"type":"v1","addr":"172.21.15.151:6837","nonce":4004038733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-16T14:25:54.232 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 7 2023-10-16T14:25:54.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.230+0000 7fefb6139640 1 -- 172.21.15.59:0/1424321949 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fef9c06ae70 msgr2=0x7fef9c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:54.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.230+0000 7fefb6139640 1 --2- 172.21.15.59:0/1424321949 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fef9c06ae70 0x7fef9c06d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fefb015c130 tx=0x7fefa4008040 comp rx=0 tx=0).stop 2023-10-16T14:25:54.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.230+0000 7fefb6139640 1 -- 172.21.15.59:0/1424321949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb00b0010 msgr2=0x7fefb00c20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:54.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.230+0000 7fefb6139640 1 --2- 172.21.15.59:0/1424321949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb00b0010 0x7fefb00c20c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fefa000e840 tx=0x7fefa000ed00 comp rx=0 tx=0).stop 2023-10-16T14:25:54.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.230+0000 7fefb6139640 1 -- 172.21.15.59:0/1424321949 shutdown_connections 2023-10-16T14:25:54.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.230+0000 7fefb6139640 1 --2- 172.21.15.59:0/1424321949 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fef9c06ae70 0x7fef9c06d330 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.230+0000 7fefb6139640 1 --2- 172.21.15.59:0/1424321949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefb015ad00 0x7fefb015e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.230+0000 7fefb6139640 1 --2- 172.21.15.59:0/1424321949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fefb00b03f0 0x7fefb015db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.230+0000 7fefb6139640 1 --2- 172.21.15.59:0/1424321949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb00b0010 0x7fefb00c20c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.230+0000 7fefb6139640 1 -- 172.21.15.59:0/1424321949 >> 172.21.15.59:0/1424321949 conn(0x7fefb006c1c0 msgr2=0x7fefb00ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:54.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.230+0000 7fefb6139640 1 -- 172.21.15.59:0/1424321949 shutdown_connections 2023-10-16T14:25:54.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.230+0000 7fefb6139640 1 -- 172.21.15.59:0/1424321949 wait complete. 2023-10-16T14:25:54.251 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:25:54.281 INFO:tasks.ceph.mds.d.smithi151.stderr:2023-10-16T14:25:54.278+0000 7f0ad50ae640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T14:25:54.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.470+0000 7f53dde83640 1 Processor -- start 2023-10-16T14:25:54.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.470+0000 7f53dde83640 1 -- start start 2023-10-16T14:25:54.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.471+0000 7f53dde83640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f53d815a8d0 0x7f53d80cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:54.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.471+0000 7f53dde83640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53d80ca660 0x7f53d80cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:54.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.472+0000 7f53dde83640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d815acb0 con 0x7f53d806ff40 2023-10-16T14:25:54.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.472+0000 7f53dde83640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d80c1c60 con 0x7f53d815a8d0 2023-10-16T14:25:54.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.472+0000 7f53dde83640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d815e350 con 0x7f53d80ca660 2023-10-16T14:25:54.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.472+0000 7f53dce81640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f53d815a8d0 0x7f53d80cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:54.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.472+0000 7f53d7fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53d80ca660 0x7f53d80cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:54.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.472+0000 7f53dce81640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f53d815a8d0 0x7f53d80cab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.59:55070/0 (socket says 172.21.15.59:55070) 2023-10-16T14:25:54.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.472+0000 7f53dce81640 1 -- 172.21.15.59:0/2336638851 learned_addr learned my addr 172.21.15.59:0/2336638851 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:54.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.473+0000 7f53d7fff640 1 -- 172.21.15.59:0/2336638851 >> v2:172.21.15.151:3300/0 conn(0x7f53d815a8d0 msgr2=0x7f53d80cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:54.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.473+0000 7f53d7fff640 1 --2- 172.21.15.59:0/2336638851 >> v2:172.21.15.151:3300/0 conn(0x7f53d815a8d0 0x7f53d80cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.473+0000 7f53d7fff640 1 -- 172.21.15.59:0/2336638851 >> v1:172.21.15.151:6789/0 conn(0x7f53d806ff40 legacy=0x7f53d806bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:54.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.473+0000 7f53d7fff640 1 -- 172.21.15.59:0/2336638851 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d815e630 con 0x7f53d80ca660 2023-10-16T14:25:54.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.475+0000 7f53d7fff640 1 --2- 172.21.15.59:0/2336638851 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53d80ca660 0x7f53d80cb080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f53c40097a0 tx=0x7f53c402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3f5397fe1529951 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:54.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.476+0000 7f53d77fe640 1 -- 172.21.15.59:0/2336638851 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c402d040 con 0x7f53d80ca660 2023-10-16T14:25:54.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.476+0000 7f53d77fe640 1 -- 172.21.15.59:0/2336638851 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c4031810 con 0x7f53d80ca660 2023-10-16T14:25:54.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.476+0000 7f53d77fe640 1 -- 172.21.15.59:0/2336638851 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c4031ba0 con 0x7f53d80ca660 2023-10-16T14:25:54.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.477+0000 7f53dde83640 1 -- 172.21.15.59:0/2336638851 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53d80ca660 msgr2=0x7f53d80cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:54.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.477+0000 7f53dde83640 1 --2- 172.21.15.59:0/2336638851 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53d80ca660 0x7f53d80cb080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f53c40097a0 tx=0x7f53c402b8b0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.477+0000 7f53dde83640 1 -- 172.21.15.59:0/2336638851 shutdown_connections 2023-10-16T14:25:54.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.477+0000 7f53dde83640 1 --2- 172.21.15.59:0/2336638851 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53d80ca660 0x7f53d80cb080 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.477+0000 7f53dde83640 1 --2- 172.21.15.59:0/2336638851 >> v2:172.21.15.151:3300/0 conn(0x7f53d815a8d0 0x7f53d80cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.477+0000 7f53dde83640 1 -- 172.21.15.59:0/2336638851 >> 172.21.15.59:0/2336638851 conn(0x7f53d806a470 msgr2=0x7f53d80afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:54.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.477+0000 7f53dde83640 1 -- 172.21.15.59:0/2336638851 shutdown_connections 2023-10-16T14:25:54.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.477+0000 7f53dde83640 1 -- 172.21.15.59:0/2336638851 wait complete. 2023-10-16T14:25:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.479+0000 7f53dde83640 1 Processor -- start 2023-10-16T14:25:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.480+0000 7f53dde83640 1 -- start start 2023-10-16T14:25:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.481+0000 7f53dde83640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53d806ff40 0x7f53d80c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:54.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.481+0000 7f53dde83640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53d80ca660 0x7f53d81f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.481+0000 7f53dde83640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53d815a8d0 0x7f53d80c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.481+0000 7f53dde83640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d815ddc0 con 0x7f53d80ca660 2023-10-16T14:25:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.481+0000 7f53dde83640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d815b1a0 con 0x7f53d815a8d0 2023-10-16T14:25:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.481+0000 7f53dde83640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80cc6f0 con 0x7f53d806ff40 2023-10-16T14:25:54.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.481+0000 7f53d7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53d80ca660 0x7f53d81f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.481+0000 7f53d7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53d80ca660 0x7f53d81f2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35658/0 (socket says 172.21.15.59:35658) 2023-10-16T14:25:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.481+0000 7f53d7fff640 1 -- 172.21.15.59:0/3332097257 learned_addr learned my addr 172.21.15.59:0/3332097257 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.482+0000 7f53dce81640 1 --2- 172.21.15.59:0/3332097257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53d806ff40 0x7f53d80c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.482+0000 7f53dd682640 1 --2- 172.21.15.59:0/3332097257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53d815a8d0 0x7f53d80c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:54.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.482+0000 7f53d7fff640 1 -- 172.21.15.59:0/3332097257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53d806ff40 msgr2=0x7f53d80c2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:54.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.482+0000 7f53d7fff640 1 --2- 172.21.15.59:0/3332097257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53d806ff40 0x7f53d80c2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.482+0000 7f53d7fff640 1 -- 172.21.15.59:0/3332097257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53d815a8d0 msgr2=0x7f53d80c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:54.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.482+0000 7f53d7fff640 1 --2- 172.21.15.59:0/3332097257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53d815a8d0 0x7f53d80c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.482+0000 7f53d7fff640 1 -- 172.21.15.59:0/3332097257 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c4009400 con 0x7f53d80ca660 2023-10-16T14:25:54.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.482+0000 7f53d7fff640 1 --2- 172.21.15.59:0/3332097257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53d80ca660 0x7f53d81f2bd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53c40098c0 tx=0x7f53c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:54.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.483+0000 7f53d57fa640 1 -- 172.21.15.59:0/3332097257 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c4006e10 con 0x7f53d80ca660 2023-10-16T14:25:54.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.483+0000 7f53d57fa640 1 -- 172.21.15.59:0/3332097257 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c403ad60 con 0x7f53d80ca660 2023-10-16T14:25:54.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.483+0000 7f53d57fa640 1 -- 172.21.15.59:0/3332097257 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c4044620 con 0x7f53d80ca660 2023-10-16T14:25:54.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.483+0000 7f53dde83640 1 -- 172.21.15.59:0/3332097257 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d81f3110 con 0x7f53d80ca660 2023-10-16T14:25:54.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.483+0000 7f53dde83640 1 -- 172.21.15.59:0/3332097257 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d80cc0a0 con 0x7f53d80ca660 2023-10-16T14:25:54.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.484+0000 7f53dde83640 1 -- 172.21.15.59:0/3332097257 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d80cbf00 con 0x7f53d80ca660 2023-10-16T14:25:54.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.485+0000 7f53d57fa640 1 -- 172.21.15.59:0/3332097257 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f53c404d440 con 0x7f53d80ca660 2023-10-16T14:25:54.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.487+0000 7f53d57fa640 1 --2- 172.21.15.59:0/3332097257 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f53bc06ae70 0x7f53bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:54.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.487+0000 7f53d57fa640 1 -- 172.21.15.59:0/3332097257 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f53c40abc70 con 0x7f53d80ca660 2023-10-16T14:25:54.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.487+0000 7f53dce81640 1 --2- 172.21.15.59:0/3332097257 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f53bc06ae70 0x7f53bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:54.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.489+0000 7f53dce81640 1 --2- 172.21.15.59:0/3332097257 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f53bc06ae70 0x7f53bc06d330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009a20 tx=0x7f53cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:54.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.492+0000 7f53d57fa640 1 -- 172.21.15.59:0/3332097257 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f53d80cbf00 con 0x7f53d80ca660 2023-10-16T14:25:54.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.689+0000 7f53dde83640 1 -- 172.21.15.59:0/3332097257 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53d80cbf00 con 0x7f53d80ca660 2023-10-16T14:25:54.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.691+0000 7f53d57fa640 1 -- 172.21.15.59:0/3332097257 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f53d80cbf00 con 0x7f53d80ca660 2023-10-16T14:25:54.695 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:25:54.695 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:25:53.209862+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:25:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.694+0000 7f53dde83640 1 -- 172.21.15.59:0/3332097257 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f53bc06ae70 msgr2=0x7f53bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.694+0000 7f53dde83640 1 --2- 172.21.15.59:0/3332097257 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f53bc06ae70 0x7f53bc06d330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009a20 tx=0x7f53cc008040 comp rx=0 tx=0).stop 2023-10-16T14:25:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.694+0000 7f53dde83640 1 -- 172.21.15.59:0/3332097257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53d80ca660 msgr2=0x7f53d81f2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.694+0000 7f53dde83640 1 --2- 172.21.15.59:0/3332097257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53d80ca660 0x7f53d81f2bd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53c40098c0 tx=0x7f53c40046c0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.694+0000 7f53dde83640 1 -- 172.21.15.59:0/3332097257 shutdown_connections 2023-10-16T14:25:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.694+0000 7f53dde83640 1 --2- 172.21.15.59:0/3332097257 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f53bc06ae70 0x7f53bc06d330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.694+0000 7f53dde83640 1 --2- 172.21.15.59:0/3332097257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53d815a8d0 0x7f53d80c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.694+0000 7f53dde83640 1 --2- 172.21.15.59:0/3332097257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53d80ca660 0x7f53d81f2bd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.694+0000 7f53dde83640 1 --2- 172.21.15.59:0/3332097257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53d806ff40 0x7f53d80c2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.695+0000 7f53dde83640 1 -- 172.21.15.59:0/3332097257 >> 172.21.15.59:0/3332097257 conn(0x7f53d806a470 msgr2=0x7f53d80af0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:54.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.695+0000 7f53dde83640 1 -- 172.21.15.59:0/3332097257 shutdown_connections 2023-10-16T14:25:54.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.695+0000 7f53dde83640 1 -- 172.21.15.59:0/3332097257 wait complete. 2023-10-16T14:25:54.719 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:25:54.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.942+0000 7f81fbfff640 1 Processor -- start 2023-10-16T14:25:54.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.943+0000 7f81fbfff640 1 -- start start 2023-10-16T14:25:54.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.944+0000 7f81fbfff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f81fc0cf850 0x7f81fc167860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:54.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.944+0000 7f81fbfff640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81fc0b2f90 con 0x7f81fc15c9d0 2023-10-16T14:25:54.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.944+0000 7f81fbfff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81fc0d0320 con 0x7f81fc0d16a0 2023-10-16T14:25:54.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.944+0000 7f81fbfff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81fc0d0600 con 0x7f81fc0cf850 2023-10-16T14:25:54.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.945+0000 7f81faffd640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f81fc15c9d0 0x7f81fc0cdf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35396/0 (socket says 172.21.15.59:35396) 2023-10-16T14:25:54.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.945+0000 7f81faffd640 1 -- 172.21.15.59:0/3604338003 learned_addr learned my addr 172.21.15.59:0/3604338003 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:25:54.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.945+0000 7f81fb7fe640 1 --2- 172.21.15.59:0/3604338003 >> v2:172.21.15.151:3300/0 conn(0x7f81fc0cf850 0x7f81fc167860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:54.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.945+0000 7f81fa7fc640 1 -- 172.21.15.59:0/3604338003 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201159869 0 0) 0x7f81fc0b2f90 con 0x7f81fc15c9d0 2023-10-16T14:25:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.945+0000 7f81fa7fc640 1 -- 172.21.15.59:0/3604338003 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81e8003520 con 0x7f81fc15c9d0 2023-10-16T14:25:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.946+0000 7f81fa7fc640 1 -- 172.21.15.59:0/3604338003 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1421442418 0 0) 0x7f81e8003520 con 0x7f81fc15c9d0 2023-10-16T14:25:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.946+0000 7f81fa7fc640 1 -- 172.21.15.59:0/3604338003 >> v2:172.21.15.151:3300/0 conn(0x7f81fc0cf850 msgr2=0x7f81fc167860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.946+0000 7f81fa7fc640 1 --2- 172.21.15.59:0/3604338003 >> v2:172.21.15.151:3300/0 conn(0x7f81fc0cf850 0x7f81fc167860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.946+0000 7f81fa7fc640 1 -- 172.21.15.59:0/3604338003 >> v1:172.21.15.151:6789/0 conn(0x7f81fc0d16a0 legacy=0x7f81fc0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:54.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.946+0000 7f81fa7fc640 1 -- 172.21.15.59:0/3604338003 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc0d08e0 con 0x7f81fc15c9d0 2023-10-16T14:25:54.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.946+0000 7f81fa7fc640 1 -- 172.21.15.59:0/3604338003 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f81ec001670 con 0x7f81fc15c9d0 2023-10-16T14:25:54.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.946+0000 7f81fa7fc640 1 -- 172.21.15.59:0/3604338003 >> v1:172.21.15.59:6789/0 conn(0x7f81fc15c9d0 legacy=0x7f81fc0cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:54.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.946+0000 7f81fa7fc640 1 --2- 172.21.15.59:0/3604338003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e80039c0 0x7f81e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:54.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.946+0000 7f81fa7fc640 1 --2- 172.21.15.59:0/3604338003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81e80047c0 0x7f81e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:54.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.946+0000 7f81fa7fc640 1 --2- 172.21.15.59:0/3604338003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81e8005180 0x7f81e800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:54.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.946+0000 7f81fa7fc640 1 -- 172.21.15.59:0/3604338003 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc0d0600 con 0x7f81e80039c0 2023-10-16T14:25:54.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.946+0000 7f81fa7fc640 1 -- 172.21.15.59:0/3604338003 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e800c080 con 0x7f81e8005180 2023-10-16T14:25:54.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.946+0000 7f81fa7fc640 1 -- 172.21.15.59:0/3604338003 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e800c240 con 0x7f81e80047c0 2023-10-16T14:25:54.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.946+0000 7f81faffd640 1 --2- 172.21.15.59:0/3604338003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e80039c0 0x7f81e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:54.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.947+0000 7f81fb7fe640 1 --2- 172.21.15.59:0/3604338003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81e8005180 0x7f81e800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:54.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.947+0000 7f81f3fff640 1 --2- 172.21.15.59:0/3604338003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81e80047c0 0x7f81e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:54.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.947+0000 7f81faffd640 1 -- 172.21.15.59:0/3604338003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81e80047c0 msgr2=0x7f81e8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:54.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.947+0000 7f81faffd640 1 --2- 172.21.15.59:0/3604338003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81e80047c0 0x7f81e8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.947+0000 7f81faffd640 1 -- 172.21.15.59:0/3604338003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81e8005180 msgr2=0x7f81e800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:54.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.947+0000 7f81faffd640 1 --2- 172.21.15.59:0/3604338003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81e8005180 0x7f81e800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.947+0000 7f81faffd640 1 -- 172.21.15.59:0/3604338003 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e8003520 con 0x7f81e80039c0 2023-10-16T14:25:54.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.947+0000 7f81fb7fe640 1 --2- 172.21.15.59:0/3604338003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81e8005180 0x7f81e800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:25:54.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.947+0000 7f81fb7fe640 1 -- 172.21.15.59:0/3604338003 reap_dead start 2023-10-16T14:25:54.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.948+0000 7f81faffd640 1 --2- 172.21.15.59:0/3604338003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e80039c0 0x7f81e8003de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00c0e0 tx=0x7f81e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5936a74f416b6d97 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:54.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.949+0000 7f81fa7fc640 1 -- 172.21.15.59:0/3604338003 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec005ad0 con 0x7f81e80039c0 2023-10-16T14:25:54.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.949+0000 7f81fa7fc640 1 -- 172.21.15.59:0/3604338003 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ec005c30 con 0x7f81e80039c0 2023-10-16T14:25:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.949+0000 7f81fa7fc640 1 -- 172.21.15.59:0/3604338003 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec02ca30 con 0x7f81e80039c0 2023-10-16T14:25:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.949+0000 7f81fbfff640 1 -- 172.21.15.59:0/3604338003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e80039c0 msgr2=0x7f81e8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.949+0000 7f81fbfff640 1 --2- 172.21.15.59:0/3604338003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e80039c0 0x7f81e8003de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00c0e0 tx=0x7f81e80057f0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.950+0000 7f81fbfff640 1 -- 172.21.15.59:0/3604338003 shutdown_connections 2023-10-16T14:25:54.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.950+0000 7f81fbfff640 1 --2- 172.21.15.59:0/3604338003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e80039c0 0x7f81e8003de0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.950+0000 7f81fbfff640 1 -- 172.21.15.59:0/3604338003 >> 172.21.15.59:0/3604338003 conn(0x7f81fc09bad0 msgr2=0x7f81fc0d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:54.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.950+0000 7f81fbfff640 1 -- 172.21.15.59:0/3604338003 shutdown_connections 2023-10-16T14:25:54.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.950+0000 7f81fbfff640 1 -- 172.21.15.59:0/3604338003 wait complete. 2023-10-16T14:25:54.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.952+0000 7f81fbfff640 1 Processor -- start 2023-10-16T14:25:54.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.952+0000 7f81fbfff640 1 -- start start 2023-10-16T14:25:54.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.953+0000 7f81fbfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81e80039c0 0x7f81fc1f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:54.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.953+0000 7f81fbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81fc15cdb0 0x7f81fc15fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:54.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.953+0000 7f81fbfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81fc0b1f60 0x7f81fc0b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:54.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.954+0000 7f81fbfff640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc0b2950 con 0x7f81fc15cdb0 2023-10-16T14:25:54.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.954+0000 7f81fbfff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc1f2f50 con 0x7f81e80039c0 2023-10-16T14:25:54.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.954+0000 7f81fbfff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc0b8090 con 0x7f81fc0b1f60 2023-10-16T14:25:54.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.954+0000 7f81f3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81fc15cdb0 0x7f81fc15fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:54.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.954+0000 7f81f3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81fc15cdb0 0x7f81fc15fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35670/0 (socket says 172.21.15.59:35670) 2023-10-16T14:25:54.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.954+0000 7f81f3fff640 1 -- 172.21.15.59:0/1647936834 learned_addr learned my addr 172.21.15.59:0/1647936834 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:54.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.954+0000 7f81faffd640 1 --2- 172.21.15.59:0/1647936834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81e80039c0 0x7f81fc1f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:54.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.954+0000 7f81fb7fe640 1 --2- 172.21.15.59:0/1647936834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81fc0b1f60 0x7f81fc0b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.954+0000 7f81f3fff640 1 -- 172.21.15.59:0/1647936834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81fc0b1f60 msgr2=0x7f81fc0b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.954+0000 7f81f3fff640 1 --2- 172.21.15.59:0/1647936834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81fc0b1f60 0x7f81fc0b2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.954+0000 7f81f3fff640 1 -- 172.21.15.59:0/1647936834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81e80039c0 msgr2=0x7f81fc1f2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.954+0000 7f81f3fff640 1 --2- 172.21.15.59:0/1647936834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81e80039c0 0x7f81fc1f2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:54.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.954+0000 7f81f3fff640 1 -- 172.21.15.59:0/1647936834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc1f6480 con 0x7f81fc15cdb0 2023-10-16T14:25:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.955+0000 7f81f3fff640 1 --2- 172.21.15.59:0/1647936834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81fc15cdb0 0x7f81fc15fcd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f81e400e490 tx=0x7f81e400e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.955+0000 7f81f37fe640 1 -- 172.21.15.59:0/1647936834 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e40052e0 con 0x7f81fc15cdb0 2023-10-16T14:25:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.955+0000 7f81f37fe640 1 -- 172.21.15.59:0/1647936834 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e4005440 con 0x7f81fc15cdb0 2023-10-16T14:25:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.955+0000 7f81fbfff640 1 -- 172.21.15.59:0/1647936834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81fc15d320 con 0x7f81fc15cdb0 2023-10-16T14:25:54.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.955+0000 7f81f37fe640 1 -- 172.21.15.59:0/1647936834 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4003830 con 0x7f81fc15cdb0 2023-10-16T14:25:54.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.955+0000 7f81fbfff640 1 -- 172.21.15.59:0/1647936834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81fc1f56e0 con 0x7f81fc15cdb0 2023-10-16T14:25:54.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.956+0000 7f81fbfff640 1 -- 172.21.15.59:0/1647936834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81fc0b1850 con 0x7f81fc15cdb0 2023-10-16T14:25:54.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.957+0000 7f81f37fe640 1 -- 172.21.15.59:0/1647936834 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f81e4003990 con 0x7f81fc15cdb0 2023-10-16T14:25:54.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.959+0000 7f81f37fe640 1 --2- 172.21.15.59:0/1647936834 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f81dc06ae70 0x7f81dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:54.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.959+0000 7f81f37fe640 1 -- 172.21.15.59:0/1647936834 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f81e4088e00 con 0x7f81fc15cdb0 2023-10-16T14:25:54.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.959+0000 7f81faffd640 1 --2- 172.21.15.59:0/1647936834 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f81dc06ae70 0x7f81dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:54.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.960+0000 7f81faffd640 1 --2- 172.21.15.59:0/1647936834 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f81dc06ae70 0x7f81dc06d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f81ec034000 tx=0x7f81ec009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:54.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:54.963+0000 7f81f37fe640 1 -- 172.21.15.59:0/1647936834 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f81e4053c90 con 0x7f81fc15cdb0 2023-10-16T14:25:55.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.156+0000 7f81fbfff640 1 -- 172.21.15.59:0/1647936834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81fc1f6480 con 0x7f81fc15cdb0 2023-10-16T14:25:55.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.159+0000 7f81f37fe640 1 -- 172.21.15.59:0/1647936834 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f81fc1f6480 con 0x7f81fc15cdb0 2023-10-16T14:25:55.163 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:25:55.163 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:25:53.209862+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:25:55.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.162+0000 7f81fbfff640 1 -- 172.21.15.59:0/1647936834 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f81dc06ae70 msgr2=0x7f81dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:55.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.162+0000 7f81fbfff640 1 --2- 172.21.15.59:0/1647936834 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f81dc06ae70 0x7f81dc06d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f81ec034000 tx=0x7f81ec009030 comp rx=0 tx=0).stop 2023-10-16T14:25:55.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.162+0000 7f81fbfff640 1 -- 172.21.15.59:0/1647936834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81fc15cdb0 msgr2=0x7f81fc15fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:55.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.162+0000 7f81fbfff640 1 --2- 172.21.15.59:0/1647936834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81fc15cdb0 0x7f81fc15fcd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f81e400e490 tx=0x7f81e400e950 comp rx=0 tx=0).stop 2023-10-16T14:25:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.162+0000 7f81fbfff640 1 -- 172.21.15.59:0/1647936834 shutdown_connections 2023-10-16T14:25:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.162+0000 7f81fbfff640 1 --2- 172.21.15.59:0/1647936834 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f81dc06ae70 0x7f81dc06d330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.162+0000 7f81fbfff640 1 --2- 172.21.15.59:0/1647936834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81fc0b1f60 0x7f81fc0b2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.162+0000 7f81fbfff640 1 --2- 172.21.15.59:0/1647936834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81fc15cdb0 0x7f81fc15fcd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:55.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.162+0000 7f81fbfff640 1 --2- 172.21.15.59:0/1647936834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81e80039c0 0x7f81fc1f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.162+0000 7f81fbfff640 1 -- 172.21.15.59:0/1647936834 >> 172.21.15.59:0/1647936834 conn(0x7f81fc09bad0 msgr2=0x7f81fc0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.162+0000 7f81fbfff640 1 -- 172.21.15.59:0/1647936834 shutdown_connections 2023-10-16T14:25:55.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.162+0000 7f81fbfff640 1 -- 172.21.15.59:0/1647936834 wait complete. 2023-10-16T14:25:55.202 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T14:25:55.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.431+0000 7f07448ca640 1 Processor -- start 2023-10-16T14:25:55.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.431+0000 7f07448ca640 1 -- start start 2023-10-16T14:25:55.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.432+0000 7f07448ca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f074015a8d0 0x7f07400cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:55.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.432+0000 7f07448ca640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074015acb0 con 0x7f074006ff40 2023-10-16T14:25:55.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.433+0000 7f07448ca640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07400c1c60 con 0x7f07400ca660 2023-10-16T14:25:55.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.433+0000 7f07448ca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074006cd50 con 0x7f074015a8d0 2023-10-16T14:25:55.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.433+0000 7f073ffff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f074006ff40 0x7f074006c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35410/0 (socket says 172.21.15.59:35410) 2023-10-16T14:25:55.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.433+0000 7f073ffff640 1 -- 172.21.15.59:0/3092613039 learned_addr learned my addr 172.21.15.59:0/3092613039 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:25:55.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.433+0000 7f073f7fe640 1 --2- 172.21.15.59:0/3092613039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f074015a8d0 0x7f07400cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:55.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.433+0000 7f073effd640 1 -- 172.21.15.59:0/3092613039 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1024172317 0 0) 0x7f0738001110 con 0x7f074006ff40 2023-10-16T14:25:55.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.433+0000 7f073effd640 1 -- 172.21.15.59:0/3092613039 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f072c003520 con 0x7f074006ff40 2023-10-16T14:25:55.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.434+0000 7f073effd640 1 -- 172.21.15.59:0/3092613039 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3565519231 0 0) 0x7f072c003520 con 0x7f074006ff40 2023-10-16T14:25:55.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.434+0000 7f073effd640 1 -- 172.21.15.59:0/3092613039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f074015a8d0 msgr2=0x7f07400cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:55.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.434+0000 7f073effd640 1 --2- 172.21.15.59:0/3092613039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f074015a8d0 0x7f07400cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:55.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.434+0000 7f073effd640 1 -- 172.21.15.59:0/3092613039 >> v1:172.21.15.151:6789/0 conn(0x7f07400ca660 legacy=0x7f074006bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:55.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.434+0000 7f073effd640 1 -- 172.21.15.59:0/3092613039 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074015e350 con 0x7f074006ff40 2023-10-16T14:25:55.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.434+0000 7f073effd640 1 -- 172.21.15.59:0/3092613039 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f0738001800 con 0x7f074006ff40 2023-10-16T14:25:55.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.434+0000 7f073effd640 1 -- 172.21.15.59:0/3092613039 >> v1:172.21.15.59:6789/0 conn(0x7f074006ff40 legacy=0x7f074006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:55.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.434+0000 7f073effd640 1 --2- 172.21.15.59:0/3092613039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f072c0039a0 0x7f072c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:55.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.434+0000 7f073effd640 1 --2- 172.21.15.59:0/3092613039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f072c0047c0 0x7f072c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:55.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.434+0000 7f073effd640 1 --2- 172.21.15.59:0/3092613039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f074015a8d0 0x7f072c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.434+0000 7f073effd640 1 -- 172.21.15.59:0/3092613039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074006cd50 con 0x7f072c0039a0 2023-10-16T14:25:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.434+0000 7f073effd640 1 -- 172.21.15.59:0/3092613039 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c00ba30 con 0x7f072c0047c0 2023-10-16T14:25:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.434+0000 7f073effd640 1 -- 172.21.15.59:0/3092613039 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c00bbf0 con 0x7f074015a8d0 2023-10-16T14:25:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.434+0000 7f073f7fe640 1 --2- 172.21.15.59:0/3092613039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f072c0039a0 0x7f072c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:55.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.434+0000 7f0736ffd640 1 --2- 172.21.15.59:0/3092613039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f072c0047c0 0x7f072c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:55.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.434+0000 7f073ffff640 1 --2- 172.21.15.59:0/3092613039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f074015a8d0 0x7f072c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:55.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.435+0000 7f073f7fe640 1 -- 172.21.15.59:0/3092613039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f074015a8d0 msgr2=0x7f072c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:55.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.435+0000 7f073f7fe640 1 --2- 172.21.15.59:0/3092613039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f074015a8d0 0x7f072c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:55.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.435+0000 7f073f7fe640 1 -- 172.21.15.59:0/3092613039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f072c0047c0 msgr2=0x7f072c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:55.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.435+0000 7f073f7fe640 1 --2- 172.21.15.59:0/3092613039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f072c0047c0 0x7f072c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:55.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.435+0000 7f073f7fe640 1 -- 172.21.15.59:0/3092613039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072c003520 con 0x7f072c0039a0 2023-10-16T14:25:55.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.435+0000 7f073ffff640 1 --2- 172.21.15.59:0/3092613039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f074015a8d0 0x7f072c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:25:55.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.436+0000 7f073f7fe640 1 --2- 172.21.15.59:0/3092613039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f072c0039a0 0x7f072c003dc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f073000e140 tx=0x7f072c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c89f00815ef36e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:55.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.436+0000 7f073effd640 1 -- 172.21.15.59:0/3092613039 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073002cbf0 con 0x7f072c0039a0 2023-10-16T14:25:55.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.436+0000 7f073effd640 1 -- 172.21.15.59:0/3092613039 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073000f040 con 0x7f072c0039a0 2023-10-16T14:25:55.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.436+0000 7f073effd640 1 -- 172.21.15.59:0/3092613039 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0730034440 con 0x7f072c0039a0 2023-10-16T14:25:55.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.436+0000 7f07448ca640 1 -- 172.21.15.59:0/3092613039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f072c0039a0 msgr2=0x7f072c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:55.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.436+0000 7f07448ca640 1 --2- 172.21.15.59:0/3092613039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f072c0039a0 0x7f072c003dc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f073000e140 tx=0x7f072c0057f0 comp rx=0 tx=0).stop 2023-10-16T14:25:55.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.437+0000 7f073ffff640 1 -- 172.21.15.59:0/3092613039 reap_dead start 2023-10-16T14:25:55.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.437+0000 7f07448ca640 1 -- 172.21.15.59:0/3092613039 shutdown_connections 2023-10-16T14:25:55.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.437+0000 7f07448ca640 1 -- 172.21.15.59:0/3092613039 >> 172.21.15.59:0/3092613039 conn(0x7f074006a470 msgr2=0x7f07400afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:55.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.437+0000 7f07448ca640 1 -- 172.21.15.59:0/3092613039 shutdown_connections 2023-10-16T14:25:55.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.437+0000 7f07448ca640 1 -- 172.21.15.59:0/3092613039 wait complete. 2023-10-16T14:25:55.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.438+0000 7f07448ca640 1 Processor -- start 2023-10-16T14:25:55.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.439+0000 7f07448ca640 1 -- start start 2023-10-16T14:25:55.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.440+0000 7f07448ca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f072c0039a0 0x7f07401577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:55.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.440+0000 7f07448ca640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07400b2610 0x7f07400c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:55.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.440+0000 7f07448ca640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07400c7bb0 0x7f07400c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:55.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.440+0000 7f07448ca640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07400c5d50 con 0x7f07400c7bb0 2023-10-16T14:25:55.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.440+0000 7f07448ca640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07400c5440 con 0x7f07400b2610 2023-10-16T14:25:55.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.440+0000 7f07448ca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07400c80f0 con 0x7f072c0039a0 2023-10-16T14:25:55.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.440+0000 7f073ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07400c7bb0 0x7f07400c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:55.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.440+0000 7f073ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07400c7bb0 0x7f07400c6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35690/0 (socket says 172.21.15.59:35690) 2023-10-16T14:25:55.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.440+0000 7f073ffff640 1 -- 172.21.15.59:0/3202628043 learned_addr learned my addr 172.21.15.59:0/3202628043 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:55.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.440+0000 7f073f7fe640 1 --2- 172.21.15.59:0/3202628043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f072c0039a0 0x7f07401577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:55.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.440+0000 7f0736ffd640 1 --2- 172.21.15.59:0/3202628043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07400b2610 0x7f07400c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:55.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.440+0000 7f073ffff640 1 -- 172.21.15.59:0/3202628043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f072c0039a0 msgr2=0x7f07401577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:55.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.440+0000 7f073ffff640 1 --2- 172.21.15.59:0/3202628043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f072c0039a0 0x7f07401577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:55.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.440+0000 7f073ffff640 1 -- 172.21.15.59:0/3202628043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07400b2610 msgr2=0x7f07400c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:55.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.440+0000 7f073ffff640 1 --2- 172.21.15.59:0/3202628043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07400b2610 0x7f07400c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:55.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.440+0000 7f073ffff640 1 -- 172.21.15.59:0/3202628043 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07400c5690 con 0x7f07400c7bb0 2023-10-16T14:25:55.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.441+0000 7f073ffff640 1 --2- 172.21.15.59:0/3202628043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07400c7bb0 0x7f07400c6170 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0738000c00 tx=0x7f073800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:55.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.441+0000 7f073cff9640 1 -- 172.21.15.59:0/3202628043 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07380072d0 con 0x7f07400c7bb0 2023-10-16T14:25:55.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.441+0000 7f073cff9640 1 -- 172.21.15.59:0/3202628043 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0738007430 con 0x7f07400c7bb0 2023-10-16T14:25:55.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.441+0000 7f073cff9640 1 -- 172.21.15.59:0/3202628043 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07380047e0 con 0x7f07400c7bb0 2023-10-16T14:25:55.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.441+0000 7f07448ca640 1 -- 172.21.15.59:0/3202628043 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07400c5970 con 0x7f07400c7bb0 2023-10-16T14:25:55.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.441+0000 7f07448ca640 1 -- 172.21.15.59:0/3202628043 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0740157d30 con 0x7f07400c7bb0 2023-10-16T14:25:55.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.442+0000 7f07448ca640 1 -- 172.21.15.59:0/3202628043 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07400c5e90 con 0x7f07400c7bb0 2023-10-16T14:25:55.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.443+0000 7f073cff9640 1 -- 172.21.15.59:0/3202628043 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0738004940 con 0x7f07400c7bb0 2023-10-16T14:25:55.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.444+0000 7f073cff9640 1 --2- 172.21.15.59:0/3202628043 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f072006ae70 0x7f072006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:55.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.445+0000 7f073cff9640 1 -- 172.21.15.59:0/3202628043 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0738089480 con 0x7f07400c7bb0 2023-10-16T14:25:55.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.445+0000 7f073f7fe640 1 --2- 172.21.15.59:0/3202628043 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f072006ae70 0x7f072006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:55.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.446+0000 7f073f7fe640 1 --2- 172.21.15.59:0/3202628043 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f072006ae70 0x7f072006d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0730036000 tx=0x7f073002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:55.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.449+0000 7f073cff9640 1 -- 172.21.15.59:0/3202628043 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f07400c5e90 con 0x7f07400c7bb0 2023-10-16T14:25:55.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.681+0000 7f07448ca640 1 -- 172.21.15.59:0/3202628043 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f074015acb0 con 0x7f07400c7bb0 2023-10-16T14:25:55.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.682+0000 7f073cff9640 1 -- 172.21.15.59:0/3202628043 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f074015acb0 con 0x7f07400c7bb0 2023-10-16T14:25:55.685 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:25:55.686 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3959035293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3959035293},{"type":"v1","addr":"172.21.15.59:6834","nonce":3959035293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1298271347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1298271347},{"type":"v1","addr":"172.21.15.151:6835","nonce":1298271347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/249904108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":249904108},{"type":"v1","addr":"172.21.15.59:6835","nonce":249904108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T14:25:48.130662+0000","modified":"2023-10-16T14:25:53.210036+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6837/4004038733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4004038733},{"type":"v1","addr":"172.21.15.151:6837","nonce":4004038733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-16T14:25:55.686 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 7 2023-10-16T14:25:55.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.684+0000 7f07448ca640 1 -- 172.21.15.59:0/3202628043 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f072006ae70 msgr2=0x7f072006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:55.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.684+0000 7f07448ca640 1 --2- 172.21.15.59:0/3202628043 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f072006ae70 0x7f072006d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0730036000 tx=0x7f073002e000 comp rx=0 tx=0).stop 2023-10-16T14:25:55.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.685+0000 7f07448ca640 1 -- 172.21.15.59:0/3202628043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07400c7bb0 msgr2=0x7f07400c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:55.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.685+0000 7f07448ca640 1 --2- 172.21.15.59:0/3202628043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07400c7bb0 0x7f07400c6170 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0738000c00 tx=0x7f073800dc00 comp rx=0 tx=0).stop 2023-10-16T14:25:55.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.685+0000 7f07448ca640 1 -- 172.21.15.59:0/3202628043 shutdown_connections 2023-10-16T14:25:55.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.685+0000 7f07448ca640 1 --2- 172.21.15.59:0/3202628043 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f072006ae70 0x7f072006d330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:55.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.685+0000 7f07448ca640 1 --2- 172.21.15.59:0/3202628043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07400c7bb0 0x7f07400c6170 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:55.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.685+0000 7f07448ca640 1 --2- 172.21.15.59:0/3202628043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07400b2610 0x7f07400c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:55.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.685+0000 7f07448ca640 1 --2- 172.21.15.59:0/3202628043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f072c0039a0 0x7f07401577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:55.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.685+0000 7f07448ca640 1 -- 172.21.15.59:0/3202628043 >> 172.21.15.59:0/3202628043 conn(0x7f074006a470 msgr2=0x7f0740158410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:55.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.685+0000 7f07448ca640 1 -- 172.21.15.59:0/3202628043 shutdown_connections 2023-10-16T14:25:55.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.685+0000 7f07448ca640 1 -- 172.21.15.59:0/3202628043 wait complete. 2023-10-16T14:25:55.709 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:25:55.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.930+0000 7f114517c640 1 Processor -- start 2023-10-16T14:25:55.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.930+0000 7f114517c640 1 -- start start 2023-10-16T14:25:55.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.932+0000 7f114517c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11400b0010 0x7f11400701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:55.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.932+0000 7f114517c640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11400707f0 con 0x7f114015ad00 2023-10-16T14:25:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.932+0000 7f114517c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1140070ad0 con 0x7f114015f040 2023-10-16T14:25:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.932+0000 7f114517c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114015b1d0 con 0x7f11400b0010 2023-10-16T14:25:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.932+0000 7f113659c640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f114015ad00 0x7f11400b03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35412/0 (socket says 172.21.15.59:35412) 2023-10-16T14:25:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.932+0000 7f113659c640 1 -- 172.21.15.59:0/3735524600 learned_addr learned my addr 172.21.15.59:0/3735524600 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:25:55.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.932+0000 7f113ed9d640 1 --2- 172.21.15.59:0/3735524600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11400b0010 0x7f11400701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:55.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.932+0000 7f113e59c640 1 -- 172.21.15.59:0/3735524600 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099241305 0 0) 0x7f11400707f0 con 0x7f114015ad00 2023-10-16T14:25:55.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.932+0000 7f113e59c640 1 -- 172.21.15.59:0/3735524600 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f112c003520 con 0x7f114015ad00 2023-10-16T14:25:55.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.933+0000 7f113e59c640 1 -- 172.21.15.59:0/3735524600 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 837226294 0 0) 0x7f112c003520 con 0x7f114015ad00 2023-10-16T14:25:55.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.933+0000 7f113e59c640 1 -- 172.21.15.59:0/3735524600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11400b0010 msgr2=0x7f11400701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:55.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.933+0000 7f113e59c640 1 --2- 172.21.15.59:0/3735524600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11400b0010 0x7f11400701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:55.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.933+0000 7f113e59c640 1 -- 172.21.15.59:0/3735524600 >> v1:172.21.15.151:6789/0 conn(0x7f114015f040 legacy=0x7f114015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:55.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.933+0000 7f113e59c640 1 -- 172.21.15.59:0/3735524600 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114015b4b0 con 0x7f114015ad00 2023-10-16T14:25:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.933+0000 7f113e59c640 1 -- 172.21.15.59:0/3735524600 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f1128001670 con 0x7f114015ad00 2023-10-16T14:25:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.933+0000 7f113e59c640 1 -- 172.21.15.59:0/3735524600 >> v1:172.21.15.59:6789/0 conn(0x7f114015ad00 legacy=0x7f11400b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.933+0000 7f113e59c640 1 --2- 172.21.15.59:0/3735524600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f112c003a10 0x7f112c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.933+0000 7f113e59c640 1 --2- 172.21.15.59:0/3735524600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f112c0047c0 0x7f112c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.933+0000 7f113e59c640 1 --2- 172.21.15.59:0/3735524600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11400b0010 0x7f112c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:55.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.933+0000 7f113e59c640 1 -- 172.21.15.59:0/3735524600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114015b1d0 con 0x7f112c003a10 2023-10-16T14:25:55.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.933+0000 7f113e59c640 1 -- 172.21.15.59:0/3735524600 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112c00bb40 con 0x7f112c0047c0 2023-10-16T14:25:55.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.933+0000 7f113e59c640 1 -- 172.21.15.59:0/3735524600 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112c00bd00 con 0x7f11400b0010 2023-10-16T14:25:55.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.933+0000 7f113ed9d640 1 --2- 172.21.15.59:0/3735524600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f112c003a10 0x7f112c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:55.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.934+0000 7f113659c640 1 --2- 172.21.15.59:0/3735524600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f112c0047c0 0x7f112c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:55.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.934+0000 7f113ed9d640 1 -- 172.21.15.59:0/3735524600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11400b0010 msgr2=0x7f112c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:55.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.934+0000 7f113ed9d640 1 --2- 172.21.15.59:0/3735524600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11400b0010 0x7f112c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:55.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.934+0000 7f113ed9d640 1 -- 172.21.15.59:0/3735524600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f112c0047c0 msgr2=0x7f112c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:55.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.934+0000 7f113ed9d640 1 --2- 172.21.15.59:0/3735524600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f112c0047c0 0x7f112c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:55.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.934+0000 7f113ed9d640 1 -- 172.21.15.59:0/3735524600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c003520 con 0x7f112c003a10 2023-10-16T14:25:55.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.934+0000 7f113659c640 1 --2- 172.21.15.59:0/3735524600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f112c0047c0 0x7f112c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:25:55.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.935+0000 7f113ed9d640 1 --2- 172.21.15.59:0/3735524600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f112c003a10 0x7f112c003e30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1130009fc0 tx=0x7f112c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a54aa92aff1b10 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:55.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.935+0000 7f113e59c640 1 -- 172.21.15.59:0/3735524600 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113002cc60 con 0x7f112c003a10 2023-10-16T14:25:55.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.935+0000 7f113e59c640 1 -- 172.21.15.59:0/3735524600 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113000f040 con 0x7f112c003a10 2023-10-16T14:25:55.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.935+0000 7f113e59c640 1 -- 172.21.15.59:0/3735524600 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130034440 con 0x7f112c003a10 2023-10-16T14:25:55.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.936+0000 7f114517c640 1 -- 172.21.15.59:0/3735524600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f112c003a10 msgr2=0x7f112c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.936+0000 7f114517c640 1 --2- 172.21.15.59:0/3735524600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f112c003a10 0x7f112c003e30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1130009fc0 tx=0x7f112c0057f0 comp rx=0 tx=0).stop 2023-10-16T14:25:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.936+0000 7f113f59e640 1 -- 172.21.15.59:0/3735524600 reap_dead start 2023-10-16T14:25:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.936+0000 7f114517c640 1 -- 172.21.15.59:0/3735524600 shutdown_connections 2023-10-16T14:25:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.936+0000 7f114517c640 1 -- 172.21.15.59:0/3735524600 >> 172.21.15.59:0/3735524600 conn(0x7f114006c1c0 msgr2=0x7f114006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.936+0000 7f114517c640 1 -- 172.21.15.59:0/3735524600 shutdown_connections 2023-10-16T14:25:55.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.936+0000 7f114517c640 1 -- 172.21.15.59:0/3735524600 wait complete. 2023-10-16T14:25:55.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.938+0000 7f114517c640 1 Processor -- start 2023-10-16T14:25:55.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.938+0000 7f114517c640 1 -- start start 2023-10-16T14:25:55.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.939+0000 7f114517c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f112c003a10 0x7f114014c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:55.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.939+0000 7f114517c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1140149300 0x7f11400ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.939+0000 7f114517c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1140149780 0x7f11400cea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.939+0000 7f114517c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11400b1d70 con 0x7f1140149780 2023-10-16T14:25:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.939+0000 7f114517c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11400b3b30 con 0x7f1140149300 2023-10-16T14:25:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.939+0000 7f114517c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114014cc80 con 0x7f112c003a10 2023-10-16T14:25:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.939+0000 7f113f59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1140149780 0x7f11400cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:55.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.939+0000 7f113f59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1140149780 0x7f11400cea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35718/0 (socket says 172.21.15.59:35718) 2023-10-16T14:25:55.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.939+0000 7f113f59e640 1 -- 172.21.15.59:0/1419992138 learned_addr learned my addr 172.21.15.59:0/1419992138 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:55.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.939+0000 7f113659c640 1 --2- 172.21.15.59:0/1419992138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1140149300 0x7f11400ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:55.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.940+0000 7f113ed9d640 1 --2- 172.21.15.59:0/1419992138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f112c003a10 0x7f114014c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:55.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.940+0000 7f113f59e640 1 -- 172.21.15.59:0/1419992138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f112c003a10 msgr2=0x7f114014c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:55.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.940+0000 7f113f59e640 1 --2- 172.21.15.59:0/1419992138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f112c003a10 0x7f114014c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:55.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.940+0000 7f113f59e640 1 -- 172.21.15.59:0/1419992138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1140149300 msgr2=0x7f11400ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:55.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.940+0000 7f113f59e640 1 --2- 172.21.15.59:0/1419992138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1140149300 0x7f11400ce4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:55.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.940+0000 7f113f59e640 1 -- 172.21.15.59:0/1419992138 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11400b3fc0 con 0x7f1140149780 2023-10-16T14:25:55.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.940+0000 7f113f59e640 1 --2- 172.21.15.59:0/1419992138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1140149780 0x7f11400cea30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f11400b0c60 tx=0x7f113800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:55.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.940+0000 7f1137fff640 1 -- 172.21.15.59:0/1419992138 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138007480 con 0x7f1140149780 2023-10-16T14:25:55.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.940+0000 7f1137fff640 1 -- 172.21.15.59:0/1419992138 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11380075e0 con 0x7f1140149780 2023-10-16T14:25:55.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.940+0000 7f114517c640 1 -- 172.21.15.59:0/1419992138 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11400b2f20 con 0x7f1140149780 2023-10-16T14:25:55.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.940+0000 7f1137fff640 1 -- 172.21.15.59:0/1419992138 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138004260 con 0x7f1140149780 2023-10-16T14:25:55.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.940+0000 7f114517c640 1 -- 172.21.15.59:0/1419992138 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11400b34e0 con 0x7f1140149780 2023-10-16T14:25:55.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.942+0000 7f114517c640 1 -- 172.21.15.59:0/1419992138 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11400b3ce0 con 0x7f1140149780 2023-10-16T14:25:55.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.943+0000 7f1137fff640 1 -- 172.21.15.59:0/1419992138 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1138007d50 con 0x7f1140149780 2023-10-16T14:25:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.943+0000 7f1137fff640 1 --2- 172.21.15.59:0/1419992138 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f112006aea0 0x7f112006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.944+0000 7f1137fff640 1 -- 172.21.15.59:0/1419992138 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1138088a70 con 0x7f1140149780 2023-10-16T14:25:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.944+0000 7f113ed9d640 1 --2- 172.21.15.59:0/1419992138 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f112006aea0 0x7f112006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.945+0000 7f113ed9d640 1 --2- 172.21.15.59:0/1419992138 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f112006aea0 0x7f112006d360 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1130036000 tx=0x7f113002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:55.948+0000 7f1137fff640 1 -- 172.21.15.59:0/1419992138 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f11400b3ce0 con 0x7f1140149780 2023-10-16T14:25:56.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.143+0000 7f114517c640 1 -- 172.21.15.59:0/1419992138 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11400b3ce0 con 0x7f1140149780 2023-10-16T14:25:56.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.144+0000 7f1137fff640 1 -- 172.21.15.59:0/1419992138 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f11400b3ce0 con 0x7f1140149780 2023-10-16T14:25:56.148 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:25:56.149 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:25:53.209862+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:25:56.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.147+0000 7f114517c640 1 -- 172.21.15.59:0/1419992138 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f112006aea0 msgr2=0x7f112006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:56.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.147+0000 7f114517c640 1 --2- 172.21.15.59:0/1419992138 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f112006aea0 0x7f112006d360 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1130036000 tx=0x7f113002e000 comp rx=0 tx=0).stop 2023-10-16T14:25:56.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.147+0000 7f114517c640 1 -- 172.21.15.59:0/1419992138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1140149780 msgr2=0x7f11400cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:56.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.147+0000 7f114517c640 1 --2- 172.21.15.59:0/1419992138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1140149780 0x7f11400cea30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f11400b0c60 tx=0x7f113800c820 comp rx=0 tx=0).stop 2023-10-16T14:25:56.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.147+0000 7f114517c640 1 -- 172.21.15.59:0/1419992138 shutdown_connections 2023-10-16T14:25:56.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.147+0000 7f114517c640 1 --2- 172.21.15.59:0/1419992138 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f112006aea0 0x7f112006d360 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.147+0000 7f114517c640 1 --2- 172.21.15.59:0/1419992138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1140149780 0x7f11400cea30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.147+0000 7f114517c640 1 --2- 172.21.15.59:0/1419992138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1140149300 0x7f11400ce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.147+0000 7f114517c640 1 --2- 172.21.15.59:0/1419992138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f112c003a10 0x7f114014c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.147+0000 7f114517c640 1 -- 172.21.15.59:0/1419992138 >> 172.21.15.59:0/1419992138 conn(0x7f114006c1c0 msgr2=0x7f11400adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:56.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.147+0000 7f114517c640 1 -- 172.21.15.59:0/1419992138 shutdown_connections 2023-10-16T14:25:56.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.147+0000 7f114517c640 1 -- 172.21.15.59:0/1419992138 wait complete. 2023-10-16T14:25:56.572 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T14:25:48.130662+0000', 'modified': '2023-10-16T14:25:53.210036+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.151:6837/4004038733', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6836', 'nonce': 4004038733}, {'type': 'v1', 'addr': '172.21.15.151:6837', 'nonce': 4004038733}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-10-16T14:25:56.572 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T14:25:56.573 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-16T14:25:56.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.811+0000 7f6ba25c4640 1 Processor -- start 2023-10-16T14:25:56.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.811+0000 7f6ba25c4640 1 -- start start 2023-10-16T14:25:56.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.813+0000 7f6ba25c4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6b9c0cea60 0x7f6b9c0ab890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.813+0000 7f6ba25c4640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b9c15f0d0 con 0x7f6b9c0b2dd0 2023-10-16T14:25:56.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.813+0000 7f6ba25c4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b9c15ab50 con 0x7f6b9c0ce600 2023-10-16T14:25:56.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.813+0000 7f6ba25c4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b9c15e2b0 con 0x7f6b9c0cea60 2023-10-16T14:25:56.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.813+0000 7f6ba15c2640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6b9c0b2dd0 0x7f6b9c06d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35418/0 (socket says 172.21.15.59:35418) 2023-10-16T14:25:56.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.813+0000 7f6ba15c2640 1 -- 172.21.15.59:0/2222222950 learned_addr learned my addr 172.21.15.59:0/2222222950 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:25:56.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.813+0000 7f6b93fff640 1 -- 172.21.15.59:0/2222222950 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638061678 0 0) 0x7f6b9c15f0d0 con 0x7f6b9c0b2dd0 2023-10-16T14:25:56.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.813+0000 7f6b93fff640 1 -- 172.21.15.59:0/2222222950 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b88003520 con 0x7f6b9c0b2dd0 2023-10-16T14:25:56.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.814+0000 7f6ba1dc3640 1 --2- 172.21.15.59:0/2222222950 >> v2:172.21.15.151:3300/0 conn(0x7f6b9c0cea60 0x7f6b9c0ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:56.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.814+0000 7f6b93fff640 1 -- 172.21.15.59:0/2222222950 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 603737238 0 0) 0x7f6b88003520 con 0x7f6b9c0b2dd0 2023-10-16T14:25:56.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.814+0000 7f6b93fff640 1 -- 172.21.15.59:0/2222222950 >> v2:172.21.15.151:3300/0 conn(0x7f6b9c0cea60 msgr2=0x7f6b9c0ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:56.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.814+0000 7f6b93fff640 1 --2- 172.21.15.59:0/2222222950 >> v2:172.21.15.151:3300/0 conn(0x7f6b9c0cea60 0x7f6b9c0ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.814+0000 7f6b93fff640 1 -- 172.21.15.59:0/2222222950 >> v1:172.21.15.151:6789/0 conn(0x7f6b9c0ce600 legacy=0x7f6b9c0ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:56.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.814+0000 7f6b93fff640 1 -- 172.21.15.59:0/2222222950 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c06d3a0 con 0x7f6b9c0b2dd0 2023-10-16T14:25:56.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.814+0000 7f6b93fff640 1 -- 172.21.15.59:0/2222222950 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f6b980017f0 con 0x7f6b9c0b2dd0 2023-10-16T14:25:56.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.814+0000 7f6b93fff640 1 -- 172.21.15.59:0/2222222950 >> v1:172.21.15.59:6789/0 conn(0x7f6b9c0b2dd0 legacy=0x7f6b9c06d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:56.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.814+0000 7f6b93fff640 1 --2- 172.21.15.59:0/2222222950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b880039c0 0x7f6b88003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.814+0000 7f6b93fff640 1 --2- 172.21.15.59:0/2222222950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b880047c0 0x7f6b88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.814+0000 7f6b93fff640 1 --2- 172.21.15.59:0/2222222950 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b880051d0 0x7f6b8800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.814+0000 7f6b93fff640 1 -- 172.21.15.59:0/2222222950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c15e2b0 con 0x7f6b880047c0 2023-10-16T14:25:56.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.814+0000 7f6b93fff640 1 -- 172.21.15.59:0/2222222950 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8800c120 con 0x7f6b880039c0 2023-10-16T14:25:56.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.814+0000 7f6b93fff640 1 -- 172.21.15.59:0/2222222950 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8800c2e0 con 0x7f6b880051d0 2023-10-16T14:25:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.814+0000 7f6ba0dc1640 1 --2- 172.21.15.59:0/2222222950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b880047c0 0x7f6b88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.815+0000 7f6ba15c2640 1 --2- 172.21.15.59:0/2222222950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b880039c0 0x7f6b88003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.815+0000 7f6ba0dc1640 1 -- 172.21.15.59:0/2222222950 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b880051d0 msgr2=0x7f6b8800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:56.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.815+0000 7f6ba1dc3640 1 --2- 172.21.15.59:0/2222222950 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b880051d0 0x7f6b8800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:56.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.815+0000 7f6ba0dc1640 1 --2- 172.21.15.59:0/2222222950 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b880051d0 0x7f6b8800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.815+0000 7f6ba0dc1640 1 -- 172.21.15.59:0/2222222950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b880039c0 msgr2=0x7f6b88003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:56.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.815+0000 7f6ba0dc1640 1 --2- 172.21.15.59:0/2222222950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b880039c0 0x7f6b88003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.815+0000 7f6ba0dc1640 1 -- 172.21.15.59:0/2222222950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b88003520 con 0x7f6b880047c0 2023-10-16T14:25:56.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.815+0000 7f6ba1dc3640 1 -- 172.21.15.59:0/2222222950 reap_dead start 2023-10-16T14:25:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.815+0000 7f6ba15c2640 1 --2- 172.21.15.59:0/2222222950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b880039c0 0x7f6b88003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:25:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.816+0000 7f6ba0dc1640 1 --2- 172.21.15.59:0/2222222950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b880047c0 0x7f6b88004c40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c001750 tx=0x7f6b880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8f147058d624a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.816+0000 7f6b93fff640 1 -- 172.21.15.59:0/2222222950 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0052d0 con 0x7f6b880047c0 2023-10-16T14:25:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.816+0000 7f6b93fff640 1 -- 172.21.15.59:0/2222222950 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8c02e050 con 0x7f6b880047c0 2023-10-16T14:25:56.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.816+0000 7f6b93fff640 1 -- 172.21.15.59:0/2222222950 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c003830 con 0x7f6b880047c0 2023-10-16T14:25:56.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.817+0000 7f6ba25c4640 1 -- 172.21.15.59:0/2222222950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b880047c0 msgr2=0x7f6b88004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:56.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.817+0000 7f6ba25c4640 1 --2- 172.21.15.59:0/2222222950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b880047c0 0x7f6b88004c40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c001750 tx=0x7f6b880057f0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.817+0000 7f6ba25c4640 1 -- 172.21.15.59:0/2222222950 shutdown_connections 2023-10-16T14:25:56.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.817+0000 7f6ba25c4640 1 --2- 172.21.15.59:0/2222222950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b880047c0 0x7f6b88004c40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.817+0000 7f6ba25c4640 1 -- 172.21.15.59:0/2222222950 >> 172.21.15.59:0/2222222950 conn(0x7f6b9c069fc0 msgr2=0x7f6b9c06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:56.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.817+0000 7f6ba25c4640 1 -- 172.21.15.59:0/2222222950 shutdown_connections 2023-10-16T14:25:56.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.817+0000 7f6ba25c4640 1 -- 172.21.15.59:0/2222222950 wait complete. 2023-10-16T14:25:56.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.819+0000 7f6ba25c4640 1 Processor -- start 2023-10-16T14:25:56.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.819+0000 7f6ba25c4640 1 -- start start 2023-10-16T14:25:56.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.820+0000 7f6ba25c4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b880047c0 0x7f6b9c15ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.820+0000 7f6ba25c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b9c09bf20 0x7f6b9c1f5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.820+0000 7f6ba25c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b9c0ac440 0x7f6b9c1599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.820+0000 7f6ba25c4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c1f5ab0 con 0x7f6b880047c0 2023-10-16T14:25:56.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.820+0000 7f6ba25c4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c15b220 con 0x7f6b9c0ac440 2023-10-16T14:25:56.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.820+0000 7f6ba25c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c15b560 con 0x7f6b9c09bf20 2023-10-16T14:25:56.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.820+0000 7f6ba15c2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b880047c0 0x7f6b9c15ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:56.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.820+0000 7f6ba15c2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b880047c0 0x7f6b9c15ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35742/0 (socket says 172.21.15.59:35742) 2023-10-16T14:25:56.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.820+0000 7f6ba15c2640 1 -- 172.21.15.59:0/1171393722 learned_addr learned my addr 172.21.15.59:0/1171393722 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:56.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.821+0000 7f6ba0dc1640 1 --2- 172.21.15.59:0/1171393722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b9c09bf20 0x7f6b9c1f5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:56.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.821+0000 7f6ba15c2640 1 -- 172.21.15.59:0/1171393722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b9c09bf20 msgr2=0x7f6b9c1f5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:56.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.821+0000 7f6ba1dc3640 1 --2- 172.21.15.59:0/1171393722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b9c0ac440 0x7f6b9c1599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:56.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.821+0000 7f6ba15c2640 1 --2- 172.21.15.59:0/1171393722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b9c09bf20 0x7f6b9c1f5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.821+0000 7f6ba15c2640 1 -- 172.21.15.59:0/1171393722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b9c0ac440 msgr2=0x7f6b9c1599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:56.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.821+0000 7f6ba15c2640 1 --2- 172.21.15.59:0/1171393722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b9c0ac440 0x7f6b9c1599b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.821+0000 7f6ba15c2640 1 -- 172.21.15.59:0/1171393722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c1f5710 con 0x7f6b880047c0 2023-10-16T14:25:56.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.821+0000 7f6ba15c2640 1 --2- 172.21.15.59:0/1171393722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b880047c0 0x7f6b9c15ace0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800e780 tx=0x7f6b9800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:56.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.821+0000 7f6b91ffb640 1 -- 172.21.15.59:0/1171393722 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b980070d0 con 0x7f6b880047c0 2023-10-16T14:25:56.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.821+0000 7f6b91ffb640 1 -- 172.21.15.59:0/1171393722 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b98007230 con 0x7f6b880047c0 2023-10-16T14:25:56.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.821+0000 7f6b91ffb640 1 -- 172.21.15.59:0/1171393722 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b980075a0 con 0x7f6b880047c0 2023-10-16T14:25:56.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.821+0000 7f6ba25c4640 1 -- 172.21.15.59:0/1171393722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b9c15bd70 con 0x7f6b880047c0 2023-10-16T14:25:56.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.822+0000 7f6ba25c4640 1 -- 172.21.15.59:0/1171393722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b9c15ba90 con 0x7f6b880047c0 2023-10-16T14:25:56.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.825+0000 7f6b91ffb640 1 -- 172.21.15.59:0/1171393722 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6b980057a0 con 0x7f6b880047c0 2023-10-16T14:25:56.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.826+0000 7f6b91ffb640 1 --2- 172.21.15.59:0/1171393722 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6b8006aea0 0x7f6b8006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.826+0000 7f6b91ffb640 1 -- 172.21.15.59:0/1171393722 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6b980896e0 con 0x7f6b880047c0 2023-10-16T14:25:56.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.826+0000 7f6ba63bc740 1 Processor -- start 2023-10-16T14:25:56.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.826+0000 7f6ba0dc1640 1 --2- 172.21.15.59:0/1171393722 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6b8006aea0 0x7f6b8006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:56.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.827+0000 7f6ba63bc740 1 -- start start 2023-10-16T14:25:56.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.827+0000 7f6ba63bc740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564356a85170 0x564356a58070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.827+0000 7f6ba63bc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 0x564356a87f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.827+0000 7f6ba63bc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a585b0 0x564356a88440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.827+0000 7f6ba63bc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643569787a0 con 0x564356a85550 2023-10-16T14:25:56.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.827+0000 7f6ba63bc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643569ca740 con 0x564356a585b0 2023-10-16T14:25:56.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.827+0000 7f6ba63bc740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643569c7e30 con 0x564356a85170 2023-10-16T14:25:56.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.828+0000 7f6ba0dc1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 0x564356a87f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:56.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.828+0000 7f6ba0dc1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 0x564356a87f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35754/0 (socket says 172.21.15.59:35754) 2023-10-16T14:25:56.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.828+0000 7f6ba0dc1640 1 -- 172.21.15.59:0/2350889680 learned_addr learned my addr 172.21.15.59:0/2350889680 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:56.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.828+0000 7f6ba15c2640 1 --2- 172.21.15.59:0/2350889680 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564356a85170 0x564356a58070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:56.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.828+0000 7f6ba0dc1640 1 --2- 172.21.15.59:0/1171393722 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6b8006aea0 0x7f6b8006d360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c033000 tx=0x7f6b8c009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:56.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.828+0000 7f6ba1dc3640 1 --2- 172.21.15.59:0/2350889680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a585b0 0x564356a88440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:56.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.828+0000 7f6ba0dc1640 1 -- 172.21.15.59:0/2350889680 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564356a85170 msgr2=0x564356a58070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:56.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.828+0000 7f6ba0dc1640 1 --2- 172.21.15.59:0/2350889680 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564356a85170 0x564356a58070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.828+0000 7f6ba0dc1640 1 -- 172.21.15.59:0/2350889680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a585b0 msgr2=0x564356a88440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:56.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.828+0000 7f6ba0dc1640 1 --2- 172.21.15.59:0/2350889680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a585b0 0x564356a88440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.828+0000 7f6ba0dc1640 1 -- 172.21.15.59:0/2350889680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564356987910 con 0x564356a85550 2023-10-16T14:25:56.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.829+0000 7f6ba0dc1640 1 --2- 172.21.15.59:0/2350889680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 0x564356a87f00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c001870 tx=0x7f6b8c02f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27e4b0718e8f8e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:56.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.829+0000 7f6b7effd640 1 -- 172.21.15.59:0/2350889680 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c007690 con 0x564356a85550 2023-10-16T14:25:56.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.829+0000 7f6b7effd640 1 -- 172.21.15.59:0/2350889680 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8c0067d0 con 0x564356a85550 2023-10-16T14:25:56.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.829+0000 7f6b7effd640 1 -- 172.21.15.59:0/2350889680 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c006b40 con 0x564356a85550 2023-10-16T14:25:56.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.830+0000 7f6ba63bc740 1 -- 172.21.15.59:0/2350889680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 msgr2=0x564356a87f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:56.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.830+0000 7f6ba63bc740 1 --2- 172.21.15.59:0/2350889680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 0x564356a87f00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c001870 tx=0x7f6b8c02f000 comp rx=0 tx=0).stop 2023-10-16T14:25:56.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.830+0000 7f6ba63bc740 1 -- 172.21.15.59:0/2350889680 shutdown_connections 2023-10-16T14:25:56.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.830+0000 7f6ba63bc740 1 --2- 172.21.15.59:0/2350889680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a585b0 0x564356a88440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.830+0000 7f6ba63bc740 1 --2- 172.21.15.59:0/2350889680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 0x564356a87f00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.830+0000 7f6ba63bc740 1 --2- 172.21.15.59:0/2350889680 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564356a85170 0x564356a58070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.830+0000 7f6ba63bc740 1 -- 172.21.15.59:0/2350889680 >> 172.21.15.59:0/2350889680 conn(0x564356a5a380 msgr2=0x564356aa2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:56.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.830+0000 7f6ba63bc740 1 -- 172.21.15.59:0/2350889680 shutdown_connections 2023-10-16T14:25:56.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.830+0000 7f6ba63bc740 1 -- 172.21.15.59:0/2350889680 wait complete. 2023-10-16T14:25:56.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.831+0000 7f6ba63bc740 1 -- start start 2023-10-16T14:25:56.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.831+0000 7f6ba63bc740 1 Processor -- start 2023-10-16T14:25:56.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.832+0000 7f6ba63bc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85170 0x564356a99fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.832+0000 7f6ba63bc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a85550 0x564356a9a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.832+0000 7f6ba63bc740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564356ab6340 0x564356ab67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.832+0000 7f6ba63bc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643569c3720 con 0x564356a85170 2023-10-16T14:25:56.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.832+0000 7f6ba63bc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564356961970 con 0x564356a85550 2023-10-16T14:25:56.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.832+0000 7f6ba63bc740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564356961610 con 0x564356ab6340 2023-10-16T14:25:56.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.832+0000 7f6ba63bc740 10 client.0 _ll_register_callbacks cb 0x5643569839d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T14:25:56.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.832+0000 7f6ba15c2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85170 0x564356a99fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:56.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.832+0000 7f6ba15c2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85170 0x564356a99fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35762/0 (socket says 172.21.15.59:35762) 2023-10-16T14:25:56.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.832+0000 7f6ba15c2640 1 -- 172.21.15.59:0/3891543824 learned_addr learned my addr 172.21.15.59:0/3891543824 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:56.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.833+0000 7f6ba0dc1640 1 --2- 172.21.15.59:0/3891543824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a85550 0x564356a9a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:56.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.833+0000 7f6ba15c2640 1 -- 172.21.15.59:0/3891543824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564356ab6340 msgr2=0x564356ab67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:56.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.833+0000 7f6ba15c2640 1 --2- 172.21.15.59:0/3891543824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564356ab6340 0x564356ab67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.833+0000 7f6ba15c2640 1 -- 172.21.15.59:0/3891543824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a85550 msgr2=0x564356a9a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:56.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.833+0000 7f6ba15c2640 1 --2- 172.21.15.59:0/3891543824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a85550 0x564356a9a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.833+0000 7f6ba15c2640 1 -- 172.21.15.59:0/3891543824 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b88003520 con 0x564356a85170 2023-10-16T14:25:56.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.833+0000 7f6ba0dc1640 1 --2- 172.21.15.59:0/3891543824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a85550 0x564356a9a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:25:56.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.833+0000 7f6ba15c2640 1 --2- 172.21.15.59:0/3891543824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85170 0x564356a99fb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6b98057e50 tx=0x7f6b98058990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59bd27c3bc45b8f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:56.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.833+0000 7f6b77fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-16T14:25:56.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.833+0000 7f6b77fff640 1 -- 172.21.15.59:0/3891543824 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9806bea0 con 0x564356a85170 2023-10-16T14:25:56.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.833+0000 7f6b77fff640 1 -- 172.21.15.59:0/3891543824 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6b98060450 con 0x564356a85170 2023-10-16T14:25:56.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.833+0000 7f6ba63bc740 1 -- 172.21.15.59:0/3891543824 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5643569ea160 con 0x564356a85170 2023-10-16T14:25:56.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.833+0000 7f6b77fff640 1 -- 172.21.15.59:0/3891543824 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b9805ffc0 con 0x564356a85170 2023-10-16T14:25:56.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.833+0000 7f6ba63bc740 10 client.4395 fetch_fsmap learned FSMap version 7 2023-10-16T14:25:56.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.833+0000 7f6ba63bc740 1 -- 172.21.15.59:0/3891543824 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5643569c1da0 con 0x564356a85170 2023-10-16T14:25:56.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.834+0000 7f6b77fff640 1 -- 172.21.15.59:0/3891543824 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b98073020 con 0x564356a85170 2023-10-16T14:25:56.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.834+0000 7f6b77fff640 1 -- 172.21.15.59:0/3891543824 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f6b9805e0e0 con 0x564356a85170 2023-10-16T14:25:56.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.834+0000 7f6ba63bc740 10 client.4395 fetch_fsmap finished waiting for FSMap version 7 2023-10-16T14:25:56.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.834+0000 7f6ba63bc740 10 client.4395 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-16T14:25:56.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.834+0000 7f6ba63bc740 20 client.4395 populate_metadata read hostname 'smithi059' 2023-10-16T14:25:56.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.834+0000 7f6ba63bc740 1 --2- 172.21.15.59:0/3891543824 >> [v2:172.21.15.151:6836/4004038733,v1:172.21.15.151:6837/4004038733] conn(0x564356a8afc0 0x564356a86630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.834+0000 7f6ba63bc740 4 client.4395 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T14:25:56.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.834+0000 7f6ba63bc740 1 -- 172.21.15.59:0/3891543824 --> [v2:172.21.15.151:6836/4004038733,v1:172.21.15.151:6837/4004038733] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564356995cc0 con 0x564356a8afc0 2023-10-16T14:25:56.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.834+0000 7f6ba0dc1640 1 --2- 172.21.15.59:0/3891543824 >> [v2:172.21.15.151:6836/4004038733,v1:172.21.15.151:6837/4004038733] conn(0x564356a8afc0 0x564356a86630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:56.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.836+0000 7f6ba0dc1640 1 --2- 172.21.15.59:0/3891543824 >> [v2:172.21.15.151:6836/4004038733,v1:172.21.15.151:6837/4004038733] conn(0x564356a8afc0 0x564356a86630 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=571de495fa9e3551 server_cookie=b2510427008dec5f in_seq=0 out_seq=0 2023-10-16T14:25:56.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.836+0000 7f6b77fff640 10 client.4395 ms_handle_connect on v2:172.21.15.151:6836/4004038733 2023-10-16T14:25:56.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.837+0000 7f6b77fff640 1 -- 172.21.15.59:0/3891543824 <== mds.0 v2:172.21.15.151:6836/4004038733 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564356995cc0 con 0x564356a8afc0 2023-10-16T14:25:56.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.837+0000 7f6b77fff640 10 client.4395 handle_command_reply: tid=0 2023-10-16T14:25:56.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.837+0000 7f6ba63bc740 1 client.4395 shutdown 2023-10-16T14:25:56.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.837+0000 7f6ba63bc740 1 -- 172.21.15.59:0/3891543824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85170 msgr2=0x564356a99fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:56.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.837+0000 7f6ba63bc740 1 --2- 172.21.15.59:0/3891543824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85170 0x564356a99fb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6b98057e50 tx=0x7f6b98058990 comp rx=0 tx=0).stop 2023-10-16T14:25:56.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.838+0000 7f6ba63bc740 1 -- 172.21.15.59:0/3891543824 shutdown_connections 2023-10-16T14:25:56.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.838+0000 7f6ba63bc740 1 --2- 172.21.15.59:0/3891543824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564356ab6340 0x564356ab67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.838+0000 7f6ba63bc740 1 --2- 172.21.15.59:0/3891543824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a85550 0x564356a9a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.838+0000 7f6ba63bc740 1 --2- 172.21.15.59:0/3891543824 >> [v2:172.21.15.151:6836/4004038733,v1:172.21.15.151:6837/4004038733] conn(0x564356a8afc0 0x564356a86630 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.838+0000 7f6ba63bc740 1 --2- 172.21.15.59:0/3891543824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85170 0x564356a99fb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.838+0000 7f6b77fff640 0 client.4395 ms_handle_reset on v2:172.21.15.151:6836/4004038733 2023-10-16T14:25:56.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.838+0000 7f6ba63bc740 1 -- 172.21.15.59:0/3891543824 >> 172.21.15.59:0/3891543824 conn(0x564356a585b0 msgr2=0x564356a5c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:56.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.838+0000 7f6ba63bc740 1 -- 172.21.15.59:0/3891543824 shutdown_connections 2023-10-16T14:25:56.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.838+0000 7f6ba63bc740 1 -- 172.21.15.59:0/3891543824 wait complete. 2023-10-16T14:25:56.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.838+0000 7f6ba63bc740 20 client.4395 trim_cache size 0 max 16384 2023-10-16T14:25:56.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.855+0000 7f6ba63bc740 1 Processor -- start 2023-10-16T14:25:56.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.855+0000 7f6ba63bc740 1 -- start start 2023-10-16T14:25:56.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.856+0000 7f6ba63bc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a85170 0x564356a539f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.856+0000 7f6ba63bc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 0x564356a88110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.856+0000 7f6ba63bc740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564356ab6340 0x564356a88650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.856+0000 7f6ba63bc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564356727f20 con 0x564356a85550 2023-10-16T14:25:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.856+0000 7f6ba63bc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564356aa65b0 con 0x564356a85170 2023-10-16T14:25:56.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.856+0000 7f6ba63bc740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564356a579a0 con 0x564356ab6340 2023-10-16T14:25:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.856+0000 7f6ba0dc1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 0x564356a88110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.856+0000 7f6ba0dc1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 0x564356a88110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35770/0 (socket says 172.21.15.59:35770) 2023-10-16T14:25:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.856+0000 7f6ba0dc1640 1 -- 172.21.15.59:0/2034075884 learned_addr learned my addr 172.21.15.59:0/2034075884 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:56.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.856+0000 7f6ba0dc1640 1 -- 172.21.15.59:0/2034075884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564356ab6340 msgr2=0x564356a88650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:56.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.856+0000 7f6ba0dc1640 1 --2- 172.21.15.59:0/2034075884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564356ab6340 0x564356a88650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.856+0000 7f6ba0dc1640 1 -- 172.21.15.59:0/2034075884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a85170 msgr2=0x564356a539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:56.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.856+0000 7f6ba0dc1640 1 --2- 172.21.15.59:0/2034075884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a85170 0x564356a539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.856+0000 7f6ba0dc1640 1 -- 172.21.15.59:0/2034075884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564356960b80 con 0x564356a85550 2023-10-16T14:25:56.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.857+0000 7f6ba0dc1640 1 --2- 172.21.15.59:0/2034075884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 0x564356a88110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c04a040 tx=0x7f6b8c03d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a73b08778fd286 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.857+0000 7f6b7f7fe640 1 -- 172.21.15.59:0/2034075884 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c007690 con 0x564356a85550 2023-10-16T14:25:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.857+0000 7f6b7f7fe640 1 -- 172.21.15.59:0/2034075884 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8c006ac0 con 0x564356a85550 2023-10-16T14:25:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.857+0000 7f6b7f7fe640 1 -- 172.21.15.59:0/2034075884 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c006e70 con 0x564356a85550 2023-10-16T14:25:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.858+0000 7f6ba63bc740 1 -- 172.21.15.59:0/2034075884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 msgr2=0x564356a88110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:56.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.858+0000 7f6ba63bc740 1 --2- 172.21.15.59:0/2034075884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 0x564356a88110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c04a040 tx=0x7f6b8c03d000 comp rx=0 tx=0).stop 2023-10-16T14:25:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.858+0000 7f6ba63bc740 1 -- 172.21.15.59:0/2034075884 shutdown_connections 2023-10-16T14:25:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.858+0000 7f6ba63bc740 1 --2- 172.21.15.59:0/2034075884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564356ab6340 0x564356a88650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.858+0000 7f6ba63bc740 1 --2- 172.21.15.59:0/2034075884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 0x564356a88110 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.858+0000 7f6ba63bc740 1 --2- 172.21.15.59:0/2034075884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a85170 0x564356a539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.858+0000 7f6ba63bc740 1 -- 172.21.15.59:0/2034075884 >> 172.21.15.59:0/2034075884 conn(0x564356a585b0 msgr2=0x564356aa5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.858+0000 7f6ba63bc740 1 -- 172.21.15.59:0/2034075884 shutdown_connections 2023-10-16T14:25:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.858+0000 7f6ba63bc740 1 -- 172.21.15.59:0/2034075884 wait complete. 2023-10-16T14:25:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.858+0000 7f6ba63bc740 1 -- start start 2023-10-16T14:25:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.859+0000 7f6ba63bc740 1 Processor -- start 2023-10-16T14:25:56.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.860+0000 7f6ba63bc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a85170 0x564356ab52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.860+0000 7f6ba63bc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 0x564356b04690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.860+0000 7f6ba63bc740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564356ab6340 0x564356a7ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.860+0000 7f6ba63bc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564356b04bd0 con 0x564356a85550 2023-10-16T14:25:56.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.860+0000 7f6ba63bc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564356abab00 con 0x564356a85170 2023-10-16T14:25:56.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.860+0000 7f6ba63bc740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564356ab5960 con 0x564356ab6340 2023-10-16T14:25:56.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.860+0000 7f6ba63bc740 10 client.0 _ll_register_callbacks cb 0x7f6b98057ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T14:25:56.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.860+0000 7f6ba0dc1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 0x564356b04690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:56.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.860+0000 7f6ba0dc1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 0x564356b04690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35778/0 (socket says 172.21.15.59:35778) 2023-10-16T14:25:56.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.860+0000 7f6ba0dc1640 1 -- 172.21.15.59:0/2979222306 learned_addr learned my addr 172.21.15.59:0/2979222306 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:56.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.860+0000 7f6ba15c2640 1 --2- 172.21.15.59:0/2979222306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a85170 0x564356ab52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:56.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.860+0000 7f6ba0dc1640 1 -- 172.21.15.59:0/2979222306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564356ab6340 msgr2=0x564356a7ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:56.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.860+0000 7f6ba0dc1640 1 --2- 172.21.15.59:0/2979222306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564356ab6340 0x564356a7ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.860+0000 7f6ba0dc1640 1 -- 172.21.15.59:0/2979222306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a85170 msgr2=0x564356ab52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:25:56.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.860+0000 7f6ba0dc1640 1 --2- 172.21.15.59:0/2979222306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a85170 0x564356ab52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.860+0000 7f6ba0dc1640 1 -- 172.21.15.59:0/2979222306 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564356987910 con 0x564356a85550 2023-10-16T14:25:56.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.860+0000 7f6ba15c2640 1 --2- 172.21.15.59:0/2979222306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a85170 0x564356ab52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:25:56.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.861+0000 7f6ba0dc1640 1 --2- 172.21.15.59:0/2979222306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 0x564356b04690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c034040 tx=0x7f6b8c001190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45607e596e8da022 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:56.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.861+0000 7f6b77fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-16T14:25:56.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.861+0000 7f6b77fff640 1 -- 172.21.15.59:0/2979222306 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c007790 con 0x564356a85550 2023-10-16T14:25:56.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.861+0000 7f6b77fff640 1 -- 172.21.15.59:0/2979222306 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6b8c043050 con 0x564356a85550 2023-10-16T14:25:56.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.861+0000 7f6ba63bc740 1 -- 172.21.15.59:0/2979222306 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564356a860c0 con 0x564356a85550 2023-10-16T14:25:56.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.861+0000 7f6b77fff640 1 -- 172.21.15.59:0/2979222306 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b8c006c30 con 0x564356a85550 2023-10-16T14:25:56.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.861+0000 7f6ba63bc740 10 client.4401 fetch_fsmap learned FSMap version 7 2023-10-16T14:25:56.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.861+0000 7f6ba63bc740 1 -- 172.21.15.59:0/2979222306 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x564356986170 con 0x564356a85550 2023-10-16T14:25:56.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.861+0000 7f6b77fff640 1 -- 172.21.15.59:0/2979222306 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564356a860c0 con 0x564356a85550 2023-10-16T14:25:56.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.862+0000 7f6b77fff640 1 -- 172.21.15.59:0/2979222306 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f6b8c068050 con 0x564356a85550 2023-10-16T14:25:56.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.862+0000 7f6ba63bc740 10 client.4401 fetch_fsmap finished waiting for FSMap version 7 2023-10-16T14:25:56.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.862+0000 7f6ba63bc740 10 client.4401 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-16T14:25:56.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.862+0000 7f6ba63bc740 20 client.4401 populate_metadata read hostname 'smithi059' 2023-10-16T14:25:56.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.862+0000 7f6ba63bc740 1 --2- 172.21.15.59:0/2979222306 >> [v2:172.21.15.151:6836/4004038733,v1:172.21.15.151:6837/4004038733] conn(0x564356a80560 0x564356a88110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:56.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.862+0000 7f6ba63bc740 4 client.4401 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T14:25:56.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.862+0000 7f6ba63bc740 1 -- 172.21.15.59:0/2979222306 --> [v2:172.21.15.151:6836/4004038733,v1:172.21.15.151:6837/4004038733] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f6b8c0067d0 con 0x564356a80560 2023-10-16T14:25:56.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.862+0000 7f6ba15c2640 1 --2- 172.21.15.59:0/2979222306 >> [v2:172.21.15.151:6836/4004038733,v1:172.21.15.151:6837/4004038733] conn(0x564356a80560 0x564356a88110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:56.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.863+0000 7f6ba15c2640 1 --2- 172.21.15.59:0/2979222306 >> [v2:172.21.15.151:6836/4004038733,v1:172.21.15.151:6837/4004038733] conn(0x564356a80560 0x564356a88110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7258019b9644c6fb server_cookie=4e5a27b34861ab5b in_seq=0 out_seq=0 2023-10-16T14:25:56.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.863+0000 7f6b77fff640 10 client.4401 ms_handle_connect on v2:172.21.15.151:6836/4004038733 2023-10-16T14:25:56.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.863+0000 7f6b77fff640 1 -- 172.21.15.59:0/2979222306 <== mds.0 v2:172.21.15.151:6836/4004038733 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x7f6b8c0067d0 con 0x564356a80560 2023-10-16T14:25:56.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.863+0000 7f6b77fff640 10 client.4401 handle_command_reply: tid=0 2023-10-16T14:25:56.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.864+0000 7f6ba63bc740 1 client.4401 shutdown 2023-10-16T14:25:56.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.864+0000 7f6ba63bc740 1 -- 172.21.15.59:0/2979222306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 msgr2=0x564356b04690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:56.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.864+0000 7f6ba63bc740 1 --2- 172.21.15.59:0/2979222306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 0x564356b04690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c034040 tx=0x7f6b8c001190 comp rx=0 tx=0).stop 2023-10-16T14:25:56.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.864+0000 7f6ba63bc740 1 -- 172.21.15.59:0/2979222306 shutdown_connections 2023-10-16T14:25:56.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.864+0000 7f6ba63bc740 1 --2- 172.21.15.59:0/2979222306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564356ab6340 0x564356a7ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.864+0000 7f6ba63bc740 1 --2- 172.21.15.59:0/2979222306 >> [v2:172.21.15.151:6836/4004038733,v1:172.21.15.151:6837/4004038733] conn(0x564356a80560 0x564356a88110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.864+0000 7f6ba63bc740 1 --2- 172.21.15.59:0/2979222306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564356a85550 0x564356b04690 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.864+0000 7f6ba63bc740 1 --2- 172.21.15.59:0/2979222306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564356a85170 0x564356ab52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.864+0000 7f6b77fff640 0 client.4401 ms_handle_reset on v2:172.21.15.151:6836/4004038733 2023-10-16T14:25:56.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.864+0000 7f6ba63bc740 1 -- 172.21.15.59:0/2979222306 >> 172.21.15.59:0/2979222306 conn(0x564356a585b0 msgr2=0x564356b05b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:56.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.864+0000 7f6ba63bc740 1 -- 172.21.15.59:0/2979222306 shutdown_connections 2023-10-16T14:25:56.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.864+0000 7f6ba63bc740 1 -- 172.21.15.59:0/2979222306 wait complete. 2023-10-16T14:25:56.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.864+0000 7f6ba63bc740 20 client.4401 trim_cache size 0 max 16384 2023-10-16T14:25:56.880 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-16T14:25:56.880 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "c3201022-15a8-4479-95cd-5e66eaaa456b", 2023-10-16T14:25:56.880 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2023-10-16T14:25:56.880 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4282, 2023-10-16T14:25:56.881 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2023-10-16T14:25:56.881 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2023-10-16T14:25:56.881 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2023-10-16T14:25:56.881 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 8.1776589259999994, 2023-10-16T14:25:56.881 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 7, 2023-10-16T14:25:56.882 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 26, 2023-10-16T14:25:56.882 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 25, 2023-10-16T14:25:56.882 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 13.584731994 2023-10-16T14:25:56.882 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-16T14:25:56.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.865+0000 7f6ba25c4640 1 -- 172.21.15.59:0/1171393722 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6b8006aea0 msgr2=0x7f6b8006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:56.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.865+0000 7f6ba25c4640 1 --2- 172.21.15.59:0/1171393722 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6b8006aea0 0x7f6b8006d360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c033000 tx=0x7f6b8c009030 comp rx=0 tx=0).stop 2023-10-16T14:25:56.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.865+0000 7f6ba25c4640 1 -- 172.21.15.59:0/1171393722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b880047c0 msgr2=0x7f6b9c15ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:56.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.865+0000 7f6ba25c4640 1 --2- 172.21.15.59:0/1171393722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b880047c0 0x7f6b9c15ace0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800e780 tx=0x7f6b9800ec40 comp rx=0 tx=0).stop 2023-10-16T14:25:56.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.865+0000 7f6ba25c4640 1 -- 172.21.15.59:0/1171393722 shutdown_connections 2023-10-16T14:25:56.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.865+0000 7f6ba25c4640 1 --2- 172.21.15.59:0/1171393722 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6b8006aea0 0x7f6b8006d360 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.865+0000 7f6ba25c4640 1 --2- 172.21.15.59:0/1171393722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b9c0ac440 0x7f6b9c1599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.865+0000 7f6ba25c4640 1 --2- 172.21.15.59:0/1171393722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b9c09bf20 0x7f6b9c1f5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.865+0000 7f6ba25c4640 1 --2- 172.21.15.59:0/1171393722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b880047c0 0x7f6b9c15ace0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:56.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.865+0000 7f6ba25c4640 1 -- 172.21.15.59:0/1171393722 >> 172.21.15.59:0/1171393722 conn(0x7f6b9c069fc0 msgr2=0x7f6b9c06ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:56.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.865+0000 7f6ba25c4640 1 -- 172.21.15.59:0/1171393722 shutdown_connections 2023-10-16T14:25:56.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:56.865+0000 7f6ba25c4640 1 -- 172.21.15.59:0/1171393722 wait complete. 2023-10-16T14:25:56.886 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T14:25:56.887 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-16T14:25:56.887 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T14:25:57.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.108+0000 7f94d9213640 1 Processor -- start 2023-10-16T14:25:57.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.108+0000 7f94d9213640 1 -- start start 2023-10-16T14:25:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.110+0000 7f94d9213640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94d4161010 0x7f94d4070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.110+0000 7f94d9213640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d40cd110 con 0x7f94d40cb340 2023-10-16T14:25:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.110+0000 7f94d9213640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d40cc500 con 0x7f94d4160c30 2023-10-16T14:25:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.110+0000 7f94d9213640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d40cc7e0 con 0x7f94d4161010 2023-10-16T14:25:57.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.110+0000 7f94d37fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f94d40cb340 0x7f94d406fef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35424/0 (socket says 172.21.15.59:35424) 2023-10-16T14:25:57.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.110+0000 7f94d37fe640 1 -- 172.21.15.59:0/2433182832 learned_addr learned my addr 172.21.15.59:0/2433182832 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:25:57.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.110+0000 7f94d8a12640 1 --2- 172.21.15.59:0/2433182832 >> v2:172.21.15.59:3300/0 conn(0x7f94d4161010 0x7f94d4070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:57.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.111+0000 7f94d2ffd640 1 -- 172.21.15.59:0/2433182832 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865405472 0 0) 0x7f94d40cd110 con 0x7f94d40cb340 2023-10-16T14:25:57.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.111+0000 7f94d2ffd640 1 -- 172.21.15.59:0/2433182832 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c0003520 con 0x7f94d40cb340 2023-10-16T14:25:57.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.111+0000 7f94d8a12640 1 -- 172.21.15.59:0/2433182832 >> v1:172.21.15.151:6789/0 conn(0x7f94d4160c30 legacy=0x7f94d40cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:57.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.111+0000 7f94d8a12640 1 -- 172.21.15.59:0/2433182832 >> v1:172.21.15.59:6789/0 conn(0x7f94d40cb340 legacy=0x7f94d406fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:57.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.111+0000 7f94d8a12640 1 -- 172.21.15.59:0/2433182832 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d40ccac0 con 0x7f94d4161010 2023-10-16T14:25:57.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.112+0000 7f94d8a12640 1 --2- 172.21.15.59:0/2433182832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94d4161010 0x7f94d4070600 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009d90 tx=0x7f94cc02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7ad557c2af7951 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:57.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.113+0000 7f94d2ffd640 1 -- 172.21.15.59:0/2433182832 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc02cd80 con 0x7f94d4161010 2023-10-16T14:25:57.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.113+0000 7f94d2ffd640 1 -- 172.21.15.59:0/2433182832 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc034440 con 0x7f94d4161010 2023-10-16T14:25:57.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.113+0000 7f94d2ffd640 1 -- 172.21.15.59:0/2433182832 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc0347b0 con 0x7f94d4161010 2023-10-16T14:25:57.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.113+0000 7f94d9213640 1 -- 172.21.15.59:0/2433182832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94d4161010 msgr2=0x7f94d4070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:57.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.113+0000 7f94d9213640 1 --2- 172.21.15.59:0/2433182832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94d4161010 0x7f94d4070600 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009d90 tx=0x7f94cc02bfd0 comp rx=0 tx=0).stop 2023-10-16T14:25:57.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.114+0000 7f94d9213640 1 -- 172.21.15.59:0/2433182832 shutdown_connections 2023-10-16T14:25:57.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.114+0000 7f94d9213640 1 --2- 172.21.15.59:0/2433182832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94d4161010 0x7f94d4070600 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:57.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.114+0000 7f94d9213640 1 -- 172.21.15.59:0/2433182832 >> 172.21.15.59:0/2433182832 conn(0x7f94d406a470 msgr2=0x7f94d40afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:57.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.114+0000 7f94d9213640 1 -- 172.21.15.59:0/2433182832 shutdown_connections 2023-10-16T14:25:57.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.114+0000 7f94d9213640 1 -- 172.21.15.59:0/2433182832 wait complete. 2023-10-16T14:25:57.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.115+0000 7f94d9213640 1 Processor -- start 2023-10-16T14:25:57.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.116+0000 7f94d9213640 1 -- start start 2023-10-16T14:25:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.116+0000 7f94d9213640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94d40cb340 0x7f94d415e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.116+0000 7f94d9213640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94d4160c30 0x7f94d40c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.117+0000 7f94d9213640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94d4161010 0x7f94d40c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.117+0000 7f94d9213640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d40b26c0 con 0x7f94d4161010 2023-10-16T14:25:57.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.117+0000 7f94d9213640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d40b3740 con 0x7f94d4160c30 2023-10-16T14:25:57.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.117+0000 7f94d9213640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d40b2ed0 con 0x7f94d40cb340 2023-10-16T14:25:57.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.117+0000 7f94d8a12640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94d4161010 0x7f94d40c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:57.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.117+0000 7f94d8a12640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94d4161010 0x7f94d40c3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35800/0 (socket says 172.21.15.59:35800) 2023-10-16T14:25:57.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.117+0000 7f94d8a12640 1 -- 172.21.15.59:0/3148141114 learned_addr learned my addr 172.21.15.59:0/3148141114 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:25:57.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.117+0000 7f94d3fff640 1 --2- 172.21.15.59:0/3148141114 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94d40cb340 0x7f94d415e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:57.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.117+0000 7f94d37fe640 1 --2- 172.21.15.59:0/3148141114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94d4160c30 0x7f94d40c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:57.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.117+0000 7f94d8a12640 1 -- 172.21.15.59:0/3148141114 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94d40cb340 msgr2=0x7f94d415e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:57.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.117+0000 7f94d8a12640 1 --2- 172.21.15.59:0/3148141114 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94d40cb340 0x7f94d415e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:57.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.117+0000 7f94d8a12640 1 -- 172.21.15.59:0/3148141114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94d4160c30 msgr2=0x7f94d40c3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:57.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.117+0000 7f94d8a12640 1 --2- 172.21.15.59:0/3148141114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94d4160c30 0x7f94d40c3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:57.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.117+0000 7f94d8a12640 1 -- 172.21.15.59:0/3148141114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc009a70 con 0x7f94d4161010 2023-10-16T14:25:57.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.118+0000 7f94d8a12640 1 --2- 172.21.15.59:0/3148141114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94d4161010 0x7f94d40c3f90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009eb0 tx=0x7f94cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:57.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.118+0000 7f94d0ff9640 1 -- 172.21.15.59:0/3148141114 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc003b90 con 0x7f94d4161010 2023-10-16T14:25:57.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.118+0000 7f94d0ff9640 1 -- 172.21.15.59:0/3148141114 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc003d10 con 0x7f94d4161010 2023-10-16T14:25:57.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.118+0000 7f94d0ff9640 1 -- 172.21.15.59:0/3148141114 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc004270 con 0x7f94d4161010 2023-10-16T14:25:57.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.118+0000 7f94d9213640 1 -- 172.21.15.59:0/3148141114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d40b1fe0 con 0x7f94d4161010 2023-10-16T14:25:57.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.118+0000 7f94d9213640 1 -- 172.21.15.59:0/3148141114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d40b2bf0 con 0x7f94d4161010 2023-10-16T14:25:57.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.119+0000 7f94d9213640 1 -- 172.21.15.59:0/3148141114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d404e9b0 con 0x7f94d4161010 2023-10-16T14:25:57.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.120+0000 7f94d0ff9640 1 -- 172.21.15.59:0/3148141114 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f94cc03b050 con 0x7f94d4161010 2023-10-16T14:25:57.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.121+0000 7f94d0ff9640 1 --2- 172.21.15.59:0/3148141114 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f94b406aec0 0x7f94b406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:25:57.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.121+0000 7f94d0ff9640 1 -- 172.21.15.59:0/3148141114 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f94cc0abdb0 con 0x7f94d4161010 2023-10-16T14:25:57.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.122+0000 7f94d3fff640 1 --2- 172.21.15.59:0/3148141114 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f94b406aec0 0x7f94b406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:25:57.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.123+0000 7f94d3fff640 1 --2- 172.21.15.59:0/3148141114 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f94b406aec0 0x7f94b406d380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f94d41e90a0 tx=0x7f94bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:25:57.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.126+0000 7f94d0ff9640 1 -- 172.21.15.59:0/3148141114 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f94cc0b0070 con 0x7f94d4161010 2023-10-16T14:25:57.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.359+0000 7f94d9213640 1 -- 172.21.15.59:0/3148141114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f94d40b3880 con 0x7f94d4161010 2023-10-16T14:25:57.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.359+0000 7f94d0ff9640 1 -- 172.21.15.59:0/3148141114 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f94cc039020 con 0x7f94d4161010 2023-10-16T14:25:57.363 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T14:25:57.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.362+0000 7f94d9213640 1 -- 172.21.15.59:0/3148141114 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f94b406aec0 msgr2=0x7f94b406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:57.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.362+0000 7f94d9213640 1 --2- 172.21.15.59:0/3148141114 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f94b406aec0 0x7f94b406d380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f94d41e90a0 tx=0x7f94bc009040 comp rx=0 tx=0).stop 2023-10-16T14:25:57.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.362+0000 7f94d9213640 1 -- 172.21.15.59:0/3148141114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94d4161010 msgr2=0x7f94d40c3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:25:57.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.362+0000 7f94d9213640 1 --2- 172.21.15.59:0/3148141114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94d4161010 0x7f94d40c3f90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009eb0 tx=0x7f94cc004a40 comp rx=0 tx=0).stop 2023-10-16T14:25:57.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.362+0000 7f94d9213640 1 -- 172.21.15.59:0/3148141114 shutdown_connections 2023-10-16T14:25:57.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.362+0000 7f94d9213640 1 --2- 172.21.15.59:0/3148141114 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f94b406aec0 0x7f94b406d380 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:57.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.362+0000 7f94d9213640 1 --2- 172.21.15.59:0/3148141114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94d4161010 0x7f94d40c3f90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:57.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.362+0000 7f94d9213640 1 --2- 172.21.15.59:0/3148141114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f94d4160c30 0x7f94d40c3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:57.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.362+0000 7f94d9213640 1 --2- 172.21.15.59:0/3148141114 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f94d40cb340 0x7f94d415e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:25:57.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.362+0000 7f94d9213640 1 -- 172.21.15.59:0/3148141114 >> 172.21.15.59:0/3148141114 conn(0x7f94d406a470 msgr2=0x7f94d4071890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:25:57.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.362+0000 7f94d9213640 1 -- 172.21.15.59:0/3148141114 shutdown_connections 2023-10-16T14:25:57.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:25:57.362+0000 7f94d9213640 1 -- 172.21.15.59:0/3148141114 wait complete. 2023-10-16T14:25:57.387 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-16T14:25:57.387 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T14:25:57.388 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-10-16T14:25:57.388 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-16T14:25:57.388 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-16T14:25:57.388 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-16T14:25:57.389 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T14:25:57.389 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T14:25:57.389 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-16T14:25:57.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:25:57.390 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-10-16T14:25:57.446 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T14:25:57.446 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T14:25:57.446 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T14:25:57.447 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:25:57.447 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-16T14:25:57.447 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:25:57.447 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T14:25:57.447 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-10-16T14:25:57.448 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2023-10-16T14:25:57.448 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T14:25:57.448 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-10-16T14:25:57.448 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2023-10-16T14:25:57.448 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T14:25:57.449 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-10-16T14:25:57.449 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2023-10-16T14:25:57.449 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-16T14:25:57.449 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42333sec preferred_lft 42333sec 2023-10-16T14:25:57.449 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link noprefixroute 2023-10-16T14:25:57.450 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:25:57.450 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T14:25:57.450 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-10-16T14:25:57.450 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2023-10-16T14:25:57.451 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T14:25:57.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:25:57.452 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-16T14:25:57.453 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-16T14:25:57.453 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add name ceph-brx type bridge 2023-10-16T14:25:57.453 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr flush dev ceph-brx 2023-10-16T14:25:57.454 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set ceph-brx up 2023-10-16T14:25:57.454 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T14:25:57.454 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-16T14:25:57.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:25:57.948 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T14:25:58.049 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-16T14:25:58.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:25:58.053 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-10-16T14:25:58.122 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-10-16T14:25:58.122 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T14:25:58.123 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-16T14:25:58.123 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-16T14:25:58.123 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T14:25:58.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:25:58.124 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-16T14:25:58.124 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-16T14:25:58.125 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-16T14:25:58.125 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-16T14:25:58.125 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-16T14:25:58.126 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-16T14:25:58.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:25:58.930 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-16T14:25:58.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:25:58.991 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list-id 2023-10-16T14:25:59.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:25:59.048 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-16T14:25:59.049 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-16T14:25:59.049 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T14:25:59.049 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-16T14:25:59.050 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-16T14:25:59.207 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-16T14:25:59.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:25:59.208 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-16T14:25:59.209 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-16T14:25:59.209 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-16T14:25:59.209 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T14:25:59.210 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-16T14:25:59.210 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-16T14:25:59.210 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-16T14:25:59.211 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-16T14:25:59.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:25:59.521 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-16T14:25:59.521 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-16T14:25:59.521 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2023-10-16T14:25:59.522 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T14:25:59.522 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-16T14:25:59.701 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-16T14:25:59.702 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T14:25:59.702 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-16T14:25:59.753 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-16T14:25:59.753 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T14:25:59.753 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-16T14:25:59.811 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2023-10-16T14:25:59.915 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T14:25:59.974 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2023-10-16T14:25:59.975 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2023-10-16T14:25:59.975 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2023-10-16T14:25:59.975 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2023-10-16T14:25:59.975 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2023-10-16T14:25:59.975 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2023-10-16T14:25:59.976 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2023-10-16T14:25:59.976 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2023-10-16T14:25:59.976 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2023-10-16T14:25:59.976 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2023-10-16T14:25:59.976 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/selinux 2023-10-16T14:25:59.976 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T14:25:59.977 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2023-10-16T14:25:59.977 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2023-10-16T14:25:59.977 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2023-10-16T14:25:59.977 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2023-10-16T14:25:59.977 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2023-10-16T14:25:59.978 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T14:25:59.978 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T14:25:59.978 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2023-10-16T14:25:59.978 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T14:25:59.978 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T14:25:59.979 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2023-10-16T14:25:59.979 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2023-10-16T14:25:59.979 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T14:25:59.979 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T14:25:59.979 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T14:25:59.980 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T14:25:59.980 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2023-10-16T14:25:59.980 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T14:25:59.980 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T14:25:59.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:25:59.981 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2023-10-16T14:26:00.033 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-16T14:26:00.033 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-16T14:26:00.039 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2023-10-16T14:26:00.117 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T14:26:00.161 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2023-10-16T14:26:00.161 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2023-10-16T14:26:00.162 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2023-10-16T14:26:00.162 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2023-10-16T14:26:00.162 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2023-10-16T14:26:00.162 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2023-10-16T14:26:00.162 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2023-10-16T14:26:00.163 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2023-10-16T14:26:00.163 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2023-10-16T14:26:00.163 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2023-10-16T14:26:00.163 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/selinux 2023-10-16T14:26:00.163 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T14:26:00.164 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2023-10-16T14:26:00.164 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2023-10-16T14:26:00.164 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2023-10-16T14:26:00.164 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2023-10-16T14:26:00.164 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2023-10-16T14:26:00.164 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T14:26:00.165 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T14:26:00.165 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2023-10-16T14:26:00.165 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T14:26:00.165 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T14:26:00.165 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2023-10-16T14:26:00.166 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2023-10-16T14:26:00.166 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T14:26:00.166 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T14:26:00.166 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T14:26:00.166 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T14:26:00.166 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2023-10-16T14:26:00.167 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T14:26:00.167 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T14:26:00.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:00.168 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2023-10-16T14:26:00.243 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi059.stderr:2023-10-16T14:26:00.240+0000 7f648757c480 -1 init, newargv = 0x559aaee996c0 newargc=15 2023-10-16T14:26:00.244 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi059.stderr:ceph-fuse[93786]: starting ceph client 2023-10-16T14:26:00.258 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi059.stderr:ceph-fuse[93786]: starting fuse 2023-10-16T14:26:00.260 INFO:teuthology.orchestra.run.smithi059.stdout:41 2023-10-16T14:26:00.261 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-10-16T14:26:00.261 DEBUG:teuthology.orchestra.run.smithi059:> sudo stdin-killer -- python3 -c ' 2023-10-16T14:26:00.261 DEBUG:teuthology.orchestra.run.smithi059:> import glob 2023-10-16T14:26:00.262 DEBUG:teuthology.orchestra.run.smithi059:> import re 2023-10-16T14:26:00.262 DEBUG:teuthology.orchestra.run.smithi059:> import os 2023-10-16T14:26:00.263 DEBUG:teuthology.orchestra.run.smithi059:> import subprocess 2023-10-16T14:26:00.263 DEBUG:teuthology.orchestra.run.smithi059:> 2023-10-16T14:26:00.263 DEBUG:teuthology.orchestra.run.smithi059:> def _find_admin_socket(client_name): 2023-10-16T14:26:00.264 DEBUG:teuthology.orchestra.run.smithi059:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-16T14:26:00.264 DEBUG:teuthology.orchestra.run.smithi059:> files = glob.glob(asok_path) 2023-10-16T14:26:00.264 DEBUG:teuthology.orchestra.run.smithi059:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-16T14:26:00.265 DEBUG:teuthology.orchestra.run.smithi059:> 2023-10-16T14:26:00.265 DEBUG:teuthology.orchestra.run.smithi059:> # Given a non-glob path, it better be there 2023-10-16T14:26:00.265 DEBUG:teuthology.orchestra.run.smithi059:> if "*" not in asok_path: 2023-10-16T14:26:00.266 DEBUG:teuthology.orchestra.run.smithi059:> assert(len(files) == 1) 2023-10-16T14:26:00.266 DEBUG:teuthology.orchestra.run.smithi059:> return files[0] 2023-10-16T14:26:00.266 DEBUG:teuthology.orchestra.run.smithi059:> 2023-10-16T14:26:00.267 DEBUG:teuthology.orchestra.run.smithi059:> for f in files: 2023-10-16T14:26:00.267 DEBUG:teuthology.orchestra.run.smithi059:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-16T14:26:00.267 DEBUG:teuthology.orchestra.run.smithi059:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-16T14:26:00.268 DEBUG:teuthology.orchestra.run.smithi059:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-16T14:26:00.268 DEBUG:teuthology.orchestra.run.smithi059:> contents = proc_f.read() 2023-10-16T14:26:00.268 DEBUG:teuthology.orchestra.run.smithi059:> if mountpoint in contents: 2023-10-16T14:26:00.269 DEBUG:teuthology.orchestra.run.smithi059:> return f 2023-10-16T14:26:00.269 DEBUG:teuthology.orchestra.run.smithi059:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-16T14:26:00.269 DEBUG:teuthology.orchestra.run.smithi059:> 2023-10-16T14:26:00.270 DEBUG:teuthology.orchestra.run.smithi059:> print(_find_admin_socket("client.admin")) 2023-10-16T14:26:00.270 DEBUG:teuthology.orchestra.run.smithi059:> ' 2023-10-16T14:26:00.470 INFO:teuthology.orchestra.run.smithi059.stdout:/var/run/ceph/ceph-client.admin.93786.asok 2023-10-16T14:26:00.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-16T14:26:00.487 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.93786.asok 2023-10-16T14:26:00.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:00.488 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.93786.asok status 2023-10-16T14:26:00.738 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-16T14:26:00.739 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": { 2023-10-16T14:26:00.739 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-16T14:26:00.739 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-16T14:26:00.739 INFO:teuthology.orchestra.run.smithi059.stdout: "entity_id": "admin", 2023-10-16T14:26:00.740 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": "smithi059", 2023-10-16T14:26:00.740 INFO:teuthology.orchestra.run.smithi059.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-16T14:26:00.740 INFO:teuthology.orchestra.run.smithi059.stdout: "pid": "93786", 2023-10-16T14:26:00.740 INFO:teuthology.orchestra.run.smithi059.stdout: "root": "/" 2023-10-16T14:26:00.740 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:26:00.741 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_count": 0, 2023-10-16T14:26:00.741 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_pinned_count": 0, 2023-10-16T14:26:00.741 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4416, 2023-10-16T14:26:00.741 INFO:teuthology.orchestra.run.smithi059.stdout: "inst": { 2023-10-16T14:26:00.741 INFO:teuthology.orchestra.run.smithi059.stdout: "name": { 2023-10-16T14:26:00.742 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "client", 2023-10-16T14:26:00.742 INFO:teuthology.orchestra.run.smithi059.stdout: "num": 4416 2023-10-16T14:26:00.742 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:26:00.742 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2023-10-16T14:26:00.742 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-16T14:26:00.743 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2023-10-16T14:26:00.743 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3931998571 2023-10-16T14:26:00.743 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:26:00.743 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:26:00.743 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2023-10-16T14:26:00.743 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-16T14:26:00.744 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2023-10-16T14:26:00.744 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3931998571 2023-10-16T14:26:00.744 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:26:00.744 INFO:teuthology.orchestra.run.smithi059.stdout: "inst_str": "client.4416 192.168.0.1:0/3931998571", 2023-10-16T14:26:00.744 INFO:teuthology.orchestra.run.smithi059.stdout: "addr_str": "192.168.0.1:0/3931998571", 2023-10-16T14:26:00.745 INFO:teuthology.orchestra.run.smithi059.stdout: "inode_count": 1, 2023-10-16T14:26:00.745 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_epoch": 7, 2023-10-16T14:26:00.745 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch": 26, 2023-10-16T14:26:00.745 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch_barrier": 0, 2023-10-16T14:26:00.745 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklisted": false, 2023-10-16T14:26:00.746 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs" 2023-10-16T14:26:00.746 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-16T14:26:00.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:00.756 DEBUG:teuthology.orchestra.run.smithi059:> stat --file-system '--printf=%T 2023-10-16T14:26:00.756 DEBUG:teuthology.orchestra.run.smithi059:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-16T14:26:00.818 INFO:teuthology.orchestra.run.smithi059.stdout:fuseblk 2023-10-16T14:26:00.818 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-16T14:26:00.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:00.819 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-16T14:26:00.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:00.911 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-16T14:26:01.012 INFO:teuthology.orchestra.run.smithi059.stdout:# file: . 2023-10-16T14:26:01.012 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-16T14:26:01.012 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:01.013 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:26:01.014 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T14:26:01.070 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:26:01.218 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:26:01.226 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:26:01.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.290+0000 7f870fc26640 1 Processor -- start 2023-10-16T14:26:01.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.290+0000 7f870fc26640 1 -- start start 2023-10-16T14:26:01.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.291+0000 7f870fc26640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87080b0720 0x7f87080cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:01.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.292+0000 7f870fc26640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8708161620 con 0x7f870815ca80 2023-10-16T14:26:01.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.292+0000 7f870fc26640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87080cafa0 con 0x7f870815ce60 2023-10-16T14:26:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.292+0000 7f870fc26640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87080cb280 con 0x7f87080b0720 2023-10-16T14:26:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.292+0000 7f870d9c2640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f870815ca80 0x7f87080b0010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:35432/0 (socket says 172.21.15.59:35432) 2023-10-16T14:26:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.292+0000 7f870d9c2640 1 -- 172.21.15.59:0/2077747839 learned_addr learned my addr 172.21.15.59:0/2077747839 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:01.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.292+0000 7f870d1c1640 1 --2- 172.21.15.59:0/2077747839 >> v2:172.21.15.59:3300/0 conn(0x7f87080b0720 0x7f87080cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:01.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.292+0000 7f870c9c0640 1 -- 172.21.15.59:0/2077747839 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2543419518 0 0) 0x7f8708161620 con 0x7f870815ca80 2023-10-16T14:26:01.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.292+0000 7f870d1c1640 1 -- 172.21.15.59:0/2077747839 >> v1:172.21.15.151:6789/0 conn(0x7f870815ce60 legacy=0x7f87080cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:01.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.292+0000 7f870d1c1640 1 -- 172.21.15.59:0/2077747839 >> v1:172.21.15.59:6789/0 conn(0x7f870815ca80 legacy=0x7f87080b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:01.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.293+0000 7f870d1c1640 1 -- 172.21.15.59:0/2077747839 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87080cb560 con 0x7f87080b0720 2023-10-16T14:26:01.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.294+0000 7f870d1c1640 1 --2- 172.21.15.59:0/2077747839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87080b0720 0x7f87080cddf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f86f80097a0 tx=0x7f86f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a60e756366424f23 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:01.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.294+0000 7f870c9c0640 1 -- 172.21.15.59:0/2077747839 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8031830 con 0x7f87080b0720 2023-10-16T14:26:01.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.294+0000 7f870c9c0640 1 -- 172.21.15.59:0/2077747839 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f8031990 con 0x7f87080b0720 2023-10-16T14:26:01.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.294+0000 7f870c9c0640 1 -- 172.21.15.59:0/2077747839 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8031d20 con 0x7f87080b0720 2023-10-16T14:26:01.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.295+0000 7f870fc26640 1 -- 172.21.15.59:0/2077747839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87080b0720 msgr2=0x7f87080cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.295+0000 7f870fc26640 1 --2- 172.21.15.59:0/2077747839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87080b0720 0x7f87080cddf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f86f80097a0 tx=0x7f86f802b8d0 comp rx=0 tx=0).stop 2023-10-16T14:26:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.295+0000 7f870fc26640 1 -- 172.21.15.59:0/2077747839 shutdown_connections 2023-10-16T14:26:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.295+0000 7f870fc26640 1 --2- 172.21.15.59:0/2077747839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87080b0720 0x7f87080cddf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:01.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.295+0000 7f870fc26640 1 -- 172.21.15.59:0/2077747839 >> 172.21.15.59:0/2077747839 conn(0x7f870806c1c0 msgr2=0x7f870806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.295+0000 7f870fc26640 1 -- 172.21.15.59:0/2077747839 shutdown_connections 2023-10-16T14:26:01.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.295+0000 7f870fc26640 1 -- 172.21.15.59:0/2077747839 wait complete. 2023-10-16T14:26:01.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.297+0000 7f870fc26640 1 Processor -- start 2023-10-16T14:26:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.297+0000 7f870fc26640 1 -- start start 2023-10-16T14:26:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.298+0000 7f870fc26640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87080b0720 0x7f870814fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.298+0000 7f870fc26640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f870815ca80 0x7f870815d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.298+0000 7f870fc26640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f870815ce60 0x7f87080aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:01.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.298+0000 7f870fc26640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8708160140 con 0x7f870815ca80 2023-10-16T14:26:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.298+0000 7f870fc26640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870815f8a0 con 0x7f870815ce60 2023-10-16T14:26:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.298+0000 7f870fc26640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870815fb80 con 0x7f87080b0720 2023-10-16T14:26:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.298+0000 7f870d1c1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f870815ca80 0x7f870815d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.299+0000 7f870d1c1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f870815ca80 0x7f870815d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35814/0 (socket says 172.21.15.59:35814) 2023-10-16T14:26:01.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.299+0000 7f870d1c1640 1 -- 172.21.15.59:0/2133630655 learned_addr learned my addr 172.21.15.59:0/2133630655 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.299+0000 7f870d9c2640 1 --2- 172.21.15.59:0/2133630655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87080b0720 0x7f870814fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.299+0000 7f870e1c3640 1 --2- 172.21.15.59:0/2133630655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f870815ce60 0x7f87080aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.299+0000 7f870d1c1640 1 -- 172.21.15.59:0/2133630655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87080b0720 msgr2=0x7f870814fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.299+0000 7f870d1c1640 1 --2- 172.21.15.59:0/2133630655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87080b0720 0x7f870814fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.299+0000 7f870d1c1640 1 -- 172.21.15.59:0/2133630655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f870815ce60 msgr2=0x7f87080aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:01.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.299+0000 7f870d1c1640 1 --2- 172.21.15.59:0/2133630655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f870815ce60 0x7f87080aca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:01.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.299+0000 7f870d1c1640 1 -- 172.21.15.59:0/2133630655 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f8009400 con 0x7f870815ca80 2023-10-16T14:26:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.300+0000 7f870d1c1640 1 --2- 172.21.15.59:0/2133630655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f870815ca80 0x7f870815d2a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f86f80097a0 tx=0x7f86f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.300+0000 7f86fe7fc640 1 -- 172.21.15.59:0/2133630655 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f803aa60 con 0x7f870815ca80 2023-10-16T14:26:01.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.300+0000 7f86fe7fc640 1 -- 172.21.15.59:0/2133630655 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f803abc0 con 0x7f870815ca80 2023-10-16T14:26:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.300+0000 7f870fc26640 1 -- 172.21.15.59:0/2133630655 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870815fe60 con 0x7f870815ca80 2023-10-16T14:26:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.300+0000 7f86fe7fc640 1 -- 172.21.15.59:0/2133630655 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f80443f0 con 0x7f870815ca80 2023-10-16T14:26:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.300+0000 7f870fc26640 1 -- 172.21.15.59:0/2133630655 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87080c2570 con 0x7f870815ca80 2023-10-16T14:26:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.302+0000 7f870fc26640 1 -- 172.21.15.59:0/2133630655 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87080c2760 con 0x7f870815ca80 2023-10-16T14:26:01.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.303+0000 7f86fe7fc640 1 -- 172.21.15.59:0/2133630655 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f86f804d450 con 0x7f870815ca80 2023-10-16T14:26:01.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.304+0000 7f86fe7fc640 1 --2- 172.21.15.59:0/2133630655 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f86ec06aea0 0x7f86ec06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:01.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.304+0000 7f86fe7fc640 1 -- 172.21.15.59:0/2133630655 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86f80ab9b0 con 0x7f870815ca80 2023-10-16T14:26:01.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.304+0000 7f870d9c2640 1 --2- 172.21.15.59:0/2133630655 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f86ec06aea0 0x7f86ec06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:01.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.305+0000 7f870d9c2640 1 --2- 172.21.15.59:0/2133630655 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f86ec06aea0 0x7f86ec06d360 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8704000f60 tx=0x7f8704009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:01.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.309+0000 7f86fe7fc640 1 -- 172.21.15.59:0/2133630655 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f86f8076810 con 0x7f870815ca80 2023-10-16T14:26:01.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.507+0000 7f870fc26640 1 -- 172.21.15.59:0/2133630655 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87080cb810 con 0x7f870815ca80 2023-10-16T14:26:01.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.510+0000 7f86fe7fc640 1 -- 172.21.15.59:0/2133630655 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f86f8079e30 con 0x7f870815ca80 2023-10-16T14:26:01.514 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:01.514 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:25:53.209862+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:26:01.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.512+0000 7f870fc26640 1 -- 172.21.15.59:0/2133630655 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f86ec06aea0 msgr2=0x7f86ec06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:01.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.512+0000 7f870fc26640 1 --2- 172.21.15.59:0/2133630655 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f86ec06aea0 0x7f86ec06d360 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8704000f60 tx=0x7f8704009040 comp rx=0 tx=0).stop 2023-10-16T14:26:01.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.513+0000 7f870fc26640 1 -- 172.21.15.59:0/2133630655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f870815ca80 msgr2=0x7f870815d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:01.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.513+0000 7f870fc26640 1 --2- 172.21.15.59:0/2133630655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f870815ca80 0x7f870815d2a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f86f80097a0 tx=0x7f86f80046c0 comp rx=0 tx=0).stop 2023-10-16T14:26:01.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.513+0000 7f870fc26640 1 -- 172.21.15.59:0/2133630655 shutdown_connections 2023-10-16T14:26:01.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.513+0000 7f870fc26640 1 --2- 172.21.15.59:0/2133630655 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f86ec06aea0 0x7f86ec06d360 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:01.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.513+0000 7f870fc26640 1 --2- 172.21.15.59:0/2133630655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f870815ce60 0x7f87080aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:01.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.513+0000 7f870fc26640 1 --2- 172.21.15.59:0/2133630655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f870815ca80 0x7f870815d2a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:01.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.513+0000 7f870fc26640 1 --2- 172.21.15.59:0/2133630655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87080b0720 0x7f870814fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:01.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.513+0000 7f870fc26640 1 -- 172.21.15.59:0/2133630655 >> 172.21.15.59:0/2133630655 conn(0x7f870806c1c0 msgr2=0x7f87080abf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:01.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.513+0000 7f870fc26640 1 -- 172.21.15.59:0/2133630655 shutdown_connections 2023-10-16T14:26:01.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.513+0000 7f870fc26640 1 -- 172.21.15.59:0/2133630655 wait complete. 2023-10-16T14:26:01.536 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T14:25:46.371818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T14:25:47.145341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T14:25:50.758038+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T14:26:01.537 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:26:01.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.751+0000 7faeaecf7640 1 Processor -- start 2023-10-16T14:26:01.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.751+0000 7faeaecf7640 1 -- start start 2023-10-16T14:26:01.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.752+0000 7faeaecf7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7faea81611f0 0x7faea815cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:01.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.753+0000 7faeaecf7640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faea80cb3b0 0x7faea815d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:01.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.753+0000 7faeaecf7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea8160730 con 0x7faea815cbf0 2023-10-16T14:26:01.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.753+0000 7faeaecf7640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea815dd60 con 0x7faea80cb3b0 2023-10-16T14:26:01.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.753+0000 7faeaecf7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea81609f0 con 0x7faea81611f0 2023-10-16T14:26:01.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.753+0000 7faead294640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faea80cb3b0 0x7faea815d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:01.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.753+0000 7faea7fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7faea81611f0 0x7faea815cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:01.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.753+0000 7faea7fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7faea81611f0 0x7faea815cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.59:55218/0 (socket says 172.21.15.59:55218) 2023-10-16T14:26:01.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.753+0000 7faea7fff640 1 -- 172.21.15.59:0/1695274011 learned_addr learned my addr 172.21.15.59:0/1695274011 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:01.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.754+0000 7faea7fff640 1 -- 172.21.15.59:0/1695274011 >> v2:172.21.15.59:3300/0 conn(0x7faea80cb3b0 msgr2=0x7faea815d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:01.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.754+0000 7faea7fff640 1 --2- 172.21.15.59:0/1695274011 >> v2:172.21.15.59:3300/0 conn(0x7faea80cb3b0 0x7faea815d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:01.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.754+0000 7faea7fff640 1 -- 172.21.15.59:0/1695274011 >> v1:172.21.15.151:6789/0 conn(0x7faea815cbf0 legacy=0x7faea80caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:01.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.754+0000 7faea7fff640 1 -- 172.21.15.59:0/1695274011 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea8160cd0 con 0x7faea81611f0 2023-10-16T14:26:01.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.754+0000 7faead294640 1 --2- 172.21.15.59:0/1695274011 >> v2:172.21.15.59:3300/0 conn(0x7faea80cb3b0 0x7faea815d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:26:01.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.756+0000 7faea7fff640 1 --2- 172.21.15.59:0/1695274011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faea81611f0 0x7faea815cfd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faea806d670 tx=0x7fae9402b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e57c1ccd58a0f7c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:01.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.756+0000 7faea77fe640 1 -- 172.21.15.59:0/1695274011 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94031880 con 0x7faea81611f0 2023-10-16T14:26:01.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.757+0000 7faea77fe640 1 -- 172.21.15.59:0/1695274011 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae940319e0 con 0x7faea81611f0 2023-10-16T14:26:01.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.757+0000 7faea77fe640 1 -- 172.21.15.59:0/1695274011 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94031d70 con 0x7faea81611f0 2023-10-16T14:26:01.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.757+0000 7faeaecf7640 1 -- 172.21.15.59:0/1695274011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faea81611f0 msgr2=0x7faea815cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:01.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.757+0000 7faeaecf7640 1 --2- 172.21.15.59:0/1695274011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faea81611f0 0x7faea815cfd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faea806d670 tx=0x7fae9402b920 comp rx=0 tx=0).stop 2023-10-16T14:26:01.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.757+0000 7faeaecf7640 1 -- 172.21.15.59:0/1695274011 shutdown_connections 2023-10-16T14:26:01.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.757+0000 7faeaecf7640 1 --2- 172.21.15.59:0/1695274011 >> v2:172.21.15.59:3300/0 conn(0x7faea80cb3b0 0x7faea815d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:01.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.757+0000 7faeaecf7640 1 --2- 172.21.15.59:0/1695274011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faea81611f0 0x7faea815cfd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:01.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.757+0000 7faeaecf7640 1 -- 172.21.15.59:0/1695274011 >> 172.21.15.59:0/1695274011 conn(0x7faea80b0030 msgr2=0x7faea80b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:01.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.757+0000 7faeaecf7640 1 -- 172.21.15.59:0/1695274011 shutdown_connections 2023-10-16T14:26:01.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.757+0000 7faeaecf7640 1 -- 172.21.15.59:0/1695274011 wait complete. 2023-10-16T14:26:01.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.759+0000 7faeaecf7640 1 Processor -- start 2023-10-16T14:26:01.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.760+0000 7faeaecf7640 1 -- start start 2023-10-16T14:26:01.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.761+0000 7faeaecf7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faea80cb3b0 0x7faea8156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:01.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.761+0000 7faeaecf7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faea815cbf0 0x7faea81485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:01.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.761+0000 7faeaecf7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faea81611f0 0x7faea8144840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:01.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.761+0000 7faeaecf7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea8156660 con 0x7faea81611f0 2023-10-16T14:26:01.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.761+0000 7faeaecf7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea8148b20 con 0x7faea815cbf0 2023-10-16T14:26:01.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.761+0000 7faeaecf7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea8159c50 con 0x7faea80cb3b0 2023-10-16T14:26:01.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.761+0000 7faead294640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faea81611f0 0x7faea8144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:01.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.761+0000 7faead294640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faea81611f0 0x7faea8144840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35822/0 (socket says 172.21.15.59:35822) 2023-10-16T14:26:01.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.761+0000 7faead294640 1 -- 172.21.15.59:0/3676592493 learned_addr learned my addr 172.21.15.59:0/3676592493 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:01.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.761+0000 7faeaca93640 1 --2- 172.21.15.59:0/3676592493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faea80cb3b0 0x7faea8156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:01.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.761+0000 7faea7fff640 1 --2- 172.21.15.59:0/3676592493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faea815cbf0 0x7faea81485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:01.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.762+0000 7faead294640 1 -- 172.21.15.59:0/3676592493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faea80cb3b0 msgr2=0x7faea8156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:01.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.762+0000 7faead294640 1 --2- 172.21.15.59:0/3676592493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faea80cb3b0 0x7faea8156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:01.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.762+0000 7faead294640 1 -- 172.21.15.59:0/3676592493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faea815cbf0 msgr2=0x7faea81485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:01.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.762+0000 7faead294640 1 --2- 172.21.15.59:0/3676592493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faea815cbf0 0x7faea81485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:01.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.762+0000 7faead294640 1 -- 172.21.15.59:0/3676592493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea0009a70 con 0x7faea81611f0 2023-10-16T14:26:01.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.762+0000 7faead294640 1 --2- 172.21.15.59:0/3676592493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faea81611f0 0x7faea8144840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faea000efc0 tx=0x7faea0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:01.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.762+0000 7faea57fa640 1 -- 172.21.15.59:0/3676592493 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0009d70 con 0x7faea81611f0 2023-10-16T14:26:01.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.762+0000 7faea57fa640 1 -- 172.21.15.59:0/3676592493 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea000f040 con 0x7faea81611f0 2023-10-16T14:26:01.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.762+0000 7faea57fa640 1 -- 172.21.15.59:0/3676592493 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0003990 con 0x7faea81611f0 2023-10-16T14:26:01.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.762+0000 7faeaecf7640 1 -- 172.21.15.59:0/3676592493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae940094d0 con 0x7faea81611f0 2023-10-16T14:26:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.763+0000 7faeaecf7640 1 -- 172.21.15.59:0/3676592493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea81593b0 con 0x7faea81611f0 2023-10-16T14:26:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.764+0000 7faeaecf7640 1 -- 172.21.15.59:0/3676592493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea8073ef0 con 0x7faea81611f0 2023-10-16T14:26:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.765+0000 7faea57fa640 1 -- 172.21.15.59:0/3676592493 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faea00144a0 con 0x7faea81611f0 2023-10-16T14:26:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.766+0000 7faea57fa640 1 --2- 172.21.15.59:0/3676592493 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fae8c06ae70 0x7fae8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:01.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.766+0000 7faea57fa640 1 -- 172.21.15.59:0/3676592493 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faea008a610 con 0x7faea81611f0 2023-10-16T14:26:01.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.767+0000 7faeaca93640 1 --2- 172.21.15.59:0/3676592493 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fae8c06ae70 0x7fae8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:01.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.768+0000 7faeaca93640 1 --2- 172.21.15.59:0/3676592493 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fae8c06ae70 0x7fae8c06d330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae9c000f60 tx=0x7fae9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:01.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.770+0000 7faea57fa640 1 -- 172.21.15.59:0/3676592493 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faea0055330 con 0x7faea81611f0 2023-10-16T14:26:01.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.976+0000 7faeaecf7640 1 -- 172.21.15.59:0/3676592493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faea80cc1a0 con 0x7faea81611f0 2023-10-16T14:26:01.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.977+0000 7faea57fa640 1 -- 172.21.15.59:0/3676592493 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7faea0058950 con 0x7faea81611f0 2023-10-16T14:26:01.980 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:26:01.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.979+0000 7faeaecf7640 1 -- 172.21.15.59:0/3676592493 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fae8c06ae70 msgr2=0x7fae8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:01.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.979+0000 7faeaecf7640 1 --2- 172.21.15.59:0/3676592493 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fae8c06ae70 0x7fae8c06d330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fae9c000f60 tx=0x7fae9c009040 comp rx=0 tx=0).stop 2023-10-16T14:26:01.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.979+0000 7faeaecf7640 1 -- 172.21.15.59:0/3676592493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faea81611f0 msgr2=0x7faea8144840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:01.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.979+0000 7faeaecf7640 1 --2- 172.21.15.59:0/3676592493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faea81611f0 0x7faea8144840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faea000efc0 tx=0x7faea0009f90 comp rx=0 tx=0).stop 2023-10-16T14:26:01.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.979+0000 7faeaecf7640 1 -- 172.21.15.59:0/3676592493 shutdown_connections 2023-10-16T14:26:01.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.979+0000 7faeaecf7640 1 --2- 172.21.15.59:0/3676592493 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fae8c06ae70 0x7fae8c06d330 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:01.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.979+0000 7faeaecf7640 1 --2- 172.21.15.59:0/3676592493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faea81611f0 0x7faea8144840 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:01.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.979+0000 7faeaecf7640 1 --2- 172.21.15.59:0/3676592493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faea815cbf0 0x7faea81485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:01.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.979+0000 7faeaecf7640 1 --2- 172.21.15.59:0/3676592493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faea80cb3b0 0x7faea8156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:01.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.979+0000 7faeaecf7640 1 -- 172.21.15.59:0/3676592493 >> 172.21.15.59:0/3676592493 conn(0x7faea80b0030 msgr2=0x7faea80ac250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:01.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.980+0000 7faeaecf7640 1 -- 172.21.15.59:0/3676592493 shutdown_connections 2023-10-16T14:26:01.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:01.980+0000 7faeaecf7640 1 -- 172.21.15.59:0/3676592493 wait complete. 2023-10-16T14:26:02.003 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T14:26:02.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.219+0000 7fb7414b4640 1 Processor -- start 2023-10-16T14:26:02.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.219+0000 7fb7414b4640 1 -- start start 2023-10-16T14:26:02.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.220+0000 7fb7414b4640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb73c0ad940 0x7fb73c06c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:02.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.220+0000 7fb7414b4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb73c06cbf0 0x7fb73c0ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:02.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.220+0000 7fb7414b4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb73c0ca3a0 0x7fb73c0ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:02.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.220+0000 7fb7414b4640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73c0b34c0 con 0x7fb73c0ad940 2023-10-16T14:26:02.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.220+0000 7fb7414b4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73c0b2fd0 con 0x7fb73c06cbf0 2023-10-16T14:26:02.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.220+0000 7fb7414b4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c159ca0 con 0x7fb73c0ca3a0 2023-10-16T14:26:02.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.220+0000 7fb73bfff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb73c0ad940 0x7fb73c06c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:02.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.220+0000 7fb73bfff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb73c0ad940 0x7fb73c06c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50862/0 (socket says 172.21.15.59:50862) 2023-10-16T14:26:02.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.220+0000 7fb73bfff640 1 -- 172.21.15.59:0/792032952 learned_addr learned my addr 172.21.15.59:0/792032952 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:02.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.221+0000 7fb740cb3640 1 --2- 172.21.15.59:0/792032952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb73c0ca3a0 0x7fb73c0ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:02.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.221+0000 7fb73b7fe640 1 --2- 172.21.15.59:0/792032952 >> v2:172.21.15.151:3300/0 conn(0x7fb73c06cbf0 0x7fb73c0ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:02.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.221+0000 7fb73bfff640 1 -- 172.21.15.59:0/792032952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb73c0ca3a0 msgr2=0x7fb73c0ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:02.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.221+0000 7fb73bfff640 1 --2- 172.21.15.59:0/792032952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb73c0ca3a0 0x7fb73c0ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.221+0000 7fb73bfff640 1 -- 172.21.15.59:0/792032952 >> v2:172.21.15.151:3300/0 conn(0x7fb73c06cbf0 msgr2=0x7fb73c0ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:02.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.221+0000 7fb73bfff640 1 --2- 172.21.15.59:0/792032952 >> v2:172.21.15.151:3300/0 conn(0x7fb73c06cbf0 0x7fb73c0ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.221+0000 7fb73bfff640 1 -- 172.21.15.59:0/792032952 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73c0cac20 con 0x7fb73c0ad940 2023-10-16T14:26:02.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.222+0000 7fb73bfff640 1 --2- 172.21.15.59:0/792032952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb73c0ad940 0x7fb73c06c6b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb73c06be00 tx=0x7fb72402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b347efe3a3a7d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:02.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.222+0000 7fb73affd640 1 -- 172.21.15.59:0/792032952 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724031870 con 0x7fb73c0ad940 2023-10-16T14:26:02.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.223+0000 7fb73affd640 1 -- 172.21.15.59:0/792032952 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7240319d0 con 0x7fb73c0ad940 2023-10-16T14:26:02.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.223+0000 7fb73affd640 1 -- 172.21.15.59:0/792032952 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724031d60 con 0x7fb73c0ad940 2023-10-16T14:26:02.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.223+0000 7fb7414b4640 1 -- 172.21.15.59:0/792032952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb73c0ad940 msgr2=0x7fb73c06c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:02.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.223+0000 7fb7414b4640 1 --2- 172.21.15.59:0/792032952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb73c0ad940 0x7fb73c06c6b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb73c06be00 tx=0x7fb72402b910 comp rx=0 tx=0).stop 2023-10-16T14:26:02.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.223+0000 7fb7414b4640 1 -- 172.21.15.59:0/792032952 shutdown_connections 2023-10-16T14:26:02.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.223+0000 7fb7414b4640 1 --2- 172.21.15.59:0/792032952 >> v2:172.21.15.151:3300/0 conn(0x7fb73c06cbf0 0x7fb73c0ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.223+0000 7fb7414b4640 1 --2- 172.21.15.59:0/792032952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb73c0ca3a0 0x7fb73c0ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.223+0000 7fb7414b4640 1 --2- 172.21.15.59:0/792032952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb73c0ad940 0x7fb73c06c6b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.223+0000 7fb7414b4640 1 -- 172.21.15.59:0/792032952 >> 172.21.15.59:0/792032952 conn(0x7fb73c06a200 msgr2=0x7fb73c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.223+0000 7fb7414b4640 1 -- 172.21.15.59:0/792032952 shutdown_connections 2023-10-16T14:26:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.223+0000 7fb7414b4640 1 -- 172.21.15.59:0/792032952 wait complete. 2023-10-16T14:26:02.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.225+0000 7fb7414b4640 1 Processor -- start 2023-10-16T14:26:02.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.225+0000 7fb7414b4640 1 -- start start 2023-10-16T14:26:02.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.226+0000 7fb7414b4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb73c0ad940 0x7fb73c15a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:02.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.226+0000 7fb7414b4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb73c0ca3a0 0x7fb73c150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:02.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.226+0000 7fb7414b4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb73c070170 0x7fb73c150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:02.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.226+0000 7fb7414b4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c14fd30 con 0x7fb73c0ad940 2023-10-16T14:26:02.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.226+0000 7fb7414b4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c097ab0 con 0x7fb73c0ca3a0 2023-10-16T14:26:02.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.226+0000 7fb7414b4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c14d5b0 con 0x7fb73c070170 2023-10-16T14:26:02.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.226+0000 7fb73bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb73c0ad940 0x7fb73c15a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:02.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.227+0000 7fb73bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb73c0ad940 0x7fb73c15a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50870/0 (socket says 172.21.15.59:50870) 2023-10-16T14:26:02.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.227+0000 7fb73bfff640 1 -- 172.21.15.59:0/963732373 learned_addr learned my addr 172.21.15.59:0/963732373 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:02.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.227+0000 7fb73b7fe640 1 --2- 172.21.15.59:0/963732373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb73c0ca3a0 0x7fb73c150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:02.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.227+0000 7fb740cb3640 1 --2- 172.21.15.59:0/963732373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb73c070170 0x7fb73c150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:02.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.227+0000 7fb73bfff640 1 -- 172.21.15.59:0/963732373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb73c070170 msgr2=0x7fb73c150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:02.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.227+0000 7fb73bfff640 1 --2- 172.21.15.59:0/963732373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb73c070170 0x7fb73c150f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.227+0000 7fb73bfff640 1 -- 172.21.15.59:0/963732373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb73c0ca3a0 msgr2=0x7fb73c150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:02.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.227+0000 7fb73bfff640 1 --2- 172.21.15.59:0/963732373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb73c0ca3a0 0x7fb73c150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.227+0000 7fb73bfff640 1 -- 172.21.15.59:0/963732373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7240094d0 con 0x7fb73c0ad940 2023-10-16T14:26:02.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.227+0000 7fb73bfff640 1 --2- 172.21.15.59:0/963732373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb73c0ad940 0x7fb73c15a710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb72402b950 tx=0x7fb7240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:02.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.228+0000 7fb738ff9640 1 -- 172.21.15.59:0/963732373 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72403ad30 con 0x7fb73c0ad940 2023-10-16T14:26:02.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.228+0000 7fb738ff9640 1 -- 172.21.15.59:0/963732373 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7240443f0 con 0x7fb73c0ad940 2023-10-16T14:26:02.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.228+0000 7fb7414b4640 1 -- 172.21.15.59:0/963732373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73c14d2d0 con 0x7fb73c0ad940 2023-10-16T14:26:02.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.228+0000 7fb738ff9640 1 -- 172.21.15.59:0/963732373 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7240447a0 con 0x7fb73c0ad940 2023-10-16T14:26:02.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.228+0000 7fb7414b4640 1 -- 172.21.15.59:0/963732373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb73c150200 con 0x7fb73c0ad940 2023-10-16T14:26:02.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.229+0000 7fb7414b4640 1 -- 172.21.15.59:0/963732373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb73c0ad050 con 0x7fb73c0ad940 2023-10-16T14:26:02.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.230+0000 7fb738ff9640 1 -- 172.21.15.59:0/963732373 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb724044900 con 0x7fb73c0ad940 2023-10-16T14:26:02.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.231+0000 7fb738ff9640 1 --2- 172.21.15.59:0/963732373 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb71c06ae70 0x7fb71c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:02.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.231+0000 7fb738ff9640 1 -- 172.21.15.59:0/963732373 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb72402d040 con 0x7fb73c0ad940 2023-10-16T14:26:02.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.232+0000 7fb73b7fe640 1 --2- 172.21.15.59:0/963732373 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb71c06ae70 0x7fb71c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:02.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.233+0000 7fb73b7fe640 1 --2- 172.21.15.59:0/963732373 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb71c06ae70 0x7fb71c06d330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb73c14f320 tx=0x7fb72c003a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:02.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.239+0000 7fb738ff9640 1 -- 172.21.15.59:0/963732373 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb724076d70 con 0x7fb73c0ad940 2023-10-16T14:26:02.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.431+0000 7fb7414b4640 1 -- 172.21.15.59:0/963732373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb73c04e9b0 con 0x7fb73c0ad940 2023-10-16T14:26:02.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.432+0000 7fb738ff9640 1 -- 172.21.15.59:0/963732373 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb724035020 con 0x7fb73c0ad940 2023-10-16T14:26:02.436 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:02.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.435+0000 7fb7414b4640 1 -- 172.21.15.59:0/963732373 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb71c06ae70 msgr2=0x7fb71c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:02.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.435+0000 7fb7414b4640 1 --2- 172.21.15.59:0/963732373 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb71c06ae70 0x7fb71c06d330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb73c14f320 tx=0x7fb72c003a30 comp rx=0 tx=0).stop 2023-10-16T14:26:02.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.435+0000 7fb7414b4640 1 -- 172.21.15.59:0/963732373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb73c0ad940 msgr2=0x7fb73c15a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:02.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.435+0000 7fb7414b4640 1 --2- 172.21.15.59:0/963732373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb73c0ad940 0x7fb73c15a710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb72402b950 tx=0x7fb7240046c0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.435+0000 7fb7414b4640 1 -- 172.21.15.59:0/963732373 shutdown_connections 2023-10-16T14:26:02.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.435+0000 7fb7414b4640 1 --2- 172.21.15.59:0/963732373 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb71c06ae70 0x7fb71c06d330 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.435+0000 7fb7414b4640 1 --2- 172.21.15.59:0/963732373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb73c070170 0x7fb73c150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.435+0000 7fb7414b4640 1 --2- 172.21.15.59:0/963732373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb73c0ca3a0 0x7fb73c150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.435+0000 7fb7414b4640 1 --2- 172.21.15.59:0/963732373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb73c0ad940 0x7fb73c15a710 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.435+0000 7fb7414b4640 1 -- 172.21.15.59:0/963732373 >> 172.21.15.59:0/963732373 conn(0x7fb73c06a200 msgr2=0x7fb73c0705c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:02.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.435+0000 7fb7414b4640 1 -- 172.21.15.59:0/963732373 shutdown_connections 2023-10-16T14:26:02.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.435+0000 7fb7414b4640 1 -- 172.21.15.59:0/963732373 wait complete. 2023-10-16T14:26:02.456 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T14:26:02.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.660+0000 7f2973593640 1 Processor -- start 2023-10-16T14:26:02.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.660+0000 7f2973593640 1 -- start start 2023-10-16T14:26:02.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.662+0000 7f2973593640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f296c158f80 0x7f296c0cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:02.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.662+0000 7f2973593640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c0cb420 0x7f296c0c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:02.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.662+0000 7f2973593640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f296c06d8f0 con 0x7f296c15a130 2023-10-16T14:26:02.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.662+0000 7f2973593640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f296c0ce3c0 con 0x7f296c158f80 2023-10-16T14:26:02.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.662+0000 7f2973593640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296c0ce0e0 con 0x7f296c0cb420 2023-10-16T14:26:02.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.663+0000 7f2972591640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f296c158f80 0x7f296c0cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:02.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.663+0000 7f2972d92640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c0cb420 0x7f296c0c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:02.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.663+0000 7f2972591640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f296c158f80 0x7f296c0cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.59:45838/0 (socket says 172.21.15.59:45838) 2023-10-16T14:26:02.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.663+0000 7f2972591640 1 -- 172.21.15.59:0/1599424194 learned_addr learned my addr 172.21.15.59:0/1599424194 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:02.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.663+0000 7f2972591640 1 -- 172.21.15.59:0/1599424194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c0cb420 msgr2=0x7f296c0c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:02.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.663+0000 7f2972591640 1 --2- 172.21.15.59:0/1599424194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c0cb420 0x7f296c0c8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.663+0000 7f2972591640 1 -- 172.21.15.59:0/1599424194 >> v1:172.21.15.151:6789/0 conn(0x7f296c15a130 legacy=0x7f296c0cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:02.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.663+0000 7f2972591640 1 -- 172.21.15.59:0/1599424194 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296c06d330 con 0x7f296c158f80 2023-10-16T14:26:02.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.665+0000 7f2972591640 1 --2- 172.21.15.59:0/1599424194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c158f80 0x7f296c0cdae0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2968009870 tx=0x7f296802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31e85453d05012c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.665+0000 7f297158f640 1 -- 172.21.15.59:0/1599424194 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968030840 con 0x7f296c158f80 2023-10-16T14:26:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.665+0000 7f297158f640 1 -- 172.21.15.59:0/1599424194 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29680309a0 con 0x7f296c158f80 2023-10-16T14:26:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.665+0000 7f297158f640 1 -- 172.21.15.59:0/1599424194 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968030d30 con 0x7f296c158f80 2023-10-16T14:26:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.666+0000 7f2973593640 1 -- 172.21.15.59:0/1599424194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c158f80 msgr2=0x7f296c0cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:02.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.666+0000 7f2973593640 1 --2- 172.21.15.59:0/1599424194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c158f80 0x7f296c0cdae0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2968009870 tx=0x7f296802b980 comp rx=0 tx=0).stop 2023-10-16T14:26:02.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.666+0000 7f2973593640 1 -- 172.21.15.59:0/1599424194 shutdown_connections 2023-10-16T14:26:02.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.666+0000 7f2973593640 1 --2- 172.21.15.59:0/1599424194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c0cb420 0x7f296c0c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.666+0000 7f2973593640 1 --2- 172.21.15.59:0/1599424194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c158f80 0x7f296c0cdae0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.666+0000 7f2973593640 1 -- 172.21.15.59:0/1599424194 >> 172.21.15.59:0/1599424194 conn(0x7f296c06a200 msgr2=0x7f296c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:02.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.666+0000 7f2973593640 1 -- 172.21.15.59:0/1599424194 shutdown_connections 2023-10-16T14:26:02.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.666+0000 7f2973593640 1 -- 172.21.15.59:0/1599424194 wait complete. 2023-10-16T14:26:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.668+0000 7f2973593640 1 Processor -- start 2023-10-16T14:26:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.668+0000 7f2973593640 1 -- start start 2023-10-16T14:26:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.669+0000 7f2973593640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c0cb420 0x7f296c0c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:02.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.669+0000 7f2973593640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f296c158f80 0x7f296c0c5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.669+0000 7f2973593640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c15a130 0x7f296c1583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.669+0000 7f2973593640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c0c6bc0 con 0x7f296c158f80 2023-10-16T14:26:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.669+0000 7f2973593640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c0afd00 con 0x7f296c15a130 2023-10-16T14:26:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.669+0000 7f2973593640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296c0c31d0 con 0x7f296c0cb420 2023-10-16T14:26:02.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.669+0000 7f2971d90640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f296c158f80 0x7f296c0c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:02.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.669+0000 7f2971d90640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f296c158f80 0x7f296c0c5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50872/0 (socket says 172.21.15.59:50872) 2023-10-16T14:26:02.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.669+0000 7f2971d90640 1 -- 172.21.15.59:0/4080797463 learned_addr learned my addr 172.21.15.59:0/4080797463 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:02.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.669+0000 7f2972591640 1 --2- 172.21.15.59:0/4080797463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c0cb420 0x7f296c0c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:02.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.669+0000 7f2972d92640 1 --2- 172.21.15.59:0/4080797463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c15a130 0x7f296c1583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:02.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.670+0000 7f2971d90640 1 -- 172.21.15.59:0/4080797463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c0cb420 msgr2=0x7f296c0c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:02.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.670+0000 7f2971d90640 1 --2- 172.21.15.59:0/4080797463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c0cb420 0x7f296c0c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.670+0000 7f2971d90640 1 -- 172.21.15.59:0/4080797463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c15a130 msgr2=0x7f296c1583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:02.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.670+0000 7f2971d90640 1 --2- 172.21.15.59:0/4080797463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c15a130 0x7f296c1583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.670+0000 7f2971d90640 1 -- 172.21.15.59:0/4080797463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29680094d0 con 0x7f296c158f80 2023-10-16T14:26:02.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.670+0000 7f2971d90640 1 --2- 172.21.15.59:0/4080797463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f296c158f80 0x7f296c0c5920 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f295c00c3f0 tx=0x7f295c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:02.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.670+0000 7f2962ffd640 1 -- 172.21.15.59:0/4080797463 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c0052d0 con 0x7f296c158f80 2023-10-16T14:26:02.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.670+0000 7f2962ffd640 1 -- 172.21.15.59:0/4080797463 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c005450 con 0x7f296c158f80 2023-10-16T14:26:02.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.670+0000 7f2962ffd640 1 -- 172.21.15.59:0/4080797463 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c007260 con 0x7f296c158f80 2023-10-16T14:26:02.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.670+0000 7f2973593640 1 -- 172.21.15.59:0/4080797463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296c0c5fb0 con 0x7f296c158f80 2023-10-16T14:26:02.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.670+0000 7f2973593640 1 -- 172.21.15.59:0/4080797463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296c0c6570 con 0x7f296c158f80 2023-10-16T14:26:02.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.671+0000 7f2973593640 1 -- 172.21.15.59:0/4080797463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f296c04e9b0 con 0x7f296c158f80 2023-10-16T14:26:02.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.673+0000 7f2962ffd640 1 -- 172.21.15.59:0/4080797463 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f295c0073c0 con 0x7f296c158f80 2023-10-16T14:26:02.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.674+0000 7f2962ffd640 1 --2- 172.21.15.59:0/4080797463 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f295006ae70 0x7f295006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:02.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.674+0000 7f2962ffd640 1 -- 172.21.15.59:0/4080797463 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f295c088db0 con 0x7f296c158f80 2023-10-16T14:26:02.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.675+0000 7f2972591640 1 --2- 172.21.15.59:0/4080797463 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f295006ae70 0x7f295006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:02.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.676+0000 7f2972591640 1 --2- 172.21.15.59:0/4080797463 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f295006ae70 0x7f295006d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2968036000 tx=0x7f2968008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:02.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.679+0000 7f2962ffd640 1 -- 172.21.15.59:0/4080797463 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f295c08d070 con 0x7f296c158f80 2023-10-16T14:26:02.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.873+0000 7f2973593640 1 -- 172.21.15.59:0/4080797463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f296c0c3310 con 0x7f296c158f80 2023-10-16T14:26:02.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.874+0000 7f2962ffd640 1 -- 172.21.15.59:0/4080797463 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f295c053a40 con 0x7f296c158f80 2023-10-16T14:26:02.878 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-16T14:26:02.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.877+0000 7f2973593640 1 -- 172.21.15.59:0/4080797463 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f295006ae70 msgr2=0x7f295006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:02.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.877+0000 7f2973593640 1 --2- 172.21.15.59:0/4080797463 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f295006ae70 0x7f295006d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2968036000 tx=0x7f2968008030 comp rx=0 tx=0).stop 2023-10-16T14:26:02.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.877+0000 7f2973593640 1 -- 172.21.15.59:0/4080797463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f296c158f80 msgr2=0x7f296c0c5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:02.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.877+0000 7f2973593640 1 --2- 172.21.15.59:0/4080797463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f296c158f80 0x7f296c0c5920 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f295c00c3f0 tx=0x7f295c00c8b0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.877+0000 7f2973593640 1 -- 172.21.15.59:0/4080797463 shutdown_connections 2023-10-16T14:26:02.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.877+0000 7f2973593640 1 --2- 172.21.15.59:0/4080797463 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f295006ae70 0x7f295006d330 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.877+0000 7f2973593640 1 --2- 172.21.15.59:0/4080797463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c15a130 0x7f296c1583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.877+0000 7f2973593640 1 --2- 172.21.15.59:0/4080797463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f296c158f80 0x7f296c0c5920 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.877+0000 7f2973593640 1 --2- 172.21.15.59:0/4080797463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c0cb420 0x7f296c0c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:02.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.877+0000 7f2973593640 1 -- 172.21.15.59:0/4080797463 >> 172.21.15.59:0/4080797463 conn(0x7f296c06a200 msgr2=0x7f296c167600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:02.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.877+0000 7f2973593640 1 -- 172.21.15.59:0/4080797463 shutdown_connections 2023-10-16T14:26:02.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:02.877+0000 7f2973593640 1 -- 172.21.15.59:0/4080797463 wait complete. 2023-10-16T14:26:02.899 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T14:26:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.126+0000 7fd95359e640 1 Processor -- start 2023-10-16T14:26:03.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.126+0000 7fd95359e640 1 -- start start 2023-10-16T14:26:03.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.128+0000 7fd95359e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd95415c940 0x7fd9540d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.128+0000 7fd95359e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd9540b6fe0 0x7fd9540d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.128+0000 7fd95359e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9540ce810 con 0x7fd9540d0d80 2023-10-16T14:26:03.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.128+0000 7fd95359e640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9540d1740 con 0x7fd95415c940 2023-10-16T14:26:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.128+0000 7fd95359e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9540b5b40 con 0x7fd9540b6fe0 2023-10-16T14:26:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.128+0000 7fd95259c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd95415c940 0x7fd9540d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.128+0000 7fd94bfff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd9540d0d80 0x7fd954160520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38240/0 (socket says 172.21.15.59:38240) 2023-10-16T14:26:03.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.128+0000 7fd94bfff640 1 -- 172.21.15.59:0/2121197935 learned_addr learned my addr 172.21.15.59:0/2121197935 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.129+0000 7fd952d9d640 1 --2- 172.21.15.59:0/2121197935 >> v2:172.21.15.151:3300/0 conn(0x7fd9540b6fe0 0x7fd9540d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.129+0000 7fd95259c640 1 -- 172.21.15.59:0/2121197935 >> v2:172.21.15.151:3300/0 conn(0x7fd9540b6fe0 msgr2=0x7fd9540d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.129+0000 7fd95259c640 1 --2- 172.21.15.59:0/2121197935 >> v2:172.21.15.151:3300/0 conn(0x7fd9540b6fe0 0x7fd9540d1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.129+0000 7fd95259c640 1 -- 172.21.15.59:0/2121197935 >> v1:172.21.15.59:6789/0 conn(0x7fd9540d0d80 legacy=0x7fd954160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.129+0000 7fd951d9b640 1 -- 172.21.15.59:0/2121197935 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496777326 0 0) 0x7fd9540ce810 con 0x7fd9540d0d80 2023-10-16T14:26:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.129+0000 7fd95259c640 1 -- 172.21.15.59:0/2121197935 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9540ce250 con 0x7fd95415c940 2023-10-16T14:26:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.130+0000 7fd95259c640 1 --2- 172.21.15.59:0/2121197935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95415c940 0x7fd9540d0400 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd954160460 tx=0x7fd94402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09cb33a3d0645b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.130+0000 7fd951d9b640 1 -- 172.21.15.59:0/2121197935 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94402e070 con 0x7fd95415c940 2023-10-16T14:26:03.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.130+0000 7fd951d9b640 1 -- 172.21.15.59:0/2121197935 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9440315a0 con 0x7fd95415c940 2023-10-16T14:26:03.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.130+0000 7fd951d9b640 1 -- 172.21.15.59:0/2121197935 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd944031930 con 0x7fd95415c940 2023-10-16T14:26:03.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.131+0000 7fd95359e640 1 -- 172.21.15.59:0/2121197935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95415c940 msgr2=0x7fd9540d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:03.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.131+0000 7fd95359e640 1 --2- 172.21.15.59:0/2121197935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95415c940 0x7fd9540d0400 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd954160460 tx=0x7fd94402b840 comp rx=0 tx=0).stop 2023-10-16T14:26:03.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.131+0000 7fd95359e640 1 -- 172.21.15.59:0/2121197935 shutdown_connections 2023-10-16T14:26:03.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.131+0000 7fd95359e640 1 --2- 172.21.15.59:0/2121197935 >> v2:172.21.15.151:3300/0 conn(0x7fd9540b6fe0 0x7fd9540d1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.131+0000 7fd95359e640 1 --2- 172.21.15.59:0/2121197935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95415c940 0x7fd9540d0400 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.131+0000 7fd95359e640 1 -- 172.21.15.59:0/2121197935 >> 172.21.15.59:0/2121197935 conn(0x7fd95409bb30 msgr2=0x7fd9540d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:03.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.132+0000 7fd95359e640 1 -- 172.21.15.59:0/2121197935 shutdown_connections 2023-10-16T14:26:03.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.132+0000 7fd95359e640 1 -- 172.21.15.59:0/2121197935 wait complete. 2023-10-16T14:26:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.133+0000 7fd95359e640 1 Processor -- start 2023-10-16T14:26:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.134+0000 7fd95359e640 1 -- start start 2023-10-16T14:26:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.134+0000 7fd95359e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9540b6fe0 0x7fd95415cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.134+0000 7fd95359e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9540d0d80 0x7fd954151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:03.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.135+0000 7fd95359e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95415c940 0x7fd954152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:03.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.135+0000 7fd95359e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95415e290 con 0x7fd95415c940 2023-10-16T14:26:03.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.135+0000 7fd95359e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9540b7c80 con 0x7fd9540b6fe0 2023-10-16T14:26:03.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.135+0000 7fd95359e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95415d680 con 0x7fd9540d0d80 2023-10-16T14:26:03.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.135+0000 7fd952d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95415c940 0x7fd954152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:03.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.135+0000 7fd952d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95415c940 0x7fd954152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50894/0 (socket says 172.21.15.59:50894) 2023-10-16T14:26:03.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.135+0000 7fd952d9d640 1 -- 172.21.15.59:0/1773557126 learned_addr learned my addr 172.21.15.59:0/1773557126 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:03.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.135+0000 7fd95259c640 1 --2- 172.21.15.59:0/1773557126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9540b6fe0 0x7fd95415cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:03.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.135+0000 7fd94bfff640 1 --2- 172.21.15.59:0/1773557126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9540d0d80 0x7fd954151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:03.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.135+0000 7fd952d9d640 1 -- 172.21.15.59:0/1773557126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9540d0d80 msgr2=0x7fd954151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:03.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.135+0000 7fd952d9d640 1 --2- 172.21.15.59:0/1773557126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9540d0d80 0x7fd954151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.135+0000 7fd952d9d640 1 -- 172.21.15.59:0/1773557126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9540b6fe0 msgr2=0x7fd95415cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:03.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.135+0000 7fd952d9d640 1 --2- 172.21.15.59:0/1773557126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9540b6fe0 0x7fd95415cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.135+0000 7fd952d9d640 1 -- 172.21.15.59:0/1773557126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd944009400 con 0x7fd95415c940 2023-10-16T14:26:03.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.136+0000 7fd952d9d640 1 --2- 172.21.15.59:0/1773557126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95415c940 0x7fd954152f60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd94c007e60 tx=0x7fd94c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.136+0000 7fd94affd640 1 -- 172.21.15.59:0/1773557126 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c014420 con 0x7fd95415c940 2023-10-16T14:26:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.136+0000 7fd94affd640 1 -- 172.21.15.59:0/1773557126 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c0145a0 con 0x7fd95415c940 2023-10-16T14:26:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.136+0000 7fd94affd640 1 -- 172.21.15.59:0/1773557126 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c014950 con 0x7fd95415c940 2023-10-16T14:26:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.136+0000 7fd95359e640 1 -- 172.21.15.59:0/1773557126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd95415d960 con 0x7fd95415c940 2023-10-16T14:26:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.136+0000 7fd95359e640 1 -- 172.21.15.59:0/1773557126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95415df20 con 0x7fd95415c940 2023-10-16T14:26:03.146 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.137+0000 7fd95359e640 1 -- 172.21.15.59:0/1773557126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95415e400 con 0x7fd95415c940 2023-10-16T14:26:03.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.138+0000 7fd94affd640 1 -- 172.21.15.59:0/1773557126 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd94c014ab0 con 0x7fd95415c940 2023-10-16T14:26:03.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.139+0000 7fd94affd640 1 --2- 172.21.15.59:0/1773557126 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd93406ae70 0x7fd93406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:03.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.139+0000 7fd94affd640 1 -- 172.21.15.59:0/1773557126 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd94c08a2f0 con 0x7fd95415c940 2023-10-16T14:26:03.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.140+0000 7fd95259c640 1 --2- 172.21.15.59:0/1773557126 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd93406ae70 0x7fd93406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:03.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.141+0000 7fd95259c640 1 --2- 172.21.15.59:0/1773557126 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd93406ae70 0x7fd93406d330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd944036000 tx=0x7fd944008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:03.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.143+0000 7fd94affd640 1 -- 172.21.15.59:0/1773557126 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd94c055010 con 0x7fd95415c940 2023-10-16T14:26:03.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.336+0000 7fd95359e640 1 -- 172.21.15.59:0/1773557126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd95404e9b0 con 0x7fd95415c940 2023-10-16T14:26:03.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.337+0000 7fd94affd640 1 -- 172.21.15.59:0/1773557126 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd94c058630 con 0x7fd95415c940 2023-10-16T14:26:03.341 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:03.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.340+0000 7fd95359e640 1 -- 172.21.15.59:0/1773557126 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd93406ae70 msgr2=0x7fd93406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:03.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.340+0000 7fd95359e640 1 --2- 172.21.15.59:0/1773557126 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd93406ae70 0x7fd93406d330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd944036000 tx=0x7fd944008030 comp rx=0 tx=0).stop 2023-10-16T14:26:03.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.340+0000 7fd95359e640 1 -- 172.21.15.59:0/1773557126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95415c940 msgr2=0x7fd954152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:03.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.340+0000 7fd95359e640 1 --2- 172.21.15.59:0/1773557126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95415c940 0x7fd954152f60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd94c007e60 tx=0x7fd94c00e4b0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.340+0000 7fd95359e640 1 -- 172.21.15.59:0/1773557126 shutdown_connections 2023-10-16T14:26:03.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.340+0000 7fd95359e640 1 --2- 172.21.15.59:0/1773557126 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd93406ae70 0x7fd93406d330 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.340+0000 7fd95359e640 1 --2- 172.21.15.59:0/1773557126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95415c940 0x7fd954152f60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.340+0000 7fd95359e640 1 --2- 172.21.15.59:0/1773557126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9540d0d80 0x7fd954151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.340+0000 7fd95359e640 1 --2- 172.21.15.59:0/1773557126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9540b6fe0 0x7fd95415cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.340+0000 7fd95359e640 1 -- 172.21.15.59:0/1773557126 >> 172.21.15.59:0/1773557126 conn(0x7fd95409bb30 msgr2=0x7fd9540cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:03.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.340+0000 7fd95359e640 1 -- 172.21.15.59:0/1773557126 shutdown_connections 2023-10-16T14:26:03.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.340+0000 7fd95359e640 1 -- 172.21.15.59:0/1773557126 wait complete. 2023-10-16T14:26:03.362 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T14:26:03.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.586+0000 7f2e4c0a2640 1 Processor -- start 2023-10-16T14:26:03.590 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.586+0000 7f2e4c0a2640 1 -- start start 2023-10-16T14:26:03.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.587+0000 7f2e4c0a2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e4415aa60 0x7f2e440c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:03.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.587+0000 7f2e4c0a2640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e4406c760 0x7f2e440b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:03.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.587+0000 7f2e4c0a2640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4415ae40 con 0x7f2e440b06f0 2023-10-16T14:26:03.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.587+0000 7f2e4c0a2640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e440b0b80 con 0x7f2e4406c760 2023-10-16T14:26:03.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.587+0000 7f2e4c0a2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4406cbc0 con 0x7f2e4415aa60 2023-10-16T14:26:03.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.588+0000 7f2e4963d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e4406c760 0x7f2e440b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:03.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.588+0000 7f2e4963d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e4406c760 0x7f2e440b01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50896/0 (socket says 172.21.15.59:50896) 2023-10-16T14:26:03.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.588+0000 7f2e4963d640 1 -- 172.21.15.59:0/468275548 learned_addr learned my addr 172.21.15.59:0/468275548 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:03.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.588+0000 7f2e49e3e640 1 --2- 172.21.15.59:0/468275548 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e4415aa60 0x7f2e440c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:03.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.589+0000 7f2e4963d640 1 -- 172.21.15.59:0/468275548 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e4415aa60 msgr2=0x7f2e440c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:03.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.589+0000 7f2e4963d640 1 --2- 172.21.15.59:0/468275548 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e4415aa60 0x7f2e440c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.589+0000 7f2e4963d640 1 -- 172.21.15.59:0/468275548 >> v1:172.21.15.151:6789/0 conn(0x7f2e440b06f0 legacy=0x7f2e44070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:03.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.589+0000 7f2e4963d640 1 -- 172.21.15.59:0/468275548 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e440b1580 con 0x7f2e4406c760 2023-10-16T14:26:03.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.590+0000 7f2e4963d640 1 --2- 172.21.15.59:0/468275548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e4406c760 0x7f2e440b01b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2e34009870 tx=0x7f2e3402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4939c675bb42d02c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:03.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.591+0000 7f2e48e3c640 1 -- 172.21.15.59:0/468275548 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34031640 con 0x7f2e4406c760 2023-10-16T14:26:03.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.591+0000 7f2e48e3c640 1 -- 172.21.15.59:0/468275548 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e340317a0 con 0x7f2e4406c760 2023-10-16T14:26:03.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.591+0000 7f2e48e3c640 1 -- 172.21.15.59:0/468275548 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34031b30 con 0x7f2e4406c760 2023-10-16T14:26:03.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.591+0000 7f2e4c0a2640 1 -- 172.21.15.59:0/468275548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e4406c760 msgr2=0x7f2e440b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:03.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.591+0000 7f2e4c0a2640 1 --2- 172.21.15.59:0/468275548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e4406c760 0x7f2e440b01b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2e34009870 tx=0x7f2e3402b8f0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.591+0000 7f2e4c0a2640 1 -- 172.21.15.59:0/468275548 shutdown_connections 2023-10-16T14:26:03.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.591+0000 7f2e4c0a2640 1 --2- 172.21.15.59:0/468275548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e4406c760 0x7f2e440b01b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.591+0000 7f2e4c0a2640 1 --2- 172.21.15.59:0/468275548 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e4415aa60 0x7f2e440c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.591+0000 7f2e4c0a2640 1 -- 172.21.15.59:0/468275548 >> 172.21.15.59:0/468275548 conn(0x7f2e440cb1b0 msgr2=0x7f2e440cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:03.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.592+0000 7f2e4c0a2640 1 -- 172.21.15.59:0/468275548 shutdown_connections 2023-10-16T14:26:03.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.592+0000 7f2e4c0a2640 1 -- 172.21.15.59:0/468275548 wait complete. 2023-10-16T14:26:03.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.593+0000 7f2e4c0a2640 1 Processor -- start 2023-10-16T14:26:03.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.593+0000 7f2e4c0a2640 1 -- start start 2023-10-16T14:26:03.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.594+0000 7f2e4c0a2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e4406c760 0x7f2e4415c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:03.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.594+0000 7f2e4c0a2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e440b06f0 0x7f2e4415bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:03.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.594+0000 7f2e4c0a2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e4415aa60 0x7f2e440c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:03.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.594+0000 7f2e4c0a2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4415bff0 con 0x7f2e440b06f0 2023-10-16T14:26:03.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.594+0000 7f2e4c0a2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e441eff20 con 0x7f2e4406c760 2023-10-16T14:26:03.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.594+0000 7f2e4c0a2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4415ccc0 con 0x7f2e4415aa60 2023-10-16T14:26:03.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.595+0000 7f2e4963d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e440b06f0 0x7f2e4415bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:03.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.595+0000 7f2e4963d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e440b06f0 0x7f2e4415bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50910/0 (socket says 172.21.15.59:50910) 2023-10-16T14:26:03.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.595+0000 7f2e4963d640 1 -- 172.21.15.59:0/3889919903 learned_addr learned my addr 172.21.15.59:0/3889919903 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:03.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.595+0000 7f2e49e3e640 1 --2- 172.21.15.59:0/3889919903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e4406c760 0x7f2e4415c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:03.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.595+0000 7f2e4963d640 1 -- 172.21.15.59:0/3889919903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e4415aa60 msgr2=0x7f2e440c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:03.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.595+0000 7f2e4963d640 1 --2- 172.21.15.59:0/3889919903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e4415aa60 0x7f2e440c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.595+0000 7f2e4963d640 1 -- 172.21.15.59:0/3889919903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e4406c760 msgr2=0x7f2e4415c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:03.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.595+0000 7f2e4963d640 1 --2- 172.21.15.59:0/3889919903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e4406c760 0x7f2e4415c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.595+0000 7f2e4963d640 1 -- 172.21.15.59:0/3889919903 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e340094d0 con 0x7f2e440b06f0 2023-10-16T14:26:03.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.596+0000 7f2e4963d640 1 --2- 172.21.15.59:0/3889919903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e440b06f0 0x7f2e4415bab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2e34000c00 tx=0x7f2e340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:03.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.596+0000 7f2e3a7fc640 1 -- 172.21.15.59:0/3889919903 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3403a930 con 0x7f2e440b06f0 2023-10-16T14:26:03.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.596+0000 7f2e3a7fc640 1 -- 172.21.15.59:0/3889919903 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3403aa90 con 0x7f2e440b06f0 2023-10-16T14:26:03.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.596+0000 7f2e3a7fc640 1 -- 172.21.15.59:0/3889919903 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3403ae40 con 0x7f2e440b06f0 2023-10-16T14:26:03.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.596+0000 7f2e4c0a2640 1 -- 172.21.15.59:0/3889919903 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4415cfa0 con 0x7f2e440b06f0 2023-10-16T14:26:03.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.596+0000 7f2e4c0a2640 1 -- 172.21.15.59:0/3889919903 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4415d560 con 0x7f2e440b06f0 2023-10-16T14:26:03.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.597+0000 7f2e27fff640 1 -- 172.21.15.59:0/3889919903 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e440cafb0 con 0x7f2e440b06f0 2023-10-16T14:26:03.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.598+0000 7f2e3a7fc640 1 -- 172.21.15.59:0/3889919903 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2e3402f050 con 0x7f2e440b06f0 2023-10-16T14:26:03.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.599+0000 7f2e3a7fc640 1 --2- 172.21.15.59:0/3889919903 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f2e2806ae70 0x7f2e2806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:03.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.599+0000 7f2e3a7fc640 1 -- 172.21.15.59:0/3889919903 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2e340ab750 con 0x7f2e440b06f0 2023-10-16T14:26:03.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.600+0000 7f2e49e3e640 1 --2- 172.21.15.59:0/3889919903 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f2e2806ae70 0x7f2e2806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:03.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.601+0000 7f2e49e3e640 1 --2- 172.21.15.59:0/3889919903 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f2e2806ae70 0x7f2e2806d330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009970 tx=0x7f2e40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:03.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.603+0000 7f2e3a7fc640 1 -- 172.21.15.59:0/3889919903 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2e34076500 con 0x7f2e440b06f0 2023-10-16T14:26:03.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.815+0000 7f2e27fff640 1 -- 172.21.15.59:0/3889919903 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2e44073ef0 con 0x7f2e440b06f0 2023-10-16T14:26:03.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.816+0000 7f2e3a7fc640 1 -- 172.21.15.59:0/3889919903 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2e34079b20 con 0x7f2e440b06f0 2023-10-16T14:26:03.820 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2023-10-16T14:26:03.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.818+0000 7f2e27fff640 1 -- 172.21.15.59:0/3889919903 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f2e2806ae70 msgr2=0x7f2e2806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:03.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.818+0000 7f2e27fff640 1 --2- 172.21.15.59:0/3889919903 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f2e2806ae70 0x7f2e2806d330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009970 tx=0x7f2e40008040 comp rx=0 tx=0).stop 2023-10-16T14:26:03.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.818+0000 7f2e27fff640 1 -- 172.21.15.59:0/3889919903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e440b06f0 msgr2=0x7f2e4415bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:03.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.818+0000 7f2e27fff640 1 --2- 172.21.15.59:0/3889919903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e440b06f0 0x7f2e4415bab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2e34000c00 tx=0x7f2e340046c0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.818+0000 7f2e27fff640 1 -- 172.21.15.59:0/3889919903 shutdown_connections 2023-10-16T14:26:03.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.818+0000 7f2e27fff640 1 --2- 172.21.15.59:0/3889919903 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f2e2806ae70 0x7f2e2806d330 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.818+0000 7f2e27fff640 1 --2- 172.21.15.59:0/3889919903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e4415aa60 0x7f2e440c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.818+0000 7f2e27fff640 1 --2- 172.21.15.59:0/3889919903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e440b06f0 0x7f2e4415bab0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.818+0000 7f2e27fff640 1 --2- 172.21.15.59:0/3889919903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e4406c760 0x7f2e4415c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:03.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.819+0000 7f2e27fff640 1 -- 172.21.15.59:0/3889919903 >> 172.21.15.59:0/3889919903 conn(0x7f2e440cb1b0 msgr2=0x7f2e440b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:03.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.819+0000 7f2e27fff640 1 -- 172.21.15.59:0/3889919903 shutdown_connections 2023-10-16T14:26:03.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:03.819+0000 7f2e27fff640 1 -- 172.21.15.59:0/3889919903 wait complete. 2023-10-16T14:26:03.841 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:26:03.842 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T14:26:03.898 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:26:04.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.121+0000 7fb5fef93640 1 Processor -- start 2023-10-16T14:26:04.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.122+0000 7fb5fef93640 1 -- start start 2023-10-16T14:26:04.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.123+0000 7fb5fef93640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb5f80d16a0 0x7fb5f80cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:04.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.123+0000 7fb5fef93640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb5f80cf680 0x7fb5f80b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:04.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.123+0000 7fb5fef93640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f80cfa90 con 0x7fb5f815c9d0 2023-10-16T14:26:04.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.123+0000 7fb5fef93640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f80d0320 con 0x7fb5f80d16a0 2023-10-16T14:26:04.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.123+0000 7fb5fef93640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f80d0600 con 0x7fb5f80cf680 2023-10-16T14:26:04.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.123+0000 7fb5fdf91640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb5f815c9d0 0x7fb5f80cdf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38246/0 (socket says 172.21.15.59:38246) 2023-10-16T14:26:04.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.123+0000 7fb5fdf91640 1 -- 172.21.15.59:0/1671027342 learned_addr learned my addr 172.21.15.59:0/1671027342 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:04.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.124+0000 7fb5fd790640 1 --2- 172.21.15.59:0/1671027342 >> v2:172.21.15.59:3300/0 conn(0x7fb5f80d16a0 0x7fb5f80cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:04.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.124+0000 7fb5fcf8f640 1 -- 172.21.15.59:0/1671027342 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2456267122 0 0) 0x7fb5f80cfa90 con 0x7fb5f815c9d0 2023-10-16T14:26:04.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.124+0000 7fb5fe792640 1 --2- 172.21.15.59:0/1671027342 >> v2:172.21.15.151:3300/0 conn(0x7fb5f80cf680 0x7fb5f80b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:04.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.124+0000 7fb5fcf8f640 1 -- 172.21.15.59:0/1671027342 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5e4003520 con 0x7fb5f815c9d0 2023-10-16T14:26:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.124+0000 7fb5fd790640 1 -- 172.21.15.59:0/1671027342 >> v2:172.21.15.151:3300/0 conn(0x7fb5f80cf680 msgr2=0x7fb5f80b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.124+0000 7fb5fd790640 1 --2- 172.21.15.59:0/1671027342 >> v2:172.21.15.151:3300/0 conn(0x7fb5f80cf680 0x7fb5f80b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.124+0000 7fb5fd790640 1 -- 172.21.15.59:0/1671027342 >> v1:172.21.15.59:6789/0 conn(0x7fb5f815c9d0 legacy=0x7fb5f80cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.124+0000 7fb5fd790640 1 -- 172.21.15.59:0/1671027342 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f80d08e0 con 0x7fb5f80d16a0 2023-10-16T14:26:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.125+0000 7fb5fd790640 1 --2- 172.21.15.59:0/1671027342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5f80d16a0 0x7fb5f80cf140 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8160470 tx=0x7fb5ec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663f1547d6216e4a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:04.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.126+0000 7fb5fcf8f640 1 -- 172.21.15.59:0/1671027342 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec031830 con 0x7fb5f80d16a0 2023-10-16T14:26:04.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.126+0000 7fb5fcf8f640 1 -- 172.21.15.59:0/1671027342 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ec031990 con 0x7fb5f80d16a0 2023-10-16T14:26:04.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.126+0000 7fb5fcf8f640 1 -- 172.21.15.59:0/1671027342 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec031d00 con 0x7fb5f80d16a0 2023-10-16T14:26:04.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.126+0000 7fb5fef93640 1 -- 172.21.15.59:0/1671027342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5f80d16a0 msgr2=0x7fb5f80cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:04.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.126+0000 7fb5fef93640 1 --2- 172.21.15.59:0/1671027342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5f80d16a0 0x7fb5f80cf140 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8160470 tx=0x7fb5ec02b8d0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.126+0000 7fb5fef93640 1 -- 172.21.15.59:0/1671027342 shutdown_connections 2023-10-16T14:26:04.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.126+0000 7fb5fef93640 1 --2- 172.21.15.59:0/1671027342 >> v2:172.21.15.151:3300/0 conn(0x7fb5f80cf680 0x7fb5f80b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.126+0000 7fb5fef93640 1 --2- 172.21.15.59:0/1671027342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5f80d16a0 0x7fb5f80cf140 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.126+0000 7fb5fef93640 1 -- 172.21.15.59:0/1671027342 >> 172.21.15.59:0/1671027342 conn(0x7fb5f809bad0 msgr2=0x7fb5f80d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:04.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.127+0000 7fb5fef93640 1 -- 172.21.15.59:0/1671027342 shutdown_connections 2023-10-16T14:26:04.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.127+0000 7fb5fef93640 1 -- 172.21.15.59:0/1671027342 wait complete. 2023-10-16T14:26:04.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.128+0000 7fb5fef93640 1 Processor -- start 2023-10-16T14:26:04.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.128+0000 7fb5fef93640 1 -- start start 2023-10-16T14:26:04.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.129+0000 7fb5fef93640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5f80cf680 0x7fb5f814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:04.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.129+0000 7fb5fef93640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5f80d16a0 0x7fb5f81f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:04.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.129+0000 7fb5fef93640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5f815c9d0 0x7fb5f81f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:04.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.129+0000 7fb5fef93640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f81f64d0 con 0x7fb5f80cf680 2023-10-16T14:26:04.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.129+0000 7fb5fef93640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f81f67b0 con 0x7fb5f815c9d0 2023-10-16T14:26:04.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.129+0000 7fb5fef93640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f81f6a90 con 0x7fb5f80d16a0 2023-10-16T14:26:04.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.130+0000 7fb5fdf91640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5f80cf680 0x7fb5f814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:04.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.130+0000 7fb5fdf91640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5f80cf680 0x7fb5f814cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50924/0 (socket says 172.21.15.59:50924) 2023-10-16T14:26:04.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.130+0000 7fb5fdf91640 1 -- 172.21.15.59:0/3992994004 learned_addr learned my addr 172.21.15.59:0/3992994004 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:04.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.130+0000 7fb5fe792640 1 --2- 172.21.15.59:0/3992994004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5f815c9d0 0x7fb5f81f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:04.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.130+0000 7fb5fd790640 1 --2- 172.21.15.59:0/3992994004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5f80d16a0 0x7fb5f81f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:04.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.130+0000 7fb5fdf91640 1 -- 172.21.15.59:0/3992994004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5f80d16a0 msgr2=0x7fb5f81f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:04.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.130+0000 7fb5fdf91640 1 --2- 172.21.15.59:0/3992994004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5f80d16a0 0x7fb5f81f5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.130+0000 7fb5fdf91640 1 -- 172.21.15.59:0/3992994004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5f815c9d0 msgr2=0x7fb5f81f2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:04.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.130+0000 7fb5fdf91640 1 --2- 172.21.15.59:0/3992994004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5f815c9d0 0x7fb5f81f2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.130+0000 7fb5fdf91640 1 -- 172.21.15.59:0/3992994004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec009400 con 0x7fb5f80cf680 2023-10-16T14:26:04.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.130+0000 7fb5fd790640 1 --2- 172.21.15.59:0/3992994004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5f80d16a0 0x7fb5f81f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:04.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.131+0000 7fb5fdf91640 1 --2- 172.21.15.59:0/3992994004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5f80cf680 0x7fb5f814cb20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400c390 tx=0x7fb5f400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:04.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.131+0000 7fb5ea7fc640 1 -- 172.21.15.59:0/3992994004 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4005ce0 con 0x7fb5f80cf680 2023-10-16T14:26:04.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.131+0000 7fb5ea7fc640 1 -- 172.21.15.59:0/3992994004 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f4005e40 con 0x7fb5f80cf680 2023-10-16T14:26:04.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.131+0000 7fb5ea7fc640 1 -- 172.21.15.59:0/3992994004 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40072f0 con 0x7fb5f80cf680 2023-10-16T14:26:04.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.131+0000 7fb5fef93640 1 -- 172.21.15.59:0/3992994004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f81f26f0 con 0x7fb5f80cf680 2023-10-16T14:26:04.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.131+0000 7fb5fef93640 1 -- 172.21.15.59:0/3992994004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f814d060 con 0x7fb5f80cf680 2023-10-16T14:26:04.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.132+0000 7fb5fef93640 1 -- 172.21.15.59:0/3992994004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f804e9b0 con 0x7fb5f80cf680 2023-10-16T14:26:04.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.133+0000 7fb5ea7fc640 1 -- 172.21.15.59:0/3992994004 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb5f4007450 con 0x7fb5f80cf680 2023-10-16T14:26:04.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.134+0000 7fb5ea7fc640 1 --2- 172.21.15.59:0/3992994004 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb5dc06ae70 0x7fb5dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:04.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.134+0000 7fb5ea7fc640 1 -- 172.21.15.59:0/3992994004 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb5f4088fc0 con 0x7fb5f80cf680 2023-10-16T14:26:04.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.135+0000 7fb5fd790640 1 --2- 172.21.15.59:0/3992994004 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb5dc06ae70 0x7fb5dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:04.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.136+0000 7fb5fd790640 1 --2- 172.21.15.59:0/3992994004 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb5dc06ae70 0x7fb5dc06d330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec036000 tx=0x7fb5ec008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:04.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.138+0000 7fb5ea7fc640 1 -- 172.21.15.59:0/3992994004 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb5f4053ce0 con 0x7fb5f80cf680 2023-10-16T14:26:04.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.334+0000 7fb5fef93640 1 -- 172.21.15.59:0/3992994004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5f80d3320 con 0x7fb5f80cf680 2023-10-16T14:26:04.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.336+0000 7fb5ea7fc640 1 -- 172.21.15.59:0/3992994004 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18350 (secure 0 0 0) 0x7fb5f4017020 con 0x7fb5f80cf680 2023-10-16T14:26:04.340 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:04.340 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:25:53.209862+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:26:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.338+0000 7fb5fef93640 1 -- 172.21.15.59:0/3992994004 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb5dc06ae70 msgr2=0x7fb5dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:04.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.338+0000 7fb5fef93640 1 --2- 172.21.15.59:0/3992994004 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb5dc06ae70 0x7fb5dc06d330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec036000 tx=0x7fb5ec008030 comp rx=0 tx=0).stop 2023-10-16T14:26:04.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.338+0000 7fb5fef93640 1 -- 172.21.15.59:0/3992994004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5f80cf680 msgr2=0x7fb5f814cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:04.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.338+0000 7fb5fef93640 1 --2- 172.21.15.59:0/3992994004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5f80cf680 0x7fb5f814cb20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400c390 tx=0x7fb5f400c850 comp rx=0 tx=0).stop 2023-10-16T14:26:04.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.339+0000 7fb5fef93640 1 -- 172.21.15.59:0/3992994004 shutdown_connections 2023-10-16T14:26:04.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.339+0000 7fb5fef93640 1 --2- 172.21.15.59:0/3992994004 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb5dc06ae70 0x7fb5dc06d330 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.339+0000 7fb5fef93640 1 --2- 172.21.15.59:0/3992994004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5f815c9d0 0x7fb5f81f2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.339+0000 7fb5fef93640 1 --2- 172.21.15.59:0/3992994004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5f80d16a0 0x7fb5f81f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.339+0000 7fb5fef93640 1 --2- 172.21.15.59:0/3992994004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5f80cf680 0x7fb5f814cb20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.339+0000 7fb5fef93640 1 -- 172.21.15.59:0/3992994004 >> 172.21.15.59:0/3992994004 conn(0x7fb5f809bad0 msgr2=0x7fb5f80b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:04.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.339+0000 7fb5fef93640 1 -- 172.21.15.59:0/3992994004 shutdown_connections 2023-10-16T14:26:04.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.339+0000 7fb5fef93640 1 -- 172.21.15.59:0/3992994004 wait complete. 2023-10-16T14:26:04.361 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T14:25:46.371818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T14:25:47.145341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T14:25:50.758038+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T14:26:04.362 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:26:04.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.589+0000 7f367ce26640 1 Processor -- start 2023-10-16T14:26:04.592 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.589+0000 7f367ce26640 1 -- start start 2023-10-16T14:26:04.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.590+0000 7f367ce26640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f367815cbf0 0x7f36780d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.591+0000 7f367ce26640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36780b4410 0x7f36780b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.591+0000 7f367ce26640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367815cfd0 con 0x7f36780b8400 2023-10-16T14:26:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.591+0000 7f367ce26640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36780d0dc0 con 0x7f367815cbf0 2023-10-16T14:26:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.591+0000 7f367ce26640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36780d18f0 con 0x7f36780b4410 2023-10-16T14:26:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.591+0000 7f367659c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f367815cbf0 0x7f36780d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.591+0000 7f3675d9b640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f36780b8400 0x7f36780d11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38252/0 (socket says 172.21.15.59:38252) 2023-10-16T14:26:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.591+0000 7f367659c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f367815cbf0 0x7f36780d29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50938/0 (socket says 172.21.15.59:50938) 2023-10-16T14:26:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.591+0000 7f3675d9b640 1 -- 172.21.15.59:0/3327872864 learned_addr learned my addr 172.21.15.59:0/3327872864 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.591+0000 7f3676d9d640 1 --2- 172.21.15.59:0/3327872864 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36780b4410 0x7f36780b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.592+0000 7f367659c640 1 -- 172.21.15.59:0/3327872864 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36780b4410 msgr2=0x7f36780b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.592+0000 7f367659c640 1 --2- 172.21.15.59:0/3327872864 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36780b4410 0x7f36780b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.592+0000 7f367659c640 1 -- 172.21.15.59:0/3327872864 >> v1:172.21.15.59:6789/0 conn(0x7f36780b8400 legacy=0x7f36780d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.592+0000 7f367559a640 1 -- 172.21.15.59:0/3327872864 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766003820 0 0) 0x7f367815cfd0 con 0x7f36780b8400 2023-10-16T14:26:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.592+0000 7f367659c640 1 -- 172.21.15.59:0/3327872864 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36780d30b0 con 0x7f367815cbf0 2023-10-16T14:26:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.593+0000 7f367659c640 1 --2- 172.21.15.59:0/3327872864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f367815cbf0 0x7f36780d29d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f36680097d0 tx=0x7f366802b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25eb07f23b35993 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.593+0000 7f367559a640 1 -- 172.21.15.59:0/3327872864 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668031800 con 0x7f367815cbf0 2023-10-16T14:26:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.593+0000 7f367559a640 1 -- 172.21.15.59:0/3327872864 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3668031960 con 0x7f367815cbf0 2023-10-16T14:26:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.593+0000 7f367559a640 1 -- 172.21.15.59:0/3327872864 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668031cf0 con 0x7f367815cbf0 2023-10-16T14:26:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.594+0000 7f367ce26640 1 -- 172.21.15.59:0/3327872864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f367815cbf0 msgr2=0x7f36780d29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.594+0000 7f367ce26640 1 --2- 172.21.15.59:0/3327872864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f367815cbf0 0x7f36780d29d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f36680097d0 tx=0x7f366802b8a0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.594+0000 7f367ce26640 1 -- 172.21.15.59:0/3327872864 shutdown_connections 2023-10-16T14:26:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.594+0000 7f367ce26640 1 --2- 172.21.15.59:0/3327872864 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36780b4410 0x7f36780b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.594+0000 7f367ce26640 1 --2- 172.21.15.59:0/3327872864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f367815cbf0 0x7f36780d29d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.594+0000 7f367ce26640 1 -- 172.21.15.59:0/3327872864 >> 172.21.15.59:0/3327872864 conn(0x7f3678071900 msgr2=0x7f3678071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:04.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.594+0000 7f367ce26640 1 -- 172.21.15.59:0/3327872864 shutdown_connections 2023-10-16T14:26:04.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.594+0000 7f367ce26640 1 -- 172.21.15.59:0/3327872864 wait complete. 2023-10-16T14:26:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.596+0000 7f367ce26640 1 Processor -- start 2023-10-16T14:26:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.596+0000 7f367ce26640 1 -- start start 2023-10-16T14:26:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.597+0000 7f367ce26640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36780b4410 0x7f3678150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:04.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.597+0000 7f367ce26640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36780b8400 0x7f36780cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:04.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.597+0000 7f367ce26640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f367815cbf0 0x7f367815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:04.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.597+0000 7f367ce26640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36780caa30 con 0x7f36780b4410 2023-10-16T14:26:04.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.597+0000 7f367ce26640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36780cad10 con 0x7f367815cbf0 2023-10-16T14:26:04.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.597+0000 7f367ce26640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36780caff0 con 0x7f36780b8400 2023-10-16T14:26:04.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.597+0000 7f367659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36780b4410 0x7f3678150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.597+0000 7f367659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36780b4410 0x7f3678150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50944/0 (socket says 172.21.15.59:50944) 2023-10-16T14:26:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.597+0000 7f367659c640 1 -- 172.21.15.59:0/1249804172 learned_addr learned my addr 172.21.15.59:0/1249804172 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.598+0000 7f3676d9d640 1 --2- 172.21.15.59:0/1249804172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f367815cbf0 0x7f367815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.598+0000 7f3675d9b640 1 --2- 172.21.15.59:0/1249804172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36780b8400 0x7f36780cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.598+0000 7f367659c640 1 -- 172.21.15.59:0/1249804172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36780b8400 msgr2=0x7f36780cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:04.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.598+0000 7f367659c640 1 --2- 172.21.15.59:0/1249804172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36780b8400 0x7f36780cbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.598+0000 7f367659c640 1 -- 172.21.15.59:0/1249804172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f367815cbf0 msgr2=0x7f367815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:04.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.598+0000 7f367659c640 1 --2- 172.21.15.59:0/1249804172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f367815cbf0 0x7f367815ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.598+0000 7f367659c640 1 -- 172.21.15.59:0/1249804172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3668009400 con 0x7f36780b4410 2023-10-16T14:26:04.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.598+0000 7f367659c640 1 --2- 172.21.15.59:0/1249804172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36780b4410 0x7f3678150c50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3668034040 tx=0x7f36680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:04.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.599+0000 7f366effd640 1 -- 172.21.15.59:0/1249804172 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366803ad20 con 0x7f36780b4410 2023-10-16T14:26:04.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.599+0000 7f366effd640 1 -- 172.21.15.59:0/1249804172 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36680443f0 con 0x7f36780b4410 2023-10-16T14:26:04.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.599+0000 7f366effd640 1 -- 172.21.15.59:0/1249804172 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36680447a0 con 0x7f36780b4410 2023-10-16T14:26:04.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.599+0000 7f367ce26640 1 -- 172.21.15.59:0/1249804172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36780cb2d0 con 0x7f36780b4410 2023-10-16T14:26:04.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.599+0000 7f367ce26640 1 -- 172.21.15.59:0/1249804172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3678151190 con 0x7f36780b4410 2023-10-16T14:26:04.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.600+0000 7f367ce26640 1 -- 172.21.15.59:0/1249804172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3678073ef0 con 0x7f36780b4410 2023-10-16T14:26:04.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.601+0000 7f366effd640 1 -- 172.21.15.59:0/1249804172 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f366804d450 con 0x7f36780b4410 2023-10-16T14:26:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.602+0000 7f366effd640 1 --2- 172.21.15.59:0/1249804172 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f365806ae70 0x7f365806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.603+0000 7f366effd640 1 -- 172.21.15.59:0/1249804172 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f366802e070 con 0x7f36780b4410 2023-10-16T14:26:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.603+0000 7f3675d9b640 1 --2- 172.21.15.59:0/1249804172 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f365806ae70 0x7f365806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:04.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.604+0000 7f3675d9b640 1 --2- 172.21.15.59:0/1249804172 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f365806ae70 0x7f365806d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3678151a60 tx=0x7f3660007ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:04.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.607+0000 7f366effd640 1 -- 172.21.15.59:0/1249804172 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3668076b50 con 0x7f36780b4410 2023-10-16T14:26:04.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.808+0000 7f367ce26640 1 -- 172.21.15.59:0/1249804172 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36780c5f20 con 0x7f36780b4410 2023-10-16T14:26:04.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.809+0000 7f366effd640 1 -- 172.21.15.59:0/1249804172 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3668035020 con 0x7f36780b4410 2023-10-16T14:26:04.813 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:26:04.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.812+0000 7f367ce26640 1 -- 172.21.15.59:0/1249804172 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f365806ae70 msgr2=0x7f365806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:04.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.812+0000 7f367ce26640 1 --2- 172.21.15.59:0/1249804172 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f365806ae70 0x7f365806d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3678151a60 tx=0x7f3660007ed0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.812+0000 7f367ce26640 1 -- 172.21.15.59:0/1249804172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36780b4410 msgr2=0x7f3678150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:04.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.812+0000 7f367ce26640 1 --2- 172.21.15.59:0/1249804172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36780b4410 0x7f3678150c50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3668034040 tx=0x7f36680046c0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.812+0000 7f367ce26640 1 -- 172.21.15.59:0/1249804172 shutdown_connections 2023-10-16T14:26:04.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.812+0000 7f367ce26640 1 --2- 172.21.15.59:0/1249804172 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f365806ae70 0x7f365806d330 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.812+0000 7f367ce26640 1 --2- 172.21.15.59:0/1249804172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f367815cbf0 0x7f367815ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.812+0000 7f367ce26640 1 --2- 172.21.15.59:0/1249804172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36780b8400 0x7f36780cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.812+0000 7f367ce26640 1 --2- 172.21.15.59:0/1249804172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36780b4410 0x7f3678150c50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:04.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.812+0000 7f367ce26640 1 -- 172.21.15.59:0/1249804172 >> 172.21.15.59:0/1249804172 conn(0x7f3678071900 msgr2=0x7f36780b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:04.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.812+0000 7f367ce26640 1 -- 172.21.15.59:0/1249804172 shutdown_connections 2023-10-16T14:26:04.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:04.812+0000 7f367ce26640 1 -- 172.21.15.59:0/1249804172 wait complete. 2023-10-16T14:26:04.834 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T14:26:05.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.065+0000 7fc18886e640 1 Processor -- start 2023-10-16T14:26:05.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.065+0000 7fc18886e640 1 -- start start 2023-10-16T14:26:05.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.066+0000 7fc18886e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc18415c940 0x7fc1840d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:05.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.067+0000 7fc18886e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc1840d0d80 0x7fc1840d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:05.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.067+0000 7fc18886e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc184160520 0x7fc1841609b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:05.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.067+0000 7fc18886e640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1840d1740 con 0x7fc1840d0d80 2023-10-16T14:26:05.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.067+0000 7fc18886e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1840ce810 con 0x7fc18415c940 2023-10-16T14:26:05.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.067+0000 7fc18886e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840b5b40 con 0x7fc184160520 2023-10-16T14:26:05.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.067+0000 7fc17affd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc1840d0d80 0x7fc1840d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:05.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.067+0000 7fc17affd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc1840d0d80 0x7fc1840d1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50956/0 (socket says 172.21.15.59:50956) 2023-10-16T14:26:05.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.067+0000 7fc17affd640 1 -- 172.21.15.59:0/3656882242 learned_addr learned my addr 172.21.15.59:0/3656882242 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:05.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.067+0000 7fc183fff640 1 --2- 172.21.15.59:0/3656882242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc184160520 0x7fc1841609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:05.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.067+0000 7fc1837fe640 1 --2- 172.21.15.59:0/3656882242 >> v2:172.21.15.151:3300/0 conn(0x7fc18415c940 0x7fc1840d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:05.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.068+0000 7fc17affd640 1 -- 172.21.15.59:0/3656882242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc184160520 msgr2=0x7fc1841609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:05.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.068+0000 7fc17affd640 1 --2- 172.21.15.59:0/3656882242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc184160520 0x7fc1841609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.068+0000 7fc17affd640 1 -- 172.21.15.59:0/3656882242 >> v2:172.21.15.151:3300/0 conn(0x7fc18415c940 msgr2=0x7fc1840d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:05.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.068+0000 7fc17affd640 1 --2- 172.21.15.59:0/3656882242 >> v2:172.21.15.151:3300/0 conn(0x7fc18415c940 0x7fc1840d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.068+0000 7fc17affd640 1 -- 172.21.15.59:0/3656882242 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1840ce250 con 0x7fc1840d0d80 2023-10-16T14:26:05.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.069+0000 7fc17affd640 1 --2- 172.21.15.59:0/3656882242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1840d0d80 0x7fc1840d1200 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc1840671a0 tx=0x7fc16c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca42e38131c4263f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:05.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.069+0000 7fc182ffd640 1 -- 172.21.15.59:0/3656882242 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c0317e0 con 0x7fc1840d0d80 2023-10-16T14:26:05.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.069+0000 7fc182ffd640 1 -- 172.21.15.59:0/3656882242 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c031940 con 0x7fc1840d0d80 2023-10-16T14:26:05.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.069+0000 7fc182ffd640 1 -- 172.21.15.59:0/3656882242 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c031cd0 con 0x7fc1840d0d80 2023-10-16T14:26:05.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.070+0000 7fc18886e640 1 -- 172.21.15.59:0/3656882242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1840d0d80 msgr2=0x7fc1840d1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:05.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.070+0000 7fc18886e640 1 --2- 172.21.15.59:0/3656882242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1840d0d80 0x7fc1840d1200 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc1840671a0 tx=0x7fc16c02b880 comp rx=0 tx=0).stop 2023-10-16T14:26:05.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.070+0000 7fc18886e640 1 -- 172.21.15.59:0/3656882242 shutdown_connections 2023-10-16T14:26:05.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.070+0000 7fc18886e640 1 --2- 172.21.15.59:0/3656882242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc184160520 0x7fc1841609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.070+0000 7fc18886e640 1 --2- 172.21.15.59:0/3656882242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1840d0d80 0x7fc1840d1200 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.070+0000 7fc18886e640 1 --2- 172.21.15.59:0/3656882242 >> v2:172.21.15.151:3300/0 conn(0x7fc18415c940 0x7fc1840d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.070+0000 7fc18886e640 1 -- 172.21.15.59:0/3656882242 >> 172.21.15.59:0/3656882242 conn(0x7fc18409bb30 msgr2=0x7fc1840d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:05.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.070+0000 7fc18886e640 1 -- 172.21.15.59:0/3656882242 shutdown_connections 2023-10-16T14:26:05.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.070+0000 7fc18886e640 1 -- 172.21.15.59:0/3656882242 wait complete. 2023-10-16T14:26:05.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.072+0000 7fc18886e640 1 Processor -- start 2023-10-16T14:26:05.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.072+0000 7fc18886e640 1 -- start start 2023-10-16T14:26:05.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.073+0000 7fc18886e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1840d0d80 0x7fc1840cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:05.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.073+0000 7fc18886e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc18415c940 0x7fc18415abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:05.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.073+0000 7fc18886e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc184160520 0x7fc1841e6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:05.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.073+0000 7fc18886e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840cbba0 con 0x7fc18415c940 2023-10-16T14:26:05.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.073+0000 7fc18886e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc184150e60 con 0x7fc1840d0d80 2023-10-16T14:26:05.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.073+0000 7fc18886e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc184151140 con 0x7fc184160520 2023-10-16T14:26:05.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.073+0000 7fc17affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc18415c940 0x7fc18415abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:05.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.073+0000 7fc17affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc18415c940 0x7fc18415abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50970/0 (socket says 172.21.15.59:50970) 2023-10-16T14:26:05.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.073+0000 7fc17affd640 1 -- 172.21.15.59:0/1301418721 learned_addr learned my addr 172.21.15.59:0/1301418721 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:05.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.074+0000 7fc17affd640 1 -- 172.21.15.59:0/1301418721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc184160520 msgr2=0x7fc1841e6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:05.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.074+0000 7fc183fff640 1 --2- 172.21.15.59:0/1301418721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc184160520 0x7fc1841e6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:05.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.074+0000 7fc1837fe640 1 --2- 172.21.15.59:0/1301418721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1840d0d80 0x7fc1840cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:05.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.074+0000 7fc17affd640 1 --2- 172.21.15.59:0/1301418721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc184160520 0x7fc1841e6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.074+0000 7fc17affd640 1 -- 172.21.15.59:0/1301418721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1840d0d80 msgr2=0x7fc1840cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:05.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.074+0000 7fc17affd640 1 --2- 172.21.15.59:0/1301418721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1840d0d80 0x7fc1840cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.074+0000 7fc17affd640 1 -- 172.21.15.59:0/1301418721 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16c0094d0 con 0x7fc18415c940 2023-10-16T14:26:05.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.074+0000 7fc1837fe640 1 --2- 172.21.15.59:0/1301418721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1840d0d80 0x7fc1840cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:05.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.074+0000 7fc17affd640 1 --2- 172.21.15.59:0/1301418721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc18415c940 0x7fc18415abc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc16c000c00 tx=0x7fc16c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:05.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.074+0000 7fc180ff9640 1 -- 172.21.15.59:0/1301418721 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c032880 con 0x7fc18415c940 2023-10-16T14:26:05.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.074+0000 7fc180ff9640 1 -- 172.21.15.59:0/1301418721 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c032a20 con 0x7fc18415c940 2023-10-16T14:26:05.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.074+0000 7fc180ff9640 1 -- 172.21.15.59:0/1301418721 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c032dd0 con 0x7fc18415c940 2023-10-16T14:26:05.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.074+0000 7fc18886e640 1 -- 172.21.15.59:0/1301418721 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc184151420 con 0x7fc18415c940 2023-10-16T14:26:05.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.075+0000 7fc18886e640 1 -- 172.21.15.59:0/1301418721 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1841519e0 con 0x7fc18415c940 2023-10-16T14:26:05.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.076+0000 7fc18886e640 1 -- 172.21.15.59:0/1301418721 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc184151280 con 0x7fc18415c940 2023-10-16T14:26:05.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.077+0000 7fc180ff9640 1 -- 172.21.15.59:0/1301418721 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc16c0453f0 con 0x7fc18415c940 2023-10-16T14:26:05.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.078+0000 7fc180ff9640 1 --2- 172.21.15.59:0/1301418721 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc16406ae70 0x7fc16406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:05.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.078+0000 7fc180ff9640 1 -- 172.21.15.59:0/1301418721 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc16c0aba70 con 0x7fc18415c940 2023-10-16T14:26:05.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.078+0000 7fc1837fe640 1 --2- 172.21.15.59:0/1301418721 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc16406ae70 0x7fc16406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:05.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.079+0000 7fc1837fe640 1 --2- 172.21.15.59:0/1301418721 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc16406ae70 0x7fc16406d330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc1840cac80 tx=0x7fc17400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:05.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.082+0000 7fc180ff9640 1 -- 172.21.15.59:0/1301418721 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc184151280 con 0x7fc18415c940 2023-10-16T14:26:05.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.275+0000 7fc18886e640 1 -- 172.21.15.59:0/1301418721 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc184151280 con 0x7fc18415c940 2023-10-16T14:26:05.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.276+0000 7fc180ff9640 1 -- 172.21.15.59:0/1301418721 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc184151280 con 0x7fc18415c940 2023-10-16T14:26:05.280 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:05.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.279+0000 7fc18886e640 1 -- 172.21.15.59:0/1301418721 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc16406ae70 msgr2=0x7fc16406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:05.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.279+0000 7fc18886e640 1 --2- 172.21.15.59:0/1301418721 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc16406ae70 0x7fc16406d330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc1840cac80 tx=0x7fc17400b040 comp rx=0 tx=0).stop 2023-10-16T14:26:05.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.279+0000 7fc18886e640 1 -- 172.21.15.59:0/1301418721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc18415c940 msgr2=0x7fc18415abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:05.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.279+0000 7fc18886e640 1 --2- 172.21.15.59:0/1301418721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc18415c940 0x7fc18415abc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc16c000c00 tx=0x7fc16c0046c0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.279+0000 7fc18886e640 1 -- 172.21.15.59:0/1301418721 shutdown_connections 2023-10-16T14:26:05.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.279+0000 7fc18886e640 1 --2- 172.21.15.59:0/1301418721 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc16406ae70 0x7fc16406d330 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.279+0000 7fc18886e640 1 --2- 172.21.15.59:0/1301418721 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc184160520 0x7fc1841e6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.279+0000 7fc18886e640 1 --2- 172.21.15.59:0/1301418721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc18415c940 0x7fc18415abc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.279+0000 7fc18886e640 1 --2- 172.21.15.59:0/1301418721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1840d0d80 0x7fc1840cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.279+0000 7fc18886e640 1 -- 172.21.15.59:0/1301418721 >> 172.21.15.59:0/1301418721 conn(0x7fc18409bb30 msgr2=0x7fc1840cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:05.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.279+0000 7fc18886e640 1 -- 172.21.15.59:0/1301418721 shutdown_connections 2023-10-16T14:26:05.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.279+0000 7fc18886e640 1 -- 172.21.15.59:0/1301418721 wait complete. 2023-10-16T14:26:05.300 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T14:26:05.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.522+0000 7fe5d1ef3640 1 Processor -- start 2023-10-16T14:26:05.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.523+0000 7fe5d1ef3640 1 -- start start 2023-10-16T14:26:05.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.524+0000 7fe5d1ef3640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe5cc0ad940 0x7fe5cc06c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:05.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.524+0000 7fe5d1ef3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5cc0cf0c0 0x7fe5cc15d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:05.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.524+0000 7fe5d1ef3640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5cc159ca0 con 0x7fe5cc06cbf0 2023-10-16T14:26:05.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.524+0000 7fe5d1ef3640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5cc0b34c0 con 0x7fe5cc0ad940 2023-10-16T14:26:05.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.524+0000 7fe5d1ef3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc0b2fd0 con 0x7fe5cc0cf0c0 2023-10-16T14:26:05.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.524+0000 7fe5cbfff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe5cc06cbf0 0x7fe5cc0ce9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38258/0 (socket says 172.21.15.59:38258) 2023-10-16T14:26:05.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.524+0000 7fe5cbfff640 1 -- 172.21.15.59:0/3638693431 learned_addr learned my addr 172.21.15.59:0/3638693431 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:05.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.525+0000 7fe5d0ef1640 1 --2- 172.21.15.59:0/3638693431 >> v2:172.21.15.151:3300/0 conn(0x7fe5cc0ad940 0x7fe5cc06c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:05.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.525+0000 7fe5d16f2640 1 --2- 172.21.15.59:0/3638693431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5cc0cf0c0 0x7fe5cc15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:05.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.525+0000 7fe5cb7fe640 1 -- 172.21.15.59:0/3638693431 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980855311 0 0) 0x7fe5cc159ca0 con 0x7fe5cc06cbf0 2023-10-16T14:26:05.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.525+0000 7fe5cb7fe640 1 -- 172.21.15.59:0/3638693431 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5b4003520 con 0x7fe5cc06cbf0 2023-10-16T14:26:05.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.525+0000 7fe5cb7fe640 1 -- 172.21.15.59:0/3638693431 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 94288843 0 0) 0x7fe5b4003520 con 0x7fe5cc06cbf0 2023-10-16T14:26:05.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.525+0000 7fe5cb7fe640 1 -- 172.21.15.59:0/3638693431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5cc0cf0c0 msgr2=0x7fe5cc15d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:05.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.525+0000 7fe5cb7fe640 1 --2- 172.21.15.59:0/3638693431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5cc0cf0c0 0x7fe5cc15d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.525+0000 7fe5cb7fe640 1 -- 172.21.15.59:0/3638693431 >> v2:172.21.15.151:3300/0 conn(0x7fe5cc0ad940 msgr2=0x7fe5cc06c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:05.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.525+0000 7fe5cb7fe640 1 --2- 172.21.15.59:0/3638693431 >> v2:172.21.15.151:3300/0 conn(0x7fe5cc0ad940 0x7fe5cc06c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.525+0000 7fe5cb7fe640 1 -- 172.21.15.59:0/3638693431 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5cc0cac20 con 0x7fe5cc06cbf0 2023-10-16T14:26:05.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.525+0000 7fe5cb7fe640 1 -- 172.21.15.59:0/3638693431 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7fe5c0001670 con 0x7fe5cc06cbf0 2023-10-16T14:26:05.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.525+0000 7fe5cb7fe640 1 -- 172.21.15.59:0/3638693431 >> v1:172.21.15.59:6789/0 conn(0x7fe5cc06cbf0 legacy=0x7fe5cc0ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:05.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.525+0000 7fe5cb7fe640 1 --2- 172.21.15.59:0/3638693431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5cc0cf0c0 0x7fe5b40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:05.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.525+0000 7fe5cb7fe640 1 --2- 172.21.15.59:0/3638693431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5b4003fb0 0x7fe5b40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:05.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.525+0000 7fe5cb7fe640 1 --2- 172.21.15.59:0/3638693431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b4004d00 0x7fe5b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:05.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.525+0000 7fe5cb7fe640 1 -- 172.21.15.59:0/3638693431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc0b34c0 con 0x7fe5b4004d00 2023-10-16T14:26:05.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.525+0000 7fe5cb7fe640 1 -- 172.21.15.59:0/3638693431 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc0b2fd0 con 0x7fe5b4003fb0 2023-10-16T14:26:05.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.525+0000 7fe5cb7fe640 1 -- 172.21.15.59:0/3638693431 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b400ba00 con 0x7fe5cc0cf0c0 2023-10-16T14:26:05.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.526+0000 7fe5d16f2640 1 --2- 172.21.15.59:0/3638693431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b4004d00 0x7fe5b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:05.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.526+0000 7fe5cbfff640 1 --2- 172.21.15.59:0/3638693431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5b4003fb0 0x7fe5b40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:05.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.526+0000 7fe5d0ef1640 1 --2- 172.21.15.59:0/3638693431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5cc0cf0c0 0x7fe5b40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:05.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.526+0000 7fe5d16f2640 1 -- 172.21.15.59:0/3638693431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5cc0cf0c0 msgr2=0x7fe5b40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:05.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.526+0000 7fe5d16f2640 1 --2- 172.21.15.59:0/3638693431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5cc0cf0c0 0x7fe5b40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.526+0000 7fe5d16f2640 1 -- 172.21.15.59:0/3638693431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5b4003fb0 msgr2=0x7fe5b40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:05.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.526+0000 7fe5d16f2640 1 --2- 172.21.15.59:0/3638693431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5b4003fb0 0x7fe5b40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.526+0000 7fe5d16f2640 1 -- 172.21.15.59:0/3638693431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b4003520 con 0x7fe5b4004d00 2023-10-16T14:26:05.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.527+0000 7fe5d16f2640 1 --2- 172.21.15.59:0/3638693431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b4004d00 0x7fe5b4005180 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0c8b00 tx=0x7fe5b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7085af40ef7df0e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:05.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.528+0000 7fe5cb7fe640 1 -- 172.21.15.59:0/3638693431 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c402cb90 con 0x7fe5b4004d00 2023-10-16T14:26:05.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.528+0000 7fe5cb7fe640 1 -- 172.21.15.59:0/3638693431 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c400f040 con 0x7fe5b4004d00 2023-10-16T14:26:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.528+0000 7fe5cb7fe640 1 -- 172.21.15.59:0/3638693431 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4034440 con 0x7fe5b4004d00 2023-10-16T14:26:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.528+0000 7fe5d1ef3640 1 -- 172.21.15.59:0/3638693431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b4004d00 msgr2=0x7fe5b4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.528+0000 7fe5d1ef3640 1 --2- 172.21.15.59:0/3638693431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5b4004d00 0x7fe5b4005180 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0c8b00 tx=0x7fe5b40057f0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.528+0000 7fe5d16f2640 1 -- 172.21.15.59:0/3638693431 reap_dead start 2023-10-16T14:26:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.528+0000 7fe5d1ef3640 1 -- 172.21.15.59:0/3638693431 shutdown_connections 2023-10-16T14:26:05.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.528+0000 7fe5d1ef3640 1 -- 172.21.15.59:0/3638693431 >> 172.21.15.59:0/3638693431 conn(0x7fe5cc06a200 msgr2=0x7fe5cc06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:05.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.528+0000 7fe5d1ef3640 1 -- 172.21.15.59:0/3638693431 shutdown_connections 2023-10-16T14:26:05.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.528+0000 7fe5d1ef3640 1 -- 172.21.15.59:0/3638693431 wait complete. 2023-10-16T14:26:05.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.530+0000 7fe5d1ef3640 1 Processor -- start 2023-10-16T14:26:05.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.530+0000 7fe5d1ef3640 1 -- start start 2023-10-16T14:26:05.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.531+0000 7fe5d1ef3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5b4004d00 0x7fe5cc150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:05.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.531+0000 7fe5d1ef3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5cc0ca1a0 0x7fe5cc0c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:05.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.531+0000 7fe5d1ef3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5cc15a6f0 0x7fe5cc0c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:05.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.531+0000 7fe5d1ef3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc156740 con 0x7fe5cc0ca1a0 2023-10-16T14:26:05.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.531+0000 7fe5d1ef3640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc0c28e0 con 0x7fe5cc15a6f0 2023-10-16T14:26:05.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.531+0000 7fe5d1ef3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc0aefd0 con 0x7fe5b4004d00 2023-10-16T14:26:05.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.532+0000 7fe5cbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5cc0ca1a0 0x7fe5cc0c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:05.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.532+0000 7fe5cbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5cc0ca1a0 0x7fe5cc0c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50982/0 (socket says 172.21.15.59:50982) 2023-10-16T14:26:05.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.532+0000 7fe5cbfff640 1 -- 172.21.15.59:0/2169964911 learned_addr learned my addr 172.21.15.59:0/2169964911 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:05.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.532+0000 7fe5d0ef1640 1 --2- 172.21.15.59:0/2169964911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5b4004d00 0x7fe5cc150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:05.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.532+0000 7fe5d16f2640 1 --2- 172.21.15.59:0/2169964911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5cc15a6f0 0x7fe5cc0c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:05.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.532+0000 7fe5cbfff640 1 -- 172.21.15.59:0/2169964911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5b4004d00 msgr2=0x7fe5cc150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:05.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.532+0000 7fe5cbfff640 1 --2- 172.21.15.59:0/2169964911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5b4004d00 0x7fe5cc150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.532+0000 7fe5cbfff640 1 -- 172.21.15.59:0/2169964911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5cc15a6f0 msgr2=0x7fe5cc0c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:05.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.532+0000 7fe5cbfff640 1 --2- 172.21.15.59:0/2169964911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5cc15a6f0 0x7fe5cc0c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.532+0000 7fe5cbfff640 1 -- 172.21.15.59:0/2169964911 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5cc0c4c00 con 0x7fe5cc0ca1a0 2023-10-16T14:26:05.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.532+0000 7fe5d0ef1640 1 --2- 172.21.15.59:0/2169964911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5b4004d00 0x7fe5cc150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:05.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.532+0000 7fe5cbfff640 1 --2- 172.21.15.59:0/2169964911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5cc0ca1a0 0x7fe5cc0c4180 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe5c000e700 tx=0x7fe5c000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:05.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.533+0000 7fe5c97fa640 1 -- 172.21.15.59:0/2169964911 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c000ee10 con 0x7fe5cc0ca1a0 2023-10-16T14:26:05.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.533+0000 7fe5c97fa640 1 -- 172.21.15.59:0/2169964911 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c000c8d0 con 0x7fe5cc0ca1a0 2023-10-16T14:26:05.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.533+0000 7fe5c97fa640 1 -- 172.21.15.59:0/2169964911 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c000cc80 con 0x7fe5cc0ca1a0 2023-10-16T14:26:05.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.533+0000 7fe5d1ef3640 1 -- 172.21.15.59:0/2169964911 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5cc1f2330 con 0x7fe5cc0ca1a0 2023-10-16T14:26:05.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.533+0000 7fe5d1ef3640 1 -- 172.21.15.59:0/2169964911 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5cc156ac0 con 0x7fe5cc0ca1a0 2023-10-16T14:26:05.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.534+0000 7fe5d1ef3640 1 -- 172.21.15.59:0/2169964911 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5cc06c5b0 con 0x7fe5cc0ca1a0 2023-10-16T14:26:05.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.535+0000 7fe5c97fa640 1 -- 172.21.15.59:0/2169964911 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe5c001d460 con 0x7fe5cc0ca1a0 2023-10-16T14:26:05.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.536+0000 7fe5c97fa640 1 --2- 172.21.15.59:0/2169964911 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe5b806aea0 0x7fe5b806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:05.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.536+0000 7fe5c97fa640 1 -- 172.21.15.59:0/2169964911 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe5c0089820 con 0x7fe5cc0ca1a0 2023-10-16T14:26:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.537+0000 7fe5d0ef1640 1 --2- 172.21.15.59:0/2169964911 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe5b806aea0 0x7fe5b806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.538+0000 7fe5d0ef1640 1 --2- 172.21.15.59:0/2169964911 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe5b806aea0 0x7fe5b806d360 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc159950 tx=0x7fe5bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.540+0000 7fe5c97fa640 1 -- 172.21.15.59:0/2169964911 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe5c0058060 con 0x7fe5cc0ca1a0 2023-10-16T14:26:05.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.732+0000 7fe5d1ef3640 1 -- 172.21.15.59:0/2169964911 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe5cc0af140 con 0x7fe5cc0ca1a0 2023-10-16T14:26:05.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.732+0000 7fe5c97fa640 1 -- 172.21.15.59:0/2169964911 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe5c00014f0 con 0x7fe5cc0ca1a0 2023-10-16T14:26:05.736 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-16T14:26:05.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.735+0000 7fe5d1ef3640 1 -- 172.21.15.59:0/2169964911 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe5b806aea0 msgr2=0x7fe5b806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:05.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.735+0000 7fe5d1ef3640 1 --2- 172.21.15.59:0/2169964911 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe5b806aea0 0x7fe5b806d360 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc159950 tx=0x7fe5bc008040 comp rx=0 tx=0).stop 2023-10-16T14:26:05.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.735+0000 7fe5d1ef3640 1 -- 172.21.15.59:0/2169964911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5cc0ca1a0 msgr2=0x7fe5cc0c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:05.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.735+0000 7fe5d1ef3640 1 --2- 172.21.15.59:0/2169964911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5cc0ca1a0 0x7fe5cc0c4180 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe5c000e700 tx=0x7fe5c000ebc0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.736+0000 7fe5d1ef3640 1 -- 172.21.15.59:0/2169964911 shutdown_connections 2023-10-16T14:26:05.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.736+0000 7fe5d1ef3640 1 --2- 172.21.15.59:0/2169964911 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe5b806aea0 0x7fe5b806d360 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.736+0000 7fe5d1ef3640 1 --2- 172.21.15.59:0/2169964911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5cc15a6f0 0x7fe5cc0c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.736+0000 7fe5d1ef3640 1 --2- 172.21.15.59:0/2169964911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5cc0ca1a0 0x7fe5cc0c4180 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.736+0000 7fe5d1ef3640 1 --2- 172.21.15.59:0/2169964911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5b4004d00 0x7fe5cc150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.736+0000 7fe5d1ef3640 1 -- 172.21.15.59:0/2169964911 >> 172.21.15.59:0/2169964911 conn(0x7fe5cc06a200 msgr2=0x7fe5cc159fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:05.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.736+0000 7fe5d1ef3640 1 -- 172.21.15.59:0/2169964911 shutdown_connections 2023-10-16T14:26:05.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.736+0000 7fe5d1ef3640 1 -- 172.21.15.59:0/2169964911 wait complete. 2023-10-16T14:26:05.759 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T14:26:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.985+0000 7f87dafa7640 1 Processor -- start 2023-10-16T14:26:05.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.985+0000 7f87dafa7640 1 -- start start 2023-10-16T14:26:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.986+0000 7f87dafa7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87d4154d10 0x7f87d40ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.986+0000 7f87dafa7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f87d40cee60 0x7f87d406ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:05.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.986+0000 7f87dafa7640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d41550f0 con 0x7f87d406d360 2023-10-16T14:26:05.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.987+0000 7f87dafa7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d40cf2e0 con 0x7f87d40cee60 2023-10-16T14:26:05.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.987+0000 7f87dafa7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d406db50 con 0x7f87d4154d10 2023-10-16T14:26:05.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.987+0000 7f87da7a6640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f87d406d360 0x7f87d40ac1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38274/0 (socket says 172.21.15.59:38274) 2023-10-16T14:26:05.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.987+0000 7f87da7a6640 1 -- 172.21.15.59:0/3972593393 learned_addr learned my addr 172.21.15.59:0/3972593393 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:05.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.987+0000 7f87d97a4640 1 --2- 172.21.15.59:0/3972593393 >> v2:172.21.15.151:3300/0 conn(0x7f87d40cee60 0x7f87d406ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:05.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.987+0000 7f87d9fa5640 1 --2- 172.21.15.59:0/3972593393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87d4154d10 0x7f87d40ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:05.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.988+0000 7f87d8fa3640 1 -- 172.21.15.59:0/3972593393 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909038187 0 0) 0x7f87d41550f0 con 0x7f87d406d360 2023-10-16T14:26:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.988+0000 7f87d8fa3640 1 -- 172.21.15.59:0/3972593393 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87c0003520 con 0x7f87d406d360 2023-10-16T14:26:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.988+0000 7f87d97a4640 1 -- 172.21.15.59:0/3972593393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87d4154d10 msgr2=0x7f87d40ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:05.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.988+0000 7f87d97a4640 1 --2- 172.21.15.59:0/3972593393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87d4154d10 0x7f87d40ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.988+0000 7f87d97a4640 1 -- 172.21.15.59:0/3972593393 >> v1:172.21.15.59:6789/0 conn(0x7f87d406d360 legacy=0x7f87d40ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.988+0000 7f87d97a4640 1 -- 172.21.15.59:0/3972593393 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d40b13f0 con 0x7f87d40cee60 2023-10-16T14:26:05.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.989+0000 7f87d97a4640 1 --2- 172.21.15.59:0/3972593393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87d40cee60 0x7f87d406ce20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f87c40097a0 tx=0x7f87c402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=851ef4b5522d6dd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:05.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.990+0000 7f87d8fa3640 1 -- 172.21.15.59:0/3972593393 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c402d040 con 0x7f87d40cee60 2023-10-16T14:26:05.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.990+0000 7f87d8fa3640 1 -- 172.21.15.59:0/3972593393 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c4031810 con 0x7f87d40cee60 2023-10-16T14:26:05.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.990+0000 7f87d8fa3640 1 -- 172.21.15.59:0/3972593393 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c4031ba0 con 0x7f87d40cee60 2023-10-16T14:26:05.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.990+0000 7f87dafa7640 1 -- 172.21.15.59:0/3972593393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87d40cee60 msgr2=0x7f87d406ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:05.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.990+0000 7f87dafa7640 1 --2- 172.21.15.59:0/3972593393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87d40cee60 0x7f87d406ce20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f87c40097a0 tx=0x7f87c402b8b0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.990+0000 7f87dafa7640 1 -- 172.21.15.59:0/3972593393 shutdown_connections 2023-10-16T14:26:05.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.990+0000 7f87dafa7640 1 --2- 172.21.15.59:0/3972593393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87d40cee60 0x7f87d406ce20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.990+0000 7f87dafa7640 1 --2- 172.21.15.59:0/3972593393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87d4154d10 0x7f87d40ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:05.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.990+0000 7f87dafa7640 1 -- 172.21.15.59:0/3972593393 >> 172.21.15.59:0/3972593393 conn(0x7f87d406a200 msgr2=0x7f87d406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:05.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.990+0000 7f87dafa7640 1 -- 172.21.15.59:0/3972593393 shutdown_connections 2023-10-16T14:26:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.991+0000 7f87dafa7640 1 -- 172.21.15.59:0/3972593393 wait complete. 2023-10-16T14:26:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.992+0000 7f87dafa7640 1 Processor -- start 2023-10-16T14:26:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.992+0000 7f87dafa7640 1 -- start start 2023-10-16T14:26:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.993+0000 7f87dafa7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87d406d360 0x7f87d40acc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:05.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.993+0000 7f87dafa7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87d40cee60 0x7f87d41534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:06.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.993+0000 7f87dafa7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87d4154d10 0x7f87d415bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:06.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.993+0000 7f87dafa7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d40abc00 con 0x7f87d4154d10 2023-10-16T14:26:06.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.993+0000 7f87dafa7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d40ad180 con 0x7f87d40cee60 2023-10-16T14:26:06.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.993+0000 7f87dafa7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d40abea0 con 0x7f87d406d360 2023-10-16T14:26:06.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.994+0000 7f87da7a6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87d4154d10 0x7f87d415bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:06.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.994+0000 7f87da7a6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87d4154d10 0x7f87d415bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:50994/0 (socket says 172.21.15.59:50994) 2023-10-16T14:26:06.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.994+0000 7f87da7a6640 1 -- 172.21.15.59:0/2911916350 learned_addr learned my addr 172.21.15.59:0/2911916350 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:06.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.994+0000 7f87d97a4640 1 --2- 172.21.15.59:0/2911916350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87d40cee60 0x7f87d41534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:06.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.994+0000 7f87d9fa5640 1 --2- 172.21.15.59:0/2911916350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87d406d360 0x7f87d40acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:06.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.994+0000 7f87da7a6640 1 -- 172.21.15.59:0/2911916350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87d406d360 msgr2=0x7f87d40acc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:06.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.994+0000 7f87da7a6640 1 --2- 172.21.15.59:0/2911916350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87d406d360 0x7f87d40acc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:06.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.994+0000 7f87da7a6640 1 -- 172.21.15.59:0/2911916350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87d40cee60 msgr2=0x7f87d41534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:06.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.994+0000 7f87da7a6640 1 --2- 172.21.15.59:0/2911916350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87d40cee60 0x7f87d41534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:06.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.994+0000 7f87da7a6640 1 -- 172.21.15.59:0/2911916350 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c4009400 con 0x7f87d4154d10 2023-10-16T14:26:06.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.994+0000 7f87da7a6640 1 --2- 172.21.15.59:0/2911916350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87d4154d10 0x7f87d415bf10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f87cc00cb40 tx=0x7f87cc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:06.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.995+0000 7f87ca7fc640 1 -- 172.21.15.59:0/2911916350 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc00aca0 con 0x7f87d4154d10 2023-10-16T14:26:06.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.995+0000 7f87ca7fc640 1 -- 172.21.15.59:0/2911916350 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87cc00ae00 con 0x7f87d4154d10 2023-10-16T14:26:06.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.995+0000 7f87ca7fc640 1 -- 172.21.15.59:0/2911916350 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc012620 con 0x7f87d4154d10 2023-10-16T14:26:06.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.995+0000 7f87dafa7640 1 -- 172.21.15.59:0/2911916350 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d40ac180 con 0x7f87d4154d10 2023-10-16T14:26:06.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.995+0000 7f87dafa7640 1 -- 172.21.15.59:0/2911916350 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d40ac740 con 0x7f87d4154d10 2023-10-16T14:26:06.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.996+0000 7f87dafa7640 1 -- 172.21.15.59:0/2911916350 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d404e9b0 con 0x7f87d4154d10 2023-10-16T14:26:06.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.997+0000 7f87ca7fc640 1 -- 172.21.15.59:0/2911916350 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f87cc007070 con 0x7f87d4154d10 2023-10-16T14:26:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.998+0000 7f87ca7fc640 1 --2- 172.21.15.59:0/2911916350 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f87b806ae70 0x7f87b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.998+0000 7f87ca7fc640 1 -- 172.21.15.59:0/2911916350 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f87cc089a80 con 0x7f87d4154d10 2023-10-16T14:26:06.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:05.999+0000 7f87d9fa5640 1 --2- 172.21.15.59:0/2911916350 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f87b806ae70 0x7f87b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:06.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.000+0000 7f87d9fa5640 1 --2- 172.21.15.59:0/2911916350 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f87b806ae70 0x7f87b806d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009970 tx=0x7f87d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:06.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.002+0000 7f87ca7fc640 1 -- 172.21.15.59:0/2911916350 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f87cc054710 con 0x7f87d4154d10 2023-10-16T14:26:06.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.196+0000 7f87dafa7640 1 -- 172.21.15.59:0/2911916350 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f87d406c9d0 con 0x7f87d4154d10 2023-10-16T14:26:06.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.197+0000 7f87ca7fc640 1 -- 172.21.15.59:0/2911916350 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f87cc017070 con 0x7f87d4154d10 2023-10-16T14:26:06.200 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:06.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.199+0000 7f87dafa7640 1 -- 172.21.15.59:0/2911916350 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f87b806ae70 msgr2=0x7f87b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:06.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.199+0000 7f87dafa7640 1 --2- 172.21.15.59:0/2911916350 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f87b806ae70 0x7f87b806d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009970 tx=0x7f87d0008040 comp rx=0 tx=0).stop 2023-10-16T14:26:06.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.199+0000 7f87dafa7640 1 -- 172.21.15.59:0/2911916350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87d4154d10 msgr2=0x7f87d415bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:06.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.199+0000 7f87dafa7640 1 --2- 172.21.15.59:0/2911916350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87d4154d10 0x7f87d415bf10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f87cc00cb40 tx=0x7f87cc00a060 comp rx=0 tx=0).stop 2023-10-16T14:26:06.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.200+0000 7f87dafa7640 1 -- 172.21.15.59:0/2911916350 shutdown_connections 2023-10-16T14:26:06.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.200+0000 7f87dafa7640 1 --2- 172.21.15.59:0/2911916350 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f87b806ae70 0x7f87b806d330 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:06.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.200+0000 7f87dafa7640 1 --2- 172.21.15.59:0/2911916350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87d4154d10 0x7f87d415bf10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:06.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.200+0000 7f87dafa7640 1 --2- 172.21.15.59:0/2911916350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87d40cee60 0x7f87d41534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:06.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.200+0000 7f87dafa7640 1 --2- 172.21.15.59:0/2911916350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87d406d360 0x7f87d40acc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:06.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.200+0000 7f87dafa7640 1 -- 172.21.15.59:0/2911916350 >> 172.21.15.59:0/2911916350 conn(0x7f87d406a200 msgr2=0x7f87d40aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:06.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.200+0000 7f87dafa7640 1 -- 172.21.15.59:0/2911916350 shutdown_connections 2023-10-16T14:26:06.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.200+0000 7f87dafa7640 1 -- 172.21.15.59:0/2911916350 wait complete. 2023-10-16T14:26:06.223 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T14:26:06.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.437+0000 7f6c457ae640 1 Processor -- start 2023-10-16T14:26:06.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.437+0000 7f6c457ae640 1 -- start start 2023-10-16T14:26:06.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.438+0000 7f6c457ae640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c400ad970 0x7f6c400b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:06.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.438+0000 7f6c457ae640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6c400ced10 0x7f6c4006c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:06.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.438+0000 7f6c457ae640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c400c8a10 con 0x7f6c400b2e90 2023-10-16T14:26:06.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.438+0000 7f6c457ae640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c40159b40 con 0x7f6c400ad970 2023-10-16T14:26:06.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.438+0000 7f6c457ae640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4015d1a0 con 0x7f6c400ced10 2023-10-16T14:26:06.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.439+0000 7f6c3ffff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c400ad970 0x7f6c400b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:06.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.439+0000 7f6c3ffff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c400ad970 0x7f6c400b1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51000/0 (socket says 172.21.15.59:51000) 2023-10-16T14:26:06.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.439+0000 7f6c3ffff640 1 -- 172.21.15.59:0/2069558638 learned_addr learned my addr 172.21.15.59:0/2069558638 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:06.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.439+0000 7f6c44fad640 1 --2- 172.21.15.59:0/2069558638 >> v2:172.21.15.151:3300/0 conn(0x7f6c400ced10 0x7f6c4006c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:06.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.439+0000 7f6c3ffff640 1 -- 172.21.15.59:0/2069558638 >> v2:172.21.15.151:3300/0 conn(0x7f6c400ced10 msgr2=0x7f6c4006c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:06.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.439+0000 7f6c3ffff640 1 --2- 172.21.15.59:0/2069558638 >> v2:172.21.15.151:3300/0 conn(0x7f6c400ced10 0x7f6c4006c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:06.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.439+0000 7f6c3ffff640 1 -- 172.21.15.59:0/2069558638 >> v1:172.21.15.151:6789/0 conn(0x7f6c400b2e90 legacy=0x7f6c400ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:06.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.439+0000 7f6c3ffff640 1 -- 172.21.15.59:0/2069558638 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4015d3f0 con 0x7f6c400ad970 2023-10-16T14:26:06.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.441+0000 7f6c3ffff640 1 --2- 172.21.15.59:0/2069558638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c400ad970 0x7f6c400b1210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6c4006e490 tx=0x7f6c3002e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee4698d900bf774 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:06.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.441+0000 7f6c3f7fe640 1 -- 172.21.15.59:0/2069558638 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3002ea00 con 0x7f6c400ad970 2023-10-16T14:26:06.446 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.441+0000 7f6c3f7fe640 1 -- 172.21.15.59:0/2069558638 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3002eb60 con 0x7f6c400ad970 2023-10-16T14:26:06.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.441+0000 7f6c3f7fe640 1 -- 172.21.15.59:0/2069558638 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c30009600 con 0x7f6c400ad970 2023-10-16T14:26:06.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.442+0000 7f6c457ae640 1 -- 172.21.15.59:0/2069558638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c400ad970 msgr2=0x7f6c400b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:06.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.442+0000 7f6c457ae640 1 --2- 172.21.15.59:0/2069558638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c400ad970 0x7f6c400b1210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6c4006e490 tx=0x7f6c3002e060 comp rx=0 tx=0).stop 2023-10-16T14:26:06.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.442+0000 7f6c457ae640 1 -- 172.21.15.59:0/2069558638 shutdown_connections 2023-10-16T14:26:06.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.442+0000 7f6c457ae640 1 --2- 172.21.15.59:0/2069558638 >> v2:172.21.15.151:3300/0 conn(0x7f6c400ced10 0x7f6c4006c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:06.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.442+0000 7f6c457ae640 1 --2- 172.21.15.59:0/2069558638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c400ad970 0x7f6c400b1210 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:06.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.442+0000 7f6c457ae640 1 -- 172.21.15.59:0/2069558638 >> 172.21.15.59:0/2069558638 conn(0x7f6c40069fc0 msgr2=0x7f6c4006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:06.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.442+0000 7f6c457ae640 1 -- 172.21.15.59:0/2069558638 shutdown_connections 2023-10-16T14:26:06.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.442+0000 7f6c457ae640 1 -- 172.21.15.59:0/2069558638 wait complete. 2023-10-16T14:26:06.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.444+0000 7f6c457ae640 1 Processor -- start 2023-10-16T14:26:06.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.444+0000 7f6c457ae640 1 -- start start 2023-10-16T14:26:06.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.445+0000 7f6c457ae640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c400ad970 0x7f6c40159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:06.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.445+0000 7f6c457ae640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c400b2e90 0x7f6c401f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:06.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.445+0000 7f6c457ae640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c400ced10 0x7f6c400c0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:06.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.445+0000 7f6c457ae640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c400ac750 con 0x7f6c400ad970 2023-10-16T14:26:06.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.445+0000 7f6c457ae640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4015cb60 con 0x7f6c400ced10 2023-10-16T14:26:06.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.445+0000 7f6c457ae640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c40070090 con 0x7f6c400b2e90 2023-10-16T14:26:06.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.445+0000 7f6c3ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c400ad970 0x7f6c40159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:06.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.445+0000 7f6c3ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c400ad970 0x7f6c40159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51016/0 (socket says 172.21.15.59:51016) 2023-10-16T14:26:06.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.445+0000 7f6c3ffff640 1 -- 172.21.15.59:0/2578458224 learned_addr learned my addr 172.21.15.59:0/2578458224 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:06.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.445+0000 7f6c3ffff640 1 -- 172.21.15.59:0/2578458224 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c400b2e90 msgr2=0x7f6c401f1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:06.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.445+0000 7f6c3ffff640 1 --2- 172.21.15.59:0/2578458224 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c400b2e90 0x7f6c401f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:06.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.445+0000 7f6c3ffff640 1 -- 172.21.15.59:0/2578458224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c400ced10 msgr2=0x7f6c400c0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:06.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.445+0000 7f6c3ffff640 1 --2- 172.21.15.59:0/2578458224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c400ced10 0x7f6c400c0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:06.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.445+0000 7f6c3ffff640 1 -- 172.21.15.59:0/2578458224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3000bce0 con 0x7f6c400ad970 2023-10-16T14:26:06.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.446+0000 7f6c3ffff640 1 --2- 172.21.15.59:0/2578458224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c400ad970 0x7f6c40159c80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6c30038040 tx=0x7f6c30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:06.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.446+0000 7f6c3d7fa640 1 -- 172.21.15.59:0/2578458224 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3002ea00 con 0x7f6c400ad970 2023-10-16T14:26:06.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.446+0000 7f6c3d7fa640 1 -- 172.21.15.59:0/2578458224 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c30036820 con 0x7f6c400ad970 2023-10-16T14:26:06.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.446+0000 7f6c3d7fa640 1 -- 172.21.15.59:0/2578458224 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c30036bd0 con 0x7f6c400ad970 2023-10-16T14:26:06.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.446+0000 7f6c457ae640 1 -- 172.21.15.59:0/2578458224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c40070370 con 0x7f6c400ad970 2023-10-16T14:26:06.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.446+0000 7f6c457ae640 1 -- 172.21.15.59:0/2578458224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c40070930 con 0x7f6c400ad970 2023-10-16T14:26:06.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.448+0000 7f6c457ae640 1 -- 172.21.15.59:0/2578458224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4004e9b0 con 0x7f6c400ad970 2023-10-16T14:26:06.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.449+0000 7f6c3d7fa640 1 -- 172.21.15.59:0/2578458224 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6c30036d30 con 0x7f6c400ad970 2023-10-16T14:26:06.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.449+0000 7f6c3d7fa640 1 --2- 172.21.15.59:0/2578458224 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6c2006ae70 0x7f6c2006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:06.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.450+0000 7f6c3d7fa640 1 -- 172.21.15.59:0/2578458224 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6c300acc40 con 0x7f6c400ad970 2023-10-16T14:26:06.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.450+0000 7f6c377fe640 1 --2- 172.21.15.59:0/2578458224 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6c2006ae70 0x7f6c2006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:06.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.451+0000 7f6c377fe640 1 --2- 172.21.15.59:0/2578458224 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6c2006ae70 0x7f6c2006d330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6c28006fd0 tx=0x7f6c28006bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:06.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.454+0000 7f6c3d7fa640 1 -- 172.21.15.59:0/2578458224 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6c30077a10 con 0x7f6c400ad970 2023-10-16T14:26:06.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.661+0000 7f6c457ae640 1 -- 172.21.15.59:0/2578458224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6c4004e9b0 con 0x7f6c400ad970 2023-10-16T14:26:06.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.662+0000 7f6c3d7fa640 1 -- 172.21.15.59:0/2578458224 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6c3000b720 con 0x7f6c400ad970 2023-10-16T14:26:06.666 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2023-10-16T14:26:06.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.665+0000 7f6c457ae640 1 -- 172.21.15.59:0/2578458224 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6c2006ae70 msgr2=0x7f6c2006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:06.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.665+0000 7f6c457ae640 1 --2- 172.21.15.59:0/2578458224 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6c2006ae70 0x7f6c2006d330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6c28006fd0 tx=0x7f6c28006bc0 comp rx=0 tx=0).stop 2023-10-16T14:26:06.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.665+0000 7f6c457ae640 1 -- 172.21.15.59:0/2578458224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c400ad970 msgr2=0x7f6c40159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:06.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.665+0000 7f6c457ae640 1 --2- 172.21.15.59:0/2578458224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c400ad970 0x7f6c40159c80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6c30038040 tx=0x7f6c30004a40 comp rx=0 tx=0).stop 2023-10-16T14:26:06.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.665+0000 7f6c457ae640 1 -- 172.21.15.59:0/2578458224 shutdown_connections 2023-10-16T14:26:06.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.665+0000 7f6c457ae640 1 --2- 172.21.15.59:0/2578458224 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6c2006ae70 0x7f6c2006d330 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:06.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.665+0000 7f6c457ae640 1 --2- 172.21.15.59:0/2578458224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c400ced10 0x7f6c400c0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:06.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.665+0000 7f6c457ae640 1 --2- 172.21.15.59:0/2578458224 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c400b2e90 0x7f6c401f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:06.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.665+0000 7f6c457ae640 1 --2- 172.21.15.59:0/2578458224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c400ad970 0x7f6c40159c80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:06.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.665+0000 7f6c457ae640 1 -- 172.21.15.59:0/2578458224 >> 172.21.15.59:0/2578458224 conn(0x7f6c40069fc0 msgr2=0x7f6c4006c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:06.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.665+0000 7f6c457ae640 1 -- 172.21.15.59:0/2578458224 shutdown_connections 2023-10-16T14:26:06.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:06.666+0000 7f6c457ae640 1 -- 172.21.15.59:0/2578458224 wait complete. 2023-10-16T14:26:06.688 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi059.front.sepia.ceph.com... 2023-10-16T14:26:06.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:06.689 DEBUG:teuthology.orchestra.run.smithi059:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-16T14:26:06.787 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi059.stderr:ceph-fuse[93786]: fuse finished with error 0 and tester_r 0 2023-10-16T14:26:06.795 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T14:26:06.838 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-16T14:26:06.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:06.838 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-16T14:26:06.905 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:26:07.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.128+0000 7f18e1db6640 1 Processor -- start 2023-10-16T14:26:07.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.128+0000 7f18e1db6640 1 -- start start 2023-10-16T14:26:07.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.130+0000 7f18e1db6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f18dc0c20e0 0x7f18dc0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:07.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.130+0000 7f18e1db6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18dc071630 0x7f18dc0cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:07.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.130+0000 7f18e1db6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18dc0c2570 con 0x7f18dc0c9e00 2023-10-16T14:26:07.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.130+0000 7f18e1db6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18dc0cde00 con 0x7f18dc0c20e0 2023-10-16T14:26:07.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.130+0000 7f18e1db6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc071e40 con 0x7f18dc071630 2023-10-16T14:26:07.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.130+0000 7f18daffd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f18dc0c20e0 0x7f18dc0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:07.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.130+0000 7f18dbfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18dc071630 0x7f18dc0cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:07.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.131+0000 7f18daffd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f18dc0c20e0 0x7f18dc0710f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.59:46022/0 (socket says 172.21.15.59:46022) 2023-10-16T14:26:07.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.131+0000 7f18daffd640 1 -- 172.21.15.59:0/2534679349 learned_addr learned my addr 172.21.15.59:0/2534679349 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:07.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.131+0000 7f18dbfff640 1 -- 172.21.15.59:0/2534679349 >> v2:172.21.15.151:3300/0 conn(0x7f18dc0c20e0 msgr2=0x7f18dc0710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:07.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.131+0000 7f18dbfff640 1 --2- 172.21.15.59:0/2534679349 >> v2:172.21.15.151:3300/0 conn(0x7f18dc0c20e0 0x7f18dc0710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:07.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.131+0000 7f18dbfff640 1 -- 172.21.15.59:0/2534679349 >> v1:172.21.15.151:6789/0 conn(0x7f18dc0c9e00 legacy=0x7f18dc0ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:07.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.131+0000 7f18dbfff640 1 -- 172.21.15.59:0/2534679349 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc072120 con 0x7f18dc071630 2023-10-16T14:26:07.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.132+0000 7f18daffd640 1 --2- 172.21.15.59:0/2534679349 >> v2:172.21.15.151:3300/0 conn(0x7f18dc0c20e0 0x7f18dc0710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:26:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.133+0000 7f18dbfff640 1 --2- 172.21.15.59:0/2534679349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18dc071630 0x7f18dc0cca00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009d90 tx=0x7f18d402beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c53d56f567481e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.133+0000 7f18da7fc640 1 -- 172.21.15.59:0/2534679349 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d402cc60 con 0x7f18dc071630 2023-10-16T14:26:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.133+0000 7f18da7fc640 1 -- 172.21.15.59:0/2534679349 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d402cdc0 con 0x7f18dc071630 2023-10-16T14:26:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.133+0000 7f18da7fc640 1 -- 172.21.15.59:0/2534679349 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d4034660 con 0x7f18dc071630 2023-10-16T14:26:07.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.134+0000 7f18e1db6640 1 -- 172.21.15.59:0/2534679349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18dc071630 msgr2=0x7f18dc0cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:07.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.134+0000 7f18e1db6640 1 --2- 172.21.15.59:0/2534679349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18dc071630 0x7f18dc0cca00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009d90 tx=0x7f18d402beb0 comp rx=0 tx=0).stop 2023-10-16T14:26:07.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.134+0000 7f18e1db6640 1 -- 172.21.15.59:0/2534679349 shutdown_connections 2023-10-16T14:26:07.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.134+0000 7f18e1db6640 1 --2- 172.21.15.59:0/2534679349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18dc071630 0x7f18dc0cca00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:07.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.134+0000 7f18e1db6640 1 --2- 172.21.15.59:0/2534679349 >> v2:172.21.15.151:3300/0 conn(0x7f18dc0c20e0 0x7f18dc0710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:07.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.134+0000 7f18e1db6640 1 -- 172.21.15.59:0/2534679349 >> 172.21.15.59:0/2534679349 conn(0x7f18dc06c1c0 msgr2=0x7f18dc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:07.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.134+0000 7f18e1db6640 1 -- 172.21.15.59:0/2534679349 shutdown_connections 2023-10-16T14:26:07.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.134+0000 7f18e1db6640 1 -- 172.21.15.59:0/2534679349 wait complete. 2023-10-16T14:26:07.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.137+0000 7f18e1db6640 1 Processor -- start 2023-10-16T14:26:07.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.137+0000 7f18e1db6640 1 -- start start 2023-10-16T14:26:07.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.138+0000 7f18e1db6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18dc071630 0x7f18dc153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:07.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.138+0000 7f18e1db6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18dc0c20e0 0x7f18dc154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:07.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.138+0000 7f18e1db6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18dc0c9e00 0x7f18dc15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:07.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.138+0000 7f18e1db6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc150af0 con 0x7f18dc0c20e0 2023-10-16T14:26:07.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.138+0000 7f18e1db6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc150dd0 con 0x7f18dc071630 2023-10-16T14:26:07.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.138+0000 7f18e1db6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc1510b0 con 0x7f18dc0c9e00 2023-10-16T14:26:07.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.138+0000 7f18daffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18dc0c20e0 0x7f18dc154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:07.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.139+0000 7f18daffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18dc0c20e0 0x7f18dc154750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51030/0 (socket says 172.21.15.59:51030) 2023-10-16T14:26:07.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.139+0000 7f18daffd640 1 -- 172.21.15.59:0/4070396571 learned_addr learned my addr 172.21.15.59:0/4070396571 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:07.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.139+0000 7f18db7fe640 1 --2- 172.21.15.59:0/4070396571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18dc071630 0x7f18dc153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:07.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.139+0000 7f18dbfff640 1 --2- 172.21.15.59:0/4070396571 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18dc0c9e00 0x7f18dc15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:07.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.139+0000 7f18daffd640 1 -- 172.21.15.59:0/4070396571 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18dc0c9e00 msgr2=0x7f18dc15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:07.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.139+0000 7f18daffd640 1 --2- 172.21.15.59:0/4070396571 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18dc0c9e00 0x7f18dc15a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:07.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.139+0000 7f18daffd640 1 -- 172.21.15.59:0/4070396571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18dc071630 msgr2=0x7f18dc153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:07.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.139+0000 7f18daffd640 1 --2- 172.21.15.59:0/4070396571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18dc071630 0x7f18dc153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:07.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.139+0000 7f18daffd640 1 -- 172.21.15.59:0/4070396571 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc0094d0 con 0x7f18dc0c20e0 2023-10-16T14:26:07.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.139+0000 7f18dbfff640 1 --2- 172.21.15.59:0/4070396571 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18dc0c9e00 0x7f18dc15a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:07.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.139+0000 7f18daffd640 1 --2- 172.21.15.59:0/4070396571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18dc0c20e0 0x7f18dc154750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f18cc00e9b0 tx=0x7f18cc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:07.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.140+0000 7f18d3fff640 1 -- 172.21.15.59:0/4070396571 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc00c9a0 con 0x7f18dc0c20e0 2023-10-16T14:26:07.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.140+0000 7f18d3fff640 1 -- 172.21.15.59:0/4070396571 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc00cb00 con 0x7f18dc0c20e0 2023-10-16T14:26:07.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.140+0000 7f18d3fff640 1 -- 172.21.15.59:0/4070396571 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc00ce70 con 0x7f18dc0c20e0 2023-10-16T14:26:07.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.140+0000 7f18e1db6640 1 -- 172.21.15.59:0/4070396571 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d4009a70 con 0x7f18dc0c20e0 2023-10-16T14:26:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.140+0000 7f18e1db6640 1 -- 172.21.15.59:0/4070396571 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18dc151670 con 0x7f18dc0c20e0 2023-10-16T14:26:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.141+0000 7f18e1db6640 1 -- 172.21.15.59:0/4070396571 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18dc073ef0 con 0x7f18dc0c20e0 2023-10-16T14:26:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.142+0000 7f18d3fff640 1 -- 172.21.15.59:0/4070396571 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f18cc013470 con 0x7f18dc0c20e0 2023-10-16T14:26:07.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.144+0000 7f18d3fff640 1 --2- 172.21.15.59:0/4070396571 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f18bc06ae70 0x7f18bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:07.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.144+0000 7f18d3fff640 1 -- 172.21.15.59:0/4070396571 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f18cc089f70 con 0x7f18dc0c20e0 2023-10-16T14:26:07.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.144+0000 7f18db7fe640 1 --2- 172.21.15.59:0/4070396571 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f18bc06ae70 0x7f18bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:07.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.145+0000 7f18db7fe640 1 --2- 172.21.15.59:0/4070396571 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f18bc06ae70 0x7f18bc06d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f18c4001640 tx=0x7f18c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:07.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.148+0000 7f18d3fff640 1 -- 172.21.15.59:0/4070396571 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f18cc054c90 con 0x7f18dc0c20e0 2023-10-16T14:26:07.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.343+0000 7f18e1db6640 1 -- 172.21.15.59:0/4070396571 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18dc0b42f0 con 0x7f18dc0c20e0 2023-10-16T14:26:07.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.345+0000 7f18d3fff640 1 -- 172.21.15.59:0/4070396571 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f18cc017090 con 0x7f18dc0c20e0 2023-10-16T14:26:07.349 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:07.349 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:25:53.209862+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:26:07.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.348+0000 7f18e1db6640 1 -- 172.21.15.59:0/4070396571 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f18bc06ae70 msgr2=0x7f18bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:07.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.348+0000 7f18e1db6640 1 --2- 172.21.15.59:0/4070396571 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f18bc06ae70 0x7f18bc06d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f18c4001640 tx=0x7f18c4009040 comp rx=0 tx=0).stop 2023-10-16T14:26:07.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.348+0000 7f18e1db6640 1 -- 172.21.15.59:0/4070396571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18dc0c20e0 msgr2=0x7f18dc154750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:07.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.348+0000 7f18e1db6640 1 --2- 172.21.15.59:0/4070396571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18dc0c20e0 0x7f18dc154750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f18cc00e9b0 tx=0x7f18cc00ee70 comp rx=0 tx=0).stop 2023-10-16T14:26:07.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.348+0000 7f18e1db6640 1 -- 172.21.15.59:0/4070396571 shutdown_connections 2023-10-16T14:26:07.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.348+0000 7f18e1db6640 1 --2- 172.21.15.59:0/4070396571 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f18bc06ae70 0x7f18bc06d330 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:07.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.348+0000 7f18e1db6640 1 --2- 172.21.15.59:0/4070396571 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18dc0c9e00 0x7f18dc15a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:07.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.348+0000 7f18e1db6640 1 --2- 172.21.15.59:0/4070396571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18dc0c20e0 0x7f18dc154750 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:07.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.348+0000 7f18e1db6640 1 --2- 172.21.15.59:0/4070396571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18dc071630 0x7f18dc153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:07.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.348+0000 7f18e1db6640 1 -- 172.21.15.59:0/4070396571 >> 172.21.15.59:0/4070396571 conn(0x7f18dc06c1c0 msgr2=0x7f18dc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:07.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.348+0000 7f18e1db6640 1 -- 172.21.15.59:0/4070396571 shutdown_connections 2023-10-16T14:26:07.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.348+0000 7f18e1db6640 1 -- 172.21.15.59:0/4070396571 wait complete. 2023-10-16T14:26:07.372 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:26:07.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.593+0000 7fabb8a52640 1 Processor -- start 2023-10-16T14:26:07.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.594+0000 7fabb8a52640 1 -- start start 2023-10-16T14:26:07.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.595+0000 7fabb8a52640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fabb415c9d0 0x7fabb40cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:07.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.595+0000 7fabb8a52640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fabb40d16a0 0x7fabb40cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:07.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.595+0000 7fabb8a52640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb40b2f90 con 0x7fabb40ce4d0 2023-10-16T14:26:07.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.595+0000 7fabb8a52640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb40d0320 con 0x7fabb415c9d0 2023-10-16T14:26:07.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.595+0000 7fabb8a52640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb40d0600 con 0x7fabb40d16a0 2023-10-16T14:26:07.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.595+0000 7fabb37fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fabb415c9d0 0x7fabb40cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:07.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.595+0000 7fabb37fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fabb415c9d0 0x7fabb40cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51044/0 (socket says 172.21.15.59:51044) 2023-10-16T14:26:07.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.595+0000 7fabb37fe640 1 -- 172.21.15.59:0/3880186411 learned_addr learned my addr 172.21.15.59:0/3880186411 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:07.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.595+0000 7fababfff640 1 --2- 172.21.15.59:0/3880186411 >> v2:172.21.15.151:3300/0 conn(0x7fabb40d16a0 0x7fabb40cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:07.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.596+0000 7fabb37fe640 1 -- 172.21.15.59:0/3880186411 >> v2:172.21.15.151:3300/0 conn(0x7fabb40d16a0 msgr2=0x7fabb40cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:07.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.596+0000 7fabb37fe640 1 --2- 172.21.15.59:0/3880186411 >> v2:172.21.15.151:3300/0 conn(0x7fabb40d16a0 0x7fabb40cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:07.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.596+0000 7fabb37fe640 1 -- 172.21.15.59:0/3880186411 >> v1:172.21.15.151:6789/0 conn(0x7fabb40ce4d0 legacy=0x7fabb4160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.596+0000 7fabb37fe640 1 -- 172.21.15.59:0/3880186411 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb40d08e0 con 0x7fabb415c9d0 2023-10-16T14:26:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.597+0000 7fabb37fe640 1 --2- 172.21.15.59:0/3880186411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabb415c9d0 0x7fabb40cdf90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fabb408bc00 tx=0x7faba402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25cf67f010248575 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.597+0000 7fabb2ffd640 1 -- 172.21.15.59:0/3880186411 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba4031870 con 0x7fabb415c9d0 2023-10-16T14:26:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.597+0000 7fabb2ffd640 1 -- 172.21.15.59:0/3880186411 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba40319d0 con 0x7fabb415c9d0 2023-10-16T14:26:07.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.597+0000 7fabb2ffd640 1 -- 172.21.15.59:0/3880186411 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba4031d60 con 0x7fabb415c9d0 2023-10-16T14:26:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.598+0000 7fabb8a52640 1 -- 172.21.15.59:0/3880186411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabb415c9d0 msgr2=0x7fabb40cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.598+0000 7fabb8a52640 1 --2- 172.21.15.59:0/3880186411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabb415c9d0 0x7fabb40cdf90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fabb408bc00 tx=0x7faba402b910 comp rx=0 tx=0).stop 2023-10-16T14:26:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.598+0000 7fabb8a52640 1 -- 172.21.15.59:0/3880186411 shutdown_connections 2023-10-16T14:26:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.598+0000 7fabb8a52640 1 --2- 172.21.15.59:0/3880186411 >> v2:172.21.15.151:3300/0 conn(0x7fabb40d16a0 0x7fabb40cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:07.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.598+0000 7fabb8a52640 1 --2- 172.21.15.59:0/3880186411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabb415c9d0 0x7fabb40cdf90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.598+0000 7fabb8a52640 1 -- 172.21.15.59:0/3880186411 >> 172.21.15.59:0/3880186411 conn(0x7fabb409bad0 msgr2=0x7fabb40d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.598+0000 7fabb8a52640 1 -- 172.21.15.59:0/3880186411 shutdown_connections 2023-10-16T14:26:07.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.598+0000 7fabb8a52640 1 -- 172.21.15.59:0/3880186411 wait complete. 2023-10-16T14:26:07.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.600+0000 7fabb8a52640 1 Processor -- start 2023-10-16T14:26:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.600+0000 7fabb8a52640 1 -- start start 2023-10-16T14:26:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.601+0000 7fabb8a52640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabb40ce4d0 0x7fabb41f6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.601+0000 7fabb8a52640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fabb40d16a0 0x7fabb4159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.601+0000 7fabb8a52640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabb415c9d0 0x7fabb41f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:07.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.601+0000 7fabb8a52640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb41f59b0 con 0x7fabb415c9d0 2023-10-16T14:26:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.601+0000 7fabb8a52640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb41f2ed0 con 0x7fabb40ce4d0 2023-10-16T14:26:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.601+0000 7fabb8a52640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb41f31b0 con 0x7fabb40d16a0 2023-10-16T14:26:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.601+0000 7fabb3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabb415c9d0 0x7fabb41f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.601+0000 7fabb3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabb415c9d0 0x7fabb41f2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51048/0 (socket says 172.21.15.59:51048) 2023-10-16T14:26:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.601+0000 7fabb3fff640 1 -- 172.21.15.59:0/4281284947 learned_addr learned my addr 172.21.15.59:0/4281284947 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:07.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.601+0000 7fabb37fe640 1 --2- 172.21.15.59:0/4281284947 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabb40ce4d0 0x7fabb41f6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.602+0000 7fababfff640 1 --2- 172.21.15.59:0/4281284947 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fabb40d16a0 0x7fabb4159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.602+0000 7fabb3fff640 1 -- 172.21.15.59:0/4281284947 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fabb40d16a0 msgr2=0x7fabb4159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.602+0000 7fabb3fff640 1 --2- 172.21.15.59:0/4281284947 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fabb40d16a0 0x7fabb4159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.602+0000 7fabb3fff640 1 -- 172.21.15.59:0/4281284947 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabb40ce4d0 msgr2=0x7fabb41f6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:07.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.602+0000 7fabb3fff640 1 --2- 172.21.15.59:0/4281284947 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabb40ce4d0 0x7fabb41f6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:07.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.602+0000 7fabb3fff640 1 -- 172.21.15.59:0/4281284947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba40094d0 con 0x7fabb415c9d0 2023-10-16T14:26:07.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.602+0000 7fabb3fff640 1 --2- 172.21.15.59:0/4281284947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabb415c9d0 0x7fabb41f2360 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fabac00c780 tx=0x7fabac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:07.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.602+0000 7fabb0ff9640 1 -- 172.21.15.59:0/4281284947 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac003d80 con 0x7fabb415c9d0 2023-10-16T14:26:07.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.602+0000 7fabb0ff9640 1 -- 172.21.15.59:0/4281284947 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac00ce90 con 0x7fabb415c9d0 2023-10-16T14:26:07.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.602+0000 7fabb0ff9640 1 -- 172.21.15.59:0/4281284947 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac0052b0 con 0x7fabb415c9d0 2023-10-16T14:26:07.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.602+0000 7fabb8a52640 1 -- 172.21.15.59:0/4281284947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb41f5c50 con 0x7fabb415c9d0 2023-10-16T14:26:07.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.603+0000 7fabb8a52640 1 -- 172.21.15.59:0/4281284947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb40c8e80 con 0x7fabb415c9d0 2023-10-16T14:26:07.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.604+0000 7fabb8a52640 1 -- 172.21.15.59:0/4281284947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb41f6170 con 0x7fabb415c9d0 2023-10-16T14:26:07.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.605+0000 7fabb0ff9640 1 -- 172.21.15.59:0/4281284947 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fabac005410 con 0x7fabb415c9d0 2023-10-16T14:26:07.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.606+0000 7fabb0ff9640 1 --2- 172.21.15.59:0/4281284947 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fab9406ae70 0x7fab9406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:07.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.606+0000 7fabb0ff9640 1 -- 172.21.15.59:0/4281284947 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fabac088d40 con 0x7fabb415c9d0 2023-10-16T14:26:07.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.607+0000 7fabb37fe640 1 --2- 172.21.15.59:0/4281284947 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fab9406ae70 0x7fab9406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:07.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.608+0000 7fabb37fe640 1 --2- 172.21.15.59:0/4281284947 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fab9406ae70 0x7fab9406d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faba4036000 tx=0x7faba403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:07.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.611+0000 7fabb0ff9640 1 -- 172.21.15.59:0/4281284947 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fabb41f6170 con 0x7fabb415c9d0 2023-10-16T14:26:07.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.806+0000 7fabb8a52640 1 -- 172.21.15.59:0/4281284947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabb41f6170 con 0x7fabb415c9d0 2023-10-16T14:26:07.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.808+0000 7fabb0ff9640 1 -- 172.21.15.59:0/4281284947 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18350 (secure 0 0 0) 0x7fabb41f6170 con 0x7fabb415c9d0 2023-10-16T14:26:07.812 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:07.812 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:25:53.209862+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:26:07.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.811+0000 7fabb8a52640 1 -- 172.21.15.59:0/4281284947 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fab9406ae70 msgr2=0x7fab9406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:07.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.811+0000 7fabb8a52640 1 --2- 172.21.15.59:0/4281284947 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fab9406ae70 0x7fab9406d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faba4036000 tx=0x7faba403c040 comp rx=0 tx=0).stop 2023-10-16T14:26:07.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.811+0000 7fabb8a52640 1 -- 172.21.15.59:0/4281284947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabb415c9d0 msgr2=0x7fabb41f2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:07.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.811+0000 7fabb8a52640 1 --2- 172.21.15.59:0/4281284947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabb415c9d0 0x7fabb41f2360 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fabac00c780 tx=0x7fabac00cc40 comp rx=0 tx=0).stop 2023-10-16T14:26:07.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.811+0000 7fabb8a52640 1 -- 172.21.15.59:0/4281284947 shutdown_connections 2023-10-16T14:26:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.811+0000 7fabb8a52640 1 --2- 172.21.15.59:0/4281284947 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fab9406ae70 0x7fab9406d330 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.811+0000 7fabb8a52640 1 --2- 172.21.15.59:0/4281284947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabb415c9d0 0x7fabb41f2360 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.811+0000 7fabb8a52640 1 --2- 172.21.15.59:0/4281284947 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fabb40d16a0 0x7fabb4159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.811+0000 7fabb8a52640 1 --2- 172.21.15.59:0/4281284947 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabb40ce4d0 0x7fabb41f6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.811+0000 7fabb8a52640 1 -- 172.21.15.59:0/4281284947 >> 172.21.15.59:0/4281284947 conn(0x7fabb409bad0 msgr2=0x7fabb406b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:07.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.811+0000 7fabb8a52640 1 -- 172.21.15.59:0/4281284947 shutdown_connections 2023-10-16T14:26:07.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:07.811+0000 7fabb8a52640 1 -- 172.21.15.59:0/4281284947 wait complete. 2023-10-16T14:26:07.835 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-16T14:26:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.062+0000 7f9c0eeb4640 1 Processor -- start 2023-10-16T14:26:08.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.062+0000 7f9c0eeb4640 1 -- start start 2023-10-16T14:26:08.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.063+0000 7f9c0eeb4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c0815aa60 0x7f9c0815bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:08.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.063+0000 7f9c0eeb4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9c08069de0 0x7f9c080b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:08.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.064+0000 7f9c0eeb4640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c080ccf00 con 0x7f9c080b0a70 2023-10-16T14:26:08.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.064+0000 7f9c0eeb4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c080b0f00 con 0x7f9c08069de0 2023-10-16T14:26:08.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.064+0000 7f9c0eeb4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0806a5f0 con 0x7f9c0815aa60 2023-10-16T14:26:08.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.064+0000 7f9c0d451640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9c080b0a70 0x7f9c0815e4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38280/0 (socket says 172.21.15.59:38280) 2023-10-16T14:26:08.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.064+0000 7f9c0d451640 1 -- 172.21.15.59:0/3226017123 learned_addr learned my addr 172.21.15.59:0/3226017123 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:08.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.064+0000 7f9c077fe640 1 -- 172.21.15.59:0/3226017123 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672676139 0 0) 0x7f9c080ccf00 con 0x7f9c080b0a70 2023-10-16T14:26:08.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.064+0000 7f9c07fff640 1 --2- 172.21.15.59:0/3226017123 >> v2:172.21.15.151:3300/0 conn(0x7f9c08069de0 0x7f9c080b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:08.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.064+0000 7f9c077fe640 1 -- 172.21.15.59:0/3226017123 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bf4003520 con 0x7f9c080b0a70 2023-10-16T14:26:08.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.064+0000 7f9c0cc50640 1 --2- 172.21.15.59:0/3226017123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c0815aa60 0x7f9c0815bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:08.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.065+0000 7f9c077fe640 1 -- 172.21.15.59:0/3226017123 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2050062061 0 0) 0x7f9bf4003520 con 0x7f9c080b0a70 2023-10-16T14:26:08.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.065+0000 7f9c077fe640 1 -- 172.21.15.59:0/3226017123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c0815aa60 msgr2=0x7f9c0815bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:08.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.065+0000 7f9c077fe640 1 --2- 172.21.15.59:0/3226017123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c0815aa60 0x7f9c0815bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:08.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.065+0000 7f9c077fe640 1 -- 172.21.15.59:0/3226017123 >> v2:172.21.15.151:3300/0 conn(0x7f9c08069de0 msgr2=0x7f9c080b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:08.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.065+0000 7f9c077fe640 1 --2- 172.21.15.59:0/3226017123 >> v2:172.21.15.151:3300/0 conn(0x7f9c08069de0 0x7f9c080b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:08.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.065+0000 7f9c077fe640 1 -- 172.21.15.59:0/3226017123 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0806a8d0 con 0x7f9c080b0a70 2023-10-16T14:26:08.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.065+0000 7f9c077fe640 1 -- 172.21.15.59:0/3226017123 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f9c00001670 con 0x7f9c080b0a70 2023-10-16T14:26:08.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.065+0000 7f9c077fe640 1 -- 172.21.15.59:0/3226017123 >> v1:172.21.15.59:6789/0 conn(0x7f9c080b0a70 legacy=0x7f9c0815e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:08.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.065+0000 7f9c077fe640 1 --2- 172.21.15.59:0/3226017123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf4003970 0x7f9bf4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:08.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.065+0000 7f9c077fe640 1 --2- 172.21.15.59:0/3226017123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c0815aa60 0x7f9bf40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:08.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.065+0000 7f9c077fe640 1 --2- 172.21.15.59:0/3226017123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bf4004d00 0x7f9bf4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:08.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.065+0000 7f9c077fe640 1 -- 172.21.15.59:0/3226017123 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080b0f00 con 0x7f9bf4003970 2023-10-16T14:26:08.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.065+0000 7f9c077fe640 1 -- 172.21.15.59:0/3226017123 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0806a5f0 con 0x7f9bf4004d00 2023-10-16T14:26:08.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.065+0000 7f9c077fe640 1 -- 172.21.15.59:0/3226017123 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf400bab0 con 0x7f9c0815aa60 2023-10-16T14:26:08.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.065+0000 7f9c0cc50640 1 --2- 172.21.15.59:0/3226017123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf4003970 0x7f9bf4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:08.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.066+0000 7f9c0cc50640 1 -- 172.21.15.59:0/3226017123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c0815aa60 msgr2=0x7f9bf40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:08.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.066+0000 7f9c0cc50640 1 --2- 172.21.15.59:0/3226017123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c0815aa60 0x7f9bf40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:08.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.066+0000 7f9c0d451640 1 --2- 172.21.15.59:0/3226017123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bf4004d00 0x7f9bf4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:08.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.066+0000 7f9c0cc50640 1 -- 172.21.15.59:0/3226017123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bf4004d00 msgr2=0x7f9bf4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:08.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.066+0000 7f9c0cc50640 1 --2- 172.21.15.59:0/3226017123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bf4004d00 0x7f9bf4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:08.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.066+0000 7f9c0cc50640 1 -- 172.21.15.59:0/3226017123 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf4003520 con 0x7f9bf4003970 2023-10-16T14:26:08.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.066+0000 7f9c0d451640 1 --2- 172.21.15.59:0/3226017123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bf4004d00 0x7f9bf4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:08.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.067+0000 7f9c0cc50640 1 --2- 172.21.15.59:0/3226017123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf4003970 0x7f9bf4003d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80073e0 tx=0x7f9bf40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57be99bfe5ca25f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:08.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.067+0000 7f9c077fe640 1 -- 172.21.15.59:0/3226017123 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf802cd40 con 0x7f9bf4003970 2023-10-16T14:26:08.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.067+0000 7f9c077fe640 1 -- 172.21.15.59:0/3226017123 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf8034440 con 0x7f9bf4003970 2023-10-16T14:26:08.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.067+0000 7f9c077fe640 1 -- 172.21.15.59:0/3226017123 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf802cea0 con 0x7f9bf4003970 2023-10-16T14:26:08.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.068+0000 7f9c0eeb4640 1 -- 172.21.15.59:0/3226017123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf4003970 msgr2=0x7f9bf4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:08.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.068+0000 7f9c0eeb4640 1 --2- 172.21.15.59:0/3226017123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf4003970 0x7f9bf4003d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80073e0 tx=0x7f9bf40057f0 comp rx=0 tx=0).stop 2023-10-16T14:26:08.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.068+0000 7f9c0d451640 1 -- 172.21.15.59:0/3226017123 reap_dead start 2023-10-16T14:26:08.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.068+0000 7f9c0eeb4640 1 -- 172.21.15.59:0/3226017123 shutdown_connections 2023-10-16T14:26:08.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.068+0000 7f9c0eeb4640 1 -- 172.21.15.59:0/3226017123 >> 172.21.15.59:0/3226017123 conn(0x7f9c080cf660 msgr2=0x7f9c080cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:08.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.068+0000 7f9c0eeb4640 1 -- 172.21.15.59:0/3226017123 shutdown_connections 2023-10-16T14:26:08.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.068+0000 7f9c0eeb4640 1 -- 172.21.15.59:0/3226017123 wait complete. 2023-10-16T14:26:08.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.070+0000 7f9c0eeb4640 1 Processor -- start 2023-10-16T14:26:08.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.070+0000 7f9c0eeb4640 1 -- start start 2023-10-16T14:26:08.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.071+0000 7f9c0eeb4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bf4003970 0x7f9c081f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:08.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.071+0000 7f9c0eeb4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c0814eda0 0x7f9c08158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:08.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.071+0000 7f9c0eeb4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c08159150 0x7f9c080cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:08.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.071+0000 7f9c0eeb4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080c2280 con 0x7f9c08159150 2023-10-16T14:26:08.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.071+0000 7f9c0eeb4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080c24d0 con 0x7f9c0814eda0 2023-10-16T14:26:08.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.071+0000 7f9c0eeb4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080c9070 con 0x7f9bf4003970 2023-10-16T14:26:08.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.071+0000 7f9c0d451640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c08159150 0x7f9c080cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:08.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.071+0000 7f9c0d451640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c08159150 0x7f9c080cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51066/0 (socket says 172.21.15.59:51066) 2023-10-16T14:26:08.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.071+0000 7f9c0d451640 1 -- 172.21.15.59:0/686014933 learned_addr learned my addr 172.21.15.59:0/686014933 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:08.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.072+0000 7f9c07fff640 1 --2- 172.21.15.59:0/686014933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c0814eda0 0x7f9c08158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:08.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.072+0000 7f9c0cc50640 1 --2- 172.21.15.59:0/686014933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bf4003970 0x7f9c081f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:08.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.072+0000 7f9c0d451640 1 -- 172.21.15.59:0/686014933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bf4003970 msgr2=0x7f9c081f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:08.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.072+0000 7f9c0d451640 1 --2- 172.21.15.59:0/686014933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bf4003970 0x7f9c081f19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:08.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.072+0000 7f9c0d451640 1 -- 172.21.15.59:0/686014933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c0814eda0 msgr2=0x7f9c08158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:08.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.072+0000 7f9c0d451640 1 --2- 172.21.15.59:0/686014933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c0814eda0 0x7f9c08158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:08.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.072+0000 7f9c0d451640 1 -- 172.21.15.59:0/686014933 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c080c9350 con 0x7f9c08159150 2023-10-16T14:26:08.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.072+0000 7f9c0cc50640 1 --2- 172.21.15.59:0/686014933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bf4003970 0x7f9c081f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:08.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.072+0000 7f9c0d451640 1 --2- 172.21.15.59:0/686014933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c08159150 0x7f9c080cd230 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9c080c30c0 tx=0x7f9c0000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:08.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.073+0000 7f9c057fa640 1 -- 172.21.15.59:0/686014933 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00007230 con 0x7f9c08159150 2023-10-16T14:26:08.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.073+0000 7f9c057fa640 1 -- 172.21.15.59:0/686014933 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c00007390 con 0x7f9c08159150 2023-10-16T14:26:08.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.073+0000 7f9c057fa640 1 -- 172.21.15.59:0/686014933 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c000047e0 con 0x7f9c08159150 2023-10-16T14:26:08.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.073+0000 7f9c0eeb4640 1 -- 172.21.15.59:0/686014933 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c081f1f00 con 0x7f9c08159150 2023-10-16T14:26:08.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.073+0000 7f9c0eeb4640 1 -- 172.21.15.59:0/686014933 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c080cd950 con 0x7f9c08159150 2023-10-16T14:26:08.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.074+0000 7f9c0eeb4640 1 -- 172.21.15.59:0/686014933 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c080c94e0 con 0x7f9c08159150 2023-10-16T14:26:08.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.075+0000 7f9c057fa640 1 -- 172.21.15.59:0/686014933 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9c00004940 con 0x7f9c08159150 2023-10-16T14:26:08.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.077+0000 7f9c057fa640 1 --2- 172.21.15.59:0/686014933 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9be806ae70 0x7f9be806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:08.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.077+0000 7f9c057fa640 1 -- 172.21.15.59:0/686014933 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9c00089680 con 0x7f9c08159150 2023-10-16T14:26:08.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.077+0000 7f9c0cc50640 1 --2- 172.21.15.59:0/686014933 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9be806ae70 0x7f9be806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:08.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.078+0000 7f9c0cc50640 1 --2- 172.21.15.59:0/686014933 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9be806ae70 0x7f9be806d330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8036000 tx=0x7f9bf8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:08.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.082+0000 7f9c057fa640 1 -- 172.21.15.59:0/686014933 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9c00054430 con 0x7f9c08159150 2023-10-16T14:26:08.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.313+0000 7f9c0eeb4640 1 -- 172.21.15.59:0/686014933 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9c080cb6c0 con 0x7f9c08159150 2023-10-16T14:26:08.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.653+0000 7f9c057fa640 1 -- 172.21.15.59:0/686014933 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9c00057a50 con 0x7f9c08159150 2023-10-16T14:26:08.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.657+0000 7f9c0eeb4640 1 -- 172.21.15.59:0/686014933 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9be806ae70 msgr2=0x7f9be806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:08.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.657+0000 7f9c0eeb4640 1 --2- 172.21.15.59:0/686014933 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9be806ae70 0x7f9be806d330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8036000 tx=0x7f9bf8030000 comp rx=0 tx=0).stop 2023-10-16T14:26:08.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.657+0000 7f9c0eeb4640 1 -- 172.21.15.59:0/686014933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c08159150 msgr2=0x7f9c080cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.657+0000 7f9c0eeb4640 1 --2- 172.21.15.59:0/686014933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c08159150 0x7f9c080cd230 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9c080c30c0 tx=0x7f9c0000dc00 comp rx=0 tx=0).stop 2023-10-16T14:26:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.657+0000 7f9c0eeb4640 1 -- 172.21.15.59:0/686014933 shutdown_connections 2023-10-16T14:26:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.657+0000 7f9c0eeb4640 1 --2- 172.21.15.59:0/686014933 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9be806ae70 0x7f9be806d330 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.657+0000 7f9c0eeb4640 1 --2- 172.21.15.59:0/686014933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c08159150 0x7f9c080cd230 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.657+0000 7f9c0eeb4640 1 --2- 172.21.15.59:0/686014933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c0814eda0 0x7f9c08158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:08.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.657+0000 7f9c0eeb4640 1 --2- 172.21.15.59:0/686014933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bf4003970 0x7f9c081f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:08.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.657+0000 7f9c0eeb4640 1 -- 172.21.15.59:0/686014933 >> 172.21.15.59:0/686014933 conn(0x7f9c080cf660 msgr2=0x7f9c08155010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:08.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.658+0000 7f9c0eeb4640 1 -- 172.21.15.59:0/686014933 shutdown_connections 2023-10-16T14:26:08.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.658+0000 7f9c0eeb4640 1 -- 172.21.15.59:0/686014933 wait complete. 2023-10-16T14:26:08.682 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-10-16T14:26:08.683 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-16T14:26:08.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.905+0000 7f8d6d07c640 1 Processor -- start 2023-10-16T14:26:08.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.906+0000 7f8d6d07c640 1 -- start start 2023-10-16T14:26:08.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.907+0000 7f8d6d07c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d6815a910 0x7f8d680cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:08.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.907+0000 7f8d6d07c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d680cf340 0x7f8d680cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:08.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.907+0000 7f8d6d07c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8d680cd630 0x7f8d680cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:08.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.907+0000 7f8d6d07c640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d680cdac0 con 0x7f8d680cf340 2023-10-16T14:26:08.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.907+0000 7f8d6d07c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d680b37a0 con 0x7f8d680cd630 2023-10-16T14:26:08.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.907+0000 7f8d6d07c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d680b3a40 con 0x7f8d6815a910 2023-10-16T14:26:08.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.907+0000 7f8d5ffff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d680cf340 0x7f8d680cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:08.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.908+0000 7f8d5ffff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d680cf340 0x7f8d680cd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51076/0 (socket says 172.21.15.59:51076) 2023-10-16T14:26:08.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.908+0000 7f8d5ffff640 1 -- 172.21.15.59:0/1270764607 learned_addr learned my addr 172.21.15.59:0/1270764607 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:08.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.908+0000 7f8d66d9d640 1 --2- 172.21.15.59:0/1270764607 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d6815a910 0x7f8d680cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:08.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.908+0000 7f8d6759e640 1 --2- 172.21.15.59:0/1270764607 >> v2:172.21.15.151:3300/0 conn(0x7f8d680cd630 0x7f8d680cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:08.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.908+0000 7f8d5ffff640 1 -- 172.21.15.59:0/1270764607 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d6815a910 msgr2=0x7f8d680cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:08.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.908+0000 7f8d5ffff640 1 --2- 172.21.15.59:0/1270764607 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d6815a910 0x7f8d680cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:08.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.908+0000 7f8d5ffff640 1 -- 172.21.15.59:0/1270764607 >> v2:172.21.15.151:3300/0 conn(0x7f8d680cd630 msgr2=0x7f8d680cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:08.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.908+0000 7f8d5ffff640 1 --2- 172.21.15.59:0/1270764607 >> v2:172.21.15.151:3300/0 conn(0x7f8d680cd630 0x7f8d680cb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:08.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.908+0000 7f8d5ffff640 1 -- 172.21.15.59:0/1270764607 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d680b3d20 con 0x7f8d680cf340 2023-10-16T14:26:08.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.909+0000 7f8d5ffff640 1 --2- 172.21.15.59:0/1270764607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d680cf340 0x7f8d680cd0f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8d680c4230 tx=0x7f8d5002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb365230c9e8309 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:08.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.910+0000 7f8d6659c640 1 -- 172.21.15.59:0/1270764607 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d500317e0 con 0x7f8d680cf340 2023-10-16T14:26:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.910+0000 7f8d6659c640 1 -- 172.21.15.59:0/1270764607 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d50031940 con 0x7f8d680cf340 2023-10-16T14:26:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.910+0000 7f8d6659c640 1 -- 172.21.15.59:0/1270764607 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d50031cd0 con 0x7f8d680cf340 2023-10-16T14:26:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.910+0000 7f8d6d07c640 1 -- 172.21.15.59:0/1270764607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d680cf340 msgr2=0x7f8d680cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.910+0000 7f8d6d07c640 1 --2- 172.21.15.59:0/1270764607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d680cf340 0x7f8d680cd0f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8d680c4230 tx=0x7f8d5002b880 comp rx=0 tx=0).stop 2023-10-16T14:26:08.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.911+0000 7f8d6d07c640 1 -- 172.21.15.59:0/1270764607 shutdown_connections 2023-10-16T14:26:08.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.911+0000 7f8d6d07c640 1 --2- 172.21.15.59:0/1270764607 >> v2:172.21.15.151:3300/0 conn(0x7f8d680cd630 0x7f8d680cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:08.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.911+0000 7f8d6d07c640 1 --2- 172.21.15.59:0/1270764607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d680cf340 0x7f8d680cd0f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:08.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.911+0000 7f8d6d07c640 1 --2- 172.21.15.59:0/1270764607 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d6815a910 0x7f8d680cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:08.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.911+0000 7f8d6d07c640 1 -- 172.21.15.59:0/1270764607 >> 172.21.15.59:0/1270764607 conn(0x7f8d680d0820 msgr2=0x7f8d680d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:08.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.911+0000 7f8d6d07c640 1 -- 172.21.15.59:0/1270764607 shutdown_connections 2023-10-16T14:26:08.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.911+0000 7f8d6d07c640 1 -- 172.21.15.59:0/1270764607 wait complete. 2023-10-16T14:26:08.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.913+0000 7f8d6d07c640 1 Processor -- start 2023-10-16T14:26:08.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.913+0000 7f8d6d07c640 1 -- start start 2023-10-16T14:26:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.914+0000 7f8d6d07c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d680cd630 0x7f8d68153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.914+0000 7f8d6d07c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d680cf340 0x7f8d6814f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.914+0000 7f8d6d07c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d6815a910 0x7f8d68152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.914+0000 7f8d6d07c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d68156de0 con 0x7f8d680cd630 2023-10-16T14:26:08.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.914+0000 7f8d6d07c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d681520a0 con 0x7f8d6815a910 2023-10-16T14:26:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.914+0000 7f8d6d07c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d68151770 con 0x7f8d680cf340 2023-10-16T14:26:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.914+0000 7f8d66d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d680cd630 0x7f8d68153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.914+0000 7f8d66d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d680cd630 0x7f8d68153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51084/0 (socket says 172.21.15.59:51084) 2023-10-16T14:26:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.914+0000 7f8d66d9d640 1 -- 172.21.15.59:0/3854881610 learned_addr learned my addr 172.21.15.59:0/3854881610 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:08.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.915+0000 7f8d6759e640 1 --2- 172.21.15.59:0/3854881610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d6815a910 0x7f8d68152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.915+0000 7f8d5ffff640 1 --2- 172.21.15.59:0/3854881610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d680cf340 0x7f8d6814f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.915+0000 7f8d66d9d640 1 -- 172.21.15.59:0/3854881610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d680cf340 msgr2=0x7f8d6814f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.915+0000 7f8d66d9d640 1 --2- 172.21.15.59:0/3854881610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d680cf340 0x7f8d6814f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.915+0000 7f8d66d9d640 1 -- 172.21.15.59:0/3854881610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d6815a910 msgr2=0x7f8d68152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.915+0000 7f8d66d9d640 1 --2- 172.21.15.59:0/3854881610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d6815a910 0x7f8d68152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.915+0000 7f8d66d9d640 1 -- 172.21.15.59:0/3854881610 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d500094d0 con 0x7f8d680cd630 2023-10-16T14:26:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.915+0000 7f8d66d9d640 1 --2- 172.21.15.59:0/3854881610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d680cd630 0x7f8d68153c70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800d5f0 tx=0x7f8d5800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.916+0000 7f8d5f7fe640 1 -- 172.21.15.59:0/3854881610 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d580125f0 con 0x7f8d680cd630 2023-10-16T14:26:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.916+0000 7f8d5f7fe640 1 -- 172.21.15.59:0/3854881610 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d58012750 con 0x7f8d680cd630 2023-10-16T14:26:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.916+0000 7f8d5f7fe640 1 -- 172.21.15.59:0/3854881610 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58012b00 con 0x7f8d680cd630 2023-10-16T14:26:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.916+0000 7f8d6d07c640 1 -- 172.21.15.59:0/3854881610 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d68151a50 con 0x7f8d680cd630 2023-10-16T14:26:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.916+0000 7f8d6d07c640 1 -- 172.21.15.59:0/3854881610 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6814fae0 con 0x7f8d680cd630 2023-10-16T14:26:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.917+0000 7f8d6d07c640 1 -- 172.21.15.59:0/3854881610 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d68073ef0 con 0x7f8d680cd630 2023-10-16T14:26:08.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.918+0000 7f8d5f7fe640 1 -- 172.21.15.59:0/3854881610 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8d58012c60 con 0x7f8d680cd630 2023-10-16T14:26:08.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.919+0000 7f8d5f7fe640 1 --2- 172.21.15.59:0/3854881610 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8d4806ae70 0x7f8d4806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:08.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.919+0000 7f8d5f7fe640 1 -- 172.21.15.59:0/3854881610 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8d58089e90 con 0x7f8d680cd630 2023-10-16T14:26:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.920+0000 7f8d5ffff640 1 --2- 172.21.15.59:0/3854881610 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8d4806ae70 0x7f8d4806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.921+0000 7f8d5ffff640 1 --2- 172.21.15.59:0/3854881610 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8d4806ae70 0x7f8d4806d330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8d50036000 tx=0x7f8d5003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:08.923+0000 7f8d5f7fe640 1 -- 172.21.15.59:0/3854881610 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8d58054bb0 con 0x7f8d680cd630 2023-10-16T14:26:09.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.156+0000 7f8d6d07c640 1 -- 172.21.15.59:0/3854881610 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8d6806eb50 con 0x7f8d680cd630 2023-10-16T14:26:09.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.656+0000 7f8d5f7fe640 1 -- 172.21.15.59:0/3854881610 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8d5808b0c0 con 0x7f8d680cd630 2023-10-16T14:26:09.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.659+0000 7f8d6d07c640 1 -- 172.21.15.59:0/3854881610 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8d4806ae70 msgr2=0x7f8d4806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:09.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.659+0000 7f8d6d07c640 1 --2- 172.21.15.59:0/3854881610 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8d4806ae70 0x7f8d4806d330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8d50036000 tx=0x7f8d5003d040 comp rx=0 tx=0).stop 2023-10-16T14:26:09.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.659+0000 7f8d6d07c640 1 -- 172.21.15.59:0/3854881610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d680cd630 msgr2=0x7f8d68153c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:09.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.659+0000 7f8d6d07c640 1 --2- 172.21.15.59:0/3854881610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d680cd630 0x7f8d68153c70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800d5f0 tx=0x7f8d5800dab0 comp rx=0 tx=0).stop 2023-10-16T14:26:09.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.659+0000 7f8d6d07c640 1 -- 172.21.15.59:0/3854881610 shutdown_connections 2023-10-16T14:26:09.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.659+0000 7f8d6d07c640 1 --2- 172.21.15.59:0/3854881610 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8d4806ae70 0x7f8d4806d330 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:09.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.659+0000 7f8d6d07c640 1 --2- 172.21.15.59:0/3854881610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d6815a910 0x7f8d68152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:09.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.659+0000 7f8d6d07c640 1 --2- 172.21.15.59:0/3854881610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d680cf340 0x7f8d6814f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:09.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.659+0000 7f8d6d07c640 1 --2- 172.21.15.59:0/3854881610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d680cd630 0x7f8d68153c70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:09.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.659+0000 7f8d6d07c640 1 -- 172.21.15.59:0/3854881610 >> 172.21.15.59:0/3854881610 conn(0x7f8d680d0820 msgr2=0x7f8d680b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:09.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.660+0000 7f8d6d07c640 1 -- 172.21.15.59:0/3854881610 shutdown_connections 2023-10-16T14:26:09.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.660+0000 7f8d6d07c640 1 -- 172.21.15.59:0/3854881610 wait complete. 2023-10-16T14:26:09.685 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-16T14:26:09.686 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T14:26:09.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.908+0000 7f87fb525640 1 Processor -- start 2023-10-16T14:26:09.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.908+0000 7f87fb525640 1 -- start start 2023-10-16T14:26:09.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.909+0000 7f87fb525640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87f415ad00 0x7f87f40701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:09.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.909+0000 7f87fb525640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f87f415f040 0x7f87f415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:09.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.909+0000 7f87fb525640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f40707f0 con 0x7f87f40b0010 2023-10-16T14:26:09.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.909+0000 7f87fb525640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f4070ad0 con 0x7f87f415ad00 2023-10-16T14:26:09.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.909+0000 7f87fb525640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f415b1d0 con 0x7f87f415f040 2023-10-16T14:26:09.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.910+0000 7f87f8ac0640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87f415ad00 0x7f87f40701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:09.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.910+0000 7f87f8ac0640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87f415ad00 0x7f87f40701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51088/0 (socket says 172.21.15.59:51088) 2023-10-16T14:26:09.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.910+0000 7f87f8ac0640 1 -- 172.21.15.59:0/948949050 learned_addr learned my addr 172.21.15.59:0/948949050 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:09.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.910+0000 7f87f9ac2640 1 --2- 172.21.15.59:0/948949050 >> v2:172.21.15.151:3300/0 conn(0x7f87f415f040 0x7f87f415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:09.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.910+0000 7f87f8ac0640 1 -- 172.21.15.59:0/948949050 >> v2:172.21.15.151:3300/0 conn(0x7f87f415f040 msgr2=0x7f87f415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:09.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.910+0000 7f87f8ac0640 1 --2- 172.21.15.59:0/948949050 >> v2:172.21.15.151:3300/0 conn(0x7f87f415f040 0x7f87f415b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:09.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.910+0000 7f87f8ac0640 1 -- 172.21.15.59:0/948949050 >> v1:172.21.15.151:6789/0 conn(0x7f87f40b0010 legacy=0x7f87f40b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:09.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.910+0000 7f87f8ac0640 1 -- 172.21.15.59:0/948949050 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f415b4b0 con 0x7f87f415ad00 2023-10-16T14:26:09.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.912+0000 7f87f8ac0640 1 --2- 172.21.15.59:0/948949050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87f415ad00 0x7f87f40701a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f87f40adf80 tx=0x7f87f002b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcf6f9fb8184841 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:09.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.912+0000 7f87ebfff640 1 -- 172.21.15.59:0/948949050 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0030870 con 0x7f87f415ad00 2023-10-16T14:26:09.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.912+0000 7f87ebfff640 1 -- 172.21.15.59:0/948949050 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f00309d0 con 0x7f87f415ad00 2023-10-16T14:26:09.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.912+0000 7f87ebfff640 1 -- 172.21.15.59:0/948949050 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0030d60 con 0x7f87f415ad00 2023-10-16T14:26:09.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.913+0000 7f87fb525640 1 -- 172.21.15.59:0/948949050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87f415ad00 msgr2=0x7f87f40701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:09.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.913+0000 7f87fb525640 1 --2- 172.21.15.59:0/948949050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87f415ad00 0x7f87f40701a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f87f40adf80 tx=0x7f87f002b9b0 comp rx=0 tx=0).stop 2023-10-16T14:26:09.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.913+0000 7f87fb525640 1 -- 172.21.15.59:0/948949050 shutdown_connections 2023-10-16T14:26:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.913+0000 7f87fb525640 1 --2- 172.21.15.59:0/948949050 >> v2:172.21.15.151:3300/0 conn(0x7f87f415f040 0x7f87f415b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.913+0000 7f87fb525640 1 --2- 172.21.15.59:0/948949050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87f415ad00 0x7f87f40701a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.913+0000 7f87fb525640 1 -- 172.21.15.59:0/948949050 >> 172.21.15.59:0/948949050 conn(0x7f87f406c1c0 msgr2=0x7f87f406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.913+0000 7f87fb525640 1 -- 172.21.15.59:0/948949050 shutdown_connections 2023-10-16T14:26:09.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.913+0000 7f87fb525640 1 -- 172.21.15.59:0/948949050 wait complete. 2023-10-16T14:26:09.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.915+0000 7f87fb525640 1 Processor -- start 2023-10-16T14:26:09.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.915+0000 7f87fb525640 1 -- start start 2023-10-16T14:26:09.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.916+0000 7f87fb525640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87f40b0010 0x7f87f40c4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:09.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.916+0000 7f87fb525640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87f415ad00 0x7f87f415e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:09.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.916+0000 7f87fb525640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87f415f040 0x7f87f40b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:09.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.916+0000 7f87fb525640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f4145cb0 con 0x7f87f415f040 2023-10-16T14:26:09.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.916+0000 7f87fb525640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f4145450 con 0x7f87f415ad00 2023-10-16T14:26:09.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.916+0000 7f87fb525640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f415eca0 con 0x7f87f40b0010 2023-10-16T14:26:09.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.916+0000 7f87f9ac2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87f415f040 0x7f87f40b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:09.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.916+0000 7f87f9ac2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87f415f040 0x7f87f40b38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51104/0 (socket says 172.21.15.59:51104) 2023-10-16T14:26:09.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.916+0000 7f87f9ac2640 1 -- 172.21.15.59:0/4115255939 learned_addr learned my addr 172.21.15.59:0/4115255939 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:09.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.916+0000 7f87f92c1640 1 --2- 172.21.15.59:0/4115255939 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87f40b0010 0x7f87f40c4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.916+0000 7f87f8ac0640 1 --2- 172.21.15.59:0/4115255939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87f415ad00 0x7f87f415e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.917+0000 7f87f9ac2640 1 -- 172.21.15.59:0/4115255939 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87f40b0010 msgr2=0x7f87f40c4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.917+0000 7f87f9ac2640 1 --2- 172.21.15.59:0/4115255939 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87f40b0010 0x7f87f40c4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.917+0000 7f87f9ac2640 1 -- 172.21.15.59:0/4115255939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87f415ad00 msgr2=0x7f87f415e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:09.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.917+0000 7f87f9ac2640 1 --2- 172.21.15.59:0/4115255939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87f415ad00 0x7f87f415e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:09.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.917+0000 7f87f9ac2640 1 -- 172.21.15.59:0/4115255939 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f00094d0 con 0x7f87f415f040 2023-10-16T14:26:09.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.917+0000 7f87f9ac2640 1 --2- 172.21.15.59:0/4115255939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87f415f040 0x7f87f40b38a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f87ec007e60 tx=0x7f87ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:09.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.917+0000 7f87e9ffb640 1 -- 172.21.15.59:0/4115255939 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec014420 con 0x7f87f415f040 2023-10-16T14:26:09.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.917+0000 7f87e9ffb640 1 -- 172.21.15.59:0/4115255939 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec0145a0 con 0x7f87f415f040 2023-10-16T14:26:09.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.917+0000 7f87e9ffb640 1 -- 172.21.15.59:0/4115255939 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec014950 con 0x7f87f415f040 2023-10-16T14:26:09.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.917+0000 7f87fb525640 1 -- 172.21.15.59:0/4115255939 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f40c4820 con 0x7f87f415f040 2023-10-16T14:26:09.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.918+0000 7f87fb525640 1 -- 172.21.15.59:0/4115255939 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f40c4de0 con 0x7f87f415f040 2023-10-16T14:26:09.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.919+0000 7f87fb525640 1 -- 172.21.15.59:0/4115255939 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f4070d90 con 0x7f87f415f040 2023-10-16T14:26:09.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.920+0000 7f87e9ffb640 1 -- 172.21.15.59:0/4115255939 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f87ec014ab0 con 0x7f87f415f040 2023-10-16T14:26:09.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.920+0000 7f87e9ffb640 1 --2- 172.21.15.59:0/4115255939 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f87e006ae70 0x7f87e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:09.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.921+0000 7f87e9ffb640 1 -- 172.21.15.59:0/4115255939 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f87ec08a2f0 con 0x7f87f415f040 2023-10-16T14:26:09.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.921+0000 7f87f92c1640 1 --2- 172.21.15.59:0/4115255939 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f87e006ae70 0x7f87e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:09.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.922+0000 7f87f92c1640 1 --2- 172.21.15.59:0/4115255939 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f87e006ae70 0x7f87e006d330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f87e4000f60 tx=0x7f87e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:09.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:09.925+0000 7f87e9ffb640 1 -- 172.21.15.59:0/4115255939 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f87f4070d90 con 0x7f87f415f040 2023-10-16T14:26:10.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.155+0000 7f87fb525640 1 -- 172.21.15.59:0/4115255939 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87f4070d90 con 0x7f87f415f040 2023-10-16T14:26:10.159 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.156+0000 7f87e9ffb640 1 -- 172.21.15.59:0/4115255939 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f87f4070d90 con 0x7f87f415f040 2023-10-16T14:26:10.160 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:10.160 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3959035293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3959035293},{"type":"v1","addr":"172.21.15.59:6834","nonce":3959035293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1298271347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1298271347},{"type":"v1","addr":"172.21.15.151:6835","nonce":1298271347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/249904108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":249904108},{"type":"v1","addr":"172.21.15.59:6835","nonce":249904108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T14:25:48.130662+0000","modified":"2023-10-16T14:26:09.157993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6837/4004038733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4004038733},{"type":"v1","addr":"172.21.15.151:6837","nonce":4004038733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T14:26:10.160 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 9 2023-10-16T14:26:10.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.158+0000 7f87fb525640 1 -- 172.21.15.59:0/4115255939 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f87e006ae70 msgr2=0x7f87e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:10.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.158+0000 7f87fb525640 1 --2- 172.21.15.59:0/4115255939 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f87e006ae70 0x7f87e006d330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f87e4000f60 tx=0x7f87e4009040 comp rx=0 tx=0).stop 2023-10-16T14:26:10.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.158+0000 7f87fb525640 1 -- 172.21.15.59:0/4115255939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87f415f040 msgr2=0x7f87f40b38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:10.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.158+0000 7f87fb525640 1 --2- 172.21.15.59:0/4115255939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87f415f040 0x7f87f40b38a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f87ec007e60 tx=0x7f87ec00e4b0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.158+0000 7f87fb525640 1 -- 172.21.15.59:0/4115255939 shutdown_connections 2023-10-16T14:26:10.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.158+0000 7f87fb525640 1 --2- 172.21.15.59:0/4115255939 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f87e006ae70 0x7f87e006d330 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.158+0000 7f87fb525640 1 --2- 172.21.15.59:0/4115255939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87f415f040 0x7f87f40b38a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.158+0000 7f87fb525640 1 --2- 172.21.15.59:0/4115255939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87f415ad00 0x7f87f415e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.158+0000 7f87fb525640 1 --2- 172.21.15.59:0/4115255939 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87f40b0010 0x7f87f40c4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.158+0000 7f87fb525640 1 -- 172.21.15.59:0/4115255939 >> 172.21.15.59:0/4115255939 conn(0x7f87f406c1c0 msgr2=0x7f87f40adef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:10.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.159+0000 7f87fb525640 1 -- 172.21.15.59:0/4115255939 shutdown_connections 2023-10-16T14:26:10.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.159+0000 7f87fb525640 1 -- 172.21.15.59:0/4115255939 wait complete. 2023-10-16T14:26:10.180 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:26:10.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.409+0000 7ff540809640 1 Processor -- start 2023-10-16T14:26:10.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.410+0000 7ff540809640 1 -- start start 2023-10-16T14:26:10.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.411+0000 7ff540809640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff53c0c9e00 0x7ff53c0c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:10.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.411+0000 7ff540809640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c0ca1e0 0x7ff53c0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:10.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.411+0000 7ff540809640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff53c071630 0x7ff53c0cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:10.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.411+0000 7ff540809640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53c0cde00 con 0x7ff53c0c9e00 2023-10-16T14:26:10.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.411+0000 7ff540809640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53c071e40 con 0x7ff53c071630 2023-10-16T14:26:10.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.411+0000 7ff540809640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c072120 con 0x7ff53c0ca1e0 2023-10-16T14:26:10.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.411+0000 7ff53a59c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff53c0c9e00 0x7ff53c0c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:10.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.411+0000 7ff53a59c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff53c0c9e00 0x7ff53c0c20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51112/0 (socket says 172.21.15.59:51112) 2023-10-16T14:26:10.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.411+0000 7ff53a59c640 1 -- 172.21.15.59:0/3374655805 learned_addr learned my addr 172.21.15.59:0/3374655805 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:10.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.411+0000 7ff531d9b640 1 --2- 172.21.15.59:0/3374655805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c0ca1e0 0x7ff53c0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:10.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.412+0000 7ff53a59c640 1 -- 172.21.15.59:0/3374655805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c0ca1e0 msgr2=0x7ff53c0710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:10.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.412+0000 7ff53ad9d640 1 --2- 172.21.15.59:0/3374655805 >> v2:172.21.15.151:3300/0 conn(0x7ff53c071630 0x7ff53c0cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:10.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.412+0000 7ff53a59c640 1 --2- 172.21.15.59:0/3374655805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c0ca1e0 0x7ff53c0710f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.412+0000 7ff53a59c640 1 -- 172.21.15.59:0/3374655805 >> v2:172.21.15.151:3300/0 conn(0x7ff53c071630 msgr2=0x7ff53c0cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:10.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.412+0000 7ff53a59c640 1 --2- 172.21.15.59:0/3374655805 >> v2:172.21.15.151:3300/0 conn(0x7ff53c071630 0x7ff53c0cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.412+0000 7ff53a59c640 1 -- 172.21.15.59:0/3374655805 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c072400 con 0x7ff53c0c9e00 2023-10-16T14:26:10.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.413+0000 7ff53a59c640 1 --2- 172.21.15.59:0/3374655805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0c9e00 0x7ff53c0c20e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff53c06da60 tx=0x7ff52c02b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def9bdcdc054bcc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:10.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.413+0000 7ff539d9b640 1 -- 172.21.15.59:0/3374655805 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c031880 con 0x7ff53c0c9e00 2023-10-16T14:26:10.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.413+0000 7ff539d9b640 1 -- 172.21.15.59:0/3374655805 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c0319e0 con 0x7ff53c0c9e00 2023-10-16T14:26:10.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.413+0000 7ff539d9b640 1 -- 172.21.15.59:0/3374655805 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c031d70 con 0x7ff53c0c9e00 2023-10-16T14:26:10.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.414+0000 7ff540809640 1 -- 172.21.15.59:0/3374655805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0c9e00 msgr2=0x7ff53c0c20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:10.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.414+0000 7ff540809640 1 --2- 172.21.15.59:0/3374655805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0c9e00 0x7ff53c0c20e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff53c06da60 tx=0x7ff52c02b920 comp rx=0 tx=0).stop 2023-10-16T14:26:10.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.414+0000 7ff540809640 1 -- 172.21.15.59:0/3374655805 shutdown_connections 2023-10-16T14:26:10.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.414+0000 7ff540809640 1 --2- 172.21.15.59:0/3374655805 >> v2:172.21.15.151:3300/0 conn(0x7ff53c071630 0x7ff53c0cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.414+0000 7ff540809640 1 --2- 172.21.15.59:0/3374655805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c0ca1e0 0x7ff53c0710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.414+0000 7ff540809640 1 --2- 172.21.15.59:0/3374655805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0c9e00 0x7ff53c0c20e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.414+0000 7ff540809640 1 -- 172.21.15.59:0/3374655805 >> 172.21.15.59:0/3374655805 conn(0x7ff53c06c1c0 msgr2=0x7ff53c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:10.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.414+0000 7ff540809640 1 -- 172.21.15.59:0/3374655805 shutdown_connections 2023-10-16T14:26:10.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.414+0000 7ff540809640 1 -- 172.21.15.59:0/3374655805 wait complete. 2023-10-16T14:26:10.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.416+0000 7ff540809640 1 Processor -- start 2023-10-16T14:26:10.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.416+0000 7ff540809640 1 -- start start 2023-10-16T14:26:10.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.417+0000 7ff540809640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff53c071630 0x7ff53c0c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:10.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.417+0000 7ff540809640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c0c9e00 0x7ff53c0b0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:10.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.417+0000 7ff540809640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0ca1e0 0x7ff53c147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:10.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.417+0000 7ff540809640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0b3d70 con 0x7ff53c0ca1e0 2023-10-16T14:26:10.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.417+0000 7ff540809640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0b0710 con 0x7ff53c071630 2023-10-16T14:26:10.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.417+0000 7ff540809640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0b09f0 con 0x7ff53c0c9e00 2023-10-16T14:26:10.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.417+0000 7ff53ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0ca1e0 0x7ff53c147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:10.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.417+0000 7ff53ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0ca1e0 0x7ff53c147b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51124/0 (socket says 172.21.15.59:51124) 2023-10-16T14:26:10.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.417+0000 7ff53ad9d640 1 -- 172.21.15.59:0/3891117826 learned_addr learned my addr 172.21.15.59:0/3891117826 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:10.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.417+0000 7ff53a59c640 1 --2- 172.21.15.59:0/3891117826 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff53c071630 0x7ff53c0c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:10.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.417+0000 7ff531d9b640 1 --2- 172.21.15.59:0/3891117826 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c0c9e00 0x7ff53c0b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:10.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.418+0000 7ff53ad9d640 1 -- 172.21.15.59:0/3891117826 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c0c9e00 msgr2=0x7ff53c0b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:10.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.418+0000 7ff53ad9d640 1 --2- 172.21.15.59:0/3891117826 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c0c9e00 0x7ff53c0b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.418+0000 7ff53ad9d640 1 -- 172.21.15.59:0/3891117826 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff53c071630 msgr2=0x7ff53c0c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:10.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.418+0000 7ff53ad9d640 1 --2- 172.21.15.59:0/3891117826 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff53c071630 0x7ff53c0c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.418+0000 7ff53ad9d640 1 -- 172.21.15.59:0/3891117826 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c0094d0 con 0x7ff53c0ca1e0 2023-10-16T14:26:10.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.418+0000 7ff53a59c640 1 --2- 172.21.15.59:0/3891117826 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff53c071630 0x7ff53c0c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:10.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.418+0000 7ff53ad9d640 1 --2- 172.21.15.59:0/3891117826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0ca1e0 0x7ff53c147b60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff53400cc30 tx=0x7ff53400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:10.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.418+0000 7ff5337fe640 1 -- 172.21.15.59:0/3891117826 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53400ce40 con 0x7ff53c0ca1e0 2023-10-16T14:26:10.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.418+0000 7ff5337fe640 1 -- 172.21.15.59:0/3891117826 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff534003990 con 0x7ff53c0ca1e0 2023-10-16T14:26:10.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.418+0000 7ff540809640 1 -- 172.21.15.59:0/3891117826 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53c0b0cd0 con 0x7ff53c0ca1e0 2023-10-16T14:26:10.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.418+0000 7ff5337fe640 1 -- 172.21.15.59:0/3891117826 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff534003d20 con 0x7ff53c0ca1e0 2023-10-16T14:26:10.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.419+0000 7ff540809640 1 -- 172.21.15.59:0/3891117826 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53c0b1290 con 0x7ff53c0ca1e0 2023-10-16T14:26:10.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.420+0000 7ff540809640 1 -- 172.21.15.59:0/3891117826 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53c0b14b0 con 0x7ff53c0ca1e0 2023-10-16T14:26:10.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.421+0000 7ff5337fe640 1 -- 172.21.15.59:0/3891117826 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff534003e80 con 0x7ff53c0ca1e0 2023-10-16T14:26:10.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.422+0000 7ff5337fe640 1 --2- 172.21.15.59:0/3891117826 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff51c06ae70 0x7ff51c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:10.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.422+0000 7ff5337fe640 1 -- 172.21.15.59:0/3891117826 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff534089d70 con 0x7ff53c0ca1e0 2023-10-16T14:26:10.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.423+0000 7ff53a59c640 1 --2- 172.21.15.59:0/3891117826 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff51c06ae70 0x7ff51c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:10.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.424+0000 7ff53a59c640 1 --2- 172.21.15.59:0/3891117826 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff51c06ae70 0x7ff51c06d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff52c036000 tx=0x7ff52c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:10.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.426+0000 7ff5337fe640 1 -- 172.21.15.59:0/3891117826 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff534054a90 con 0x7ff53c0ca1e0 2023-10-16T14:26:10.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.622+0000 7ff540809640 1 -- 172.21.15.59:0/3891117826 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff53c06e450 con 0x7ff53c0ca1e0 2023-10-16T14:26:10.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.624+0000 7ff5337fe640 1 -- 172.21.15.59:0/3891117826 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18350 (secure 0 0 0) 0x7ff53401d070 con 0x7ff53c0ca1e0 2023-10-16T14:26:10.628 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:10.628 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:25:53.209862+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:26:10.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.627+0000 7ff540809640 1 -- 172.21.15.59:0/3891117826 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff51c06ae70 msgr2=0x7ff51c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:10.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.627+0000 7ff540809640 1 --2- 172.21.15.59:0/3891117826 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff51c06ae70 0x7ff51c06d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff52c036000 tx=0x7ff52c03c040 comp rx=0 tx=0).stop 2023-10-16T14:26:10.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.627+0000 7ff540809640 1 -- 172.21.15.59:0/3891117826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0ca1e0 msgr2=0x7ff53c147b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:10.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.627+0000 7ff540809640 1 --2- 172.21.15.59:0/3891117826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0ca1e0 0x7ff53c147b60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff53400cc30 tx=0x7ff53400a5c0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.627+0000 7ff540809640 1 -- 172.21.15.59:0/3891117826 shutdown_connections 2023-10-16T14:26:10.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.627+0000 7ff540809640 1 --2- 172.21.15.59:0/3891117826 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff51c06ae70 0x7ff51c06d330 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.627+0000 7ff540809640 1 --2- 172.21.15.59:0/3891117826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0ca1e0 0x7ff53c147b60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.627+0000 7ff540809640 1 --2- 172.21.15.59:0/3891117826 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c0c9e00 0x7ff53c0b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.627+0000 7ff540809640 1 --2- 172.21.15.59:0/3891117826 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff53c071630 0x7ff53c0c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.627+0000 7ff540809640 1 -- 172.21.15.59:0/3891117826 >> 172.21.15.59:0/3891117826 conn(0x7ff53c06c1c0 msgr2=0x7ff53c158d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:10.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.627+0000 7ff540809640 1 -- 172.21.15.59:0/3891117826 shutdown_connections 2023-10-16T14:26:10.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.627+0000 7ff540809640 1 -- 172.21.15.59:0/3891117826 wait complete. 2023-10-16T14:26:10.649 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T14:26:10.649 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T14:26:10.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.876+0000 7f5cb15ed640 1 Processor -- start 2023-10-16T14:26:10.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.876+0000 7f5cb15ed640 1 -- start start 2023-10-16T14:26:10.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.877+0000 7f5cb15ed640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5cac15c9d0 0x7f5cac0cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:10.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.877+0000 7f5cb15ed640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cac0d16a0 0x7f5cac0cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:10.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.877+0000 7f5cb15ed640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5cac0ce4d0 0x7f5cac0cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:10.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.877+0000 7f5cb15ed640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cac0d0320 con 0x7f5cac0ce4d0 2023-10-16T14:26:10.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.877+0000 7f5cb15ed640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cac0d0600 con 0x7f5cac15c9d0 2023-10-16T14:26:10.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.877+0000 7f5cb15ed640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac0d08e0 con 0x7f5cac0d16a0 2023-10-16T14:26:10.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.878+0000 7f5cb0dec640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5cac0ce4d0 0x7f5cac0cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:10.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.878+0000 7f5cabfff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5cac15c9d0 0x7f5cac0cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:10.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.878+0000 7f5cab7fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cac0d16a0 0x7f5cac0cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:10.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.878+0000 7f5cabfff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5cac15c9d0 0x7f5cac0cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.59:46106/0 (socket says 172.21.15.59:46106) 2023-10-16T14:26:10.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.878+0000 7f5cabfff640 1 -- 172.21.15.59:0/2865752263 learned_addr learned my addr 172.21.15.59:0/2865752263 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:10.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.878+0000 7f5cb0dec640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5cac0ce4d0 0x7f5cac0cf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51130/0 (socket says 172.21.15.59:51130) 2023-10-16T14:26:10.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.879+0000 7f5cb0dec640 1 -- 172.21.15.59:0/2865752263 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cac0d16a0 msgr2=0x7f5cac0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:10.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.879+0000 7f5cb0dec640 1 --2- 172.21.15.59:0/2865752263 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cac0d16a0 0x7f5cac0cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.879+0000 7f5cb0dec640 1 -- 172.21.15.59:0/2865752263 >> v2:172.21.15.151:3300/0 conn(0x7f5cac15c9d0 msgr2=0x7f5cac0cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:10.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.879+0000 7f5cb0dec640 1 --2- 172.21.15.59:0/2865752263 >> v2:172.21.15.151:3300/0 conn(0x7f5cac15c9d0 0x7f5cac0cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.879+0000 7f5cb0dec640 1 -- 172.21.15.59:0/2865752263 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac0d0bc0 con 0x7f5cac0ce4d0 2023-10-16T14:26:10.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.880+0000 7f5cb0dec640 1 --2- 172.21.15.59:0/2865752263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cac0ce4d0 0x7f5cac0cf680 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5cac0d26b0 tx=0x7f5ca402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e7c87088923882 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:10.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.880+0000 7f5caaffd640 1 -- 172.21.15.59:0/2865752263 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca402e070 con 0x7f5cac0ce4d0 2023-10-16T14:26:10.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.880+0000 7f5caaffd640 1 -- 172.21.15.59:0/2865752263 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca40315a0 con 0x7f5cac0ce4d0 2023-10-16T14:26:10.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.880+0000 7f5caaffd640 1 -- 172.21.15.59:0/2865752263 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca4031930 con 0x7f5cac0ce4d0 2023-10-16T14:26:10.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.881+0000 7f5cb15ed640 1 -- 172.21.15.59:0/2865752263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cac0ce4d0 msgr2=0x7f5cac0cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:10.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.881+0000 7f5cb15ed640 1 --2- 172.21.15.59:0/2865752263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cac0ce4d0 0x7f5cac0cf680 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5cac0d26b0 tx=0x7f5ca402b840 comp rx=0 tx=0).stop 2023-10-16T14:26:10.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.881+0000 7f5cb15ed640 1 -- 172.21.15.59:0/2865752263 shutdown_connections 2023-10-16T14:26:10.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.881+0000 7f5cb15ed640 1 --2- 172.21.15.59:0/2865752263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cac0ce4d0 0x7f5cac0cf680 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.881+0000 7f5cb15ed640 1 --2- 172.21.15.59:0/2865752263 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cac0d16a0 0x7f5cac0cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.881+0000 7f5cb15ed640 1 --2- 172.21.15.59:0/2865752263 >> v2:172.21.15.151:3300/0 conn(0x7f5cac15c9d0 0x7f5cac0cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.881+0000 7f5cb15ed640 1 -- 172.21.15.59:0/2865752263 >> 172.21.15.59:0/2865752263 conn(0x7f5cac09bad0 msgr2=0x7f5cac0d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:10.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.881+0000 7f5cb15ed640 1 -- 172.21.15.59:0/2865752263 shutdown_connections 2023-10-16T14:26:10.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.881+0000 7f5cb15ed640 1 -- 172.21.15.59:0/2865752263 wait complete. 2023-10-16T14:26:10.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.883+0000 7f5cb15ed640 1 Processor -- start 2023-10-16T14:26:10.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.883+0000 7f5cb15ed640 1 -- start start 2023-10-16T14:26:10.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.884+0000 7f5cb15ed640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cac0ce4d0 0x7f5cac1f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:10.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.884+0000 7f5cb15ed640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cac0d16a0 0x7f5cac15f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:10.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.884+0000 7f5cb15ed640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cac15c9d0 0x7f5cac15f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:10.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.884+0000 7f5cb15ed640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac0c8bd0 con 0x7f5cac15c9d0 2023-10-16T14:26:10.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.884+0000 7f5cb15ed640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac15fdf0 con 0x7f5cac0d16a0 2023-10-16T14:26:10.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.884+0000 7f5cb15ed640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac0c7fc0 con 0x7f5cac0ce4d0 2023-10-16T14:26:10.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.884+0000 7f5cb0dec640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cac15c9d0 0x7f5cac15f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:10.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.884+0000 7f5cb0dec640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cac15c9d0 0x7f5cac15f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51140/0 (socket says 172.21.15.59:51140) 2023-10-16T14:26:10.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.884+0000 7f5cb0dec640 1 -- 172.21.15.59:0/3754756266 learned_addr learned my addr 172.21.15.59:0/3754756266 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:10.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.884+0000 7f5cabfff640 1 --2- 172.21.15.59:0/3754756266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cac0ce4d0 0x7f5cac1f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:10.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.884+0000 7f5cab7fe640 1 --2- 172.21.15.59:0/3754756266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cac0d16a0 0x7f5cac15f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:10.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.885+0000 7f5cb0dec640 1 -- 172.21.15.59:0/3754756266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cac0ce4d0 msgr2=0x7f5cac1f2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:10.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.885+0000 7f5cb0dec640 1 --2- 172.21.15.59:0/3754756266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cac0ce4d0 0x7f5cac1f2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.885+0000 7f5cb0dec640 1 -- 172.21.15.59:0/3754756266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cac0d16a0 msgr2=0x7f5cac15f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:10.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.885+0000 7f5cb0dec640 1 --2- 172.21.15.59:0/3754756266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cac0d16a0 0x7f5cac15f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:10.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.885+0000 7f5cb0dec640 1 -- 172.21.15.59:0/3754756266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca4009400 con 0x7f5cac15c9d0 2023-10-16T14:26:10.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.885+0000 7f5cb0dec640 1 --2- 172.21.15.59:0/3754756266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cac15c9d0 0x7f5cac15f8b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4009890 tx=0x7f5ca40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:10.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.885+0000 7f5ca8ff9640 1 -- 172.21.15.59:0/3754756266 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca4032840 con 0x7f5cac15c9d0 2023-10-16T14:26:10.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.885+0000 7f5ca8ff9640 1 -- 172.21.15.59:0/3754756266 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca40329a0 con 0x7f5cac15c9d0 2023-10-16T14:26:10.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.885+0000 7f5cb15ed640 1 -- 172.21.15.59:0/3754756266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cac0c82a0 con 0x7f5cac15c9d0 2023-10-16T14:26:10.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.885+0000 7f5ca8ff9640 1 -- 172.21.15.59:0/3754756266 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca4032d30 con 0x7f5cac15c9d0 2023-10-16T14:26:10.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.885+0000 7f5cb15ed640 1 -- 172.21.15.59:0/3754756266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cac0c8860 con 0x7f5cac15c9d0 2023-10-16T14:26:10.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.887+0000 7f5cb15ed640 1 -- 172.21.15.59:0/3754756266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cac1f36c0 con 0x7f5cac15c9d0 2023-10-16T14:26:10.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.888+0000 7f5ca8ff9640 1 -- 172.21.15.59:0/3754756266 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5ca404e430 con 0x7f5cac15c9d0 2023-10-16T14:26:10.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.889+0000 7f5ca8ff9640 1 --2- 172.21.15.59:0/3754756266 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f5c9806aef0 0x7f5c9806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:10.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.889+0000 7f5ca8ff9640 1 -- 172.21.15.59:0/3754756266 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5ca40ab780 con 0x7f5cac15c9d0 2023-10-16T14:26:10.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.890+0000 7f5cabfff640 1 --2- 172.21.15.59:0/3754756266 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f5c9806aef0 0x7f5c9806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:10.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.891+0000 7f5cabfff640 1 --2- 172.21.15.59:0/3754756266 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f5c9806aef0 0x7f5c9806d3b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5cac0c9280 tx=0x7f5c9c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:10.898 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:10.893+0000 7f5ca8ff9640 1 -- 172.21.15.59:0/3754756266 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5cac1f36c0 con 0x7f5cac15c9d0 2023-10-16T14:26:11.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.083+0000 7f5cb15ed640 1 -- 172.21.15.59:0/3754756266 --> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5cac0d1180 con 0x7f5c9806aef0 2023-10-16T14:26:11.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.115+0000 7f5ca8ff9640 1 -- 172.21.15.59:0/3754756266 <== mgr.4100 v2:172.21.15.151:6800/518957627 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345159 (secure 0 0 0) 0x7f5c9c00f040 con 0x7f5c9806aef0 2023-10-16T14:26:11.124 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:11.126 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-16T14:26:11.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.121+0000 7f5cb15ed640 1 -- 172.21.15.59:0/3754756266 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f5c9806aef0 msgr2=0x7f5c9806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:11.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.121+0000 7f5cb15ed640 1 --2- 172.21.15.59:0/3754756266 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f5c9806aef0 0x7f5c9806d3b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5cac0c9280 tx=0x7f5c9c00b040 comp rx=0 tx=0).stop 2023-10-16T14:26:11.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.121+0000 7f5cb15ed640 1 -- 172.21.15.59:0/3754756266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cac15c9d0 msgr2=0x7f5cac15f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:11.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.121+0000 7f5cb15ed640 1 --2- 172.21.15.59:0/3754756266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cac15c9d0 0x7f5cac15f8b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4009890 tx=0x7f5ca40046c0 comp rx=0 tx=0).stop 2023-10-16T14:26:11.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.121+0000 7f5cb15ed640 1 -- 172.21.15.59:0/3754756266 shutdown_connections 2023-10-16T14:26:11.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.121+0000 7f5cb15ed640 1 --2- 172.21.15.59:0/3754756266 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f5c9806aef0 0x7f5c9806d3b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:11.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.121+0000 7f5cb15ed640 1 --2- 172.21.15.59:0/3754756266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cac15c9d0 0x7f5cac15f8b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:11.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.121+0000 7f5cb15ed640 1 --2- 172.21.15.59:0/3754756266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cac0d16a0 0x7f5cac15f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:11.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.121+0000 7f5cb15ed640 1 --2- 172.21.15.59:0/3754756266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cac0ce4d0 0x7f5cac1f2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:11.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.121+0000 7f5cb15ed640 1 -- 172.21.15.59:0/3754756266 >> 172.21.15.59:0/3754756266 conn(0x7f5cac09bad0 msgr2=0x7f5cac0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:11.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.122+0000 7f5cb15ed640 1 -- 172.21.15.59:0/3754756266 shutdown_connections 2023-10-16T14:26:11.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.122+0000 7f5cb15ed640 1 -- 172.21.15.59:0/3754756266 wait complete. 2023-10-16T14:26:11.146 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-10-16T14:26:09.873415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219492,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755228,"statfs":{"total":773094113280,"available":772869353472,"internally_reserved":0,"allocated":3383296,"data_stored":2021812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005929"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.740143+0000","last_change":"2023-10-16T14:25:47.673909+0000","last_active":"2023-10-16T14:25:52.740143+0000","last_peered":"2023-10-16T14:25:52.740143+0000","last_clean":"2023-10-16T14:25:52.740143+0000","last_became_active":"2023-10-16T14:25:47.672564+0000","last_became_peered":"2023-10-16T14:25:47.672564+0000","last_unstale":"2023-10-16T14:25:52.740143+0000","last_undegraded":"2023-10-16T14:25:52.740143+0000","last_fullsized":"2023-10-16T14:25:52.740143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:08:41.557287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.753608+0000","last_change":"2023-10-16T14:25:48.712086+0000","last_active":"2023-10-16T14:25:52.753608+0000","last_peered":"2023-10-16T14:25:52.753608+0000","last_clean":"2023-10-16T14:25:52.753608+0000","last_became_active":"2023-10-16T14:25:48.711422+0000","last_became_peered":"2023-10-16T14:25:48.711422+0000","last_unstale":"2023-10-16T14:25:52.753608+0000","last_undegraded":"2023-10-16T14:25:52.753608+0000","last_fullsized":"2023-10-16T14:25:52.753608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:15.110757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.089049+0000","last_change":"2023-10-16T14:25:52.777768+0000","last_active":"2023-10-16T14:25:54.089049+0000","last_peered":"2023-10-16T14:25:54.089049+0000","last_clean":"2023-10-16T14:25:54.089049+0000","last_became_active":"2023-10-16T14:25:52.777201+0000","last_became_peered":"2023-10-16T14:25:52.777201+0000","last_unstale":"2023-10-16T14:25:54.089049+0000","last_undegraded":"2023-10-16T14:25:54.089049+0000","last_fullsized":"2023-10-16T14:25:54.089049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:11:19.880188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.753780+0000","last_change":"2023-10-16T14:25:47.687110+0000","last_active":"2023-10-16T14:25:52.753780+0000","last_peered":"2023-10-16T14:25:52.753780+0000","last_clean":"2023-10-16T14:25:52.753780+0000","last_became_active":"2023-10-16T14:25:47.685070+0000","last_became_peered":"2023-10-16T14:25:47.685070+0000","last_unstale":"2023-10-16T14:25:52.753780+0000","last_undegraded":"2023-10-16T14:25:52.753780+0000","last_fullsized":"2023-10-16T14:25:52.753780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:23:12.328185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.751791+0000","last_change":"2023-10-16T14:25:48.698409+0000","last_active":"2023-10-16T14:25:52.751791+0000","last_peered":"2023-10-16T14:25:52.751791+0000","last_clean":"2023-10-16T14:25:52.751791+0000","last_became_active":"2023-10-16T14:25:48.697726+0000","last_became_peered":"2023-10-16T14:25:48.697726+0000","last_unstale":"2023-10-16T14:25:52.751791+0000","last_undegraded":"2023-10-16T14:25:52.751791+0000","last_fullsized":"2023-10-16T14:25:52.751791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:31.708932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.085749+0000","last_change":"2023-10-16T14:25:52.761817+0000","last_active":"2023-10-16T14:25:54.085749+0000","last_peered":"2023-10-16T14:25:54.085749+0000","last_clean":"2023-10-16T14:25:54.085749+0000","last_became_active":"2023-10-16T14:25:52.761162+0000","last_became_peered":"2023-10-16T14:25:52.761162+0000","last_unstale":"2023-10-16T14:25:54.085749+0000","last_undegraded":"2023-10-16T14:25:54.085749+0000","last_fullsized":"2023-10-16T14:25:54.085749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:12:32.541889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742426+0000","last_change":"2023-10-16T14:25:47.688476+0000","last_active":"2023-10-16T14:25:52.742426+0000","last_peered":"2023-10-16T14:25:52.742426+0000","last_clean":"2023-10-16T14:25:52.742426+0000","last_became_active":"2023-10-16T14:25:47.684107+0000","last_became_peered":"2023-10-16T14:25:47.684107+0000","last_unstale":"2023-10-16T14:25:52.742426+0000","last_undegraded":"2023-10-16T14:25:52.742426+0000","last_fullsized":"2023-10-16T14:25:52.742426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:02.376389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.730675+0000","last_change":"2023-10-16T14:25:48.698904+0000","last_active":"2023-10-16T14:25:52.730675+0000","last_peered":"2023-10-16T14:25:52.730675+0000","last_clean":"2023-10-16T14:25:52.730675+0000","last_became_active":"2023-10-16T14:25:48.698533+0000","last_became_peered":"2023-10-16T14:25:48.698533+0000","last_unstale":"2023-10-16T14:25:52.730675+0000","last_undegraded":"2023-10-16T14:25:52.730675+0000","last_fullsized":"2023-10-16T14:25:52.730675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:55:50.448443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.090560+0000","last_change":"2023-10-16T14:25:52.762960+0000","last_active":"2023-10-16T14:25:54.090560+0000","last_peered":"2023-10-16T14:25:54.090560+0000","last_clean":"2023-10-16T14:25:54.090560+0000","last_became_active":"2023-10-16T14:25:52.762507+0000","last_became_peered":"2023-10-16T14:25:52.762507+0000","last_unstale":"2023-10-16T14:25:54.090560+0000","last_undegraded":"2023-10-16T14:25:54.090560+0000","last_fullsized":"2023-10-16T14:25:54.090560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:35:03.884337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742081+0000","last_change":"2023-10-16T14:25:47.684937+0000","last_active":"2023-10-16T14:25:52.742081+0000","last_peered":"2023-10-16T14:25:52.742081+0000","last_clean":"2023-10-16T14:25:52.742081+0000","last_became_active":"2023-10-16T14:25:47.684625+0000","last_became_peered":"2023-10-16T14:25:47.684625+0000","last_unstale":"2023-10-16T14:25:52.742081+0000","last_undegraded":"2023-10-16T14:25:52.742081+0000","last_fullsized":"2023-10-16T14:25:52.742081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:05.381585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734783+0000","last_change":"2023-10-16T14:25:48.707706+0000","last_active":"2023-10-16T14:25:52.734783+0000","last_peered":"2023-10-16T14:25:52.734783+0000","last_clean":"2023-10-16T14:25:52.734783+0000","last_became_active":"2023-10-16T14:25:48.707434+0000","last_became_peered":"2023-10-16T14:25:48.707434+0000","last_unstale":"2023-10-16T14:25:52.734783+0000","last_undegraded":"2023-10-16T14:25:52.734783+0000","last_fullsized":"2023-10-16T14:25:52.734783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:25:48.053924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086892+0000","last_change":"2023-10-16T14:25:52.775947+0000","last_active":"2023-10-16T14:25:54.086892+0000","last_peered":"2023-10-16T14:25:54.086892+0000","last_clean":"2023-10-16T14:25:54.086892+0000","last_became_active":"2023-10-16T14:25:52.771892+0000","last_became_peered":"2023-10-16T14:25:52.771892+0000","last_unstale":"2023-10-16T14:25:54.086892+0000","last_undegraded":"2023-10-16T14:25:54.086892+0000","last_fullsized":"2023-10-16T14:25:54.086892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:13:27.830565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734432+0000","last_change":"2023-10-16T14:25:48.702028+0000","last_active":"2023-10-16T14:25:52.734432+0000","last_peered":"2023-10-16T14:25:52.734432+0000","last_clean":"2023-10-16T14:25:52.734432+0000","last_became_active":"2023-10-16T14:25:48.701734+0000","last_became_peered":"2023-10-16T14:25:48.701734+0000","last_unstale":"2023-10-16T14:25:52.734432+0000","last_undegraded":"2023-10-16T14:25:52.734432+0000","last_fullsized":"2023-10-16T14:25:52.734432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:27:03.907713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734923+0000","last_change":"2023-10-16T14:25:47.675386+0000","last_active":"2023-10-16T14:25:52.734923+0000","last_peered":"2023-10-16T14:25:52.734923+0000","last_clean":"2023-10-16T14:25:52.734923+0000","last_became_active":"2023-10-16T14:25:47.673235+0000","last_became_peered":"2023-10-16T14:25:47.673235+0000","last_unstale":"2023-10-16T14:25:52.734923+0000","last_undegraded":"2023-10-16T14:25:52.734923+0000","last_fullsized":"2023-10-16T14:25:52.734923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:08:41.557287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.726707+0000","last_change":"2023-10-16T14:25:52.761060+0000","last_active":"2023-10-16T14:25:53.726707+0000","last_peered":"2023-10-16T14:25:53.726707+0000","last_clean":"2023-10-16T14:25:53.726707+0000","last_became_active":"2023-10-16T14:25:52.760368+0000","last_became_peered":"2023-10-16T14:25:52.760368+0000","last_unstale":"2023-10-16T14:25:53.726707+0000","last_undegraded":"2023-10-16T14:25:53.726707+0000","last_fullsized":"2023-10-16T14:25:53.726707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:22:11.797676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.755837+0000","last_change":"2023-10-16T14:25:48.711084+0000","last_active":"2023-10-16T14:25:52.755837+0000","last_peered":"2023-10-16T14:25:52.755837+0000","last_clean":"2023-10-16T14:25:52.755837+0000","last_became_active":"2023-10-16T14:25:48.710802+0000","last_became_peered":"2023-10-16T14:25:48.710802+0000","last_unstale":"2023-10-16T14:25:52.755837+0000","last_undegraded":"2023-10-16T14:25:52.755837+0000","last_fullsized":"2023-10-16T14:25:52.755837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:06.393767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.764948+0000","last_change":"2023-10-16T14:25:47.688614+0000","last_active":"2023-10-16T14:25:52.764948+0000","last_peered":"2023-10-16T14:25:52.764948+0000","last_clean":"2023-10-16T14:25:52.764948+0000","last_became_active":"2023-10-16T14:25:47.686187+0000","last_became_peered":"2023-10-16T14:25:47.686187+0000","last_unstale":"2023-10-16T14:25:52.764948+0000","last_undegraded":"2023-10-16T14:25:52.764948+0000","last_fullsized":"2023-10-16T14:25:52.764948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:55:49.436260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.084971+0000","last_change":"2023-10-16T14:25:52.773158+0000","last_active":"2023-10-16T14:25:54.084971+0000","last_peered":"2023-10-16T14:25:54.084971+0000","last_clean":"2023-10-16T14:25:54.084971+0000","last_became_active":"2023-10-16T14:25:52.772200+0000","last_became_peered":"2023-10-16T14:25:52.772200+0000","last_unstale":"2023-10-16T14:25:54.084971+0000","last_undegraded":"2023-10-16T14:25:54.084971+0000","last_fullsized":"2023-10-16T14:25:54.084971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:01.082527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734700+0000","last_change":"2023-10-16T14:25:48.696802+0000","last_active":"2023-10-16T14:25:52.734700+0000","last_peered":"2023-10-16T14:25:52.734700+0000","last_clean":"2023-10-16T14:25:52.734700+0000","last_became_active":"2023-10-16T14:25:48.695664+0000","last_became_peered":"2023-10-16T14:25:48.695664+0000","last_unstale":"2023-10-16T14:25:52.734700+0000","last_undegraded":"2023-10-16T14:25:52.734700+0000","last_fullsized":"2023-10-16T14:25:52.734700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:44:58.603248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735333+0000","last_change":"2023-10-16T14:25:47.690959+0000","last_active":"2023-10-16T14:25:52.735333+0000","last_peered":"2023-10-16T14:25:52.735333+0000","last_clean":"2023-10-16T14:25:52.735333+0000","last_became_active":"2023-10-16T14:25:47.690583+0000","last_became_peered":"2023-10-16T14:25:47.690583+0000","last_unstale":"2023-10-16T14:25:52.735333+0000","last_undegraded":"2023-10-16T14:25:52.735333+0000","last_fullsized":"2023-10-16T14:25:52.735333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:05.381585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.090752+0000","last_change":"2023-10-16T14:25:52.774636+0000","last_active":"2023-10-16T14:25:54.090752+0000","last_peered":"2023-10-16T14:25:54.090752+0000","last_clean":"2023-10-16T14:25:54.090752+0000","last_became_active":"2023-10-16T14:25:52.771832+0000","last_became_peered":"2023-10-16T14:25:52.771832+0000","last_unstale":"2023-10-16T14:25:54.090752+0000","last_undegraded":"2023-10-16T14:25:54.090752+0000","last_fullsized":"2023-10-16T14:25:54.090752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:20.646849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735106+0000","last_change":"2023-10-16T14:25:48.704071+0000","last_active":"2023-10-16T14:25:52.735106+0000","last_peered":"2023-10-16T14:25:52.735106+0000","last_clean":"2023-10-16T14:25:52.735106+0000","last_became_active":"2023-10-16T14:25:48.703786+0000","last_became_peered":"2023-10-16T14:25:48.703786+0000","last_unstale":"2023-10-16T14:25:52.735106+0000","last_undegraded":"2023-10-16T14:25:52.735106+0000","last_fullsized":"2023-10-16T14:25:52.735106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:01:09.957934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.740520+0000","last_change":"2023-10-16T14:25:47.684412+0000","last_active":"2023-10-16T14:25:52.740520+0000","last_peered":"2023-10-16T14:25:52.740520+0000","last_clean":"2023-10-16T14:25:52.740520+0000","last_became_active":"2023-10-16T14:25:47.684067+0000","last_became_peered":"2023-10-16T14:25:47.684067+0000","last_unstale":"2023-10-16T14:25:52.740520+0000","last_undegraded":"2023-10-16T14:25:52.740520+0000","last_fullsized":"2023-10-16T14:25:52.740520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:33.359003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.091066+0000","last_change":"2023-10-16T14:25:52.760002+0000","last_active":"2023-10-16T14:25:54.091066+0000","last_peered":"2023-10-16T14:25:54.091066+0000","last_clean":"2023-10-16T14:25:54.091066+0000","last_became_active":"2023-10-16T14:25:52.759113+0000","last_became_peered":"2023-10-16T14:25:52.759113+0000","last_unstale":"2023-10-16T14:25:54.091066+0000","last_undegraded":"2023-10-16T14:25:54.091066+0000","last_fullsized":"2023-10-16T14:25:54.091066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:53.190625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.739919+0000","last_change":"2023-10-16T14:25:48.697052+0000","last_active":"2023-10-16T14:25:52.739919+0000","last_peered":"2023-10-16T14:25:52.739919+0000","last_clean":"2023-10-16T14:25:52.739919+0000","last_became_active":"2023-10-16T14:25:48.695195+0000","last_became_peered":"2023-10-16T14:25:48.695195+0000","last_unstale":"2023-10-16T14:25:52.739919+0000","last_undegraded":"2023-10-16T14:25:52.739919+0000","last_fullsized":"2023-10-16T14:25:52.739919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:34.371186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735823+0000","last_change":"2023-10-16T14:25:47.690567+0000","last_active":"2023-10-16T14:25:52.735823+0000","last_peered":"2023-10-16T14:25:52.735823+0000","last_clean":"2023-10-16T14:25:52.735823+0000","last_became_active":"2023-10-16T14:25:47.690306+0000","last_became_peered":"2023-10-16T14:25:47.690306+0000","last_unstale":"2023-10-16T14:25:52.735823+0000","last_undegraded":"2023-10-16T14:25:52.735823+0000","last_fullsized":"2023-10-16T14:25:52.735823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:18.948353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086866+0000","last_change":"2023-10-16T14:25:52.762012+0000","last_active":"2023-10-16T14:25:54.086866+0000","last_peered":"2023-10-16T14:25:54.086866+0000","last_clean":"2023-10-16T14:25:54.086866+0000","last_became_active":"2023-10-16T14:25:52.761553+0000","last_became_peered":"2023-10-16T14:25:52.761553+0000","last_unstale":"2023-10-16T14:25:54.086866+0000","last_undegraded":"2023-10-16T14:25:54.086866+0000","last_fullsized":"2023-10-16T14:25:54.086866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:57.876480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.739718+0000","last_change":"2023-10-16T14:25:48.713472+0000","last_active":"2023-10-16T14:25:52.739718+0000","last_peered":"2023-10-16T14:25:52.739718+0000","last_clean":"2023-10-16T14:25:52.739718+0000","last_became_active":"2023-10-16T14:25:48.713019+0000","last_became_peered":"2023-10-16T14:25:48.713019+0000","last_unstale":"2023-10-16T14:25:52.739718+0000","last_undegraded":"2023-10-16T14:25:52.739718+0000","last_fullsized":"2023-10-16T14:25:52.739718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:08.080421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.287222+0000","last_change":"2023-10-16T14:25:47.690820+0000","last_active":"2023-10-16T14:25:53.287222+0000","last_peered":"2023-10-16T14:25:53.287222+0000","last_clean":"2023-10-16T14:25:53.287222+0000","last_became_active":"2023-10-16T14:25:47.690554+0000","last_became_peered":"2023-10-16T14:25:47.690554+0000","last_unstale":"2023-10-16T14:25:53.287222+0000","last_undegraded":"2023-10-16T14:25:53.287222+0000","last_fullsized":"2023-10-16T14:25:53.287222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:48:55.264157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.728903+0000","last_change":"2023-10-16T14:25:52.765122+0000","last_active":"2023-10-16T14:25:53.728903+0000","last_peered":"2023-10-16T14:25:53.728903+0000","last_clean":"2023-10-16T14:25:53.728903+0000","last_became_active":"2023-10-16T14:25:52.764663+0000","last_became_peered":"2023-10-16T14:25:52.764663+0000","last_unstale":"2023-10-16T14:25:53.728903+0000","last_undegraded":"2023-10-16T14:25:53.728903+0000","last_fullsized":"2023-10-16T14:25:53.728903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:02.278979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.769095+0000","last_change":"2023-10-16T14:25:48.717743+0000","last_active":"2023-10-16T14:25:52.769095+0000","last_peered":"2023-10-16T14:25:52.769095+0000","last_clean":"2023-10-16T14:25:52.769095+0000","last_became_active":"2023-10-16T14:25:48.717468+0000","last_became_peered":"2023-10-16T14:25:48.717468+0000","last_unstale":"2023-10-16T14:25:52.769095+0000","last_undegraded":"2023-10-16T14:25:52.769095+0000","last_fullsized":"2023-10-16T14:25:52.769095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:44:58.603248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734870+0000","last_change":"2023-10-16T14:25:47.676947+0000","last_active":"2023-10-16T14:25:52.734870+0000","last_peered":"2023-10-16T14:25:52.734870+0000","last_clean":"2023-10-16T14:25:52.734870+0000","last_became_active":"2023-10-16T14:25:47.676630+0000","last_became_peered":"2023-10-16T14:25:47.676630+0000","last_unstale":"2023-10-16T14:25:52.734870+0000","last_undegraded":"2023-10-16T14:25:52.734870+0000","last_fullsized":"2023-10-16T14:25:52.734870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:33.359003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.088211+0000","last_change":"2023-10-16T14:25:52.764074+0000","last_active":"2023-10-16T14:25:54.088211+0000","last_peered":"2023-10-16T14:25:54.088211+0000","last_clean":"2023-10-16T14:25:54.088211+0000","last_became_active":"2023-10-16T14:25:52.763641+0000","last_became_peered":"2023-10-16T14:25:52.763641+0000","last_unstale":"2023-10-16T14:25:54.088211+0000","last_undegraded":"2023-10-16T14:25:54.088211+0000","last_fullsized":"2023-10-16T14:25:54.088211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:21:41.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.724375+0000","last_change":"2023-10-16T14:25:48.710134+0000","last_active":"2023-10-16T14:25:52.724375+0000","last_peered":"2023-10-16T14:25:52.724375+0000","last_clean":"2023-10-16T14:25:52.724375+0000","last_became_active":"2023-10-16T14:25:48.709462+0000","last_became_peered":"2023-10-16T14:25:48.709462+0000","last_unstale":"2023-10-16T14:25:52.724375+0000","last_undegraded":"2023-10-16T14:25:52.724375+0000","last_fullsized":"2023-10-16T14:25:52.724375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:06.393767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.752412+0000","last_change":"2023-10-16T14:25:47.687252+0000","last_active":"2023-10-16T14:25:52.752412+0000","last_peered":"2023-10-16T14:25:52.752412+0000","last_clean":"2023-10-16T14:25:52.752412+0000","last_became_active":"2023-10-16T14:25:47.685825+0000","last_became_peered":"2023-10-16T14:25:47.685825+0000","last_unstale":"2023-10-16T14:25:52.752412+0000","last_undegraded":"2023-10-16T14:25:52.752412+0000","last_fullsized":"2023-10-16T14:25:52.752412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:01.814630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.087296+0000","last_change":"2023-10-16T14:25:52.767900+0000","last_active":"2023-10-16T14:25:54.087296+0000","last_peered":"2023-10-16T14:25:54.087296+0000","last_clean":"2023-10-16T14:25:54.087296+0000","last_became_active":"2023-10-16T14:25:52.767212+0000","last_became_peered":"2023-10-16T14:25:52.767212+0000","last_unstale":"2023-10-16T14:25:54.087296+0000","last_undegraded":"2023-10-16T14:25:54.087296+0000","last_fullsized":"2023-10-16T14:25:54.087296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:35:03.884337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741846+0000","last_change":"2023-10-16T14:25:48.722313+0000","last_active":"2023-10-16T14:25:52.741846+0000","last_peered":"2023-10-16T14:25:52.741846+0000","last_clean":"2023-10-16T14:25:52.741846+0000","last_became_active":"2023-10-16T14:25:48.718701+0000","last_became_peered":"2023-10-16T14:25:48.718701+0000","last_unstale":"2023-10-16T14:25:52.741846+0000","last_undegraded":"2023-10-16T14:25:52.741846+0000","last_fullsized":"2023-10-16T14:25:52.741846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:53.816510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734713+0000","last_change":"2023-10-16T14:25:47.685303+0000","last_active":"2023-10-16T14:25:52.734713+0000","last_peered":"2023-10-16T14:25:52.734713+0000","last_clean":"2023-10-16T14:25:52.734713+0000","last_became_active":"2023-10-16T14:25:47.682721+0000","last_became_peered":"2023-10-16T14:25:47.682721+0000","last_unstale":"2023-10-16T14:25:52.734713+0000","last_undegraded":"2023-10-16T14:25:52.734713+0000","last_fullsized":"2023-10-16T14:25:52.734713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:38:16.755159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086122+0000","last_change":"2023-10-16T14:25:52.772956+0000","last_active":"2023-10-16T14:25:54.086122+0000","last_peered":"2023-10-16T14:25:54.086122+0000","last_clean":"2023-10-16T14:25:54.086122+0000","last_became_active":"2023-10-16T14:25:52.772590+0000","last_became_peered":"2023-10-16T14:25:52.772590+0000","last_unstale":"2023-10-16T14:25:54.086122+0000","last_undegraded":"2023-10-16T14:25:54.086122+0000","last_fullsized":"2023-10-16T14:25:54.086122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:13:27.830565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.748440+0000","last_change":"2023-10-16T14:25:48.695306+0000","last_active":"2023-10-16T14:25:52.748440+0000","last_peered":"2023-10-16T14:25:52.748440+0000","last_clean":"2023-10-16T14:25:52.748440+0000","last_became_active":"2023-10-16T14:25:48.694997+0000","last_became_peered":"2023-10-16T14:25:48.694997+0000","last_unstale":"2023-10-16T14:25:52.748440+0000","last_undegraded":"2023-10-16T14:25:52.748440+0000","last_fullsized":"2023-10-16T14:25:52.748440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:10:11.346850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.755114+0000","last_change":"2023-10-16T14:25:47.684999+0000","last_active":"2023-10-16T14:25:52.755114+0000","last_peered":"2023-10-16T14:25:52.755114+0000","last_clean":"2023-10-16T14:25:52.755114+0000","last_became_active":"2023-10-16T14:25:47.684456+0000","last_became_peered":"2023-10-16T14:25:47.684456+0000","last_unstale":"2023-10-16T14:25:52.755114+0000","last_undegraded":"2023-10-16T14:25:52.755114+0000","last_fullsized":"2023-10-16T14:25:52.755114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:13:52.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086890+0000","last_change":"2023-10-16T14:25:52.771370+0000","last_active":"2023-10-16T14:25:54.086890+0000","last_peered":"2023-10-16T14:25:54.086890+0000","last_clean":"2023-10-16T14:25:54.086890+0000","last_became_active":"2023-10-16T14:25:52.770704+0000","last_became_peered":"2023-10-16T14:25:52.770704+0000","last_unstale":"2023-10-16T14:25:54.086890+0000","last_undegraded":"2023-10-16T14:25:54.086890+0000","last_fullsized":"2023-10-16T14:25:54.086890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:38:21.827312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.765178+0000","last_change":"2023-10-16T14:25:48.722957+0000","last_active":"2023-10-16T14:25:52.765178+0000","last_peered":"2023-10-16T14:25:52.765178+0000","last_clean":"2023-10-16T14:25:52.765178+0000","last_became_active":"2023-10-16T14:25:48.722644+0000","last_became_peered":"2023-10-16T14:25:48.722644+0000","last_unstale":"2023-10-16T14:25:52.765178+0000","last_undegraded":"2023-10-16T14:25:52.765178+0000","last_fullsized":"2023-10-16T14:25:52.765178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:48:56.276340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.733321+0000","last_change":"2023-10-16T14:25:47.686726+0000","last_active":"2023-10-16T14:25:52.733321+0000","last_peered":"2023-10-16T14:25:52.733321+0000","last_clean":"2023-10-16T14:25:52.733321+0000","last_became_active":"2023-10-16T14:25:47.686380+0000","last_became_peered":"2023-10-16T14:25:47.686380+0000","last_unstale":"2023-10-16T14:25:52.733321+0000","last_undegraded":"2023-10-16T14:25:52.733321+0000","last_fullsized":"2023-10-16T14:25:52.733321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:11:14.808035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.088884+0000","last_change":"2023-10-16T14:25:52.775875+0000","last_active":"2023-10-16T14:25:54.088884+0000","last_peered":"2023-10-16T14:25:54.088884+0000","last_clean":"2023-10-16T14:25:54.088884+0000","last_became_active":"2023-10-16T14:25:52.774845+0000","last_became_peered":"2023-10-16T14:25:52.774845+0000","last_unstale":"2023-10-16T14:25:54.088884+0000","last_undegraded":"2023-10-16T14:25:54.088884+0000","last_fullsized":"2023-10-16T14:25:54.088884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:14:32.299751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735654+0000","last_change":"2023-10-16T14:25:48.694170+0000","last_active":"2023-10-16T14:25:52.735654+0000","last_peered":"2023-10-16T14:25:52.735654+0000","last_clean":"2023-10-16T14:25:52.735654+0000","last_became_active":"2023-10-16T14:25:48.693887+0000","last_became_peered":"2023-10-16T14:25:48.693887+0000","last_unstale":"2023-10-16T14:25:52.735654+0000","last_undegraded":"2023-10-16T14:25:52.735654+0000","last_fullsized":"2023-10-16T14:25:52.735654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:11:15.820218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735010+0000","last_change":"2023-10-16T14:25:47.672195+0000","last_active":"2023-10-16T14:25:52.735010+0000","last_peered":"2023-10-16T14:25:52.735010+0000","last_clean":"2023-10-16T14:25:52.735010+0000","last_became_active":"2023-10-16T14:25:47.671904+0000","last_became_peered":"2023-10-16T14:25:47.671904+0000","last_unstale":"2023-10-16T14:25:52.735010+0000","last_undegraded":"2023-10-16T14:25:52.735010+0000","last_fullsized":"2023-10-16T14:25:52.735010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:44:57.591065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.728977+0000","last_change":"2023-10-16T14:25:37.824419+0000","last_active":"2023-10-16T14:25:52.728977+0000","last_peered":"2023-10-16T14:25:52.728977+0000","last_clean":"2023-10-16T14:25:52.728977+0000","last_became_active":"2023-10-16T14:25:37.821909+0000","last_became_peered":"2023-10-16T14:25:37.821909+0000","last_unstale":"2023-10-16T14:25:52.728977+0000","last_undegraded":"2023-10-16T14:25:52.728977+0000","last_fullsized":"2023-10-16T14:25:52.728977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:36.449944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:36.449944+0000","last_clean_scrub_stamp":"2023-10-16T14:25:36.449944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:37:42.457821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.727527+0000","last_change":"2023-10-16T14:25:52.743776+0000","last_active":"2023-10-16T14:25:53.727527+0000","last_peered":"2023-10-16T14:25:53.727527+0000","last_clean":"2023-10-16T14:25:53.727527+0000","last_became_active":"2023-10-16T14:25:52.743307+0000","last_became_peered":"2023-10-16T14:25:52.743307+0000","last_unstale":"2023-10-16T14:25:53.727527+0000","last_undegraded":"2023-10-16T14:25:53.727527+0000","last_fullsized":"2023-10-16T14:25:53.727527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:44:03.308638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734705+0000","last_change":"2023-10-16T14:25:48.698529+0000","last_active":"2023-10-16T14:25:52.734705+0000","last_peered":"2023-10-16T14:25:52.734705+0000","last_clean":"2023-10-16T14:25:52.734705+0000","last_became_active":"2023-10-16T14:25:48.698220+0000","last_became_peered":"2023-10-16T14:25:48.698220+0000","last_unstale":"2023-10-16T14:25:52.734705+0000","last_undegraded":"2023-10-16T14:25:52.734705+0000","last_fullsized":"2023-10-16T14:25:52.734705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:24:18.840113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.769078+0000","last_change":"2023-10-16T14:25:47.689827+0000","last_active":"2023-10-16T14:25:52.769078+0000","last_peered":"2023-10-16T14:25:52.769078+0000","last_clean":"2023-10-16T14:25:52.769078+0000","last_became_active":"2023-10-16T14:25:47.689464+0000","last_became_peered":"2023-10-16T14:25:47.689464+0000","last_unstale":"2023-10-16T14:25:52.769078+0000","last_undegraded":"2023-10-16T14:25:52.769078+0000","last_fullsized":"2023-10-16T14:25:52.769078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:13:52.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.090293+0000","last_change":"2023-10-16T14:25:52.752794+0000","last_active":"2023-10-16T14:25:54.090293+0000","last_peered":"2023-10-16T14:25:54.090293+0000","last_clean":"2023-10-16T14:25:54.090293+0000","last_became_active":"2023-10-16T14:25:52.751655+0000","last_became_peered":"2023-10-16T14:25:52.751655+0000","last_unstale":"2023-10-16T14:25:54.090293+0000","last_undegraded":"2023-10-16T14:25:54.090293+0000","last_fullsized":"2023-10-16T14:25:54.090293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:38:21.827312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742050+0000","last_change":"2023-10-16T14:25:48.697393+0000","last_active":"2023-10-16T14:25:52.742050+0000","last_peered":"2023-10-16T14:25:52.742050+0000","last_clean":"2023-10-16T14:25:52.742050+0000","last_became_active":"2023-10-16T14:25:48.697054+0000","last_became_peered":"2023-10-16T14:25:48.697054+0000","last_unstale":"2023-10-16T14:25:52.742050+0000","last_undegraded":"2023-10-16T14:25:52.742050+0000","last_fullsized":"2023-10-16T14:25:52.742050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:49.130655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.750852+0000","last_change":"2023-10-16T14:25:47.684985+0000","last_active":"2023-10-16T14:25:52.750852+0000","last_peered":"2023-10-16T14:25:52.750852+0000","last_clean":"2023-10-16T14:25:52.750852+0000","last_became_active":"2023-10-16T14:25:47.684330+0000","last_became_peered":"2023-10-16T14:25:47.684330+0000","last_unstale":"2023-10-16T14:25:52.750852+0000","last_undegraded":"2023-10-16T14:25:52.750852+0000","last_fullsized":"2023-10-16T14:25:52.750852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:30:15.114400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086956+0000","last_change":"2023-10-16T14:25:52.757607+0000","last_active":"2023-10-16T14:25:54.086956+0000","last_peered":"2023-10-16T14:25:54.086956+0000","last_clean":"2023-10-16T14:25:54.086956+0000","last_became_active":"2023-10-16T14:25:52.757210+0000","last_became_peered":"2023-10-16T14:25:52.757210+0000","last_unstale":"2023-10-16T14:25:54.086956+0000","last_undegraded":"2023-10-16T14:25:54.086956+0000","last_fullsized":"2023-10-16T14:25:54.086956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:04:13.493245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742186+0000","last_change":"2023-10-16T14:25:48.706248+0000","last_active":"2023-10-16T14:25:52.742186+0000","last_peered":"2023-10-16T14:25:52.742186+0000","last_clean":"2023-10-16T14:25:52.742186+0000","last_became_active":"2023-10-16T14:25:48.705245+0000","last_became_peered":"2023-10-16T14:25:48.705245+0000","last_unstale":"2023-10-16T14:25:52.742186+0000","last_undegraded":"2023-10-16T14:25:52.742186+0000","last_fullsized":"2023-10-16T14:25:52.742186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:13:23.770595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.740182+0000","last_change":"2023-10-16T14:25:47.689189+0000","last_active":"2023-10-16T14:25:52.740182+0000","last_peered":"2023-10-16T14:25:52.740182+0000","last_clean":"2023-10-16T14:25:52.740182+0000","last_became_active":"2023-10-16T14:25:47.688019+0000","last_became_peered":"2023-10-16T14:25:47.688019+0000","last_unstale":"2023-10-16T14:25:52.740182+0000","last_undegraded":"2023-10-16T14:25:52.740182+0000","last_fullsized":"2023-10-16T14:25:52.740182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:02.376389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.725983+0000","last_change":"2023-10-16T14:25:52.743545+0000","last_active":"2023-10-16T14:25:53.725983+0000","last_peered":"2023-10-16T14:25:53.725983+0000","last_clean":"2023-10-16T14:25:53.725983+0000","last_became_active":"2023-10-16T14:25:52.743011+0000","last_became_peered":"2023-10-16T14:25:52.743011+0000","last_unstale":"2023-10-16T14:25:53.725983+0000","last_undegraded":"2023-10-16T14:25:53.725983+0000","last_fullsized":"2023-10-16T14:25:53.725983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:44:58.353984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.726324+0000","last_change":"2023-10-16T14:25:48.718247+0000","last_active":"2023-10-16T14:25:52.726324+0000","last_peered":"2023-10-16T14:25:52.726324+0000","last_clean":"2023-10-16T14:25:52.726324+0000","last_became_active":"2023-10-16T14:25:48.717927+0000","last_became_peered":"2023-10-16T14:25:48.717927+0000","last_unstale":"2023-10-16T14:25:52.726324+0000","last_undegraded":"2023-10-16T14:25:52.726324+0000","last_fullsized":"2023-10-16T14:25:52.726324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:08:42.569470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742310+0000","last_change":"2023-10-16T14:25:47.689833+0000","last_active":"2023-10-16T14:25:52.742310+0000","last_peered":"2023-10-16T14:25:52.742310+0000","last_clean":"2023-10-16T14:25:52.742310+0000","last_became_active":"2023-10-16T14:25:47.689476+0000","last_became_peered":"2023-10-16T14:25:47.689476+0000","last_unstale":"2023-10-16T14:25:52.742310+0000","last_undegraded":"2023-10-16T14:25:52.742310+0000","last_fullsized":"2023-10-16T14:25:52.742310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:15.574696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.087293+0000","last_change":"2023-10-16T14:25:52.751674+0000","last_active":"2023-10-16T14:25:54.087293+0000","last_peered":"2023-10-16T14:25:54.087293+0000","last_clean":"2023-10-16T14:25:54.087293+0000","last_became_active":"2023-10-16T14:25:52.751135+0000","last_became_peered":"2023-10-16T14:25:52.751135+0000","last_unstale":"2023-10-16T14:25:54.087293+0000","last_undegraded":"2023-10-16T14:25:54.087293+0000","last_fullsized":"2023-10-16T14:25:54.087293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:49:00.336310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.733096+0000","last_change":"2023-10-16T14:25:48.713856+0000","last_active":"2023-10-16T14:25:52.733096+0000","last_peered":"2023-10-16T14:25:52.733096+0000","last_clean":"2023-10-16T14:25:52.733096+0000","last_became_active":"2023-10-16T14:25:48.713593+0000","last_became_peered":"2023-10-16T14:25:48.713593+0000","last_unstale":"2023-10-16T14:25:52.733096+0000","last_undegraded":"2023-10-16T14:25:52.733096+0000","last_fullsized":"2023-10-16T14:25:52.733096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:32.458956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734709+0000","last_change":"2023-10-16T14:25:47.670890+0000","last_active":"2023-10-16T14:25:52.734709+0000","last_peered":"2023-10-16T14:25:52.734709+0000","last_clean":"2023-10-16T14:25:52.734709+0000","last_became_active":"2023-10-16T14:25:47.670394+0000","last_became_peered":"2023-10-16T14:25:47.670394+0000","last_unstale":"2023-10-16T14:25:52.734709+0000","last_undegraded":"2023-10-16T14:25:52.734709+0000","last_fullsized":"2023-10-16T14:25:52.734709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:05:41.428042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.089075+0000","last_change":"2023-10-16T14:25:52.766516+0000","last_active":"2023-10-16T14:25:54.089075+0000","last_peered":"2023-10-16T14:25:54.089075+0000","last_clean":"2023-10-16T14:25:54.089075+0000","last_became_active":"2023-10-16T14:25:52.766073+0000","last_became_peered":"2023-10-16T14:25:52.766073+0000","last_unstale":"2023-10-16T14:25:54.089075+0000","last_undegraded":"2023-10-16T14:25:54.089075+0000","last_fullsized":"2023-10-16T14:25:54.089075+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:58.114992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.728872+0000","last_change":"2023-10-16T14:25:48.696048+0000","last_active":"2023-10-16T14:25:52.728872+0000","last_peered":"2023-10-16T14:25:52.728872+0000","last_clean":"2023-10-16T14:25:52.728872+0000","last_became_active":"2023-10-16T14:25:48.695762+0000","last_became_peered":"2023-10-16T14:25:48.695762+0000","last_unstale":"2023-10-16T14:25:52.728872+0000","last_undegraded":"2023-10-16T14:25:52.728872+0000","last_fullsized":"2023-10-16T14:25:52.728872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:23:02.569007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741599+0000","last_change":"2023-10-16T14:25:47.688476+0000","last_active":"2023-10-16T14:25:52.741599+0000","last_peered":"2023-10-16T14:25:52.741599+0000","last_clean":"2023-10-16T14:25:52.741599+0000","last_became_active":"2023-10-16T14:25:47.688163+0000","last_became_peered":"2023-10-16T14:25:47.688163+0000","last_unstale":"2023-10-16T14:25:52.741599+0000","last_undegraded":"2023-10-16T14:25:52.741599+0000","last_fullsized":"2023-10-16T14:25:52.741599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:07:28.689085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.090941+0000","last_change":"2023-10-16T14:25:52.768793+0000","last_active":"2023-10-16T14:25:54.090941+0000","last_peered":"2023-10-16T14:25:54.090941+0000","last_clean":"2023-10-16T14:25:54.090941+0000","last_became_active":"2023-10-16T14:25:52.765782+0000","last_became_peered":"2023-10-16T14:25:52.765782+0000","last_unstale":"2023-10-16T14:25:54.090941+0000","last_undegraded":"2023-10-16T14:25:54.090941+0000","last_fullsized":"2023-10-16T14:25:54.090941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:48:18.923566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734835+0000","last_change":"2023-10-16T14:25:48.706114+0000","last_active":"2023-10-16T14:25:52.734835+0000","last_peered":"2023-10-16T14:25:52.734835+0000","last_clean":"2023-10-16T14:25:52.734835+0000","last_became_active":"2023-10-16T14:25:48.705841+0000","last_became_peered":"2023-10-16T14:25:48.705841+0000","last_unstale":"2023-10-16T14:25:52.734835+0000","last_undegraded":"2023-10-16T14:25:52.734835+0000","last_fullsized":"2023-10-16T14:25:52.734835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:23:57.022557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734625+0000","last_change":"2023-10-16T14:25:47.672757+0000","last_active":"2023-10-16T14:25:52.734625+0000","last_peered":"2023-10-16T14:25:52.734625+0000","last_clean":"2023-10-16T14:25:52.734625+0000","last_became_active":"2023-10-16T14:25:47.671677+0000","last_became_peered":"2023-10-16T14:25:47.671677+0000","last_unstale":"2023-10-16T14:25:52.734625+0000","last_undegraded":"2023-10-16T14:25:52.734625+0000","last_fullsized":"2023-10-16T14:25:52.734625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:13:22.758413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086002+0000","last_change":"2023-10-16T14:25:52.772092+0000","last_active":"2023-10-16T14:25:54.086002+0000","last_peered":"2023-10-16T14:25:54.086002+0000","last_clean":"2023-10-16T14:25:54.086002+0000","last_became_active":"2023-10-16T14:25:52.771630+0000","last_became_peered":"2023-10-16T14:25:52.771630+0000","last_unstale":"2023-10-16T14:25:54.086002+0000","last_undegraded":"2023-10-16T14:25:54.086002+0000","last_fullsized":"2023-10-16T14:25:54.086002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:57.876480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.764800+0000","last_change":"2023-10-16T14:25:48.716516+0000","last_active":"2023-10-16T14:25:52.764800+0000","last_peered":"2023-10-16T14:25:52.764800+0000","last_clean":"2023-10-16T14:25:52.764800+0000","last_became_active":"2023-10-16T14:25:48.716176+0000","last_became_peered":"2023-10-16T14:25:48.716176+0000","last_unstale":"2023-10-16T14:25:52.764800+0000","last_undegraded":"2023-10-16T14:25:52.764800+0000","last_fullsized":"2023-10-16T14:25:52.764800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:03.388572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.757734+0000","last_change":"2023-10-16T14:25:47.689971+0000","last_active":"2023-10-16T14:25:52.757734+0000","last_peered":"2023-10-16T14:25:52.757734+0000","last_clean":"2023-10-16T14:25:52.757734+0000","last_became_active":"2023-10-16T14:25:47.689597+0000","last_became_peered":"2023-10-16T14:25:47.689597+0000","last_unstale":"2023-10-16T14:25:52.757734+0000","last_undegraded":"2023-10-16T14:25:52.757734+0000","last_fullsized":"2023-10-16T14:25:52.757734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:48:33.689068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.727072+0000","last_change":"2023-10-16T14:25:52.770776+0000","last_active":"2023-10-16T14:25:53.727072+0000","last_peered":"2023-10-16T14:25:53.727072+0000","last_clean":"2023-10-16T14:25:53.727072+0000","last_became_active":"2023-10-16T14:25:52.769836+0000","last_became_peered":"2023-10-16T14:25:52.769836+0000","last_unstale":"2023-10-16T14:25:53.727072+0000","last_undegraded":"2023-10-16T14:25:53.727072+0000","last_fullsized":"2023-10-16T14:25:53.727072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:11:16.574099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742318+0000","last_change":"2023-10-16T14:25:48.713120+0000","last_active":"2023-10-16T14:25:52.742318+0000","last_peered":"2023-10-16T14:25:52.742318+0000","last_clean":"2023-10-16T14:25:52.742318+0000","last_became_active":"2023-10-16T14:25:48.712749+0000","last_became_peered":"2023-10-16T14:25:48.712749+0000","last_unstale":"2023-10-16T14:25:52.742318+0000","last_undegraded":"2023-10-16T14:25:52.742318+0000","last_fullsized":"2023-10-16T14:25:52.742318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:38:17.767342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:26:06.790145+0000","last_change":"2023-10-16T14:25:47.677057+0000","last_active":"2023-10-16T14:26:06.790145+0000","last_peered":"2023-10-16T14:26:06.790145+0000","last_clean":"2023-10-16T14:26:06.790145+0000","last_became_active":"2023-10-16T14:25:47.676793+0000","last_became_peered":"2023-10-16T14:25:47.676793+0000","last_unstale":"2023-10-16T14:26:06.790145+0000","last_undegraded":"2023-10-16T14:26:06.790145+0000","last_fullsized":"2023-10-16T14:26:06.790145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:27:37.655811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.727776+0000","last_change":"2023-10-16T14:25:52.749720+0000","last_active":"2023-10-16T14:25:53.727776+0000","last_peered":"2023-10-16T14:25:53.727776+0000","last_clean":"2023-10-16T14:25:53.727776+0000","last_became_active":"2023-10-16T14:25:52.749259+0000","last_became_peered":"2023-10-16T14:25:52.749259+0000","last_unstale":"2023-10-16T14:25:53.727776+0000","last_undegraded":"2023-10-16T14:25:53.727776+0000","last_fullsized":"2023-10-16T14:25:53.727776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:21:41.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.733638+0000","last_change":"2023-10-16T14:25:48.713531+0000","last_active":"2023-10-16T14:25:52.733638+0000","last_peered":"2023-10-16T14:25:52.733638+0000","last_clean":"2023-10-16T14:25:52.733638+0000","last_became_active":"2023-10-16T14:25:48.713160+0000","last_became_peered":"2023-10-16T14:25:48.713160+0000","last_unstale":"2023-10-16T14:25:52.733638+0000","last_undegraded":"2023-10-16T14:25:52.733638+0000","last_fullsized":"2023-10-16T14:25:52.733638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:32:51.782302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.762449+0000","last_change":"2023-10-16T14:25:47.685499+0000","last_active":"2023-10-16T14:25:52.762449+0000","last_peered":"2023-10-16T14:25:52.762449+0000","last_clean":"2023-10-16T14:25:52.762449+0000","last_became_active":"2023-10-16T14:25:47.685151+0000","last_became_peered":"2023-10-16T14:25:47.685151+0000","last_unstale":"2023-10-16T14:25:52.762449+0000","last_undegraded":"2023-10-16T14:25:52.762449+0000","last_fullsized":"2023-10-16T14:25:52.762449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:54.472297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.090819+0000","last_change":"2023-10-16T14:25:52.764063+0000","last_active":"2023-10-16T14:25:54.090819+0000","last_peered":"2023-10-16T14:25:54.090819+0000","last_clean":"2023-10-16T14:25:54.090819+0000","last_became_active":"2023-10-16T14:25:52.763641+0000","last_became_peered":"2023-10-16T14:25:52.763641+0000","last_unstale":"2023-10-16T14:25:54.090819+0000","last_undegraded":"2023-10-16T14:25:54.090819+0000","last_fullsized":"2023-10-16T14:25:54.090819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:21:41.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.751879+0000","last_change":"2023-10-16T14:25:48.703305+0000","last_active":"2023-10-16T14:25:52.751879+0000","last_peered":"2023-10-16T14:25:52.751879+0000","last_clean":"2023-10-16T14:25:52.751879+0000","last_became_active":"2023-10-16T14:25:48.702978+0000","last_became_peered":"2023-10-16T14:25:48.702978+0000","last_unstale":"2023-10-16T14:25:52.751879+0000","last_undegraded":"2023-10-16T14:25:52.751879+0000","last_fullsized":"2023-10-16T14:25:52.751879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:08.702138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742225+0000","last_change":"2023-10-16T14:25:47.688400+0000","last_active":"2023-10-16T14:25:52.742225+0000","last_peered":"2023-10-16T14:25:52.742225+0000","last_clean":"2023-10-16T14:25:52.742225+0000","last_became_active":"2023-10-16T14:25:47.688066+0000","last_became_peered":"2023-10-16T14:25:47.688066+0000","last_unstale":"2023-10-16T14:25:52.742225+0000","last_undegraded":"2023-10-16T14:25:52.742225+0000","last_fullsized":"2023-10-16T14:25:52.742225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:18.948353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.085217+0000","last_change":"2023-10-16T14:25:52.761062+0000","last_active":"2023-10-16T14:25:54.085217+0000","last_peered":"2023-10-16T14:25:54.085217+0000","last_clean":"2023-10-16T14:25:54.085217+0000","last_became_active":"2023-10-16T14:25:52.759852+0000","last_became_peered":"2023-10-16T14:25:52.759852+0000","last_unstale":"2023-10-16T14:25:54.085217+0000","last_undegraded":"2023-10-16T14:25:54.085217+0000","last_fullsized":"2023-10-16T14:25:54.085217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:45:02.663218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.726232+0000","last_change":"2023-10-16T14:25:48.712154+0000","last_active":"2023-10-16T14:25:52.726232+0000","last_peered":"2023-10-16T14:25:52.726232+0000","last_clean":"2023-10-16T14:25:52.726232+0000","last_became_active":"2023-10-16T14:25:48.711510+0000","last_became_peered":"2023-10-16T14:25:48.711510+0000","last_unstale":"2023-10-16T14:25:52.726232+0000","last_undegraded":"2023-10-16T14:25:52.726232+0000","last_fullsized":"2023-10-16T14:25:52.726232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:48:56.276340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.729439+0000","last_change":"2023-10-16T14:25:47.668179+0000","last_active":"2023-10-16T14:25:52.729439+0000","last_peered":"2023-10-16T14:25:52.729439+0000","last_clean":"2023-10-16T14:25:52.729439+0000","last_became_active":"2023-10-16T14:25:47.667021+0000","last_became_peered":"2023-10-16T14:25:47.667021+0000","last_unstale":"2023-10-16T14:25:52.729439+0000","last_undegraded":"2023-10-16T14:25:52.729439+0000","last_fullsized":"2023-10-16T14:25:52.729439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:35:07.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.727768+0000","last_change":"2023-10-16T14:25:52.756998+0000","last_active":"2023-10-16T14:25:53.727768+0000","last_peered":"2023-10-16T14:25:53.727768+0000","last_clean":"2023-10-16T14:25:53.727768+0000","last_became_active":"2023-10-16T14:25:52.756551+0000","last_became_peered":"2023-10-16T14:25:52.756551+0000","last_unstale":"2023-10-16T14:25:53.727768+0000","last_undegraded":"2023-10-16T14:25:53.727768+0000","last_fullsized":"2023-10-16T14:25:53.727768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:53.190625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.729124+0000","last_change":"2023-10-16T14:25:52.770650+0000","last_active":"2023-10-16T14:25:53.729124+0000","last_peered":"2023-10-16T14:25:53.729124+0000","last_clean":"2023-10-16T14:25:53.729124+0000","last_became_active":"2023-10-16T14:25:52.769652+0000","last_became_peered":"2023-10-16T14:25:52.769652+0000","last_unstale":"2023-10-16T14:25:53.729124+0000","last_undegraded":"2023-10-16T14:25:53.729124+0000","last_fullsized":"2023-10-16T14:25:53.729124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:01:14.017904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735103+0000","last_change":"2023-10-16T14:25:48.679714+0000","last_active":"2023-10-16T14:25:52.735103+0000","last_peered":"2023-10-16T14:25:52.735103+0000","last_clean":"2023-10-16T14:25:52.735103+0000","last_became_active":"2023-10-16T14:25:48.678913+0000","last_became_peered":"2023-10-16T14:25:48.678913+0000","last_unstale":"2023-10-16T14:25:52.735103+0000","last_undegraded":"2023-10-16T14:25:52.735103+0000","last_fullsized":"2023-10-16T14:25:52.735103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:43.182462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.736001+0000","last_change":"2023-10-16T14:25:47.670716+0000","last_active":"2023-10-16T14:25:52.736001+0000","last_peered":"2023-10-16T14:25:52.736001+0000","last_clean":"2023-10-16T14:25:52.736001+0000","last_became_active":"2023-10-16T14:25:47.669479+0000","last_became_peered":"2023-10-16T14:25:47.669479+0000","last_unstale":"2023-10-16T14:25:52.736001+0000","last_undegraded":"2023-10-16T14:25:52.736001+0000","last_fullsized":"2023-10-16T14:25:52.736001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:07:28.689085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.727220+0000","last_change":"2023-10-16T14:25:52.766844+0000","last_active":"2023-10-16T14:25:53.727220+0000","last_peered":"2023-10-16T14:25:53.727220+0000","last_clean":"2023-10-16T14:25:53.727220+0000","last_became_active":"2023-10-16T14:25:52.766324+0000","last_became_peered":"2023-10-16T14:25:52.766324+0000","last_unstale":"2023-10-16T14:25:53.727220+0000","last_undegraded":"2023-10-16T14:25:53.727220+0000","last_fullsized":"2023-10-16T14:25:53.727220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:23:27.304235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.748605+0000","last_change":"2023-10-16T14:25:48.707865+0000","last_active":"2023-10-16T14:25:52.748605+0000","last_peered":"2023-10-16T14:25:52.748605+0000","last_clean":"2023-10-16T14:25:52.748605+0000","last_became_active":"2023-10-16T14:25:48.707590+0000","last_became_peered":"2023-10-16T14:25:48.707590+0000","last_unstale":"2023-10-16T14:25:52.748605+0000","last_undegraded":"2023-10-16T14:25:52.748605+0000","last_fullsized":"2023-10-16T14:25:52.748605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:09.386851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.765286+0000","last_change":"2023-10-16T14:25:47.689952+0000","last_active":"2023-10-16T14:25:52.765286+0000","last_peered":"2023-10-16T14:25:52.765286+0000","last_clean":"2023-10-16T14:25:52.765286+0000","last_became_active":"2023-10-16T14:25:47.689569+0000","last_became_peered":"2023-10-16T14:25:47.689569+0000","last_unstale":"2023-10-16T14:25:52.765286+0000","last_undegraded":"2023-10-16T14:25:52.765286+0000","last_fullsized":"2023-10-16T14:25:52.765286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:33.258222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734526+0000","last_change":"2023-10-16T14:25:47.684407+0000","last_active":"2023-10-16T14:25:52.734526+0000","last_peered":"2023-10-16T14:25:52.734526+0000","last_clean":"2023-10-16T14:25:52.734526+0000","last_became_active":"2023-10-16T14:25:47.683112+0000","last_became_peered":"2023-10-16T14:25:47.683112+0000","last_unstale":"2023-10-16T14:25:52.734526+0000","last_undegraded":"2023-10-16T14:25:52.734526+0000","last_fullsized":"2023-10-16T14:25:52.734526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:58.812184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.736192+0000","last_change":"2023-10-16T14:25:48.707553+0000","last_active":"2023-10-16T14:25:52.736192+0000","last_peered":"2023-10-16T14:25:52.736192+0000","last_clean":"2023-10-16T14:25:52.736192+0000","last_became_active":"2023-10-16T14:25:48.707287+0000","last_became_peered":"2023-10-16T14:25:48.707287+0000","last_unstale":"2023-10-16T14:25:52.736192+0000","last_undegraded":"2023-10-16T14:25:52.736192+0000","last_fullsized":"2023-10-16T14:25:52.736192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:16.586879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.728065+0000","last_change":"2023-10-16T14:25:52.772152+0000","last_active":"2023-10-16T14:25:53.728065+0000","last_peered":"2023-10-16T14:25:53.728065+0000","last_clean":"2023-10-16T14:25:53.728065+0000","last_became_active":"2023-10-16T14:25:52.771782+0000","last_became_peered":"2023-10-16T14:25:52.771782+0000","last_unstale":"2023-10-16T14:25:53.728065+0000","last_undegraded":"2023-10-16T14:25:53.728065+0000","last_fullsized":"2023-10-16T14:25:53.728065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:36.518926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.750890+0000","last_change":"2023-10-16T14:25:47.686396+0000","last_active":"2023-10-16T14:25:52.750890+0000","last_peered":"2023-10-16T14:25:52.750890+0000","last_clean":"2023-10-16T14:25:52.750890+0000","last_became_active":"2023-10-16T14:25:47.685837+0000","last_became_peered":"2023-10-16T14:25:47.685837+0000","last_unstale":"2023-10-16T14:25:52.750890+0000","last_undegraded":"2023-10-16T14:25:52.750890+0000","last_fullsized":"2023-10-16T14:25:52.750890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:59:01.867434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.729122+0000","last_change":"2023-10-16T14:25:48.699469+0000","last_active":"2023-10-16T14:25:52.729122+0000","last_peered":"2023-10-16T14:25:52.729122+0000","last_clean":"2023-10-16T14:25:52.729122+0000","last_became_active":"2023-10-16T14:25:48.697897+0000","last_became_peered":"2023-10-16T14:25:48.697897+0000","last_unstale":"2023-10-16T14:25:52.729122+0000","last_undegraded":"2023-10-16T14:25:52.729122+0000","last_fullsized":"2023-10-16T14:25:52.729122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:06.393767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.089865+0000","last_change":"2023-10-16T14:25:52.769049+0000","last_active":"2023-10-16T14:25:54.089865+0000","last_peered":"2023-10-16T14:25:54.089865+0000","last_clean":"2023-10-16T14:25:54.089865+0000","last_became_active":"2023-10-16T14:25:52.768002+0000","last_became_peered":"2023-10-16T14:25:52.768002+0000","last_unstale":"2023-10-16T14:25:54.089865+0000","last_undegraded":"2023-10-16T14:25:54.089865+0000","last_fullsized":"2023-10-16T14:25:54.089865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:24.020506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.722319+0000","last_change":"2023-10-16T14:25:48.710638+0000","last_active":"2023-10-16T14:25:52.722319+0000","last_peered":"2023-10-16T14:25:52.722319+0000","last_clean":"2023-10-16T14:25:52.722319+0000","last_became_active":"2023-10-16T14:25:48.710317+0000","last_became_peered":"2023-10-16T14:25:48.710317+0000","last_unstale":"2023-10-16T14:25:52.722319+0000","last_undegraded":"2023-10-16T14:25:52.722319+0000","last_fullsized":"2023-10-16T14:25:52.722319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:55:50.448443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.754813+0000","last_change":"2023-10-16T14:25:48.697149+0000","last_active":"2023-10-16T14:25:52.754813+0000","last_peered":"2023-10-16T14:25:52.754813+0000","last_clean":"2023-10-16T14:25:52.754813+0000","last_became_active":"2023-10-16T14:25:48.696842+0000","last_became_peered":"2023-10-16T14:25:48.696842+0000","last_unstale":"2023-10-16T14:25:52.754813+0000","last_undegraded":"2023-10-16T14:25:52.754813+0000","last_fullsized":"2023-10-16T14:25:52.754813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:55:50.448443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734336+0000","last_change":"2023-10-16T14:25:48.703113+0000","last_active":"2023-10-16T14:25:52.734336+0000","last_peered":"2023-10-16T14:25:52.734336+0000","last_clean":"2023-10-16T14:25:52.734336+0000","last_became_active":"2023-10-16T14:25:48.702819+0000","last_became_peered":"2023-10-16T14:25:48.702819+0000","last_unstale":"2023-10-16T14:25:52.734336+0000","last_undegraded":"2023-10-16T14:25:52.734336+0000","last_fullsized":"2023-10-16T14:25:52.734336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:11:43.934469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.750660+0000","last_change":"2023-10-16T14:25:48.698637+0000","last_active":"2023-10-16T14:25:52.750660+0000","last_peered":"2023-10-16T14:25:52.750660+0000","last_clean":"2023-10-16T14:25:52.750660+0000","last_became_active":"2023-10-16T14:25:48.698315+0000","last_became_peered":"2023-10-16T14:25:48.698315+0000","last_unstale":"2023-10-16T14:25:52.750660+0000","last_undegraded":"2023-10-16T14:25:52.750660+0000","last_fullsized":"2023-10-16T14:25:52.750660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:40:17.879871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.766726+0000","last_change":"2023-10-16T14:25:48.718882+0000","last_active":"2023-10-16T14:25:52.766726+0000","last_peered":"2023-10-16T14:25:52.766726+0000","last_clean":"2023-10-16T14:25:52.766726+0000","last_became_active":"2023-10-16T14:25:48.718101+0000","last_became_peered":"2023-10-16T14:25:48.718101+0000","last_unstale":"2023-10-16T14:25:52.766726+0000","last_undegraded":"2023-10-16T14:25:52.766726+0000","last_fullsized":"2023-10-16T14:25:52.766726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:07:29.701267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.775872+0000","last_change":"2023-10-16T14:25:48.720844+0000","last_active":"2023-10-16T14:25:52.775872+0000","last_peered":"2023-10-16T14:25:52.775872+0000","last_clean":"2023-10-16T14:25:52.775872+0000","last_became_active":"2023-10-16T14:25:48.719311+0000","last_became_peered":"2023-10-16T14:25:48.719311+0000","last_unstale":"2023-10-16T14:25:52.775872+0000","last_undegraded":"2023-10-16T14:25:52.775872+0000","last_fullsized":"2023-10-16T14:25:52.775872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:19.960536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.726182+0000","last_change":"2023-10-16T14:25:48.712401+0000","last_active":"2023-10-16T14:25:52.726182+0000","last_peered":"2023-10-16T14:25:52.726182+0000","last_clean":"2023-10-16T14:25:52.726182+0000","last_became_active":"2023-10-16T14:25:48.711895+0000","last_became_peered":"2023-10-16T14:25:48.711895+0000","last_unstale":"2023-10-16T14:25:52.726182+0000","last_undegraded":"2023-10-16T14:25:52.726182+0000","last_fullsized":"2023-10-16T14:25:52.726182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:03.388572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.751689+0000","last_change":"2023-10-16T14:25:48.698610+0000","last_active":"2023-10-16T14:25:52.751689+0000","last_peered":"2023-10-16T14:25:52.751689+0000","last_clean":"2023-10-16T14:25:52.751689+0000","last_became_active":"2023-10-16T14:25:48.698036+0000","last_became_peered":"2023-10-16T14:25:48.698036+0000","last_unstale":"2023-10-16T14:25:52.751689+0000","last_undegraded":"2023-10-16T14:25:52.751689+0000","last_fullsized":"2023-10-16T14:25:52.751689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:21:35.715486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.733105+0000","last_change":"2023-10-16T14:25:48.698898+0000","last_active":"2023-10-16T14:25:52.733105+0000","last_peered":"2023-10-16T14:25:52.733105+0000","last_clean":"2023-10-16T14:25:52.733105+0000","last_became_active":"2023-10-16T14:25:48.698683+0000","last_became_peered":"2023-10-16T14:25:48.698683+0000","last_unstale":"2023-10-16T14:25:52.733105+0000","last_undegraded":"2023-10-16T14:25:52.733105+0000","last_fullsized":"2023-10-16T14:25:52.733105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:38:58.219009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.748894+0000","last_change":"2023-10-16T14:25:48.705464+0000","last_active":"2023-10-16T14:25:52.748894+0000","last_peered":"2023-10-16T14:25:52.748894+0000","last_clean":"2023-10-16T14:25:52.748894+0000","last_became_active":"2023-10-16T14:25:48.704985+0000","last_became_peered":"2023-10-16T14:25:48.704985+0000","last_unstale":"2023-10-16T14:25:52.748894+0000","last_undegraded":"2023-10-16T14:25:52.748894+0000","last_fullsized":"2023-10-16T14:25:52.748894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:56:45.547392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.729034+0000","last_change":"2023-10-16T14:25:48.712431+0000","last_active":"2023-10-16T14:25:52.729034+0000","last_peered":"2023-10-16T14:25:52.729034+0000","last_clean":"2023-10-16T14:25:52.729034+0000","last_became_active":"2023-10-16T14:25:48.711943+0000","last_became_peered":"2023-10-16T14:25:48.711943+0000","last_unstale":"2023-10-16T14:25:52.729034+0000","last_undegraded":"2023-10-16T14:25:52.729034+0000","last_fullsized":"2023-10-16T14:25:52.729034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:27:38.667994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.736054+0000","last_change":"2023-10-16T14:25:48.696594+0000","last_active":"2023-10-16T14:25:52.736054+0000","last_peered":"2023-10-16T14:25:52.736054+0000","last_clean":"2023-10-16T14:25:52.736054+0000","last_became_active":"2023-10-16T14:25:48.696094+0000","last_became_peered":"2023-10-16T14:25:48.696094+0000","last_unstale":"2023-10-16T14:25:52.736054+0000","last_undegraded":"2023-10-16T14:25:52.736054+0000","last_fullsized":"2023-10-16T14:25:52.736054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:19.960536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741992+0000","last_change":"2023-10-16T14:25:48.696032+0000","last_active":"2023-10-16T14:25:52.741992+0000","last_peered":"2023-10-16T14:25:52.741992+0000","last_clean":"2023-10-16T14:25:52.741992+0000","last_became_active":"2023-10-16T14:25:48.695395+0000","last_became_peered":"2023-10-16T14:25:48.695395+0000","last_unstale":"2023-10-16T14:25:52.741992+0000","last_undegraded":"2023-10-16T14:25:52.741992+0000","last_fullsized":"2023-10-16T14:25:52.741992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:32.458956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734829+0000","last_change":"2023-10-16T14:25:48.709380+0000","last_active":"2023-10-16T14:25:52.734829+0000","last_peered":"2023-10-16T14:25:52.734829+0000","last_clean":"2023-10-16T14:25:52.734829+0000","last_became_active":"2023-10-16T14:25:48.708997+0000","last_became_peered":"2023-10-16T14:25:48.708997+0000","last_unstale":"2023-10-16T14:25:52.734829+0000","last_undegraded":"2023-10-16T14:25:52.734829+0000","last_fullsized":"2023-10-16T14:25:52.734829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:02:54.594118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.761766+0000","last_change":"2023-10-16T14:25:48.705638+0000","last_active":"2023-10-16T14:25:52.761766+0000","last_peered":"2023-10-16T14:25:52.761766+0000","last_clean":"2023-10-16T14:25:52.761766+0000","last_became_active":"2023-10-16T14:25:48.705345+0000","last_became_peered":"2023-10-16T14:25:48.705345+0000","last_unstale":"2023-10-16T14:25:52.761766+0000","last_undegraded":"2023-10-16T14:25:52.761766+0000","last_fullsized":"2023-10-16T14:25:52.761766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:34.270405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735728+0000","last_change":"2023-10-16T14:25:48.713557+0000","last_active":"2023-10-16T14:25:52.735728+0000","last_peered":"2023-10-16T14:25:52.735728+0000","last_clean":"2023-10-16T14:25:52.735728+0000","last_became_active":"2023-10-16T14:25:48.712873+0000","last_became_peered":"2023-10-16T14:25:48.712873+0000","last_unstale":"2023-10-16T14:25:52.735728+0000","last_undegraded":"2023-10-16T14:25:52.735728+0000","last_fullsized":"2023-10-16T14:25:52.735728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:50:37.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.733005+0000","last_change":"2023-10-16T14:25:48.710840+0000","last_active":"2023-10-16T14:25:52.733005+0000","last_peered":"2023-10-16T14:25:52.733005+0000","last_clean":"2023-10-16T14:25:52.733005+0000","last_became_active":"2023-10-16T14:25:48.710547+0000","last_became_peered":"2023-10-16T14:25:48.710547+0000","last_unstale":"2023-10-16T14:25:52.733005+0000","last_undegraded":"2023-10-16T14:25:52.733005+0000","last_fullsized":"2023-10-16T14:25:52.733005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:49.130655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.748159+0000","last_change":"2023-10-16T14:25:48.705260+0000","last_active":"2023-10-16T14:25:52.748159+0000","last_peered":"2023-10-16T14:25:52.748159+0000","last_clean":"2023-10-16T14:25:52.748159+0000","last_became_active":"2023-10-16T14:25:48.704600+0000","last_became_peered":"2023-10-16T14:25:48.704600+0000","last_unstale":"2023-10-16T14:25:52.748159+0000","last_undegraded":"2023-10-16T14:25:52.748159+0000","last_fullsized":"2023-10-16T14:25:52.748159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:31:37.405710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.764712+0000","last_change":"2023-10-16T14:25:48.718876+0000","last_active":"2023-10-16T14:25:52.764712+0000","last_peered":"2023-10-16T14:25:52.764712+0000","last_clean":"2023-10-16T14:25:52.764712+0000","last_became_active":"2023-10-16T14:25:48.718576+0000","last_became_peered":"2023-10-16T14:25:48.718576+0000","last_unstale":"2023-10-16T14:25:52.764712+0000","last_undegraded":"2023-10-16T14:25:52.764712+0000","last_fullsized":"2023-10-16T14:25:52.764712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:08:42.569470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.765953+0000","last_change":"2023-10-16T14:25:48.724429+0000","last_active":"2023-10-16T14:25:52.765953+0000","last_peered":"2023-10-16T14:25:52.765953+0000","last_clean":"2023-10-16T14:25:52.765953+0000","last_became_active":"2023-10-16T14:25:48.724125+0000","last_became_peered":"2023-10-16T14:25:48.724125+0000","last_unstale":"2023-10-16T14:25:52.765953+0000","last_undegraded":"2023-10-16T14:25:52.765953+0000","last_fullsized":"2023-10-16T14:25:52.765953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:11:15.820218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741965+0000","last_change":"2023-10-16T14:25:48.696219+0000","last_active":"2023-10-16T14:25:52.741965+0000","last_peered":"2023-10-16T14:25:52.741965+0000","last_clean":"2023-10-16T14:25:52.741965+0000","last_became_active":"2023-10-16T14:25:48.695737+0000","last_became_peered":"2023-10-16T14:25:48.695737+0000","last_unstale":"2023-10-16T14:25:52.741965+0000","last_undegraded":"2023-10-16T14:25:52.741965+0000","last_fullsized":"2023-10-16T14:25:52.741965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:21:37.481107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742197+0000","last_change":"2023-10-16T14:25:48.710966+0000","last_active":"2023-10-16T14:25:52.742197+0000","last_peered":"2023-10-16T14:25:52.742197+0000","last_clean":"2023-10-16T14:25:52.742197+0000","last_became_active":"2023-10-16T14:25:48.709590+0000","last_became_peered":"2023-10-16T14:25:48.709590+0000","last_unstale":"2023-10-16T14:25:52.742197+0000","last_undegraded":"2023-10-16T14:25:52.742197+0000","last_fullsized":"2023-10-16T14:25:52.742197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:12:28.481919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742091+0000","last_change":"2023-10-16T14:25:48.717832+0000","last_active":"2023-10-16T14:25:52.742091+0000","last_peered":"2023-10-16T14:25:52.742091+0000","last_clean":"2023-10-16T14:25:52.742091+0000","last_became_active":"2023-10-16T14:25:48.716501+0000","last_became_peered":"2023-10-16T14:25:48.716501+0000","last_unstale":"2023-10-16T14:25:52.742091+0000","last_undegraded":"2023-10-16T14:25:52.742091+0000","last_fullsized":"2023-10-16T14:25:52.742091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:59.824367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.729329+0000","last_change":"2023-10-16T14:25:48.705714+0000","last_active":"2023-10-16T14:25:52.729329+0000","last_peered":"2023-10-16T14:25:52.729329+0000","last_clean":"2023-10-16T14:25:52.729329+0000","last_became_active":"2023-10-16T14:25:48.705423+0000","last_became_peered":"2023-10-16T14:25:48.705423+0000","last_unstale":"2023-10-16T14:25:52.729329+0000","last_undegraded":"2023-10-16T14:25:52.729329+0000","last_fullsized":"2023-10-16T14:25:52.729329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:34.270405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.748340+0000","last_change":"2023-10-16T14:25:48.716492+0000","last_active":"2023-10-16T14:25:52.748340+0000","last_peered":"2023-10-16T14:25:52.748340+0000","last_clean":"2023-10-16T14:25:52.748340+0000","last_became_active":"2023-10-16T14:25:48.716196+0000","last_became_peered":"2023-10-16T14:25:48.716196+0000","last_unstale":"2023-10-16T14:25:52.748340+0000","last_undegraded":"2023-10-16T14:25:52.748340+0000","last_fullsized":"2023-10-16T14:25:52.748340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:20:54.230056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741582+0000","last_change":"2023-10-16T14:25:48.707726+0000","last_active":"2023-10-16T14:25:52.741582+0000","last_peered":"2023-10-16T14:25:52.741582+0000","last_clean":"2023-10-16T14:25:52.741582+0000","last_became_active":"2023-10-16T14:25:48.707504+0000","last_became_peered":"2023-10-16T14:25:48.707504+0000","last_unstale":"2023-10-16T14:25:52.741582+0000","last_undegraded":"2023-10-16T14:25:52.741582+0000","last_fullsized":"2023-10-16T14:25:52.741582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:08.080421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.723283+0000","last_change":"2023-10-16T14:25:48.702028+0000","last_active":"2023-10-16T14:25:52.723283+0000","last_peered":"2023-10-16T14:25:52.723283+0000","last_clean":"2023-10-16T14:25:52.723283+0000","last_became_active":"2023-10-16T14:25:48.701713+0000","last_became_peered":"2023-10-16T14:25:48.701713+0000","last_unstale":"2023-10-16T14:25:52.723283+0000","last_undegraded":"2023-10-16T14:25:52.723283+0000","last_fullsized":"2023-10-16T14:25:52.723283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:05:42.440225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741959+0000","last_change":"2023-10-16T14:25:48.700619+0000","last_active":"2023-10-16T14:25:52.741959+0000","last_peered":"2023-10-16T14:25:52.741959+0000","last_clean":"2023-10-16T14:25:52.741959+0000","last_became_active":"2023-10-16T14:25:48.700374+0000","last_became_peered":"2023-10-16T14:25:48.700374+0000","last_unstale":"2023-10-16T14:25:52.741959+0000","last_undegraded":"2023-10-16T14:25:52.741959+0000","last_fullsized":"2023-10-16T14:25:52.741959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:38:58.219009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.725459+0000","last_change":"2023-10-16T14:25:48.699642+0000","last_active":"2023-10-16T14:25:52.725459+0000","last_peered":"2023-10-16T14:25:52.725459+0000","last_clean":"2023-10-16T14:25:52.725459+0000","last_became_active":"2023-10-16T14:25:48.698763+0000","last_became_peered":"2023-10-16T14:25:48.698763+0000","last_unstale":"2023-10-16T14:25:52.725459+0000","last_undegraded":"2023-10-16T14:25:52.725459+0000","last_fullsized":"2023-10-16T14:25:52.725459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:34.270405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.750728+0000","last_change":"2023-10-16T14:25:48.701810+0000","last_active":"2023-10-16T14:25:52.750728+0000","last_peered":"2023-10-16T14:25:52.750728+0000","last_clean":"2023-10-16T14:25:52.750728+0000","last_became_active":"2023-10-16T14:25:48.701531+0000","last_became_peered":"2023-10-16T14:25:48.701531+0000","last_unstale":"2023-10-16T14:25:52.750728+0000","last_undegraded":"2023-10-16T14:25:52.750728+0000","last_fullsized":"2023-10-16T14:25:52.750728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:02:15.116385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.753502+0000","last_change":"2023-10-16T14:25:48.705687+0000","last_active":"2023-10-16T14:25:52.753502+0000","last_peered":"2023-10-16T14:25:52.753502+0000","last_clean":"2023-10-16T14:25:52.753502+0000","last_became_active":"2023-10-16T14:25:48.705392+0000","last_became_peered":"2023-10-16T14:25:48.705392+0000","last_unstale":"2023-10-16T14:25:52.753502+0000","last_undegraded":"2023-10-16T14:25:52.753502+0000","last_fullsized":"2023-10-16T14:25:52.753502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:04.130129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742180+0000","last_change":"2023-10-16T14:25:48.705631+0000","last_active":"2023-10-16T14:25:52.742180+0000","last_peered":"2023-10-16T14:25:52.742180+0000","last_clean":"2023-10-16T14:25:52.742180+0000","last_became_active":"2023-10-16T14:25:48.705344+0000","last_became_peered":"2023-10-16T14:25:48.705344+0000","last_unstale":"2023-10-16T14:25:52.742180+0000","last_undegraded":"2023-10-16T14:25:52.742180+0000","last_fullsized":"2023-10-16T14:25:52.742180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:43.182462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476744,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":104592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]}]},{"osd":2,"up_from":16,"seq":68719476744,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":107710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4059999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.47}]}]},{"osd":1,"up_from":16,"seq":68719476745,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":694448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]}]},{"osd":0,"up_from":16,"seq":68719476746,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":104066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.508}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6539999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]}]},{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":104134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.528}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.72}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7909999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.762}]}]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":108382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0179999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.716}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3380000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T14:26:11.154 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T14:26:11.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.412+0000 7fe443fff640 1 Processor -- start 2023-10-16T14:26:11.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.412+0000 7fe443fff640 1 -- start start 2023-10-16T14:26:11.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.414+0000 7fe443fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4440cdd60 0x7fe44415d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:11.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.414+0000 7fe443fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe44415def0 0x7fe44406bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:11.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.414+0000 7fe443fff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe444154110 con 0x7fe4440cd980 2023-10-16T14:26:11.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.414+0000 7fe443fff640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe44415d1f0 con 0x7fe4440cdd60 2023-10-16T14:26:11.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.414+0000 7fe443fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe44415a4c0 con 0x7fe44415def0 2023-10-16T14:26:11.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.414+0000 7fe43a7fc640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4440cdd60 0x7fe44415d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:11.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.415+0000 7fe43a7fc640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4440cdd60 0x7fe44415d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51150/0 (socket says 172.21.15.59:51150) 2023-10-16T14:26:11.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.415+0000 7fe43a7fc640 1 -- 172.21.15.59:0/2005039029 learned_addr learned my addr 172.21.15.59:0/2005039029 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:11.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.415+0000 7fe4437fe640 1 --2- 172.21.15.59:0/2005039029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe44415def0 0x7fe44406bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:11.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.415+0000 7fe43a7fc640 1 -- 172.21.15.59:0/2005039029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe44415def0 msgr2=0x7fe44406bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:11.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.415+0000 7fe43a7fc640 1 --2- 172.21.15.59:0/2005039029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe44415def0 0x7fe44406bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:11.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.415+0000 7fe43a7fc640 1 -- 172.21.15.59:0/2005039029 >> v1:172.21.15.151:6789/0 conn(0x7fe4440cd980 legacy=0x7fe444159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:11.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.415+0000 7fe43a7fc640 1 -- 172.21.15.59:0/2005039029 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44415a7a0 con 0x7fe4440cdd60 2023-10-16T14:26:11.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.416+0000 7fe43a7fc640 1 --2- 172.21.15.59:0/2005039029 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4440cdd60 0x7fe44415d9b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009870 tx=0x7fe42c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7d30bca2213be5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:11.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.417+0000 7fe4427fc640 1 -- 172.21.15.59:0/2005039029 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c030840 con 0x7fe4440cdd60 2023-10-16T14:26:11.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.417+0000 7fe4427fc640 1 -- 172.21.15.59:0/2005039029 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c0309a0 con 0x7fe4440cdd60 2023-10-16T14:26:11.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.417+0000 7fe4427fc640 1 -- 172.21.15.59:0/2005039029 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c030d30 con 0x7fe4440cdd60 2023-10-16T14:26:11.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.417+0000 7fe443fff640 1 -- 172.21.15.59:0/2005039029 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4440cdd60 msgr2=0x7fe44415d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:11.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.417+0000 7fe443fff640 1 --2- 172.21.15.59:0/2005039029 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4440cdd60 0x7fe44415d9b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009870 tx=0x7fe42c02b980 comp rx=0 tx=0).stop 2023-10-16T14:26:11.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.417+0000 7fe443fff640 1 -- 172.21.15.59:0/2005039029 shutdown_connections 2023-10-16T14:26:11.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.417+0000 7fe443fff640 1 --2- 172.21.15.59:0/2005039029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe44415def0 0x7fe44406bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:11.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.417+0000 7fe443fff640 1 --2- 172.21.15.59:0/2005039029 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4440cdd60 0x7fe44415d9b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:11.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.417+0000 7fe443fff640 1 -- 172.21.15.59:0/2005039029 >> 172.21.15.59:0/2005039029 conn(0x7fe44406a470 msgr2=0x7fe4440afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:11.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.417+0000 7fe443fff640 1 -- 172.21.15.59:0/2005039029 shutdown_connections 2023-10-16T14:26:11.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.418+0000 7fe443fff640 1 -- 172.21.15.59:0/2005039029 wait complete. 2023-10-16T14:26:11.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.419+0000 7fe443fff640 1 Processor -- start 2023-10-16T14:26:11.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.419+0000 7fe443fff640 1 -- start start 2023-10-16T14:26:11.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.420+0000 7fe443fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4440cd980 0x7fe4440cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:11.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.420+0000 7fe443fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4440cdd60 0x7fe444148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:11.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.420+0000 7fe443fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4440cbd70 0x7fe44414c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:11.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.420+0000 7fe443fff640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4440cc4a0 con 0x7fe4440cbd70 2023-10-16T14:26:11.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.420+0000 7fe443fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe444154d90 con 0x7fe4440cdd60 2023-10-16T14:26:11.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.420+0000 7fe443fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4440cc200 con 0x7fe4440cd980 2023-10-16T14:26:11.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.421+0000 7fe4437fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4440cbd70 0x7fe44414c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:11.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.421+0000 7fe4437fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4440cbd70 0x7fe44414c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51152/0 (socket says 172.21.15.59:51152) 2023-10-16T14:26:11.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.421+0000 7fe4437fe640 1 -- 172.21.15.59:0/498053680 learned_addr learned my addr 172.21.15.59:0/498053680 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:11.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.421+0000 7fe43a7fc640 1 --2- 172.21.15.59:0/498053680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4440cdd60 0x7fe444148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:11.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.421+0000 7fe442ffd640 1 --2- 172.21.15.59:0/498053680 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4440cd980 0x7fe4440cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:11.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.421+0000 7fe4437fe640 1 -- 172.21.15.59:0/498053680 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4440cd980 msgr2=0x7fe4440cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:11.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.421+0000 7fe4437fe640 1 --2- 172.21.15.59:0/498053680 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4440cd980 0x7fe4440cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:11.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.421+0000 7fe4437fe640 1 -- 172.21.15.59:0/498053680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4440cdd60 msgr2=0x7fe444148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:11.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.421+0000 7fe4437fe640 1 --2- 172.21.15.59:0/498053680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4440cdd60 0x7fe444148360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:11.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.421+0000 7fe4437fe640 1 -- 172.21.15.59:0/498053680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c0094d0 con 0x7fe4440cbd70 2023-10-16T14:26:11.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.422+0000 7fe4437fe640 1 --2- 172.21.15.59:0/498053680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4440cbd70 0x7fe44414c670 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00d4e0 tx=0x7fe43c00d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:11.430 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.422+0000 7fe440ff9640 1 -- 172.21.15.59:0/498053680 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c0125f0 con 0x7fe4440cbd70 2023-10-16T14:26:11.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.422+0000 7fe440ff9640 1 -- 172.21.15.59:0/498053680 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c012770 con 0x7fe4440cbd70 2023-10-16T14:26:11.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.422+0000 7fe440ff9640 1 -- 172.21.15.59:0/498053680 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c012b20 con 0x7fe4440cbd70 2023-10-16T14:26:11.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.422+0000 7fe443fff640 1 -- 172.21.15.59:0/498053680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe444154460 con 0x7fe4440cbd70 2023-10-16T14:26:11.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.422+0000 7fe443fff640 1 -- 172.21.15.59:0/498053680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe444154a20 con 0x7fe4440cbd70 2023-10-16T14:26:11.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.423+0000 7fe443fff640 1 -- 172.21.15.59:0/498053680 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe444154f00 con 0x7fe4440cbd70 2023-10-16T14:26:11.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.424+0000 7fe440ff9640 1 -- 172.21.15.59:0/498053680 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe43c012c80 con 0x7fe4440cbd70 2023-10-16T14:26:11.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.425+0000 7fe440ff9640 1 --2- 172.21.15.59:0/498053680 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe42406ae70 0x7fe42406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:11.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.425+0000 7fe440ff9640 1 -- 172.21.15.59:0/498053680 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe43c089ce0 con 0x7fe4440cbd70 2023-10-16T14:26:11.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.426+0000 7fe442ffd640 1 --2- 172.21.15.59:0/498053680 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe42406ae70 0x7fe42406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:11.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.427+0000 7fe442ffd640 1 --2- 172.21.15.59:0/498053680 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe42406ae70 0x7fe42406d330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe434001330 tx=0x7fe434009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:11.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.430+0000 7fe440ff9640 1 -- 172.21.15.59:0/498053680 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe43c054b30 con 0x7fe4440cbd70 2023-10-16T14:26:11.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.623+0000 7fe443fff640 1 -- 172.21.15.59:0/498053680 --> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe44415d490 con 0x7fe42406ae70 2023-10-16T14:26:11.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.651+0000 7fe440ff9640 1 -- 172.21.15.59:0/498053680 <== mgr.4100 v2:172.21.15.151:6800/518957627 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345159 (secure 0 0 0) 0x7fe4340039c0 con 0x7fe42406ae70 2023-10-16T14:26:11.656 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:11.660 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-16T14:26:11.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.658+0000 7fe443fff640 1 -- 172.21.15.59:0/498053680 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe42406ae70 msgr2=0x7fe42406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:11.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.658+0000 7fe443fff640 1 --2- 172.21.15.59:0/498053680 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe42406ae70 0x7fe42406d330 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe434001330 tx=0x7fe434009040 comp rx=0 tx=0).stop 2023-10-16T14:26:11.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.658+0000 7fe443fff640 1 -- 172.21.15.59:0/498053680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4440cbd70 msgr2=0x7fe44414c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.658+0000 7fe443fff640 1 --2- 172.21.15.59:0/498053680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4440cbd70 0x7fe44414c670 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00d4e0 tx=0x7fe43c00d9a0 comp rx=0 tx=0).stop 2023-10-16T14:26:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.658+0000 7fe443fff640 1 -- 172.21.15.59:0/498053680 shutdown_connections 2023-10-16T14:26:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.658+0000 7fe443fff640 1 --2- 172.21.15.59:0/498053680 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe42406ae70 0x7fe42406d330 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.658+0000 7fe443fff640 1 --2- 172.21.15.59:0/498053680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4440cbd70 0x7fe44414c670 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:11.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.658+0000 7fe443fff640 1 --2- 172.21.15.59:0/498053680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4440cdd60 0x7fe444148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:11.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.658+0000 7fe443fff640 1 --2- 172.21.15.59:0/498053680 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4440cd980 0x7fe4440cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:11.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.658+0000 7fe443fff640 1 -- 172.21.15.59:0/498053680 >> 172.21.15.59:0/498053680 conn(0x7fe44406a470 msgr2=0x7fe444158ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:11.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.659+0000 7fe443fff640 1 -- 172.21.15.59:0/498053680 shutdown_connections 2023-10-16T14:26:11.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.659+0000 7fe443fff640 1 -- 172.21.15.59:0/498053680 wait complete. 2023-10-16T14:26:11.685 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-10-16T14:26:09.873415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219492,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755228,"statfs":{"total":773094113280,"available":772869353472,"internally_reserved":0,"allocated":3383296,"data_stored":2021812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005929"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.740143+0000","last_change":"2023-10-16T14:25:47.673909+0000","last_active":"2023-10-16T14:25:52.740143+0000","last_peered":"2023-10-16T14:25:52.740143+0000","last_clean":"2023-10-16T14:25:52.740143+0000","last_became_active":"2023-10-16T14:25:47.672564+0000","last_became_peered":"2023-10-16T14:25:47.672564+0000","last_unstale":"2023-10-16T14:25:52.740143+0000","last_undegraded":"2023-10-16T14:25:52.740143+0000","last_fullsized":"2023-10-16T14:25:52.740143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:08:41.557287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.753608+0000","last_change":"2023-10-16T14:25:48.712086+0000","last_active":"2023-10-16T14:25:52.753608+0000","last_peered":"2023-10-16T14:25:52.753608+0000","last_clean":"2023-10-16T14:25:52.753608+0000","last_became_active":"2023-10-16T14:25:48.711422+0000","last_became_peered":"2023-10-16T14:25:48.711422+0000","last_unstale":"2023-10-16T14:25:52.753608+0000","last_undegraded":"2023-10-16T14:25:52.753608+0000","last_fullsized":"2023-10-16T14:25:52.753608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:15.110757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.089049+0000","last_change":"2023-10-16T14:25:52.777768+0000","last_active":"2023-10-16T14:25:54.089049+0000","last_peered":"2023-10-16T14:25:54.089049+0000","last_clean":"2023-10-16T14:25:54.089049+0000","last_became_active":"2023-10-16T14:25:52.777201+0000","last_became_peered":"2023-10-16T14:25:52.777201+0000","last_unstale":"2023-10-16T14:25:54.089049+0000","last_undegraded":"2023-10-16T14:25:54.089049+0000","last_fullsized":"2023-10-16T14:25:54.089049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:11:19.880188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.753780+0000","last_change":"2023-10-16T14:25:47.687110+0000","last_active":"2023-10-16T14:25:52.753780+0000","last_peered":"2023-10-16T14:25:52.753780+0000","last_clean":"2023-10-16T14:25:52.753780+0000","last_became_active":"2023-10-16T14:25:47.685070+0000","last_became_peered":"2023-10-16T14:25:47.685070+0000","last_unstale":"2023-10-16T14:25:52.753780+0000","last_undegraded":"2023-10-16T14:25:52.753780+0000","last_fullsized":"2023-10-16T14:25:52.753780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:23:12.328185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.751791+0000","last_change":"2023-10-16T14:25:48.698409+0000","last_active":"2023-10-16T14:25:52.751791+0000","last_peered":"2023-10-16T14:25:52.751791+0000","last_clean":"2023-10-16T14:25:52.751791+0000","last_became_active":"2023-10-16T14:25:48.697726+0000","last_became_peered":"2023-10-16T14:25:48.697726+0000","last_unstale":"2023-10-16T14:25:52.751791+0000","last_undegraded":"2023-10-16T14:25:52.751791+0000","last_fullsized":"2023-10-16T14:25:52.751791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:31.708932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.085749+0000","last_change":"2023-10-16T14:25:52.761817+0000","last_active":"2023-10-16T14:25:54.085749+0000","last_peered":"2023-10-16T14:25:54.085749+0000","last_clean":"2023-10-16T14:25:54.085749+0000","last_became_active":"2023-10-16T14:25:52.761162+0000","last_became_peered":"2023-10-16T14:25:52.761162+0000","last_unstale":"2023-10-16T14:25:54.085749+0000","last_undegraded":"2023-10-16T14:25:54.085749+0000","last_fullsized":"2023-10-16T14:25:54.085749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:12:32.541889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742426+0000","last_change":"2023-10-16T14:25:47.688476+0000","last_active":"2023-10-16T14:25:52.742426+0000","last_peered":"2023-10-16T14:25:52.742426+0000","last_clean":"2023-10-16T14:25:52.742426+0000","last_became_active":"2023-10-16T14:25:47.684107+0000","last_became_peered":"2023-10-16T14:25:47.684107+0000","last_unstale":"2023-10-16T14:25:52.742426+0000","last_undegraded":"2023-10-16T14:25:52.742426+0000","last_fullsized":"2023-10-16T14:25:52.742426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:02.376389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.730675+0000","last_change":"2023-10-16T14:25:48.698904+0000","last_active":"2023-10-16T14:25:52.730675+0000","last_peered":"2023-10-16T14:25:52.730675+0000","last_clean":"2023-10-16T14:25:52.730675+0000","last_became_active":"2023-10-16T14:25:48.698533+0000","last_became_peered":"2023-10-16T14:25:48.698533+0000","last_unstale":"2023-10-16T14:25:52.730675+0000","last_undegraded":"2023-10-16T14:25:52.730675+0000","last_fullsized":"2023-10-16T14:25:52.730675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:55:50.448443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.090560+0000","last_change":"2023-10-16T14:25:52.762960+0000","last_active":"2023-10-16T14:25:54.090560+0000","last_peered":"2023-10-16T14:25:54.090560+0000","last_clean":"2023-10-16T14:25:54.090560+0000","last_became_active":"2023-10-16T14:25:52.762507+0000","last_became_peered":"2023-10-16T14:25:52.762507+0000","last_unstale":"2023-10-16T14:25:54.090560+0000","last_undegraded":"2023-10-16T14:25:54.090560+0000","last_fullsized":"2023-10-16T14:25:54.090560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:35:03.884337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742081+0000","last_change":"2023-10-16T14:25:47.684937+0000","last_active":"2023-10-16T14:25:52.742081+0000","last_peered":"2023-10-16T14:25:52.742081+0000","last_clean":"2023-10-16T14:25:52.742081+0000","last_became_active":"2023-10-16T14:25:47.684625+0000","last_became_peered":"2023-10-16T14:25:47.684625+0000","last_unstale":"2023-10-16T14:25:52.742081+0000","last_undegraded":"2023-10-16T14:25:52.742081+0000","last_fullsized":"2023-10-16T14:25:52.742081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:05.381585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734783+0000","last_change":"2023-10-16T14:25:48.707706+0000","last_active":"2023-10-16T14:25:52.734783+0000","last_peered":"2023-10-16T14:25:52.734783+0000","last_clean":"2023-10-16T14:25:52.734783+0000","last_became_active":"2023-10-16T14:25:48.707434+0000","last_became_peered":"2023-10-16T14:25:48.707434+0000","last_unstale":"2023-10-16T14:25:52.734783+0000","last_undegraded":"2023-10-16T14:25:52.734783+0000","last_fullsized":"2023-10-16T14:25:52.734783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:25:48.053924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086892+0000","last_change":"2023-10-16T14:25:52.775947+0000","last_active":"2023-10-16T14:25:54.086892+0000","last_peered":"2023-10-16T14:25:54.086892+0000","last_clean":"2023-10-16T14:25:54.086892+0000","last_became_active":"2023-10-16T14:25:52.771892+0000","last_became_peered":"2023-10-16T14:25:52.771892+0000","last_unstale":"2023-10-16T14:25:54.086892+0000","last_undegraded":"2023-10-16T14:25:54.086892+0000","last_fullsized":"2023-10-16T14:25:54.086892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:13:27.830565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734432+0000","last_change":"2023-10-16T14:25:48.702028+0000","last_active":"2023-10-16T14:25:52.734432+0000","last_peered":"2023-10-16T14:25:52.734432+0000","last_clean":"2023-10-16T14:25:52.734432+0000","last_became_active":"2023-10-16T14:25:48.701734+0000","last_became_peered":"2023-10-16T14:25:48.701734+0000","last_unstale":"2023-10-16T14:25:52.734432+0000","last_undegraded":"2023-10-16T14:25:52.734432+0000","last_fullsized":"2023-10-16T14:25:52.734432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:27:03.907713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734923+0000","last_change":"2023-10-16T14:25:47.675386+0000","last_active":"2023-10-16T14:25:52.734923+0000","last_peered":"2023-10-16T14:25:52.734923+0000","last_clean":"2023-10-16T14:25:52.734923+0000","last_became_active":"2023-10-16T14:25:47.673235+0000","last_became_peered":"2023-10-16T14:25:47.673235+0000","last_unstale":"2023-10-16T14:25:52.734923+0000","last_undegraded":"2023-10-16T14:25:52.734923+0000","last_fullsized":"2023-10-16T14:25:52.734923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:08:41.557287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.726707+0000","last_change":"2023-10-16T14:25:52.761060+0000","last_active":"2023-10-16T14:25:53.726707+0000","last_peered":"2023-10-16T14:25:53.726707+0000","last_clean":"2023-10-16T14:25:53.726707+0000","last_became_active":"2023-10-16T14:25:52.760368+0000","last_became_peered":"2023-10-16T14:25:52.760368+0000","last_unstale":"2023-10-16T14:25:53.726707+0000","last_undegraded":"2023-10-16T14:25:53.726707+0000","last_fullsized":"2023-10-16T14:25:53.726707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:22:11.797676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.755837+0000","last_change":"2023-10-16T14:25:48.711084+0000","last_active":"2023-10-16T14:25:52.755837+0000","last_peered":"2023-10-16T14:25:52.755837+0000","last_clean":"2023-10-16T14:25:52.755837+0000","last_became_active":"2023-10-16T14:25:48.710802+0000","last_became_peered":"2023-10-16T14:25:48.710802+0000","last_unstale":"2023-10-16T14:25:52.755837+0000","last_undegraded":"2023-10-16T14:25:52.755837+0000","last_fullsized":"2023-10-16T14:25:52.755837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:06.393767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.764948+0000","last_change":"2023-10-16T14:25:47.688614+0000","last_active":"2023-10-16T14:25:52.764948+0000","last_peered":"2023-10-16T14:25:52.764948+0000","last_clean":"2023-10-16T14:25:52.764948+0000","last_became_active":"2023-10-16T14:25:47.686187+0000","last_became_peered":"2023-10-16T14:25:47.686187+0000","last_unstale":"2023-10-16T14:25:52.764948+0000","last_undegraded":"2023-10-16T14:25:52.764948+0000","last_fullsized":"2023-10-16T14:25:52.764948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:55:49.436260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.084971+0000","last_change":"2023-10-16T14:25:52.773158+0000","last_active":"2023-10-16T14:25:54.084971+0000","last_peered":"2023-10-16T14:25:54.084971+0000","last_clean":"2023-10-16T14:25:54.084971+0000","last_became_active":"2023-10-16T14:25:52.772200+0000","last_became_peered":"2023-10-16T14:25:52.772200+0000","last_unstale":"2023-10-16T14:25:54.084971+0000","last_undegraded":"2023-10-16T14:25:54.084971+0000","last_fullsized":"2023-10-16T14:25:54.084971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:01.082527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734700+0000","last_change":"2023-10-16T14:25:48.696802+0000","last_active":"2023-10-16T14:25:52.734700+0000","last_peered":"2023-10-16T14:25:52.734700+0000","last_clean":"2023-10-16T14:25:52.734700+0000","last_became_active":"2023-10-16T14:25:48.695664+0000","last_became_peered":"2023-10-16T14:25:48.695664+0000","last_unstale":"2023-10-16T14:25:52.734700+0000","last_undegraded":"2023-10-16T14:25:52.734700+0000","last_fullsized":"2023-10-16T14:25:52.734700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:44:58.603248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735333+0000","last_change":"2023-10-16T14:25:47.690959+0000","last_active":"2023-10-16T14:25:52.735333+0000","last_peered":"2023-10-16T14:25:52.735333+0000","last_clean":"2023-10-16T14:25:52.735333+0000","last_became_active":"2023-10-16T14:25:47.690583+0000","last_became_peered":"2023-10-16T14:25:47.690583+0000","last_unstale":"2023-10-16T14:25:52.735333+0000","last_undegraded":"2023-10-16T14:25:52.735333+0000","last_fullsized":"2023-10-16T14:25:52.735333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:05.381585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.090752+0000","last_change":"2023-10-16T14:25:52.774636+0000","last_active":"2023-10-16T14:25:54.090752+0000","last_peered":"2023-10-16T14:25:54.090752+0000","last_clean":"2023-10-16T14:25:54.090752+0000","last_became_active":"2023-10-16T14:25:52.771832+0000","last_became_peered":"2023-10-16T14:25:52.771832+0000","last_unstale":"2023-10-16T14:25:54.090752+0000","last_undegraded":"2023-10-16T14:25:54.090752+0000","last_fullsized":"2023-10-16T14:25:54.090752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:20.646849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735106+0000","last_change":"2023-10-16T14:25:48.704071+0000","last_active":"2023-10-16T14:25:52.735106+0000","last_peered":"2023-10-16T14:25:52.735106+0000","last_clean":"2023-10-16T14:25:52.735106+0000","last_became_active":"2023-10-16T14:25:48.703786+0000","last_became_peered":"2023-10-16T14:25:48.703786+0000","last_unstale":"2023-10-16T14:25:52.735106+0000","last_undegraded":"2023-10-16T14:25:52.735106+0000","last_fullsized":"2023-10-16T14:25:52.735106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:01:09.957934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.740520+0000","last_change":"2023-10-16T14:25:47.684412+0000","last_active":"2023-10-16T14:25:52.740520+0000","last_peered":"2023-10-16T14:25:52.740520+0000","last_clean":"2023-10-16T14:25:52.740520+0000","last_became_active":"2023-10-16T14:25:47.684067+0000","last_became_peered":"2023-10-16T14:25:47.684067+0000","last_unstale":"2023-10-16T14:25:52.740520+0000","last_undegraded":"2023-10-16T14:25:52.740520+0000","last_fullsized":"2023-10-16T14:25:52.740520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:33.359003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.091066+0000","last_change":"2023-10-16T14:25:52.760002+0000","last_active":"2023-10-16T14:25:54.091066+0000","last_peered":"2023-10-16T14:25:54.091066+0000","last_clean":"2023-10-16T14:25:54.091066+0000","last_became_active":"2023-10-16T14:25:52.759113+0000","last_became_peered":"2023-10-16T14:25:52.759113+0000","last_unstale":"2023-10-16T14:25:54.091066+0000","last_undegraded":"2023-10-16T14:25:54.091066+0000","last_fullsized":"2023-10-16T14:25:54.091066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:53.190625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.739919+0000","last_change":"2023-10-16T14:25:48.697052+0000","last_active":"2023-10-16T14:25:52.739919+0000","last_peered":"2023-10-16T14:25:52.739919+0000","last_clean":"2023-10-16T14:25:52.739919+0000","last_became_active":"2023-10-16T14:25:48.695195+0000","last_became_peered":"2023-10-16T14:25:48.695195+0000","last_unstale":"2023-10-16T14:25:52.739919+0000","last_undegraded":"2023-10-16T14:25:52.739919+0000","last_fullsized":"2023-10-16T14:25:52.739919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:34.371186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735823+0000","last_change":"2023-10-16T14:25:47.690567+0000","last_active":"2023-10-16T14:25:52.735823+0000","last_peered":"2023-10-16T14:25:52.735823+0000","last_clean":"2023-10-16T14:25:52.735823+0000","last_became_active":"2023-10-16T14:25:47.690306+0000","last_became_peered":"2023-10-16T14:25:47.690306+0000","last_unstale":"2023-10-16T14:25:52.735823+0000","last_undegraded":"2023-10-16T14:25:52.735823+0000","last_fullsized":"2023-10-16T14:25:52.735823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:18.948353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086866+0000","last_change":"2023-10-16T14:25:52.762012+0000","last_active":"2023-10-16T14:25:54.086866+0000","last_peered":"2023-10-16T14:25:54.086866+0000","last_clean":"2023-10-16T14:25:54.086866+0000","last_became_active":"2023-10-16T14:25:52.761553+0000","last_became_peered":"2023-10-16T14:25:52.761553+0000","last_unstale":"2023-10-16T14:25:54.086866+0000","last_undegraded":"2023-10-16T14:25:54.086866+0000","last_fullsized":"2023-10-16T14:25:54.086866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:57.876480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.739718+0000","last_change":"2023-10-16T14:25:48.713472+0000","last_active":"2023-10-16T14:25:52.739718+0000","last_peered":"2023-10-16T14:25:52.739718+0000","last_clean":"2023-10-16T14:25:52.739718+0000","last_became_active":"2023-10-16T14:25:48.713019+0000","last_became_peered":"2023-10-16T14:25:48.713019+0000","last_unstale":"2023-10-16T14:25:52.739718+0000","last_undegraded":"2023-10-16T14:25:52.739718+0000","last_fullsized":"2023-10-16T14:25:52.739718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:08.080421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.287222+0000","last_change":"2023-10-16T14:25:47.690820+0000","last_active":"2023-10-16T14:25:53.287222+0000","last_peered":"2023-10-16T14:25:53.287222+0000","last_clean":"2023-10-16T14:25:53.287222+0000","last_became_active":"2023-10-16T14:25:47.690554+0000","last_became_peered":"2023-10-16T14:25:47.690554+0000","last_unstale":"2023-10-16T14:25:53.287222+0000","last_undegraded":"2023-10-16T14:25:53.287222+0000","last_fullsized":"2023-10-16T14:25:53.287222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:48:55.264157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.728903+0000","last_change":"2023-10-16T14:25:52.765122+0000","last_active":"2023-10-16T14:25:53.728903+0000","last_peered":"2023-10-16T14:25:53.728903+0000","last_clean":"2023-10-16T14:25:53.728903+0000","last_became_active":"2023-10-16T14:25:52.764663+0000","last_became_peered":"2023-10-16T14:25:52.764663+0000","last_unstale":"2023-10-16T14:25:53.728903+0000","last_undegraded":"2023-10-16T14:25:53.728903+0000","last_fullsized":"2023-10-16T14:25:53.728903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:02.278979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.769095+0000","last_change":"2023-10-16T14:25:48.717743+0000","last_active":"2023-10-16T14:25:52.769095+0000","last_peered":"2023-10-16T14:25:52.769095+0000","last_clean":"2023-10-16T14:25:52.769095+0000","last_became_active":"2023-10-16T14:25:48.717468+0000","last_became_peered":"2023-10-16T14:25:48.717468+0000","last_unstale":"2023-10-16T14:25:52.769095+0000","last_undegraded":"2023-10-16T14:25:52.769095+0000","last_fullsized":"2023-10-16T14:25:52.769095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:44:58.603248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734870+0000","last_change":"2023-10-16T14:25:47.676947+0000","last_active":"2023-10-16T14:25:52.734870+0000","last_peered":"2023-10-16T14:25:52.734870+0000","last_clean":"2023-10-16T14:25:52.734870+0000","last_became_active":"2023-10-16T14:25:47.676630+0000","last_became_peered":"2023-10-16T14:25:47.676630+0000","last_unstale":"2023-10-16T14:25:52.734870+0000","last_undegraded":"2023-10-16T14:25:52.734870+0000","last_fullsized":"2023-10-16T14:25:52.734870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:33.359003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.088211+0000","last_change":"2023-10-16T14:25:52.764074+0000","last_active":"2023-10-16T14:25:54.088211+0000","last_peered":"2023-10-16T14:25:54.088211+0000","last_clean":"2023-10-16T14:25:54.088211+0000","last_became_active":"2023-10-16T14:25:52.763641+0000","last_became_peered":"2023-10-16T14:25:52.763641+0000","last_unstale":"2023-10-16T14:25:54.088211+0000","last_undegraded":"2023-10-16T14:25:54.088211+0000","last_fullsized":"2023-10-16T14:25:54.088211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:21:41.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.724375+0000","last_change":"2023-10-16T14:25:48.710134+0000","last_active":"2023-10-16T14:25:52.724375+0000","last_peered":"2023-10-16T14:25:52.724375+0000","last_clean":"2023-10-16T14:25:52.724375+0000","last_became_active":"2023-10-16T14:25:48.709462+0000","last_became_peered":"2023-10-16T14:25:48.709462+0000","last_unstale":"2023-10-16T14:25:52.724375+0000","last_undegraded":"2023-10-16T14:25:52.724375+0000","last_fullsized":"2023-10-16T14:25:52.724375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:06.393767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.752412+0000","last_change":"2023-10-16T14:25:47.687252+0000","last_active":"2023-10-16T14:25:52.752412+0000","last_peered":"2023-10-16T14:25:52.752412+0000","last_clean":"2023-10-16T14:25:52.752412+0000","last_became_active":"2023-10-16T14:25:47.685825+0000","last_became_peered":"2023-10-16T14:25:47.685825+0000","last_unstale":"2023-10-16T14:25:52.752412+0000","last_undegraded":"2023-10-16T14:25:52.752412+0000","last_fullsized":"2023-10-16T14:25:52.752412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:01.814630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.087296+0000","last_change":"2023-10-16T14:25:52.767900+0000","last_active":"2023-10-16T14:25:54.087296+0000","last_peered":"2023-10-16T14:25:54.087296+0000","last_clean":"2023-10-16T14:25:54.087296+0000","last_became_active":"2023-10-16T14:25:52.767212+0000","last_became_peered":"2023-10-16T14:25:52.767212+0000","last_unstale":"2023-10-16T14:25:54.087296+0000","last_undegraded":"2023-10-16T14:25:54.087296+0000","last_fullsized":"2023-10-16T14:25:54.087296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:35:03.884337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741846+0000","last_change":"2023-10-16T14:25:48.722313+0000","last_active":"2023-10-16T14:25:52.741846+0000","last_peered":"2023-10-16T14:25:52.741846+0000","last_clean":"2023-10-16T14:25:52.741846+0000","last_became_active":"2023-10-16T14:25:48.718701+0000","last_became_peered":"2023-10-16T14:25:48.718701+0000","last_unstale":"2023-10-16T14:25:52.741846+0000","last_undegraded":"2023-10-16T14:25:52.741846+0000","last_fullsized":"2023-10-16T14:25:52.741846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:53.816510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734713+0000","last_change":"2023-10-16T14:25:47.685303+0000","last_active":"2023-10-16T14:25:52.734713+0000","last_peered":"2023-10-16T14:25:52.734713+0000","last_clean":"2023-10-16T14:25:52.734713+0000","last_became_active":"2023-10-16T14:25:47.682721+0000","last_became_peered":"2023-10-16T14:25:47.682721+0000","last_unstale":"2023-10-16T14:25:52.734713+0000","last_undegraded":"2023-10-16T14:25:52.734713+0000","last_fullsized":"2023-10-16T14:25:52.734713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:38:16.755159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086122+0000","last_change":"2023-10-16T14:25:52.772956+0000","last_active":"2023-10-16T14:25:54.086122+0000","last_peered":"2023-10-16T14:25:54.086122+0000","last_clean":"2023-10-16T14:25:54.086122+0000","last_became_active":"2023-10-16T14:25:52.772590+0000","last_became_peered":"2023-10-16T14:25:52.772590+0000","last_unstale":"2023-10-16T14:25:54.086122+0000","last_undegraded":"2023-10-16T14:25:54.086122+0000","last_fullsized":"2023-10-16T14:25:54.086122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:13:27.830565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.748440+0000","last_change":"2023-10-16T14:25:48.695306+0000","last_active":"2023-10-16T14:25:52.748440+0000","last_peered":"2023-10-16T14:25:52.748440+0000","last_clean":"2023-10-16T14:25:52.748440+0000","last_became_active":"2023-10-16T14:25:48.694997+0000","last_became_peered":"2023-10-16T14:25:48.694997+0000","last_unstale":"2023-10-16T14:25:52.748440+0000","last_undegraded":"2023-10-16T14:25:52.748440+0000","last_fullsized":"2023-10-16T14:25:52.748440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:10:11.346850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.755114+0000","last_change":"2023-10-16T14:25:47.684999+0000","last_active":"2023-10-16T14:25:52.755114+0000","last_peered":"2023-10-16T14:25:52.755114+0000","last_clean":"2023-10-16T14:25:52.755114+0000","last_became_active":"2023-10-16T14:25:47.684456+0000","last_became_peered":"2023-10-16T14:25:47.684456+0000","last_unstale":"2023-10-16T14:25:52.755114+0000","last_undegraded":"2023-10-16T14:25:52.755114+0000","last_fullsized":"2023-10-16T14:25:52.755114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:13:52.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086890+0000","last_change":"2023-10-16T14:25:52.771370+0000","last_active":"2023-10-16T14:25:54.086890+0000","last_peered":"2023-10-16T14:25:54.086890+0000","last_clean":"2023-10-16T14:25:54.086890+0000","last_became_active":"2023-10-16T14:25:52.770704+0000","last_became_peered":"2023-10-16T14:25:52.770704+0000","last_unstale":"2023-10-16T14:25:54.086890+0000","last_undegraded":"2023-10-16T14:25:54.086890+0000","last_fullsized":"2023-10-16T14:25:54.086890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:38:21.827312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.765178+0000","last_change":"2023-10-16T14:25:48.722957+0000","last_active":"2023-10-16T14:25:52.765178+0000","last_peered":"2023-10-16T14:25:52.765178+0000","last_clean":"2023-10-16T14:25:52.765178+0000","last_became_active":"2023-10-16T14:25:48.722644+0000","last_became_peered":"2023-10-16T14:25:48.722644+0000","last_unstale":"2023-10-16T14:25:52.765178+0000","last_undegraded":"2023-10-16T14:25:52.765178+0000","last_fullsized":"2023-10-16T14:25:52.765178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:48:56.276340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.733321+0000","last_change":"2023-10-16T14:25:47.686726+0000","last_active":"2023-10-16T14:25:52.733321+0000","last_peered":"2023-10-16T14:25:52.733321+0000","last_clean":"2023-10-16T14:25:52.733321+0000","last_became_active":"2023-10-16T14:25:47.686380+0000","last_became_peered":"2023-10-16T14:25:47.686380+0000","last_unstale":"2023-10-16T14:25:52.733321+0000","last_undegraded":"2023-10-16T14:25:52.733321+0000","last_fullsized":"2023-10-16T14:25:52.733321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:11:14.808035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.088884+0000","last_change":"2023-10-16T14:25:52.775875+0000","last_active":"2023-10-16T14:25:54.088884+0000","last_peered":"2023-10-16T14:25:54.088884+0000","last_clean":"2023-10-16T14:25:54.088884+0000","last_became_active":"2023-10-16T14:25:52.774845+0000","last_became_peered":"2023-10-16T14:25:52.774845+0000","last_unstale":"2023-10-16T14:25:54.088884+0000","last_undegraded":"2023-10-16T14:25:54.088884+0000","last_fullsized":"2023-10-16T14:25:54.088884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:14:32.299751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735654+0000","last_change":"2023-10-16T14:25:48.694170+0000","last_active":"2023-10-16T14:25:52.735654+0000","last_peered":"2023-10-16T14:25:52.735654+0000","last_clean":"2023-10-16T14:25:52.735654+0000","last_became_active":"2023-10-16T14:25:48.693887+0000","last_became_peered":"2023-10-16T14:25:48.693887+0000","last_unstale":"2023-10-16T14:25:52.735654+0000","last_undegraded":"2023-10-16T14:25:52.735654+0000","last_fullsized":"2023-10-16T14:25:52.735654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:11:15.820218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735010+0000","last_change":"2023-10-16T14:25:47.672195+0000","last_active":"2023-10-16T14:25:52.735010+0000","last_peered":"2023-10-16T14:25:52.735010+0000","last_clean":"2023-10-16T14:25:52.735010+0000","last_became_active":"2023-10-16T14:25:47.671904+0000","last_became_peered":"2023-10-16T14:25:47.671904+0000","last_unstale":"2023-10-16T14:25:52.735010+0000","last_undegraded":"2023-10-16T14:25:52.735010+0000","last_fullsized":"2023-10-16T14:25:52.735010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:44:57.591065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.728977+0000","last_change":"2023-10-16T14:25:37.824419+0000","last_active":"2023-10-16T14:25:52.728977+0000","last_peered":"2023-10-16T14:25:52.728977+0000","last_clean":"2023-10-16T14:25:52.728977+0000","last_became_active":"2023-10-16T14:25:37.821909+0000","last_became_peered":"2023-10-16T14:25:37.821909+0000","last_unstale":"2023-10-16T14:25:52.728977+0000","last_undegraded":"2023-10-16T14:25:52.728977+0000","last_fullsized":"2023-10-16T14:25:52.728977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:36.449944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:36.449944+0000","last_clean_scrub_stamp":"2023-10-16T14:25:36.449944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:37:42.457821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.727527+0000","last_change":"2023-10-16T14:25:52.743776+0000","last_active":"2023-10-16T14:25:53.727527+0000","last_peered":"2023-10-16T14:25:53.727527+0000","last_clean":"2023-10-16T14:25:53.727527+0000","last_became_active":"2023-10-16T14:25:52.743307+0000","last_became_peered":"2023-10-16T14:25:52.743307+0000","last_unstale":"2023-10-16T14:25:53.727527+0000","last_undegraded":"2023-10-16T14:25:53.727527+0000","last_fullsized":"2023-10-16T14:25:53.727527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:44:03.308638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734705+0000","last_change":"2023-10-16T14:25:48.698529+0000","last_active":"2023-10-16T14:25:52.734705+0000","last_peered":"2023-10-16T14:25:52.734705+0000","last_clean":"2023-10-16T14:25:52.734705+0000","last_became_active":"2023-10-16T14:25:48.698220+0000","last_became_peered":"2023-10-16T14:25:48.698220+0000","last_unstale":"2023-10-16T14:25:52.734705+0000","last_undegraded":"2023-10-16T14:25:52.734705+0000","last_fullsized":"2023-10-16T14:25:52.734705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:24:18.840113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.769078+0000","last_change":"2023-10-16T14:25:47.689827+0000","last_active":"2023-10-16T14:25:52.769078+0000","last_peered":"2023-10-16T14:25:52.769078+0000","last_clean":"2023-10-16T14:25:52.769078+0000","last_became_active":"2023-10-16T14:25:47.689464+0000","last_became_peered":"2023-10-16T14:25:47.689464+0000","last_unstale":"2023-10-16T14:25:52.769078+0000","last_undegraded":"2023-10-16T14:25:52.769078+0000","last_fullsized":"2023-10-16T14:25:52.769078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:13:52.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.090293+0000","last_change":"2023-10-16T14:25:52.752794+0000","last_active":"2023-10-16T14:25:54.090293+0000","last_peered":"2023-10-16T14:25:54.090293+0000","last_clean":"2023-10-16T14:25:54.090293+0000","last_became_active":"2023-10-16T14:25:52.751655+0000","last_became_peered":"2023-10-16T14:25:52.751655+0000","last_unstale":"2023-10-16T14:25:54.090293+0000","last_undegraded":"2023-10-16T14:25:54.090293+0000","last_fullsized":"2023-10-16T14:25:54.090293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:38:21.827312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742050+0000","last_change":"2023-10-16T14:25:48.697393+0000","last_active":"2023-10-16T14:25:52.742050+0000","last_peered":"2023-10-16T14:25:52.742050+0000","last_clean":"2023-10-16T14:25:52.742050+0000","last_became_active":"2023-10-16T14:25:48.697054+0000","last_became_peered":"2023-10-16T14:25:48.697054+0000","last_unstale":"2023-10-16T14:25:52.742050+0000","last_undegraded":"2023-10-16T14:25:52.742050+0000","last_fullsized":"2023-10-16T14:25:52.742050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:49.130655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.750852+0000","last_change":"2023-10-16T14:25:47.684985+0000","last_active":"2023-10-16T14:25:52.750852+0000","last_peered":"2023-10-16T14:25:52.750852+0000","last_clean":"2023-10-16T14:25:52.750852+0000","last_became_active":"2023-10-16T14:25:47.684330+0000","last_became_peered":"2023-10-16T14:25:47.684330+0000","last_unstale":"2023-10-16T14:25:52.750852+0000","last_undegraded":"2023-10-16T14:25:52.750852+0000","last_fullsized":"2023-10-16T14:25:52.750852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:30:15.114400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086956+0000","last_change":"2023-10-16T14:25:52.757607+0000","last_active":"2023-10-16T14:25:54.086956+0000","last_peered":"2023-10-16T14:25:54.086956+0000","last_clean":"2023-10-16T14:25:54.086956+0000","last_became_active":"2023-10-16T14:25:52.757210+0000","last_became_peered":"2023-10-16T14:25:52.757210+0000","last_unstale":"2023-10-16T14:25:54.086956+0000","last_undegraded":"2023-10-16T14:25:54.086956+0000","last_fullsized":"2023-10-16T14:25:54.086956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:04:13.493245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742186+0000","last_change":"2023-10-16T14:25:48.706248+0000","last_active":"2023-10-16T14:25:52.742186+0000","last_peered":"2023-10-16T14:25:52.742186+0000","last_clean":"2023-10-16T14:25:52.742186+0000","last_became_active":"2023-10-16T14:25:48.705245+0000","last_became_peered":"2023-10-16T14:25:48.705245+0000","last_unstale":"2023-10-16T14:25:52.742186+0000","last_undegraded":"2023-10-16T14:25:52.742186+0000","last_fullsized":"2023-10-16T14:25:52.742186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:13:23.770595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.740182+0000","last_change":"2023-10-16T14:25:47.689189+0000","last_active":"2023-10-16T14:25:52.740182+0000","last_peered":"2023-10-16T14:25:52.740182+0000","last_clean":"2023-10-16T14:25:52.740182+0000","last_became_active":"2023-10-16T14:25:47.688019+0000","last_became_peered":"2023-10-16T14:25:47.688019+0000","last_unstale":"2023-10-16T14:25:52.740182+0000","last_undegraded":"2023-10-16T14:25:52.740182+0000","last_fullsized":"2023-10-16T14:25:52.740182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:02.376389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.725983+0000","last_change":"2023-10-16T14:25:52.743545+0000","last_active":"2023-10-16T14:25:53.725983+0000","last_peered":"2023-10-16T14:25:53.725983+0000","last_clean":"2023-10-16T14:25:53.725983+0000","last_became_active":"2023-10-16T14:25:52.743011+0000","last_became_peered":"2023-10-16T14:25:52.743011+0000","last_unstale":"2023-10-16T14:25:53.725983+0000","last_undegraded":"2023-10-16T14:25:53.725983+0000","last_fullsized":"2023-10-16T14:25:53.725983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:44:58.353984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.726324+0000","last_change":"2023-10-16T14:25:48.718247+0000","last_active":"2023-10-16T14:25:52.726324+0000","last_peered":"2023-10-16T14:25:52.726324+0000","last_clean":"2023-10-16T14:25:52.726324+0000","last_became_active":"2023-10-16T14:25:48.717927+0000","last_became_peered":"2023-10-16T14:25:48.717927+0000","last_unstale":"2023-10-16T14:25:52.726324+0000","last_undegraded":"2023-10-16T14:25:52.726324+0000","last_fullsized":"2023-10-16T14:25:52.726324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:08:42.569470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742310+0000","last_change":"2023-10-16T14:25:47.689833+0000","last_active":"2023-10-16T14:25:52.742310+0000","last_peered":"2023-10-16T14:25:52.742310+0000","last_clean":"2023-10-16T14:25:52.742310+0000","last_became_active":"2023-10-16T14:25:47.689476+0000","last_became_peered":"2023-10-16T14:25:47.689476+0000","last_unstale":"2023-10-16T14:25:52.742310+0000","last_undegraded":"2023-10-16T14:25:52.742310+0000","last_fullsized":"2023-10-16T14:25:52.742310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:15.574696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.087293+0000","last_change":"2023-10-16T14:25:52.751674+0000","last_active":"2023-10-16T14:25:54.087293+0000","last_peered":"2023-10-16T14:25:54.087293+0000","last_clean":"2023-10-16T14:25:54.087293+0000","last_became_active":"2023-10-16T14:25:52.751135+0000","last_became_peered":"2023-10-16T14:25:52.751135+0000","last_unstale":"2023-10-16T14:25:54.087293+0000","last_undegraded":"2023-10-16T14:25:54.087293+0000","last_fullsized":"2023-10-16T14:25:54.087293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:49:00.336310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.733096+0000","last_change":"2023-10-16T14:25:48.713856+0000","last_active":"2023-10-16T14:25:52.733096+0000","last_peered":"2023-10-16T14:25:52.733096+0000","last_clean":"2023-10-16T14:25:52.733096+0000","last_became_active":"2023-10-16T14:25:48.713593+0000","last_became_peered":"2023-10-16T14:25:48.713593+0000","last_unstale":"2023-10-16T14:25:52.733096+0000","last_undegraded":"2023-10-16T14:25:52.733096+0000","last_fullsized":"2023-10-16T14:25:52.733096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:32.458956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734709+0000","last_change":"2023-10-16T14:25:47.670890+0000","last_active":"2023-10-16T14:25:52.734709+0000","last_peered":"2023-10-16T14:25:52.734709+0000","last_clean":"2023-10-16T14:25:52.734709+0000","last_became_active":"2023-10-16T14:25:47.670394+0000","last_became_peered":"2023-10-16T14:25:47.670394+0000","last_unstale":"2023-10-16T14:25:52.734709+0000","last_undegraded":"2023-10-16T14:25:52.734709+0000","last_fullsized":"2023-10-16T14:25:52.734709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:05:41.428042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.089075+0000","last_change":"2023-10-16T14:25:52.766516+0000","last_active":"2023-10-16T14:25:54.089075+0000","last_peered":"2023-10-16T14:25:54.089075+0000","last_clean":"2023-10-16T14:25:54.089075+0000","last_became_active":"2023-10-16T14:25:52.766073+0000","last_became_peered":"2023-10-16T14:25:52.766073+0000","last_unstale":"2023-10-16T14:25:54.089075+0000","last_undegraded":"2023-10-16T14:25:54.089075+0000","last_fullsized":"2023-10-16T14:25:54.089075+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:58.114992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.728872+0000","last_change":"2023-10-16T14:25:48.696048+0000","last_active":"2023-10-16T14:25:52.728872+0000","last_peered":"2023-10-16T14:25:52.728872+0000","last_clean":"2023-10-16T14:25:52.728872+0000","last_became_active":"2023-10-16T14:25:48.695762+0000","last_became_peered":"2023-10-16T14:25:48.695762+0000","last_unstale":"2023-10-16T14:25:52.728872+0000","last_undegraded":"2023-10-16T14:25:52.728872+0000","last_fullsized":"2023-10-16T14:25:52.728872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:23:02.569007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741599+0000","last_change":"2023-10-16T14:25:47.688476+0000","last_active":"2023-10-16T14:25:52.741599+0000","last_peered":"2023-10-16T14:25:52.741599+0000","last_clean":"2023-10-16T14:25:52.741599+0000","last_became_active":"2023-10-16T14:25:47.688163+0000","last_became_peered":"2023-10-16T14:25:47.688163+0000","last_unstale":"2023-10-16T14:25:52.741599+0000","last_undegraded":"2023-10-16T14:25:52.741599+0000","last_fullsized":"2023-10-16T14:25:52.741599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:07:28.689085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.090941+0000","last_change":"2023-10-16T14:25:52.768793+0000","last_active":"2023-10-16T14:25:54.090941+0000","last_peered":"2023-10-16T14:25:54.090941+0000","last_clean":"2023-10-16T14:25:54.090941+0000","last_became_active":"2023-10-16T14:25:52.765782+0000","last_became_peered":"2023-10-16T14:25:52.765782+0000","last_unstale":"2023-10-16T14:25:54.090941+0000","last_undegraded":"2023-10-16T14:25:54.090941+0000","last_fullsized":"2023-10-16T14:25:54.090941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:48:18.923566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734835+0000","last_change":"2023-10-16T14:25:48.706114+0000","last_active":"2023-10-16T14:25:52.734835+0000","last_peered":"2023-10-16T14:25:52.734835+0000","last_clean":"2023-10-16T14:25:52.734835+0000","last_became_active":"2023-10-16T14:25:48.705841+0000","last_became_peered":"2023-10-16T14:25:48.705841+0000","last_unstale":"2023-10-16T14:25:52.734835+0000","last_undegraded":"2023-10-16T14:25:52.734835+0000","last_fullsized":"2023-10-16T14:25:52.734835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:23:57.022557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734625+0000","last_change":"2023-10-16T14:25:47.672757+0000","last_active":"2023-10-16T14:25:52.734625+0000","last_peered":"2023-10-16T14:25:52.734625+0000","last_clean":"2023-10-16T14:25:52.734625+0000","last_became_active":"2023-10-16T14:25:47.671677+0000","last_became_peered":"2023-10-16T14:25:47.671677+0000","last_unstale":"2023-10-16T14:25:52.734625+0000","last_undegraded":"2023-10-16T14:25:52.734625+0000","last_fullsized":"2023-10-16T14:25:52.734625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:13:22.758413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086002+0000","last_change":"2023-10-16T14:25:52.772092+0000","last_active":"2023-10-16T14:25:54.086002+0000","last_peered":"2023-10-16T14:25:54.086002+0000","last_clean":"2023-10-16T14:25:54.086002+0000","last_became_active":"2023-10-16T14:25:52.771630+0000","last_became_peered":"2023-10-16T14:25:52.771630+0000","last_unstale":"2023-10-16T14:25:54.086002+0000","last_undegraded":"2023-10-16T14:25:54.086002+0000","last_fullsized":"2023-10-16T14:25:54.086002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:57.876480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.764800+0000","last_change":"2023-10-16T14:25:48.716516+0000","last_active":"2023-10-16T14:25:52.764800+0000","last_peered":"2023-10-16T14:25:52.764800+0000","last_clean":"2023-10-16T14:25:52.764800+0000","last_became_active":"2023-10-16T14:25:48.716176+0000","last_became_peered":"2023-10-16T14:25:48.716176+0000","last_unstale":"2023-10-16T14:25:52.764800+0000","last_undegraded":"2023-10-16T14:25:52.764800+0000","last_fullsized":"2023-10-16T14:25:52.764800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:03.388572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.757734+0000","last_change":"2023-10-16T14:25:47.689971+0000","last_active":"2023-10-16T14:25:52.757734+0000","last_peered":"2023-10-16T14:25:52.757734+0000","last_clean":"2023-10-16T14:25:52.757734+0000","last_became_active":"2023-10-16T14:25:47.689597+0000","last_became_peered":"2023-10-16T14:25:47.689597+0000","last_unstale":"2023-10-16T14:25:52.757734+0000","last_undegraded":"2023-10-16T14:25:52.757734+0000","last_fullsized":"2023-10-16T14:25:52.757734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:48:33.689068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.727072+0000","last_change":"2023-10-16T14:25:52.770776+0000","last_active":"2023-10-16T14:25:53.727072+0000","last_peered":"2023-10-16T14:25:53.727072+0000","last_clean":"2023-10-16T14:25:53.727072+0000","last_became_active":"2023-10-16T14:25:52.769836+0000","last_became_peered":"2023-10-16T14:25:52.769836+0000","last_unstale":"2023-10-16T14:25:53.727072+0000","last_undegraded":"2023-10-16T14:25:53.727072+0000","last_fullsized":"2023-10-16T14:25:53.727072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:11:16.574099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742318+0000","last_change":"2023-10-16T14:25:48.713120+0000","last_active":"2023-10-16T14:25:52.742318+0000","last_peered":"2023-10-16T14:25:52.742318+0000","last_clean":"2023-10-16T14:25:52.742318+0000","last_became_active":"2023-10-16T14:25:48.712749+0000","last_became_peered":"2023-10-16T14:25:48.712749+0000","last_unstale":"2023-10-16T14:25:52.742318+0000","last_undegraded":"2023-10-16T14:25:52.742318+0000","last_fullsized":"2023-10-16T14:25:52.742318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:38:17.767342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:26:06.790145+0000","last_change":"2023-10-16T14:25:47.677057+0000","last_active":"2023-10-16T14:26:06.790145+0000","last_peered":"2023-10-16T14:26:06.790145+0000","last_clean":"2023-10-16T14:26:06.790145+0000","last_became_active":"2023-10-16T14:25:47.676793+0000","last_became_peered":"2023-10-16T14:25:47.676793+0000","last_unstale":"2023-10-16T14:26:06.790145+0000","last_undegraded":"2023-10-16T14:26:06.790145+0000","last_fullsized":"2023-10-16T14:26:06.790145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:27:37.655811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.727776+0000","last_change":"2023-10-16T14:25:52.749720+0000","last_active":"2023-10-16T14:25:53.727776+0000","last_peered":"2023-10-16T14:25:53.727776+0000","last_clean":"2023-10-16T14:25:53.727776+0000","last_became_active":"2023-10-16T14:25:52.749259+0000","last_became_peered":"2023-10-16T14:25:52.749259+0000","last_unstale":"2023-10-16T14:25:53.727776+0000","last_undegraded":"2023-10-16T14:25:53.727776+0000","last_fullsized":"2023-10-16T14:25:53.727776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:21:41.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.733638+0000","last_change":"2023-10-16T14:25:48.713531+0000","last_active":"2023-10-16T14:25:52.733638+0000","last_peered":"2023-10-16T14:25:52.733638+0000","last_clean":"2023-10-16T14:25:52.733638+0000","last_became_active":"2023-10-16T14:25:48.713160+0000","last_became_peered":"2023-10-16T14:25:48.713160+0000","last_unstale":"2023-10-16T14:25:52.733638+0000","last_undegraded":"2023-10-16T14:25:52.733638+0000","last_fullsized":"2023-10-16T14:25:52.733638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:32:51.782302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.762449+0000","last_change":"2023-10-16T14:25:47.685499+0000","last_active":"2023-10-16T14:25:52.762449+0000","last_peered":"2023-10-16T14:25:52.762449+0000","last_clean":"2023-10-16T14:25:52.762449+0000","last_became_active":"2023-10-16T14:25:47.685151+0000","last_became_peered":"2023-10-16T14:25:47.685151+0000","last_unstale":"2023-10-16T14:25:52.762449+0000","last_undegraded":"2023-10-16T14:25:52.762449+0000","last_fullsized":"2023-10-16T14:25:52.762449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:54.472297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.090819+0000","last_change":"2023-10-16T14:25:52.764063+0000","last_active":"2023-10-16T14:25:54.090819+0000","last_peered":"2023-10-16T14:25:54.090819+0000","last_clean":"2023-10-16T14:25:54.090819+0000","last_became_active":"2023-10-16T14:25:52.763641+0000","last_became_peered":"2023-10-16T14:25:52.763641+0000","last_unstale":"2023-10-16T14:25:54.090819+0000","last_undegraded":"2023-10-16T14:25:54.090819+0000","last_fullsized":"2023-10-16T14:25:54.090819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:21:41.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.751879+0000","last_change":"2023-10-16T14:25:48.703305+0000","last_active":"2023-10-16T14:25:52.751879+0000","last_peered":"2023-10-16T14:25:52.751879+0000","last_clean":"2023-10-16T14:25:52.751879+0000","last_became_active":"2023-10-16T14:25:48.702978+0000","last_became_peered":"2023-10-16T14:25:48.702978+0000","last_unstale":"2023-10-16T14:25:52.751879+0000","last_undegraded":"2023-10-16T14:25:52.751879+0000","last_fullsized":"2023-10-16T14:25:52.751879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:08.702138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742225+0000","last_change":"2023-10-16T14:25:47.688400+0000","last_active":"2023-10-16T14:25:52.742225+0000","last_peered":"2023-10-16T14:25:52.742225+0000","last_clean":"2023-10-16T14:25:52.742225+0000","last_became_active":"2023-10-16T14:25:47.688066+0000","last_became_peered":"2023-10-16T14:25:47.688066+0000","last_unstale":"2023-10-16T14:25:52.742225+0000","last_undegraded":"2023-10-16T14:25:52.742225+0000","last_fullsized":"2023-10-16T14:25:52.742225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:18.948353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.085217+0000","last_change":"2023-10-16T14:25:52.761062+0000","last_active":"2023-10-16T14:25:54.085217+0000","last_peered":"2023-10-16T14:25:54.085217+0000","last_clean":"2023-10-16T14:25:54.085217+0000","last_became_active":"2023-10-16T14:25:52.759852+0000","last_became_peered":"2023-10-16T14:25:52.759852+0000","last_unstale":"2023-10-16T14:25:54.085217+0000","last_undegraded":"2023-10-16T14:25:54.085217+0000","last_fullsized":"2023-10-16T14:25:54.085217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:45:02.663218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.726232+0000","last_change":"2023-10-16T14:25:48.712154+0000","last_active":"2023-10-16T14:25:52.726232+0000","last_peered":"2023-10-16T14:25:52.726232+0000","last_clean":"2023-10-16T14:25:52.726232+0000","last_became_active":"2023-10-16T14:25:48.711510+0000","last_became_peered":"2023-10-16T14:25:48.711510+0000","last_unstale":"2023-10-16T14:25:52.726232+0000","last_undegraded":"2023-10-16T14:25:52.726232+0000","last_fullsized":"2023-10-16T14:25:52.726232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:48:56.276340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.729439+0000","last_change":"2023-10-16T14:25:47.668179+0000","last_active":"2023-10-16T14:25:52.729439+0000","last_peered":"2023-10-16T14:25:52.729439+0000","last_clean":"2023-10-16T14:25:52.729439+0000","last_became_active":"2023-10-16T14:25:47.667021+0000","last_became_peered":"2023-10-16T14:25:47.667021+0000","last_unstale":"2023-10-16T14:25:52.729439+0000","last_undegraded":"2023-10-16T14:25:52.729439+0000","last_fullsized":"2023-10-16T14:25:52.729439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:35:07.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.727768+0000","last_change":"2023-10-16T14:25:52.756998+0000","last_active":"2023-10-16T14:25:53.727768+0000","last_peered":"2023-10-16T14:25:53.727768+0000","last_clean":"2023-10-16T14:25:53.727768+0000","last_became_active":"2023-10-16T14:25:52.756551+0000","last_became_peered":"2023-10-16T14:25:52.756551+0000","last_unstale":"2023-10-16T14:25:53.727768+0000","last_undegraded":"2023-10-16T14:25:53.727768+0000","last_fullsized":"2023-10-16T14:25:53.727768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:53.190625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.729124+0000","last_change":"2023-10-16T14:25:52.770650+0000","last_active":"2023-10-16T14:25:53.729124+0000","last_peered":"2023-10-16T14:25:53.729124+0000","last_clean":"2023-10-16T14:25:53.729124+0000","last_became_active":"2023-10-16T14:25:52.769652+0000","last_became_peered":"2023-10-16T14:25:52.769652+0000","last_unstale":"2023-10-16T14:25:53.729124+0000","last_undegraded":"2023-10-16T14:25:53.729124+0000","last_fullsized":"2023-10-16T14:25:53.729124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:01:14.017904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735103+0000","last_change":"2023-10-16T14:25:48.679714+0000","last_active":"2023-10-16T14:25:52.735103+0000","last_peered":"2023-10-16T14:25:52.735103+0000","last_clean":"2023-10-16T14:25:52.735103+0000","last_became_active":"2023-10-16T14:25:48.678913+0000","last_became_peered":"2023-10-16T14:25:48.678913+0000","last_unstale":"2023-10-16T14:25:52.735103+0000","last_undegraded":"2023-10-16T14:25:52.735103+0000","last_fullsized":"2023-10-16T14:25:52.735103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:43.182462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.736001+0000","last_change":"2023-10-16T14:25:47.670716+0000","last_active":"2023-10-16T14:25:52.736001+0000","last_peered":"2023-10-16T14:25:52.736001+0000","last_clean":"2023-10-16T14:25:52.736001+0000","last_became_active":"2023-10-16T14:25:47.669479+0000","last_became_peered":"2023-10-16T14:25:47.669479+0000","last_unstale":"2023-10-16T14:25:52.736001+0000","last_undegraded":"2023-10-16T14:25:52.736001+0000","last_fullsized":"2023-10-16T14:25:52.736001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:07:28.689085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.727220+0000","last_change":"2023-10-16T14:25:52.766844+0000","last_active":"2023-10-16T14:25:53.727220+0000","last_peered":"2023-10-16T14:25:53.727220+0000","last_clean":"2023-10-16T14:25:53.727220+0000","last_became_active":"2023-10-16T14:25:52.766324+0000","last_became_peered":"2023-10-16T14:25:52.766324+0000","last_unstale":"2023-10-16T14:25:53.727220+0000","last_undegraded":"2023-10-16T14:25:53.727220+0000","last_fullsized":"2023-10-16T14:25:53.727220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:23:27.304235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.748605+0000","last_change":"2023-10-16T14:25:48.707865+0000","last_active":"2023-10-16T14:25:52.748605+0000","last_peered":"2023-10-16T14:25:52.748605+0000","last_clean":"2023-10-16T14:25:52.748605+0000","last_became_active":"2023-10-16T14:25:48.707590+0000","last_became_peered":"2023-10-16T14:25:48.707590+0000","last_unstale":"2023-10-16T14:25:52.748605+0000","last_undegraded":"2023-10-16T14:25:52.748605+0000","last_fullsized":"2023-10-16T14:25:52.748605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:09.386851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.765286+0000","last_change":"2023-10-16T14:25:47.689952+0000","last_active":"2023-10-16T14:25:52.765286+0000","last_peered":"2023-10-16T14:25:52.765286+0000","last_clean":"2023-10-16T14:25:52.765286+0000","last_became_active":"2023-10-16T14:25:47.689569+0000","last_became_peered":"2023-10-16T14:25:47.689569+0000","last_unstale":"2023-10-16T14:25:52.765286+0000","last_undegraded":"2023-10-16T14:25:52.765286+0000","last_fullsized":"2023-10-16T14:25:52.765286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:33.258222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734526+0000","last_change":"2023-10-16T14:25:47.684407+0000","last_active":"2023-10-16T14:25:52.734526+0000","last_peered":"2023-10-16T14:25:52.734526+0000","last_clean":"2023-10-16T14:25:52.734526+0000","last_became_active":"2023-10-16T14:25:47.683112+0000","last_became_peered":"2023-10-16T14:25:47.683112+0000","last_unstale":"2023-10-16T14:25:52.734526+0000","last_undegraded":"2023-10-16T14:25:52.734526+0000","last_fullsized":"2023-10-16T14:25:52.734526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:58.812184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.736192+0000","last_change":"2023-10-16T14:25:48.707553+0000","last_active":"2023-10-16T14:25:52.736192+0000","last_peered":"2023-10-16T14:25:52.736192+0000","last_clean":"2023-10-16T14:25:52.736192+0000","last_became_active":"2023-10-16T14:25:48.707287+0000","last_became_peered":"2023-10-16T14:25:48.707287+0000","last_unstale":"2023-10-16T14:25:52.736192+0000","last_undegraded":"2023-10-16T14:25:52.736192+0000","last_fullsized":"2023-10-16T14:25:52.736192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:16.586879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.728065+0000","last_change":"2023-10-16T14:25:52.772152+0000","last_active":"2023-10-16T14:25:53.728065+0000","last_peered":"2023-10-16T14:25:53.728065+0000","last_clean":"2023-10-16T14:25:53.728065+0000","last_became_active":"2023-10-16T14:25:52.771782+0000","last_became_peered":"2023-10-16T14:25:52.771782+0000","last_unstale":"2023-10-16T14:25:53.728065+0000","last_undegraded":"2023-10-16T14:25:53.728065+0000","last_fullsized":"2023-10-16T14:25:53.728065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:36.518926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.750890+0000","last_change":"2023-10-16T14:25:47.686396+0000","last_active":"2023-10-16T14:25:52.750890+0000","last_peered":"2023-10-16T14:25:52.750890+0000","last_clean":"2023-10-16T14:25:52.750890+0000","last_became_active":"2023-10-16T14:25:47.685837+0000","last_became_peered":"2023-10-16T14:25:47.685837+0000","last_unstale":"2023-10-16T14:25:52.750890+0000","last_undegraded":"2023-10-16T14:25:52.750890+0000","last_fullsized":"2023-10-16T14:25:52.750890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:59:01.867434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.729122+0000","last_change":"2023-10-16T14:25:48.699469+0000","last_active":"2023-10-16T14:25:52.729122+0000","last_peered":"2023-10-16T14:25:52.729122+0000","last_clean":"2023-10-16T14:25:52.729122+0000","last_became_active":"2023-10-16T14:25:48.697897+0000","last_became_peered":"2023-10-16T14:25:48.697897+0000","last_unstale":"2023-10-16T14:25:52.729122+0000","last_undegraded":"2023-10-16T14:25:52.729122+0000","last_fullsized":"2023-10-16T14:25:52.729122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:06.393767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.089865+0000","last_change":"2023-10-16T14:25:52.769049+0000","last_active":"2023-10-16T14:25:54.089865+0000","last_peered":"2023-10-16T14:25:54.089865+0000","last_clean":"2023-10-16T14:25:54.089865+0000","last_became_active":"2023-10-16T14:25:52.768002+0000","last_became_peered":"2023-10-16T14:25:52.768002+0000","last_unstale":"2023-10-16T14:25:54.089865+0000","last_undegraded":"2023-10-16T14:25:54.089865+0000","last_fullsized":"2023-10-16T14:25:54.089865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:24.020506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.722319+0000","last_change":"2023-10-16T14:25:48.710638+0000","last_active":"2023-10-16T14:25:52.722319+0000","last_peered":"2023-10-16T14:25:52.722319+0000","last_clean":"2023-10-16T14:25:52.722319+0000","last_became_active":"2023-10-16T14:25:48.710317+0000","last_became_peered":"2023-10-16T14:25:48.710317+0000","last_unstale":"2023-10-16T14:25:52.722319+0000","last_undegraded":"2023-10-16T14:25:52.722319+0000","last_fullsized":"2023-10-16T14:25:52.722319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:55:50.448443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.754813+0000","last_change":"2023-10-16T14:25:48.697149+0000","last_active":"2023-10-16T14:25:52.754813+0000","last_peered":"2023-10-16T14:25:52.754813+0000","last_clean":"2023-10-16T14:25:52.754813+0000","last_became_active":"2023-10-16T14:25:48.696842+0000","last_became_peered":"2023-10-16T14:25:48.696842+0000","last_unstale":"2023-10-16T14:25:52.754813+0000","last_undegraded":"2023-10-16T14:25:52.754813+0000","last_fullsized":"2023-10-16T14:25:52.754813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:55:50.448443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734336+0000","last_change":"2023-10-16T14:25:48.703113+0000","last_active":"2023-10-16T14:25:52.734336+0000","last_peered":"2023-10-16T14:25:52.734336+0000","last_clean":"2023-10-16T14:25:52.734336+0000","last_became_active":"2023-10-16T14:25:48.702819+0000","last_became_peered":"2023-10-16T14:25:48.702819+0000","last_unstale":"2023-10-16T14:25:52.734336+0000","last_undegraded":"2023-10-16T14:25:52.734336+0000","last_fullsized":"2023-10-16T14:25:52.734336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:11:43.934469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.750660+0000","last_change":"2023-10-16T14:25:48.698637+0000","last_active":"2023-10-16T14:25:52.750660+0000","last_peered":"2023-10-16T14:25:52.750660+0000","last_clean":"2023-10-16T14:25:52.750660+0000","last_became_active":"2023-10-16T14:25:48.698315+0000","last_became_peered":"2023-10-16T14:25:48.698315+0000","last_unstale":"2023-10-16T14:25:52.750660+0000","last_undegraded":"2023-10-16T14:25:52.750660+0000","last_fullsized":"2023-10-16T14:25:52.750660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:40:17.879871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.766726+0000","last_change":"2023-10-16T14:25:48.718882+0000","last_active":"2023-10-16T14:25:52.766726+0000","last_peered":"2023-10-16T14:25:52.766726+0000","last_clean":"2023-10-16T14:25:52.766726+0000","last_became_active":"2023-10-16T14:25:48.718101+0000","last_became_peered":"2023-10-16T14:25:48.718101+0000","last_unstale":"2023-10-16T14:25:52.766726+0000","last_undegraded":"2023-10-16T14:25:52.766726+0000","last_fullsized":"2023-10-16T14:25:52.766726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:07:29.701267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.775872+0000","last_change":"2023-10-16T14:25:48.720844+0000","last_active":"2023-10-16T14:25:52.775872+0000","last_peered":"2023-10-16T14:25:52.775872+0000","last_clean":"2023-10-16T14:25:52.775872+0000","last_became_active":"2023-10-16T14:25:48.719311+0000","last_became_peered":"2023-10-16T14:25:48.719311+0000","last_unstale":"2023-10-16T14:25:52.775872+0000","last_undegraded":"2023-10-16T14:25:52.775872+0000","last_fullsized":"2023-10-16T14:25:52.775872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:19.960536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.726182+0000","last_change":"2023-10-16T14:25:48.712401+0000","last_active":"2023-10-16T14:25:52.726182+0000","last_peered":"2023-10-16T14:25:52.726182+0000","last_clean":"2023-10-16T14:25:52.726182+0000","last_became_active":"2023-10-16T14:25:48.711895+0000","last_became_peered":"2023-10-16T14:25:48.711895+0000","last_unstale":"2023-10-16T14:25:52.726182+0000","last_undegraded":"2023-10-16T14:25:52.726182+0000","last_fullsized":"2023-10-16T14:25:52.726182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:03.388572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.751689+0000","last_change":"2023-10-16T14:25:48.698610+0000","last_active":"2023-10-16T14:25:52.751689+0000","last_peered":"2023-10-16T14:25:52.751689+0000","last_clean":"2023-10-16T14:25:52.751689+0000","last_became_active":"2023-10-16T14:25:48.698036+0000","last_became_peered":"2023-10-16T14:25:48.698036+0000","last_unstale":"2023-10-16T14:25:52.751689+0000","last_undegraded":"2023-10-16T14:25:52.751689+0000","last_fullsized":"2023-10-16T14:25:52.751689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:21:35.715486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.733105+0000","last_change":"2023-10-16T14:25:48.698898+0000","last_active":"2023-10-16T14:25:52.733105+0000","last_peered":"2023-10-16T14:25:52.733105+0000","last_clean":"2023-10-16T14:25:52.733105+0000","last_became_active":"2023-10-16T14:25:48.698683+0000","last_became_peered":"2023-10-16T14:25:48.698683+0000","last_unstale":"2023-10-16T14:25:52.733105+0000","last_undegraded":"2023-10-16T14:25:52.733105+0000","last_fullsized":"2023-10-16T14:25:52.733105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:38:58.219009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.748894+0000","last_change":"2023-10-16T14:25:48.705464+0000","last_active":"2023-10-16T14:25:52.748894+0000","last_peered":"2023-10-16T14:25:52.748894+0000","last_clean":"2023-10-16T14:25:52.748894+0000","last_became_active":"2023-10-16T14:25:48.704985+0000","last_became_peered":"2023-10-16T14:25:48.704985+0000","last_unstale":"2023-10-16T14:25:52.748894+0000","last_undegraded":"2023-10-16T14:25:52.748894+0000","last_fullsized":"2023-10-16T14:25:52.748894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:56:45.547392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.729034+0000","last_change":"2023-10-16T14:25:48.712431+0000","last_active":"2023-10-16T14:25:52.729034+0000","last_peered":"2023-10-16T14:25:52.729034+0000","last_clean":"2023-10-16T14:25:52.729034+0000","last_became_active":"2023-10-16T14:25:48.711943+0000","last_became_peered":"2023-10-16T14:25:48.711943+0000","last_unstale":"2023-10-16T14:25:52.729034+0000","last_undegraded":"2023-10-16T14:25:52.729034+0000","last_fullsized":"2023-10-16T14:25:52.729034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:27:38.667994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.736054+0000","last_change":"2023-10-16T14:25:48.696594+0000","last_active":"2023-10-16T14:25:52.736054+0000","last_peered":"2023-10-16T14:25:52.736054+0000","last_clean":"2023-10-16T14:25:52.736054+0000","last_became_active":"2023-10-16T14:25:48.696094+0000","last_became_peered":"2023-10-16T14:25:48.696094+0000","last_unstale":"2023-10-16T14:25:52.736054+0000","last_undegraded":"2023-10-16T14:25:52.736054+0000","last_fullsized":"2023-10-16T14:25:52.736054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:19.960536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741992+0000","last_change":"2023-10-16T14:25:48.696032+0000","last_active":"2023-10-16T14:25:52.741992+0000","last_peered":"2023-10-16T14:25:52.741992+0000","last_clean":"2023-10-16T14:25:52.741992+0000","last_became_active":"2023-10-16T14:25:48.695395+0000","last_became_peered":"2023-10-16T14:25:48.695395+0000","last_unstale":"2023-10-16T14:25:52.741992+0000","last_undegraded":"2023-10-16T14:25:52.741992+0000","last_fullsized":"2023-10-16T14:25:52.741992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:32.458956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734829+0000","last_change":"2023-10-16T14:25:48.709380+0000","last_active":"2023-10-16T14:25:52.734829+0000","last_peered":"2023-10-16T14:25:52.734829+0000","last_clean":"2023-10-16T14:25:52.734829+0000","last_became_active":"2023-10-16T14:25:48.708997+0000","last_became_peered":"2023-10-16T14:25:48.708997+0000","last_unstale":"2023-10-16T14:25:52.734829+0000","last_undegraded":"2023-10-16T14:25:52.734829+0000","last_fullsized":"2023-10-16T14:25:52.734829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:02:54.594118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.761766+0000","last_change":"2023-10-16T14:25:48.705638+0000","last_active":"2023-10-16T14:25:52.761766+0000","last_peered":"2023-10-16T14:25:52.761766+0000","last_clean":"2023-10-16T14:25:52.761766+0000","last_became_active":"2023-10-16T14:25:48.705345+0000","last_became_peered":"2023-10-16T14:25:48.705345+0000","last_unstale":"2023-10-16T14:25:52.761766+0000","last_undegraded":"2023-10-16T14:25:52.761766+0000","last_fullsized":"2023-10-16T14:25:52.761766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:34.270405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735728+0000","last_change":"2023-10-16T14:25:48.713557+0000","last_active":"2023-10-16T14:25:52.735728+0000","last_peered":"2023-10-16T14:25:52.735728+0000","last_clean":"2023-10-16T14:25:52.735728+0000","last_became_active":"2023-10-16T14:25:48.712873+0000","last_became_peered":"2023-10-16T14:25:48.712873+0000","last_unstale":"2023-10-16T14:25:52.735728+0000","last_undegraded":"2023-10-16T14:25:52.735728+0000","last_fullsized":"2023-10-16T14:25:52.735728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:50:37.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.733005+0000","last_change":"2023-10-16T14:25:48.710840+0000","last_active":"2023-10-16T14:25:52.733005+0000","last_peered":"2023-10-16T14:25:52.733005+0000","last_clean":"2023-10-16T14:25:52.733005+0000","last_became_active":"2023-10-16T14:25:48.710547+0000","last_became_peered":"2023-10-16T14:25:48.710547+0000","last_unstale":"2023-10-16T14:25:52.733005+0000","last_undegraded":"2023-10-16T14:25:52.733005+0000","last_fullsized":"2023-10-16T14:25:52.733005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:49.130655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.748159+0000","last_change":"2023-10-16T14:25:48.705260+0000","last_active":"2023-10-16T14:25:52.748159+0000","last_peered":"2023-10-16T14:25:52.748159+0000","last_clean":"2023-10-16T14:25:52.748159+0000","last_became_active":"2023-10-16T14:25:48.704600+0000","last_became_peered":"2023-10-16T14:25:48.704600+0000","last_unstale":"2023-10-16T14:25:52.748159+0000","last_undegraded":"2023-10-16T14:25:52.748159+0000","last_fullsized":"2023-10-16T14:25:52.748159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:31:37.405710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.764712+0000","last_change":"2023-10-16T14:25:48.718876+0000","last_active":"2023-10-16T14:25:52.764712+0000","last_peered":"2023-10-16T14:25:52.764712+0000","last_clean":"2023-10-16T14:25:52.764712+0000","last_became_active":"2023-10-16T14:25:48.718576+0000","last_became_peered":"2023-10-16T14:25:48.718576+0000","last_unstale":"2023-10-16T14:25:52.764712+0000","last_undegraded":"2023-10-16T14:25:52.764712+0000","last_fullsized":"2023-10-16T14:25:52.764712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:08:42.569470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.765953+0000","last_change":"2023-10-16T14:25:48.724429+0000","last_active":"2023-10-16T14:25:52.765953+0000","last_peered":"2023-10-16T14:25:52.765953+0000","last_clean":"2023-10-16T14:25:52.765953+0000","last_became_active":"2023-10-16T14:25:48.724125+0000","last_became_peered":"2023-10-16T14:25:48.724125+0000","last_unstale":"2023-10-16T14:25:52.765953+0000","last_undegraded":"2023-10-16T14:25:52.765953+0000","last_fullsized":"2023-10-16T14:25:52.765953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:11:15.820218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741965+0000","last_change":"2023-10-16T14:25:48.696219+0000","last_active":"2023-10-16T14:25:52.741965+0000","last_peered":"2023-10-16T14:25:52.741965+0000","last_clean":"2023-10-16T14:25:52.741965+0000","last_became_active":"2023-10-16T14:25:48.695737+0000","last_became_peered":"2023-10-16T14:25:48.695737+0000","last_unstale":"2023-10-16T14:25:52.741965+0000","last_undegraded":"2023-10-16T14:25:52.741965+0000","last_fullsized":"2023-10-16T14:25:52.741965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:21:37.481107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742197+0000","last_change":"2023-10-16T14:25:48.710966+0000","last_active":"2023-10-16T14:25:52.742197+0000","last_peered":"2023-10-16T14:25:52.742197+0000","last_clean":"2023-10-16T14:25:52.742197+0000","last_became_active":"2023-10-16T14:25:48.709590+0000","last_became_peered":"2023-10-16T14:25:48.709590+0000","last_unstale":"2023-10-16T14:25:52.742197+0000","last_undegraded":"2023-10-16T14:25:52.742197+0000","last_fullsized":"2023-10-16T14:25:52.742197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:12:28.481919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742091+0000","last_change":"2023-10-16T14:25:48.717832+0000","last_active":"2023-10-16T14:25:52.742091+0000","last_peered":"2023-10-16T14:25:52.742091+0000","last_clean":"2023-10-16T14:25:52.742091+0000","last_became_active":"2023-10-16T14:25:48.716501+0000","last_became_peered":"2023-10-16T14:25:48.716501+0000","last_unstale":"2023-10-16T14:25:52.742091+0000","last_undegraded":"2023-10-16T14:25:52.742091+0000","last_fullsized":"2023-10-16T14:25:52.742091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:59.824367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.729329+0000","last_change":"2023-10-16T14:25:48.705714+0000","last_active":"2023-10-16T14:25:52.729329+0000","last_peered":"2023-10-16T14:25:52.729329+0000","last_clean":"2023-10-16T14:25:52.729329+0000","last_became_active":"2023-10-16T14:25:48.705423+0000","last_became_peered":"2023-10-16T14:25:48.705423+0000","last_unstale":"2023-10-16T14:25:52.729329+0000","last_undegraded":"2023-10-16T14:25:52.729329+0000","last_fullsized":"2023-10-16T14:25:52.729329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:34.270405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.748340+0000","last_change":"2023-10-16T14:25:48.716492+0000","last_active":"2023-10-16T14:25:52.748340+0000","last_peered":"2023-10-16T14:25:52.748340+0000","last_clean":"2023-10-16T14:25:52.748340+0000","last_became_active":"2023-10-16T14:25:48.716196+0000","last_became_peered":"2023-10-16T14:25:48.716196+0000","last_unstale":"2023-10-16T14:25:52.748340+0000","last_undegraded":"2023-10-16T14:25:52.748340+0000","last_fullsized":"2023-10-16T14:25:52.748340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:20:54.230056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741582+0000","last_change":"2023-10-16T14:25:48.707726+0000","last_active":"2023-10-16T14:25:52.741582+0000","last_peered":"2023-10-16T14:25:52.741582+0000","last_clean":"2023-10-16T14:25:52.741582+0000","last_became_active":"2023-10-16T14:25:48.707504+0000","last_became_peered":"2023-10-16T14:25:48.707504+0000","last_unstale":"2023-10-16T14:25:52.741582+0000","last_undegraded":"2023-10-16T14:25:52.741582+0000","last_fullsized":"2023-10-16T14:25:52.741582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:08.080421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.723283+0000","last_change":"2023-10-16T14:25:48.702028+0000","last_active":"2023-10-16T14:25:52.723283+0000","last_peered":"2023-10-16T14:25:52.723283+0000","last_clean":"2023-10-16T14:25:52.723283+0000","last_became_active":"2023-10-16T14:25:48.701713+0000","last_became_peered":"2023-10-16T14:25:48.701713+0000","last_unstale":"2023-10-16T14:25:52.723283+0000","last_undegraded":"2023-10-16T14:25:52.723283+0000","last_fullsized":"2023-10-16T14:25:52.723283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:05:42.440225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741959+0000","last_change":"2023-10-16T14:25:48.700619+0000","last_active":"2023-10-16T14:25:52.741959+0000","last_peered":"2023-10-16T14:25:52.741959+0000","last_clean":"2023-10-16T14:25:52.741959+0000","last_became_active":"2023-10-16T14:25:48.700374+0000","last_became_peered":"2023-10-16T14:25:48.700374+0000","last_unstale":"2023-10-16T14:25:52.741959+0000","last_undegraded":"2023-10-16T14:25:52.741959+0000","last_fullsized":"2023-10-16T14:25:52.741959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:38:58.219009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.725459+0000","last_change":"2023-10-16T14:25:48.699642+0000","last_active":"2023-10-16T14:25:52.725459+0000","last_peered":"2023-10-16T14:25:52.725459+0000","last_clean":"2023-10-16T14:25:52.725459+0000","last_became_active":"2023-10-16T14:25:48.698763+0000","last_became_peered":"2023-10-16T14:25:48.698763+0000","last_unstale":"2023-10-16T14:25:52.725459+0000","last_undegraded":"2023-10-16T14:25:52.725459+0000","last_fullsized":"2023-10-16T14:25:52.725459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:34.270405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.750728+0000","last_change":"2023-10-16T14:25:48.701810+0000","last_active":"2023-10-16T14:25:52.750728+0000","last_peered":"2023-10-16T14:25:52.750728+0000","last_clean":"2023-10-16T14:25:52.750728+0000","last_became_active":"2023-10-16T14:25:48.701531+0000","last_became_peered":"2023-10-16T14:25:48.701531+0000","last_unstale":"2023-10-16T14:25:52.750728+0000","last_undegraded":"2023-10-16T14:25:52.750728+0000","last_fullsized":"2023-10-16T14:25:52.750728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:02:15.116385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.753502+0000","last_change":"2023-10-16T14:25:48.705687+0000","last_active":"2023-10-16T14:25:52.753502+0000","last_peered":"2023-10-16T14:25:52.753502+0000","last_clean":"2023-10-16T14:25:52.753502+0000","last_became_active":"2023-10-16T14:25:48.705392+0000","last_became_peered":"2023-10-16T14:25:48.705392+0000","last_unstale":"2023-10-16T14:25:52.753502+0000","last_undegraded":"2023-10-16T14:25:52.753502+0000","last_fullsized":"2023-10-16T14:25:52.753502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:04.130129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742180+0000","last_change":"2023-10-16T14:25:48.705631+0000","last_active":"2023-10-16T14:25:52.742180+0000","last_peered":"2023-10-16T14:25:52.742180+0000","last_clean":"2023-10-16T14:25:52.742180+0000","last_became_active":"2023-10-16T14:25:48.705344+0000","last_became_peered":"2023-10-16T14:25:48.705344+0000","last_unstale":"2023-10-16T14:25:52.742180+0000","last_undegraded":"2023-10-16T14:25:52.742180+0000","last_fullsized":"2023-10-16T14:25:52.742180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:43.182462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476744,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":104592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]}]},{"osd":2,"up_from":16,"seq":68719476744,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":107710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4059999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.47}]}]},{"osd":1,"up_from":16,"seq":68719476745,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":694448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4850000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2929999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]}]},{"osd":0,"up_from":16,"seq":68719476746,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":104066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.508}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6539999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]}]},{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":104134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.528}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.464}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.72}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7909999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.762}]}]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":108382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0179999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.716}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3380000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T14:26:11.691 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T14:26:11.692 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-16T14:26:11.692 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-16T14:26:11.692 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-16T14:26:11.693 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-16T14:26:11.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.947+0000 7f56e2f97640 1 Processor -- start 2023-10-16T14:26:11.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.947+0000 7f56e2f97640 1 -- start start 2023-10-16T14:26:11.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.948+0000 7f56e2f97640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f56dc0c20e0 0x7f56dc0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:11.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.948+0000 7f56e2f97640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f56dc071630 0x7f56dc0cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:11.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.949+0000 7f56e2f97640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56dc0c2570 con 0x7f56dc0c9e00 2023-10-16T14:26:11.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.949+0000 7f56e2f97640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56dc0cde00 con 0x7f56dc0c20e0 2023-10-16T14:26:11.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.949+0000 7f56e2f97640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56dc071e40 con 0x7f56dc071630 2023-10-16T14:26:11.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.949+0000 7f56d3fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f56dc0c20e0 0x7f56dc0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:11.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.949+0000 7f56d3fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f56dc0c20e0 0x7f56dc0710f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41732/0 (socket says 172.21.15.59:41732) 2023-10-16T14:26:11.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.949+0000 7f56d3fff640 1 -- 172.21.15.59:0/2163705076 learned_addr learned my addr 172.21.15.59:0/2163705076 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:11.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.949+0000 7f56e1534640 1 --2- 172.21.15.59:0/2163705076 >> v2:172.21.15.151:3300/0 conn(0x7f56dc071630 0x7f56dc0cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:11.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.949+0000 7f56d3fff640 1 -- 172.21.15.59:0/2163705076 >> v2:172.21.15.151:3300/0 conn(0x7f56dc071630 msgr2=0x7f56dc0cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:11.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.949+0000 7f56d3fff640 1 --2- 172.21.15.59:0/2163705076 >> v2:172.21.15.151:3300/0 conn(0x7f56dc071630 0x7f56dc0cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:11.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.949+0000 7f56d3fff640 1 -- 172.21.15.59:0/2163705076 >> v1:172.21.15.151:6789/0 conn(0x7f56dc0c9e00 legacy=0x7f56dc0ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:11.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.949+0000 7f56d3fff640 1 -- 172.21.15.59:0/2163705076 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc072120 con 0x7f56dc0c20e0 2023-10-16T14:26:11.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.951+0000 7f56d3fff640 1 --2- 172.21.15.59:0/2163705076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56dc0c20e0 0x7f56dc0710f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f56dc0c8b70 tx=0x7f56cc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff5340996833fdc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:11.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.951+0000 7f56d37fe640 1 -- 172.21.15.59:0/2163705076 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc031870 con 0x7f56dc0c20e0 2023-10-16T14:26:11.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.951+0000 7f56d37fe640 1 -- 172.21.15.59:0/2163705076 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56cc0319d0 con 0x7f56dc0c20e0 2023-10-16T14:26:11.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.951+0000 7f56d37fe640 1 -- 172.21.15.59:0/2163705076 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc031d60 con 0x7f56dc0c20e0 2023-10-16T14:26:11.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.951+0000 7f56e2f97640 1 -- 172.21.15.59:0/2163705076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56dc0c20e0 msgr2=0x7f56dc0710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:11.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.951+0000 7f56e2f97640 1 --2- 172.21.15.59:0/2163705076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56dc0c20e0 0x7f56dc0710f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f56dc0c8b70 tx=0x7f56cc02b910 comp rx=0 tx=0).stop 2023-10-16T14:26:11.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.952+0000 7f56e2f97640 1 -- 172.21.15.59:0/2163705076 shutdown_connections 2023-10-16T14:26:11.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.952+0000 7f56e2f97640 1 --2- 172.21.15.59:0/2163705076 >> v2:172.21.15.151:3300/0 conn(0x7f56dc071630 0x7f56dc0cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:11.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.952+0000 7f56e2f97640 1 --2- 172.21.15.59:0/2163705076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56dc0c20e0 0x7f56dc0710f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:11.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.952+0000 7f56e2f97640 1 -- 172.21.15.59:0/2163705076 >> 172.21.15.59:0/2163705076 conn(0x7f56dc06c1c0 msgr2=0x7f56dc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:11.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.952+0000 7f56e2f97640 1 -- 172.21.15.59:0/2163705076 shutdown_connections 2023-10-16T14:26:11.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.952+0000 7f56e2f97640 1 -- 172.21.15.59:0/2163705076 wait complete. 2023-10-16T14:26:11.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.953+0000 7f56e2f97640 1 Processor -- start 2023-10-16T14:26:11.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.954+0000 7f56e2f97640 1 -- start start 2023-10-16T14:26:11.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.954+0000 7f56e2f97640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56dc071630 0x7f56dc14d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:11.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.954+0000 7f56e2f97640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56dc0c20e0 0x7f56dc14f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:11.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.954+0000 7f56e2f97640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56dc0c9e00 0x7f56dc14fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:11.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.954+0000 7f56e2f97640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc15a720 con 0x7f56dc071630 2023-10-16T14:26:11.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.954+0000 7f56e2f97640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc159b30 con 0x7f56dc0c20e0 2023-10-16T14:26:11.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.954+0000 7f56e2f97640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc14dd20 con 0x7f56dc0c9e00 2023-10-16T14:26:11.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.955+0000 7f56e0d33640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56dc071630 0x7f56dc14d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:11.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.955+0000 7f56e0d33640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56dc071630 0x7f56dc14d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41744/0 (socket says 172.21.15.59:41744) 2023-10-16T14:26:11.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.955+0000 7f56e0d33640 1 -- 172.21.15.59:0/1138071062 learned_addr learned my addr 172.21.15.59:0/1138071062 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:11.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.955+0000 7f56d3fff640 1 --2- 172.21.15.59:0/1138071062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56dc0c20e0 0x7f56dc14f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:11.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.955+0000 7f56e1534640 1 --2- 172.21.15.59:0/1138071062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56dc0c9e00 0x7f56dc14fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:11.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.955+0000 7f56e0d33640 1 -- 172.21.15.59:0/1138071062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56dc0c9e00 msgr2=0x7f56dc14fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:11.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.955+0000 7f56e0d33640 1 --2- 172.21.15.59:0/1138071062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56dc0c9e00 0x7f56dc14fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:11.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.955+0000 7f56e0d33640 1 -- 172.21.15.59:0/1138071062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56dc0c20e0 msgr2=0x7f56dc14f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:11.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.955+0000 7f56e0d33640 1 --2- 172.21.15.59:0/1138071062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56dc0c20e0 0x7f56dc14f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:11.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.955+0000 7f56e0d33640 1 -- 172.21.15.59:0/1138071062 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc0094d0 con 0x7f56dc071630 2023-10-16T14:26:11.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.956+0000 7f56e0d33640 1 --2- 172.21.15.59:0/1138071062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56dc071630 0x7f56dc14d7e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f56d800b410 tx=0x7f56d800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:11.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.956+0000 7f56d17fa640 1 -- 172.21.15.59:0/1138071062 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8011830 con 0x7f56dc071630 2023-10-16T14:26:11.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.956+0000 7f56d17fa640 1 -- 172.21.15.59:0/1138071062 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d8011990 con 0x7f56dc071630 2023-10-16T14:26:11.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.956+0000 7f56e2f97640 1 -- 172.21.15.59:0/1138071062 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56dc159d80 con 0x7f56dc071630 2023-10-16T14:26:11.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.956+0000 7f56d17fa640 1 -- 172.21.15.59:0/1138071062 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8011d40 con 0x7f56dc071630 2023-10-16T14:26:11.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.956+0000 7f56e2f97640 1 -- 172.21.15.59:0/1138071062 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56dc15a340 con 0x7f56dc071630 2023-10-16T14:26:11.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.957+0000 7f56e2f97640 1 -- 172.21.15.59:0/1138071062 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56dc073ef0 con 0x7f56dc071630 2023-10-16T14:26:11.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.958+0000 7f56d17fa640 1 -- 172.21.15.59:0/1138071062 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f56d801a400 con 0x7f56dc071630 2023-10-16T14:26:11.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.959+0000 7f56d17fa640 1 --2- 172.21.15.59:0/1138071062 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f56c806ae70 0x7f56c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:11.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.959+0000 7f56d17fa640 1 -- 172.21.15.59:0/1138071062 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f56d8089b10 con 0x7f56dc071630 2023-10-16T14:26:11.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.960+0000 7f56d3fff640 1 --2- 172.21.15.59:0/1138071062 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f56c806ae70 0x7f56c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:11.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.961+0000 7f56d3fff640 1 --2- 172.21.15.59:0/1138071062 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f56c806ae70 0x7f56c806d330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f56cc036000 tx=0x7f56cc03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:11.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:11.966+0000 7f56d17fa640 1 -- 172.21.15.59:0/1138071062 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f56d8054830 con 0x7f56dc071630 2023-10-16T14:26:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.231+0000 7f56e2f97640 1 -- 172.21.15.59:0/1138071062 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f56dc072c30 con 0x7f56dc071630 2023-10-16T14:26:12.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.235+0000 7f56d17fa640 1 -- 172.21.15.59:0/1138071062 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171033 (secure 0 0 0) 0x7f56d8015020 con 0x7f56dc071630 2023-10-16T14:26:12.240 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.238+0000 7f56e2f97640 1 -- 172.21.15.59:0/1138071062 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f56c806ae70 msgr2=0x7f56c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.238+0000 7f56e2f97640 1 --2- 172.21.15.59:0/1138071062 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f56c806ae70 0x7f56c806d330 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f56cc036000 tx=0x7f56cc03c040 comp rx=0 tx=0).stop 2023-10-16T14:26:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.238+0000 7f56e2f97640 1 -- 172.21.15.59:0/1138071062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56dc071630 msgr2=0x7f56dc14d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:12.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.238+0000 7f56e2f97640 1 --2- 172.21.15.59:0/1138071062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56dc071630 0x7f56dc14d7e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f56d800b410 tx=0x7f56d800b8d0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.238+0000 7f56e2f97640 1 -- 172.21.15.59:0/1138071062 shutdown_connections 2023-10-16T14:26:12.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.238+0000 7f56e2f97640 1 --2- 172.21.15.59:0/1138071062 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f56c806ae70 0x7f56c806d330 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.238+0000 7f56e2f97640 1 --2- 172.21.15.59:0/1138071062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56dc0c9e00 0x7f56dc14fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.238+0000 7f56e2f97640 1 --2- 172.21.15.59:0/1138071062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56dc0c20e0 0x7f56dc14f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.238+0000 7f56e2f97640 1 --2- 172.21.15.59:0/1138071062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56dc071630 0x7f56dc14d7e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.238+0000 7f56e2f97640 1 -- 172.21.15.59:0/1138071062 >> 172.21.15.59:0/1138071062 conn(0x7f56dc06c1c0 msgr2=0x7f56dc0af0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:12.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.238+0000 7f56e2f97640 1 -- 172.21.15.59:0/1138071062 shutdown_connections 2023-10-16T14:26:12.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.238+0000 7f56e2f97640 1 -- 172.21.15.59:0/1138071062 wait complete. 2023-10-16T14:26:12.260 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":518957627},{"type":"v1","addr":"172.21.15.151:6801","nonce":518957627}]},"active_addr":"172.21.15.151:6801/518957627","active_change":"2023-10-16T14:25:27.841795+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":3514662848}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":1038126937}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":913210205}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":3407711161}]}]} 2023-10-16T14:26:12.264 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-16T14:26:12.264 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-16T14:26:12.264 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:26:12.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.486+0000 7fdabd505640 1 Processor -- start 2023-10-16T14:26:12.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.486+0000 7fdabd505640 1 -- start start 2023-10-16T14:26:12.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.488+0000 7fdabd505640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab815cd10 0x7fdab80d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:12.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.488+0000 7fdabd505640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdab81611b0 0x7fdab80cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:12.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.488+0000 7fdabd505640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab80ce370 con 0x7fdab80cd9b0 2023-10-16T14:26:12.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.488+0000 7fdabd505640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab81617d0 con 0x7fdab81611b0 2023-10-16T14:26:12.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.488+0000 7fdabd505640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab80d0c30 con 0x7fdab815cd10 2023-10-16T14:26:12.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.488+0000 7fdab6ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab815cd10 0x7fdab80d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:12.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.488+0000 7fdaaffff640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fdab80cd9b0 0x7fdab8160aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.59:54078/0 (socket says 172.21.15.59:54078) 2023-10-16T14:26:12.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.488+0000 7fdaaffff640 1 -- 172.21.15.59:0/3352665016 learned_addr learned my addr 172.21.15.59:0/3352665016 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:12.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.489+0000 7fdab77fe640 1 --2- 172.21.15.59:0/3352665016 >> v2:172.21.15.151:3300/0 conn(0x7fdab81611b0 0x7fdab80cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:12.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.489+0000 7fdab67fc640 1 -- 172.21.15.59:0/3352665016 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674647179 0 0) 0x7fdab80ce370 con 0x7fdab80cd9b0 2023-10-16T14:26:12.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.489+0000 7fdab67fc640 1 -- 172.21.15.59:0/3352665016 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaa4003520 con 0x7fdab80cd9b0 2023-10-16T14:26:12.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.489+0000 7fdab6ffd640 1 -- 172.21.15.59:0/3352665016 >> v2:172.21.15.151:3300/0 conn(0x7fdab81611b0 msgr2=0x7fdab80cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:12.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.489+0000 7fdab6ffd640 1 --2- 172.21.15.59:0/3352665016 >> v2:172.21.15.151:3300/0 conn(0x7fdab81611b0 0x7fdab80cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.489+0000 7fdab6ffd640 1 -- 172.21.15.59:0/3352665016 >> v1:172.21.15.151:6789/0 conn(0x7fdab80cd9b0 legacy=0x7fdab8160aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:12.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.489+0000 7fdab6ffd640 1 -- 172.21.15.59:0/3352665016 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab80d0f10 con 0x7fdab815cd10 2023-10-16T14:26:12.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.491+0000 7fdab6ffd640 1 --2- 172.21.15.59:0/3352665016 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab815cd10 0x7fdab80d19f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80097a0 tx=0x7fdaa802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd83ad6229cc558f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:12.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.491+0000 7fdab67fc640 1 -- 172.21.15.59:0/3352665016 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa802e070 con 0x7fdab815cd10 2023-10-16T14:26:12.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.492+0000 7fdab67fc640 1 -- 172.21.15.59:0/3352665016 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa80315a0 con 0x7fdab815cd10 2023-10-16T14:26:12.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.492+0000 7fdab67fc640 1 -- 172.21.15.59:0/3352665016 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8031930 con 0x7fdab815cd10 2023-10-16T14:26:12.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.492+0000 7fdabd505640 1 -- 172.21.15.59:0/3352665016 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab815cd10 msgr2=0x7fdab80d19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:12.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.492+0000 7fdabd505640 1 --2- 172.21.15.59:0/3352665016 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab815cd10 0x7fdab80d19f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80097a0 tx=0x7fdaa802b840 comp rx=0 tx=0).stop 2023-10-16T14:26:12.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.492+0000 7fdabd505640 1 -- 172.21.15.59:0/3352665016 shutdown_connections 2023-10-16T14:26:12.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.492+0000 7fdabd505640 1 --2- 172.21.15.59:0/3352665016 >> v2:172.21.15.151:3300/0 conn(0x7fdab81611b0 0x7fdab80cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.492+0000 7fdabd505640 1 --2- 172.21.15.59:0/3352665016 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab815cd10 0x7fdab80d19f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.492+0000 7fdabd505640 1 -- 172.21.15.59:0/3352665016 >> 172.21.15.59:0/3352665016 conn(0x7fdab80b44a0 msgr2=0x7fdab80b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:12.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.492+0000 7fdabd505640 1 -- 172.21.15.59:0/3352665016 shutdown_connections 2023-10-16T14:26:12.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.492+0000 7fdabd505640 1 -- 172.21.15.59:0/3352665016 wait complete. 2023-10-16T14:26:12.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.494+0000 7fdabd505640 1 Processor -- start 2023-10-16T14:26:12.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.494+0000 7fdabd505640 1 -- start start 2023-10-16T14:26:12.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.495+0000 7fdabd505640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab80cd9b0 0x7fdab8150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:12.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.495+0000 7fdabd505640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab815cd10 0x7fdab81f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:12.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.495+0000 7fdabd505640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdab81611b0 0x7fdab80b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:12.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.495+0000 7fdabd505640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab815f720 con 0x7fdab815cd10 2023-10-16T14:26:12.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.495+0000 7fdabd505640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab814f610 con 0x7fdab81611b0 2023-10-16T14:26:12.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.495+0000 7fdabd505640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab814f860 con 0x7fdab80cd9b0 2023-10-16T14:26:12.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.495+0000 7fdaaffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab815cd10 0x7fdab81f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:12.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.495+0000 7fdaaffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab815cd10 0x7fdab81f2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41750/0 (socket says 172.21.15.59:41750) 2023-10-16T14:26:12.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.495+0000 7fdaaffff640 1 -- 172.21.15.59:0/2722547009 learned_addr learned my addr 172.21.15.59:0/2722547009 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:12.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.496+0000 7fdab77fe640 1 --2- 172.21.15.59:0/2722547009 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdab81611b0 0x7fdab80b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:12.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.496+0000 7fdab6ffd640 1 --2- 172.21.15.59:0/2722547009 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab80cd9b0 0x7fdab8150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:12.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.496+0000 7fdaaffff640 1 -- 172.21.15.59:0/2722547009 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab80cd9b0 msgr2=0x7fdab8150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:12.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.496+0000 7fdaaffff640 1 --2- 172.21.15.59:0/2722547009 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab80cd9b0 0x7fdab8150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.496+0000 7fdaaffff640 1 -- 172.21.15.59:0/2722547009 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdab81611b0 msgr2=0x7fdab80b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:12.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.496+0000 7fdaaffff640 1 --2- 172.21.15.59:0/2722547009 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdab81611b0 0x7fdab80b6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.496+0000 7fdaaffff640 1 -- 172.21.15.59:0/2722547009 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa8009400 con 0x7fdab815cd10 2023-10-16T14:26:12.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.496+0000 7fdaaffff640 1 --2- 172.21.15.59:0/2722547009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab815cd10 0x7fdab81f2f00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000c500 tx=0x7fdaa000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:12.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.496+0000 7fdaaf7fe640 1 -- 172.21.15.59:0/2722547009 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0005ce0 con 0x7fdab815cd10 2023-10-16T14:26:12.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.497+0000 7fdaaf7fe640 1 -- 172.21.15.59:0/2722547009 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa0005e40 con 0x7fdab815cd10 2023-10-16T14:26:12.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.497+0000 7fdaaf7fe640 1 -- 172.21.15.59:0/2722547009 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0007330 con 0x7fdab815cd10 2023-10-16T14:26:12.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.497+0000 7fdabd505640 1 -- 172.21.15.59:0/2722547009 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab814fb40 con 0x7fdab815cd10 2023-10-16T14:26:12.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.497+0000 7fdabd505640 1 -- 172.21.15.59:0/2722547009 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab8150100 con 0x7fdab815cd10 2023-10-16T14:26:12.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.498+0000 7fdabd505640 1 -- 172.21.15.59:0/2722547009 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab81502f0 con 0x7fdab815cd10 2023-10-16T14:26:12.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.499+0000 7fdaaf7fe640 1 -- 172.21.15.59:0/2722547009 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdaa0007490 con 0x7fdab815cd10 2023-10-16T14:26:12.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.500+0000 7fdaaf7fe640 1 --2- 172.21.15.59:0/2722547009 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fda9806aea0 0x7fda9806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:12.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.500+0000 7fdaaf7fe640 1 -- 172.21.15.59:0/2722547009 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdaa0088ee0 con 0x7fdab815cd10 2023-10-16T14:26:12.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.500+0000 7fdab6ffd640 1 --2- 172.21.15.59:0/2722547009 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fda9806aea0 0x7fda9806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:12.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.501+0000 7fdab6ffd640 1 --2- 172.21.15.59:0/2722547009 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fda9806aea0 0x7fda9806d360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8036000 tx=0x7fdaa803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:12.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.504+0000 7fdaaf7fe640 1 -- 172.21.15.59:0/2722547009 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdaa0053df0 con 0x7fdab815cd10 2023-10-16T14:26:12.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.702+0000 7fdabd505640 1 -- 172.21.15.59:0/2722547009 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdab8073ef0 con 0x7fdab815cd10 2023-10-16T14:26:12.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.705+0000 7fdaaf7fe640 1 -- 172.21.15.59:0/2722547009 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18350 (secure 0 0 0) 0x7fdaa0017020 con 0x7fdab815cd10 2023-10-16T14:26:12.709 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:12.709 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:25:53.209862+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:26:12.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.708+0000 7fdabd505640 1 -- 172.21.15.59:0/2722547009 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fda9806aea0 msgr2=0x7fda9806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:12.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.708+0000 7fdabd505640 1 --2- 172.21.15.59:0/2722547009 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fda9806aea0 0x7fda9806d360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdaa8036000 tx=0x7fdaa803d040 comp rx=0 tx=0).stop 2023-10-16T14:26:12.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.708+0000 7fdabd505640 1 -- 172.21.15.59:0/2722547009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab815cd10 msgr2=0x7fdab81f2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:12.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.708+0000 7fdabd505640 1 --2- 172.21.15.59:0/2722547009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab815cd10 0x7fdab81f2f00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000c500 tx=0x7fdaa000c9c0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.708+0000 7fdabd505640 1 -- 172.21.15.59:0/2722547009 shutdown_connections 2023-10-16T14:26:12.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.708+0000 7fdabd505640 1 --2- 172.21.15.59:0/2722547009 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fda9806aea0 0x7fda9806d360 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.708+0000 7fdabd505640 1 --2- 172.21.15.59:0/2722547009 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdab81611b0 0x7fdab80b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.708+0000 7fdabd505640 1 --2- 172.21.15.59:0/2722547009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab815cd10 0x7fdab81f2f00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.708+0000 7fdabd505640 1 --2- 172.21.15.59:0/2722547009 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab80cd9b0 0x7fdab8150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.708+0000 7fdabd505640 1 -- 172.21.15.59:0/2722547009 >> 172.21.15.59:0/2722547009 conn(0x7fdab80b44a0 msgr2=0x7fdab80cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:12.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.708+0000 7fdabd505640 1 -- 172.21.15.59:0/2722547009 shutdown_connections 2023-10-16T14:26:12.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.708+0000 7fdabd505640 1 -- 172.21.15.59:0/2722547009 wait complete. 2023-10-16T14:26:12.732 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-16T14:26:12.732 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:26:12.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.949+0000 7fdedadc9640 1 Processor -- start 2023-10-16T14:26:12.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.950+0000 7fdedadc9640 1 -- start start 2023-10-16T14:26:12.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.951+0000 7fdedadc9640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fded40cb250 0x7fded40c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:12.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.951+0000 7fdedadc9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fded40ca660 0x7fded40c9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:12.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.951+0000 7fdedadc9640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fded415acb0 con 0x7fded415a8d0 2023-10-16T14:26:12.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.951+0000 7fdedadc9640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded40c1c60 con 0x7fded40cb250 2023-10-16T14:26:12.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.951+0000 7fdedadc9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fded415e350 con 0x7fded40ca660 2023-10-16T14:26:12.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.951+0000 7fded95c6640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fded40cb250 0x7fded40c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:12.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.951+0000 7fded9dc7640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fded415a8d0 0x7fded40cab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45642/0 (socket says 172.21.15.59:45642) 2023-10-16T14:26:12.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.951+0000 7fded9dc7640 1 -- 172.21.15.59:0/869946048 learned_addr learned my addr 172.21.15.59:0/869946048 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:12.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.952+0000 7fdeda5c8640 1 --2- 172.21.15.59:0/869946048 >> v2:172.21.15.151:3300/0 conn(0x7fded40ca660 0x7fded40c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:12.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.952+0000 7fded95c6640 1 -- 172.21.15.59:0/869946048 >> v2:172.21.15.151:3300/0 conn(0x7fded40ca660 msgr2=0x7fded40c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:12.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.952+0000 7fded95c6640 1 --2- 172.21.15.59:0/869946048 >> v2:172.21.15.151:3300/0 conn(0x7fded40ca660 0x7fded40c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.952+0000 7fded95c6640 1 -- 172.21.15.59:0/869946048 >> v1:172.21.15.59:6789/0 conn(0x7fded415a8d0 legacy=0x7fded40cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:12.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.952+0000 7fded8dc5640 1 -- 172.21.15.59:0/869946048 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021015365 0 0) 0x7fdec4001610 con 0x7fded415a8d0 2023-10-16T14:26:12.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.952+0000 7fded95c6640 1 -- 172.21.15.59:0/869946048 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded415e630 con 0x7fded40cb250 2023-10-16T14:26:12.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.952+0000 7fdeda5c8640 1 --2- 172.21.15.59:0/869946048 >> v2:172.21.15.151:3300/0 conn(0x7fded40ca660 0x7fded40c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:12.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.953+0000 7fded95c6640 1 --2- 172.21.15.59:0/869946048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded40cb250 0x7fded40c8e10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fded40addb0 tx=0x7fdec802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896ec095e692c5e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:12.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.953+0000 7fded8dc5640 1 -- 172.21.15.59:0/869946048 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec8031830 con 0x7fded40cb250 2023-10-16T14:26:12.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.953+0000 7fded8dc5640 1 -- 172.21.15.59:0/869946048 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec8031990 con 0x7fded40cb250 2023-10-16T14:26:12.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.953+0000 7fded8dc5640 1 -- 172.21.15.59:0/869946048 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec8031d20 con 0x7fded40cb250 2023-10-16T14:26:12.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.954+0000 7fdedadc9640 1 -- 172.21.15.59:0/869946048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded40cb250 msgr2=0x7fded40c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:12.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.954+0000 7fdedadc9640 1 --2- 172.21.15.59:0/869946048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded40cb250 0x7fded40c8e10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fded40addb0 tx=0x7fdec802b8d0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.954+0000 7fdedadc9640 1 -- 172.21.15.59:0/869946048 shutdown_connections 2023-10-16T14:26:12.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.954+0000 7fdedadc9640 1 --2- 172.21.15.59:0/869946048 >> v2:172.21.15.151:3300/0 conn(0x7fded40ca660 0x7fded40c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.954+0000 7fdedadc9640 1 --2- 172.21.15.59:0/869946048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded40cb250 0x7fded40c8e10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.954+0000 7fdedadc9640 1 -- 172.21.15.59:0/869946048 >> 172.21.15.59:0/869946048 conn(0x7fded406a470 msgr2=0x7fded40afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:12.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.954+0000 7fdedadc9640 1 -- 172.21.15.59:0/869946048 shutdown_connections 2023-10-16T14:26:12.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.954+0000 7fdedadc9640 1 -- 172.21.15.59:0/869946048 wait complete. 2023-10-16T14:26:12.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.956+0000 7fdedadc9640 1 Processor -- start 2023-10-16T14:26:12.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.956+0000 7fdedadc9640 1 -- start start 2023-10-16T14:26:12.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.957+0000 7fdedadc9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fded40ca660 0x7fded41f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:12.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.957+0000 7fdedadc9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded40cb250 0x7fded40b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:12.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.957+0000 7fdedadc9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded415a8d0 0x7fded40b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:12.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.957+0000 7fdedadc9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded40cc3c0 con 0x7fded40cb250 2023-10-16T14:26:12.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.957+0000 7fdedadc9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded40b3ef0 con 0x7fded415a8d0 2023-10-16T14:26:12.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.957+0000 7fdedadc9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded40b3930 con 0x7fded40ca660 2023-10-16T14:26:12.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.957+0000 7fded95c6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded40cb250 0x7fded40b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:12.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.957+0000 7fded95c6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded40cb250 0x7fded40b2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41766/0 (socket says 172.21.15.59:41766) 2023-10-16T14:26:12.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.957+0000 7fded95c6640 1 -- 172.21.15.59:0/768163299 learned_addr learned my addr 172.21.15.59:0/768163299 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:12.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.957+0000 7fded9dc7640 1 --2- 172.21.15.59:0/768163299 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fded40ca660 0x7fded41f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:12.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.957+0000 7fdeda5c8640 1 --2- 172.21.15.59:0/768163299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded415a8d0 0x7fded40b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:12.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.957+0000 7fded95c6640 1 -- 172.21.15.59:0/768163299 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fded40ca660 msgr2=0x7fded41f1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:12.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.957+0000 7fded95c6640 1 --2- 172.21.15.59:0/768163299 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fded40ca660 0x7fded41f1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.957+0000 7fded95c6640 1 -- 172.21.15.59:0/768163299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded415a8d0 msgr2=0x7fded40b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:12.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.957+0000 7fded95c6640 1 --2- 172.21.15.59:0/768163299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded415a8d0 0x7fded40b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:12.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.958+0000 7fded95c6640 1 -- 172.21.15.59:0/768163299 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec8009400 con 0x7fded40cb250 2023-10-16T14:26:12.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.958+0000 7fded95c6640 1 --2- 172.21.15.59:0/768163299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded40cb250 0x7fded40b2d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdec802bee0 tx=0x7fdec80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:12.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.958+0000 7fded27fc640 1 -- 172.21.15.59:0/768163299 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec803ba70 con 0x7fded40cb250 2023-10-16T14:26:12.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.958+0000 7fded27fc640 1 -- 172.21.15.59:0/768163299 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec803bbf0 con 0x7fded40cb250 2023-10-16T14:26:12.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.958+0000 7fded27fc640 1 -- 172.21.15.59:0/768163299 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec80433f0 con 0x7fded40cb250 2023-10-16T14:26:12.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.958+0000 7fdedadc9640 1 -- 172.21.15.59:0/768163299 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fded40b3c10 con 0x7fded40cb250 2023-10-16T14:26:12.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.958+0000 7fdedadc9640 1 -- 172.21.15.59:0/768163299 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fded41f2020 con 0x7fded40cb250 2023-10-16T14:26:12.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.960+0000 7fdedadc9640 1 -- 172.21.15.59:0/768163299 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fded404e9b0 con 0x7fded40cb250 2023-10-16T14:26:12.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.960+0000 7fded27fc640 1 -- 172.21.15.59:0/768163299 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdec8043550 con 0x7fded40cb250 2023-10-16T14:26:12.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.961+0000 7fded27fc640 1 --2- 172.21.15.59:0/768163299 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fdec006ae70 0x7fdec006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:12.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.961+0000 7fded27fc640 1 -- 172.21.15.59:0/768163299 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdec80ab790 con 0x7fded40cb250 2023-10-16T14:26:12.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.962+0000 7fded9dc7640 1 --2- 172.21.15.59:0/768163299 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fdec006ae70 0x7fdec006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:12.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.963+0000 7fded9dc7640 1 --2- 172.21.15.59:0/768163299 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fdec006ae70 0x7fdec006d330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdec4001870 tx=0x7fdec4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:12.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:12.967+0000 7fded27fc640 1 -- 172.21.15.59:0/768163299 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdec8076670 con 0x7fded40cb250 2023-10-16T14:26:13.160 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.156+0000 7fdedadc9640 1 -- 172.21.15.59:0/768163299 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fded40b0d70 con 0x7fded40cb250 2023-10-16T14:26:13.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.159+0000 7fded27fc640 1 -- 172.21.15.59:0/768163299 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18350 (secure 0 0 0) 0x7fdec8079c90 con 0x7fded40cb250 2023-10-16T14:26:13.163 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:13.163 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:25:53.209862+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:26:13.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.161+0000 7fdedadc9640 1 -- 172.21.15.59:0/768163299 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fdec006ae70 msgr2=0x7fdec006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.161+0000 7fdedadc9640 1 --2- 172.21.15.59:0/768163299 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fdec006ae70 0x7fdec006d330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdec4001870 tx=0x7fdec4009040 comp rx=0 tx=0).stop 2023-10-16T14:26:13.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.161+0000 7fdedadc9640 1 -- 172.21.15.59:0/768163299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded40cb250 msgr2=0x7fded40b2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.161+0000 7fdedadc9640 1 --2- 172.21.15.59:0/768163299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded40cb250 0x7fded40b2d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdec802bee0 tx=0x7fdec80046c0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.161+0000 7fdedadc9640 1 -- 172.21.15.59:0/768163299 shutdown_connections 2023-10-16T14:26:13.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.161+0000 7fdedadc9640 1 --2- 172.21.15.59:0/768163299 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fdec006ae70 0x7fdec006d330 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.161+0000 7fdedadc9640 1 --2- 172.21.15.59:0/768163299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded415a8d0 0x7fded40b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.161+0000 7fdedadc9640 1 --2- 172.21.15.59:0/768163299 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fded40cb250 0x7fded40b2d90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.161+0000 7fdedadc9640 1 --2- 172.21.15.59:0/768163299 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fded40ca660 0x7fded41f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.161+0000 7fdedadc9640 1 -- 172.21.15.59:0/768163299 >> 172.21.15.59:0/768163299 conn(0x7fded406a470 msgr2=0x7fded40c8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:13.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.162+0000 7fdedadc9640 1 -- 172.21.15.59:0/768163299 shutdown_connections 2023-10-16T14:26:13.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.162+0000 7fdedadc9640 1 -- 172.21.15.59:0/768163299 wait complete. 2023-10-16T14:26:13.184 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-16T14:26:13.184 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-16T14:26:13.185 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-16T14:26:13.185 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-16T14:26:13.186 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-16T14:26:13.187 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-16T14:26:13.187 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-16T14:26:13.188 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-16T14:26:13.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.487+0000 7f792d0d7640 1 Processor -- start 2023-10-16T14:26:13.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.487+0000 7f792d0d7640 1 -- start start 2023-10-16T14:26:13.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.490+0000 7f792d0d7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7920006150 0x7f792003eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.490+0000 7f792d0d7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7920058870 0x7f7920056ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.490+0000 7f792d0d7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7920058d00 con 0x7f792003c050 2023-10-16T14:26:13.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.491+0000 7f792d0d7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7920057530 con 0x7f7920006150 2023-10-16T14:26:13.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.491+0000 7f792d0d7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79200577d0 con 0x7f7920058870 2023-10-16T14:26:13.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.491+0000 7f792659c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7920058870 0x7f7920056ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.491+0000 7f7926d9d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7920006150 0x7f792003eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.492+0000 7f7926d9d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7920006150 0x7f792003eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.59:58732/0 (socket says 172.21.15.59:58732) 2023-10-16T14:26:13.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.492+0000 7f792659c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7920058870 0x7f7920056ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.59:39208/0 (socket says 172.21.15.59:39208) 2023-10-16T14:26:13.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.492+0000 7f792759e640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f792003c050 0x7f792003c4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.59:54092/0 (socket says 172.21.15.59:54092) 2023-10-16T14:26:13.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.492+0000 7f792759e640 1 -- 172.21.15.59:0/3877037261 learned_addr learned my addr 172.21.15.59:0/3877037261 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:13.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.493+0000 7f28cbfff640 1 Processor -- start 2023-10-16T14:26:13.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.493+0000 7f7925d9b640 1 -- 172.21.15.59:0/3877037261 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429466431 0 0) 0x7f791c001110 con 0x7f792003c050 2023-10-16T14:26:13.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.493+0000 7f7925d9b640 1 -- 172.21.15.59:0/3877037261 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7910003520 con 0x7f792003c050 2023-10-16T14:26:13.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.493+0000 7f28cbfff640 1 -- start start 2023-10-16T14:26:13.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.493+0000 7f7926d9d640 1 -- 172.21.15.59:0/3877037261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7920058870 msgr2=0x7f7920056ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:13.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.493+0000 7f7926d9d640 1 --2- 172.21.15.59:0/3877037261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7920058870 0x7f7920056ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.494+0000 7f7926d9d640 1 -- 172.21.15.59:0/3877037261 >> v1:172.21.15.151:6789/0 conn(0x7f792003c050 legacy=0x7f792003c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.494+0000 7f7926d9d640 1 -- 172.21.15.59:0/3877037261 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7920057ab0 con 0x7f7920006150 2023-10-16T14:26:13.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.495+0000 7f7926d9d640 1 --2- 172.21.15.59:0/3877037261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7920006150 0x7f792003eae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f792804f940 tx=0x7f79280a57e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8688984149679b54 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.495+0000 7f28cbfff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f28cc15c9d0 0x7f28cc0cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.495+0000 7f28cbfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28cc0d16a0 0x7f28cc0cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.495+0000 7f28cbfff640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28cc0b2f90 con 0x7f28cc0ce4d0 2023-10-16T14:26:13.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.495+0000 7f28cbfff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28cc0d0320 con 0x7f28cc15c9d0 2023-10-16T14:26:13.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.495+0000 7f28cbfff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc0d0600 con 0x7f28cc0d16a0 2023-10-16T14:26:13.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.496+0000 7f7925d9b640 1 -- 172.21.15.59:0/3877037261 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79280ad630 con 0x7f7920006150 2023-10-16T14:26:13.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.496+0000 7f7925d9b640 1 -- 172.21.15.59:0/3877037261 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79280ad790 con 0x7f7920006150 2023-10-16T14:26:13.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.496+0000 7f7925d9b640 1 -- 172.21.15.59:0/3877037261 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79280adbc0 con 0x7f7920006150 2023-10-16T14:26:13.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.496+0000 7f28caffd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f28cc15c9d0 0x7f28cc0cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.496+0000 7f28caffd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f28cc15c9d0 0x7f28cc0cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.59:58748/0 (socket says 172.21.15.59:58748) 2023-10-16T14:26:13.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.496+0000 7f28caffd640 1 -- 172.21.15.59:0/589065054 learned_addr learned my addr 172.21.15.59:0/589065054 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:13.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.497+0000 7f28ca7fc640 1 --2- 172.21.15.59:0/589065054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28cc0d16a0 0x7f28cc0cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.497+0000 7f792d0d7640 1 -- 172.21.15.59:0/3877037261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7920006150 msgr2=0x7f792003eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.497+0000 7f792d0d7640 1 --2- 172.21.15.59:0/3877037261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7920006150 0x7f792003eae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f792804f940 tx=0x7f79280a57e0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.497+0000 7f792d0d7640 1 -- 172.21.15.59:0/3877037261 shutdown_connections 2023-10-16T14:26:13.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.497+0000 7f792d0d7640 1 --2- 172.21.15.59:0/3877037261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7920058870 0x7f7920056ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.497+0000 7f792d0d7640 1 --2- 172.21.15.59:0/3877037261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7920006150 0x7f792003eae0 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f792804f940 tx=0x7f79280a57e0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.497+0000 7f792d0d7640 1 -- 172.21.15.59:0/3877037261 >> 172.21.15.59:0/3877037261 conn(0x7f79200559c0 msgr2=0x7f7920055dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:13.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.497+0000 7f28caffd640 1 -- 172.21.15.59:0/589065054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28cc0d16a0 msgr2=0x7f28cc0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:13.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.497+0000 7f28caffd640 1 --2- 172.21.15.59:0/589065054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28cc0d16a0 0x7f28cc0cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.497+0000 7f28caffd640 1 -- 172.21.15.59:0/589065054 >> v1:172.21.15.59:6789/0 conn(0x7f28cc0ce4d0 legacy=0x7f28cc160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:13.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.497+0000 7f792d0d7640 1 -- 172.21.15.59:0/3877037261 shutdown_connections 2023-10-16T14:26:13.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.497+0000 7f792d0d7640 1 -- 172.21.15.59:0/3877037261 wait complete. 2023-10-16T14:26:13.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.498+0000 7f28caffd640 1 -- 172.21.15.59:0/589065054 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc0d08e0 con 0x7f28cc15c9d0 2023-10-16T14:26:13.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.500+0000 7fe03775e640 1 Processor -- start 2023-10-16T14:26:13.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.500+0000 7fe03775e640 1 -- start start 2023-10-16T14:26:13.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.500+0000 7f792d0d7640 1 Processor -- start 2023-10-16T14:26:13.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.500+0000 7f28caffd640 1 --2- 172.21.15.59:0/589065054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28cc15c9d0 0x7f28cc0cdf90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f28c0009870 tx=0x7f28c002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=432e4bd39c307125 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.500+0000 7f792d0d7640 1 -- start start 2023-10-16T14:26:13.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.501+0000 7f28c9ffb640 1 -- 172.21.15.59:0/589065054 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c0030840 con 0x7f28cc15c9d0 2023-10-16T14:26:13.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.501+0000 7f28c9ffb640 1 -- 172.21.15.59:0/589065054 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c00309a0 con 0x7f28cc15c9d0 2023-10-16T14:26:13.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.501+0000 7f28c9ffb640 1 -- 172.21.15.59:0/589065054 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c0030d30 con 0x7f28cc15c9d0 2023-10-16T14:26:13.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.501+0000 7fe03775e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0300cc990 0x7fe0300cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.502+0000 7f28cbfff640 1 -- 172.21.15.59:0/589065054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28cc15c9d0 msgr2=0x7f28cc0cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.502+0000 7f28cbfff640 1 --2- 172.21.15.59:0/589065054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28cc15c9d0 0x7f28cc0cdf90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f28c0009870 tx=0x7f28c002b980 comp rx=0 tx=0).stop 2023-10-16T14:26:13.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.502+0000 7fe03775e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe0300b2ff0 0x7fe0300cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.502+0000 7fe03775e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0300b2100 con 0x7fe0300b1200 2023-10-16T14:26:13.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.502+0000 7fe03775e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0300ccd70 con 0x7fe0300b2ff0 2023-10-16T14:26:13.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.502+0000 7fe03775e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03006dd90 con 0x7fe0300cc990 2023-10-16T14:26:13.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.502+0000 7fe0354fa640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0300cc990 0x7fe0300cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.503+0000 7fe035cfb640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fe0300b1200 0x7fe03006c040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.59:54096/0 (socket says 172.21.15.59:54096) 2023-10-16T14:26:13.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.503+0000 7fe035cfb640 1 -- 172.21.15.59:0/4181371690 learned_addr learned my addr 172.21.15.59:0/4181371690 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:13.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.503+0000 7fe034cf9640 1 --2- 172.21.15.59:0/4181371690 >> v2:172.21.15.151:3300/0 conn(0x7fe0300b2ff0 0x7fe0300cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.503+0000 7f28cbfff640 1 -- 172.21.15.59:0/589065054 shutdown_connections 2023-10-16T14:26:13.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.503+0000 7f28cbfff640 1 --2- 172.21.15.59:0/589065054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28cc0d16a0 0x7f28cc0cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.503+0000 7f28cbfff640 1 --2- 172.21.15.59:0/589065054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28cc15c9d0 0x7f28cc0cdf90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.503+0000 7f28cbfff640 1 -- 172.21.15.59:0/589065054 >> 172.21.15.59:0/589065054 conn(0x7f28cc09bad0 msgr2=0x7f28cc0d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:13.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.504+0000 7f28cbfff640 1 -- 172.21.15.59:0/589065054 shutdown_connections 2023-10-16T14:26:13.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.504+0000 7f28cbfff640 1 -- 172.21.15.59:0/589065054 wait complete. 2023-10-16T14:26:13.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.504+0000 7fe034cf9640 1 -- 172.21.15.59:0/4181371690 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0300cc990 msgr2=0x7fe0300cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:13.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.504+0000 7fe034cf9640 1 --2- 172.21.15.59:0/4181371690 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0300cc990 0x7fe0300cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.504+0000 7fe034cf9640 1 -- 172.21.15.59:0/4181371690 >> v1:172.21.15.151:6789/0 conn(0x7fe0300b1200 legacy=0x7fe03006c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.504+0000 7fe034cf9640 1 -- 172.21.15.59:0/4181371690 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0300b17d0 con 0x7fe0300b2ff0 2023-10-16T14:26:13.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.505+0000 7fe034cf9640 1 --2- 172.21.15.59:0/4181371690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0300b2ff0 0x7fe0300cb6c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe0240097a0 tx=0x7fe024034100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef8e555414d26e24 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.506+0000 7fe02ffff640 1 -- 172.21.15.59:0/4181371690 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02403c440 con 0x7fe0300b2ff0 2023-10-16T14:26:13.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.506+0000 7fe02ffff640 1 -- 172.21.15.59:0/4181371690 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02403c5a0 con 0x7fe0300b2ff0 2023-10-16T14:26:13.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.506+0000 7fe02ffff640 1 -- 172.21.15.59:0/4181371690 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02403c970 con 0x7fe0300b2ff0 2023-10-16T14:26:13.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.503+0000 7f792d0d7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f792003c050 0x7f79200df310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.503+0000 7f792d0d7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7920058870 0x7f792000a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.503+0000 7f792d0d7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f792000aac0 0x7f79200e5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.503+0000 7f792d0d7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792003b1b0 con 0x7f792000aac0 2023-10-16T14:26:13.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.503+0000 7f792d0d7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79200df850 con 0x7f7920058870 2023-10-16T14:26:13.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.503+0000 7f792d0d7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792003a5a0 con 0x7f792003c050 2023-10-16T14:26:13.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.504+0000 7f792759e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f792000aac0 0x7f79200e5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.504+0000 7f7926d9d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f792003c050 0x7f79200df310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.504+0000 7f792759e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f792000aac0 0x7f79200e5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41776/0 (socket says 172.21.15.59:41776) 2023-10-16T14:26:13.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.504+0000 7f7926d9d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f792003c050 0x7f79200df310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.59:39238/0 (socket says 172.21.15.59:39238) 2023-10-16T14:26:13.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.504+0000 7f792759e640 1 -- 172.21.15.59:0/2011866708 learned_addr learned my addr 172.21.15.59:0/2011866708 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:13.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.505+0000 7f792759e640 1 -- 172.21.15.59:0/2011866708 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f792003c050 msgr2=0x7f79200df310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.505+0000 7f792759e640 1 --2- 172.21.15.59:0/2011866708 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f792003c050 0x7f79200df310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.505+0000 7f792759e640 1 -- 172.21.15.59:0/2011866708 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7920058870 msgr2=0x7f792000a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.505+0000 7f792759e640 1 --2- 172.21.15.59:0/2011866708 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7920058870 0x7f792000a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.505+0000 7f792759e640 1 -- 172.21.15.59:0/2011866708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792003a880 con 0x7f792000aac0 2023-10-16T14:26:13.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.505+0000 7f792759e640 1 --2- 172.21.15.59:0/2011866708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f792000aac0 0x7f79200e5860 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f791c00c780 tx=0x7f791c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.506+0000 7f790f7fe640 1 -- 172.21.15.59:0/2011866708 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c0058b0 con 0x7f792000aac0 2023-10-16T14:26:13.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.506+0000 7f792d0d7640 1 -- 172.21.15.59:0/2011866708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f792003ab60 con 0x7f792000aac0 2023-10-16T14:26:13.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.506+0000 7f790f7fe640 1 -- 172.21.15.59:0/2011866708 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c005a10 con 0x7f792000aac0 2023-10-16T14:26:13.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.506+0000 7f790f7fe640 1 -- 172.21.15.59:0/2011866708 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c0058b0 con 0x7f792000aac0 2023-10-16T14:26:13.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.506+0000 7f792d0d7640 1 -- 172.21.15.59:0/2011866708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79200e5340 con 0x7f792000aac0 2023-10-16T14:26:13.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.507+0000 7f28cbfff640 1 Processor -- start 2023-10-16T14:26:13.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.507+0000 7f28cbfff640 1 -- start start 2023-10-16T14:26:13.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.509+0000 7f28cbfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28cc0ce4d0 0x7f28cc0c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.509+0000 7f28cbfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28cc0d16a0 0x7f28cc0c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.509+0000 7fe03775e640 1 -- 172.21.15.59:0/4181371690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0300b2ff0 msgr2=0x7fe0300cb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.509+0000 7fe03775e640 1 --2- 172.21.15.59:0/4181371690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0300b2ff0 0x7fe0300cb6c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe0240097a0 tx=0x7fe024034100 comp rx=0 tx=0).stop 2023-10-16T14:26:13.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.509+0000 7f28cbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28cc15c9d0 0x7f28cc0c9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.509+0000 7f28cbfff640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc0c6420 con 0x7f28cc15c9d0 2023-10-16T14:26:13.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.509+0000 7f28cbfff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc0c8f30 con 0x7f28cc0ce4d0 2023-10-16T14:26:13.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.509+0000 7f28cbfff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc0c66c0 con 0x7f28cc0d16a0 2023-10-16T14:26:13.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.509+0000 7f792d0d7640 1 -- 172.21.15.59:0/2011866708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7908000fc0 con 0x7f792000aac0 2023-10-16T14:26:13.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.510+0000 7f28caffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28cc0ce4d0 0x7f28cc0c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.510+0000 7fe03775e640 1 -- 172.21.15.59:0/4181371690 shutdown_connections 2023-10-16T14:26:13.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.510+0000 7fe03775e640 1 --2- 172.21.15.59:0/4181371690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0300b2ff0 0x7fe0300cb6c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.510+0000 7fe03775e640 1 --2- 172.21.15.59:0/4181371690 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0300cc990 0x7fe0300cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.510+0000 7fe03775e640 1 -- 172.21.15.59:0/4181371690 >> 172.21.15.59:0/4181371690 conn(0x7fe0300ce7d0 msgr2=0x7fe0300cebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:13.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.510+0000 7f28caffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28cc0ce4d0 0x7f28cc0c71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.59:58788/0 (socket says 172.21.15.59:58788) 2023-10-16T14:26:13.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.510+0000 7f28caffd640 1 -- 172.21.15.59:0/259967393 learned_addr learned my addr 172.21.15.59:0/259967393 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:13.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.511+0000 7f28cb7fe640 1 --2- 172.21.15.59:0/259967393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28cc15c9d0 0x7f28cc0c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.511+0000 7f28ca7fc640 1 --2- 172.21.15.59:0/259967393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28cc0d16a0 0x7f28cc0c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.511+0000 7fe03775e640 1 -- 172.21.15.59:0/4181371690 shutdown_connections 2023-10-16T14:26:13.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.511+0000 7f790f7fe640 1 -- 172.21.15.59:0/2011866708 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f791c005ba0 con 0x7f792000aac0 2023-10-16T14:26:13.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.511+0000 7f28caffd640 1 -- 172.21.15.59:0/259967393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28cc0d16a0 msgr2=0x7f28cc0c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.511+0000 7f28caffd640 1 --2- 172.21.15.59:0/259967393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28cc0d16a0 0x7f28cc0c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.511+0000 7f28caffd640 1 -- 172.21.15.59:0/259967393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28cc15c9d0 msgr2=0x7f28cc0c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.511+0000 7f28caffd640 1 --2- 172.21.15.59:0/259967393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28cc15c9d0 0x7f28cc0c9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.511+0000 7f28caffd640 1 -- 172.21.15.59:0/259967393 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c00094d0 con 0x7f28cc0ce4d0 2023-10-16T14:26:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.511+0000 7f28cb7fe640 1 --2- 172.21.15.59:0/259967393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28cc15c9d0 0x7f28cc0c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.512+0000 7f28caffd640 1 --2- 172.21.15.59:0/259967393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28cc0ce4d0 0x7f28cc0c71a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f28c0000c00 tx=0x7f28c0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.512+0000 7fe03775e640 1 -- 172.21.15.59:0/4181371690 wait complete. 2023-10-16T14:26:13.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.512+0000 7f790f7fe640 1 --2- 172.21.15.59:0/2011866708 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f791406af00 0x7f791406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.513+0000 7f28b3fff640 1 -- 172.21.15.59:0/259967393 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c0039a90 con 0x7f28cc0ce4d0 2023-10-16T14:26:13.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.513+0000 7f28b3fff640 1 -- 172.21.15.59:0/259967393 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c0039bf0 con 0x7f28cc0ce4d0 2023-10-16T14:26:13.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.513+0000 7f28cbfff640 1 -- 172.21.15.59:0/259967393 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28cc0c69a0 con 0x7f28cc0ce4d0 2023-10-16T14:26:13.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.513+0000 7f790f7fe640 1 -- 172.21.15.59:0/2011866708 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f791c0886e0 con 0x7f792000aac0 2023-10-16T14:26:13.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.513+0000 7f790f7fe640 1 --2- 172.21.15.59:0/2011866708 >> [v2:172.21.15.59:6810/3082385432,v1:172.21.15.59:6812/3082385432] conn(0x7f7914074540 0x7f7914076980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.513+0000 7f790f7fe640 1 -- 172.21.15.59:0/2011866708 --> [v2:172.21.15.59:6810/3082385432,v1:172.21.15.59:6812/3082385432] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7914077050 con 0x7f7914074540 2023-10-16T14:26:13.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.513+0000 7f790f7fe640 1 -- 172.21.15.59:0/2011866708 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f791c08ad00 con 0x7f792000aac0 2023-10-16T14:26:13.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.513+0000 7f28cbfff640 1 -- 172.21.15.59:0/259967393 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28cc0c76e0 con 0x7f28cc0ce4d0 2023-10-16T14:26:13.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.513+0000 7f28b3fff640 1 -- 172.21.15.59:0/259967393 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c0043410 con 0x7f28cc0ce4d0 2023-10-16T14:26:13.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.513+0000 7f7926d9d640 1 --2- 172.21.15.59:0/2011866708 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f791406af00 0x7f791406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.513+0000 7fada1275640 1 Processor -- start 2023-10-16T14:26:13.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.514+0000 7f792659c640 1 --2- 172.21.15.59:0/2011866708 >> [v2:172.21.15.59:6810/3082385432,v1:172.21.15.59:6812/3082385432] conn(0x7f7914074540 0x7f7914076980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.514+0000 7fada1275640 1 -- start start 2023-10-16T14:26:13.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.515+0000 7f28cbfff640 1 -- 172.21.15.59:0/259967393 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f28cc0d0ea0 con 0x7f28cc0ce4d0 2023-10-16T14:26:13.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.515+0000 7fe03775e640 1 Processor -- start 2023-10-16T14:26:13.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.515+0000 7fe03775e640 1 -- start start 2023-10-16T14:26:13.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.517+0000 7fe03775e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0300b1200 0x7fe0301ed860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.515+0000 7f792659c640 1 --2- 172.21.15.59:0/2011866708 >> [v2:172.21.15.59:6810/3082385432,v1:172.21.15.59:6812/3082385432] conn(0x7f7914074540 0x7f7914076980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.517+0000 7f7926d9d640 1 --2- 172.21.15.59:0/2011866708 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f791406af00 0x7f791406d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f79200085d0 tx=0x7f792806e030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.517+0000 7f790f7fe640 1 -- 172.21.15.59:0/2011866708 <== osd.2 v2:172.21.15.59:6810/3082385432 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f7914077050 con 0x7f7914074540 2023-10-16T14:26:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.517+0000 7f61c9b25640 1 Processor -- start 2023-10-16T14:26:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.517+0000 7fe03775e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0300b2ff0 0x7fe0300aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.517+0000 7f61c9b25640 1 -- start start 2023-10-16T14:26:13.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.518+0000 7fe03775e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0300cc990 0x7fe03014ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.517+0000 7fada1275640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad9c0b08c0 0x7fad9c0ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.517+0000 7fada1275640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9c0c8fb0 con 0x7fad9c06c9b0 2023-10-16T14:26:13.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.517+0000 7fada1275640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9c06ce40 con 0x7fad9c158b40 2023-10-16T14:26:13.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.517+0000 7fada1275640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c06d6e0 con 0x7fad9c0b08c0 2023-10-16T14:26:13.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.518+0000 7fe0354fa640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0300b1200 0x7fe0301ed860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.518+0000 7f6556e9a640 1 Processor -- start 2023-10-16T14:26:13.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.518+0000 7fe0354fa640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0300b1200 0x7fe0301ed860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.59:39250/0 (socket says 172.21.15.59:39250) 2023-10-16T14:26:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.518+0000 7fe0354fa640 1 -- 172.21.15.59:0/3662663849 learned_addr learned my addr 172.21.15.59:0/3662663849 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.518+0000 7fe034cf9640 1 --2- 172.21.15.59:0/3662663849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0300b2ff0 0x7fe0300aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.518+0000 7fe03775e640 1 -- 172.21.15.59:0/3662663849 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0301edda0 con 0x7fe0300b2ff0 2023-10-16T14:26:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.518+0000 7fad927fc640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fad9c06c9b0 0x7fad9c0b01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45662/0 (socket says 172.21.15.59:45662) 2023-10-16T14:26:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.518+0000 7fad927fc640 1 -- 172.21.15.59:0/1354756447 learned_addr learned my addr 172.21.15.59:0/1354756447 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.518+0000 7fad9b7fe640 1 --2- 172.21.15.59:0/1354756447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad9c0b08c0 0x7fad9c0ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.518+0000 7fe035cfb640 1 --2- 172.21.15.59:0/3662663849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0300cc990 0x7fe03014ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.518+0000 7f6556e9a640 1 -- start start 2023-10-16T14:26:13.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.519+0000 7f28b3fff640 1 -- 172.21.15.59:0/259967393 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f28c002f390 con 0x7f28cc0ce4d0 2023-10-16T14:26:13.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.519+0000 7fad9b7fe640 1 -- 172.21.15.59:0/1354756447 >> v1:172.21.15.151:6789/0 conn(0x7fad9c158b40 legacy=0x7fad9c06c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:13.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.519+0000 7fad9b7fe640 1 -- 172.21.15.59:0/1354756447 >> v1:172.21.15.59:6789/0 conn(0x7fad9c06c9b0 legacy=0x7fad9c0b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.519+0000 7fad9b7fe640 1 -- 172.21.15.59:0/1354756447 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c06d120 con 0x7fad9c0b08c0 2023-10-16T14:26:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.519+0000 7fe03775e640 1 -- 172.21.15.59:0/3662663849 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe030152460 con 0x7fe0300cc990 2023-10-16T14:26:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.520+0000 7fe03775e640 1 -- 172.21.15.59:0/3662663849 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03015c440 con 0x7fe0300b1200 2023-10-16T14:26:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.520+0000 7f2667f68640 1 Processor -- start 2023-10-16T14:26:13.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.520+0000 7f2667f68640 1 -- start start 2023-10-16T14:26:13.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.520+0000 7f61c9b25640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61c415cf70 0x7f61c406d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.520+0000 7f61c9b25640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61c415d350 0x7f61c40b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.520+0000 7f61c9b25640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f61c40b06f0 0x7f61c40c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.520+0000 7f61c9b25640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c415a040 con 0x7f61c415d350 2023-10-16T14:26:13.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.520+0000 7f61c9b25640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c40b0b70 con 0x7f61c40b06f0 2023-10-16T14:26:13.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.520+0000 7f61c9b25640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c406cb90 con 0x7f61c415cf70 2023-10-16T14:26:13.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7fad9b7fe640 1 --2- 172.21.15.59:0/1354756447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad9c0b08c0 0x7fad9c0ccbe0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fad9400aed0 tx=0x7fad9402cfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a01eadbf7bc9a7a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7f28b3fff640 1 --2- 172.21.15.59:0/259967393 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f28b806ae70 0x7f28b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7f28b3fff640 1 -- 172.21.15.59:0/259967393 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f28c00abac0 con 0x7f28cc0ce4d0 2023-10-16T14:26:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7f28b3fff640 1 --2- 172.21.15.59:0/259967393 >> [v2:172.21.15.59:6824/3017630955,v1:172.21.15.59:6825/3017630955] conn(0x7f28b80743b0 0x7f28b80767f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7f28b3fff640 1 -- 172.21.15.59:0/259967393 --> [v2:172.21.15.59:6824/3017630955,v1:172.21.15.59:6825/3017630955] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f28b8076ec0 con 0x7f28b80743b0 2023-10-16T14:26:13.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7f28b3fff640 1 -- 172.21.15.59:0/259967393 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28c00b02c0 con 0x7f28cc0ce4d0 2023-10-16T14:26:13.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7fe035cfb640 1 -- 172.21.15.59:0/3662663849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0300b1200 msgr2=0x7fe0301ed860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7fe035cfb640 1 --2- 172.21.15.59:0/3662663849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0300b1200 0x7fe0301ed860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7fe035cfb640 1 -- 172.21.15.59:0/3662663849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0300b2ff0 msgr2=0x7fe0300aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7fe035cfb640 1 --2- 172.21.15.59:0/3662663849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0300b2ff0 0x7fe0300aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7fe035cfb640 1 -- 172.21.15.59:0/3662663849 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe024009400 con 0x7fe0300cc990 2023-10-16T14:26:13.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7f6556e9a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f655006d900 0x7f655006dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7f6556e9a640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6550160480 0x7f65501608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7f61c2ffd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61c415d350 0x7f61c40b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7f61c2ffd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61c415d350 0x7f61c40b01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41800/0 (socket says 172.21.15.59:41800) 2023-10-16T14:26:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7f61c2ffd640 1 -- 172.21.15.59:0/1171618841 learned_addr learned my addr 172.21.15.59:0/1171618841 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7f61c3fff640 1 --2- 172.21.15.59:0/1171618841 >> v2:172.21.15.151:3300/0 conn(0x7f61c40b06f0 0x7f61c40c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7f61c2ffd640 1 -- 172.21.15.59:0/1171618841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61c415cf70 msgr2=0x7f61c406d020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T14:26:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.522+0000 7f61c2ffd640 1 --2- 172.21.15.59:0/1171618841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61c415cf70 0x7f61c406d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.522+0000 7f28cb7fe640 1 --2- 172.21.15.59:0/259967393 >> [v2:172.21.15.59:6824/3017630955,v1:172.21.15.59:6825/3017630955] conn(0x7f28b80743b0 0x7f28b80767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.522+0000 7fe034cf9640 1 --2- 172.21.15.59:0/3662663849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0300b2ff0 0x7fe0300aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:26:13.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.522+0000 7f61c2ffd640 1 -- 172.21.15.59:0/1171618841 >> v2:172.21.15.151:3300/0 conn(0x7f61c40b06f0 msgr2=0x7f61c40c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:13.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.522+0000 7f61c2ffd640 1 --2- 172.21.15.59:0/1171618841 >> v2:172.21.15.151:3300/0 conn(0x7f61c40b06f0 0x7f61c40c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.522+0000 7f61c2ffd640 1 -- 172.21.15.59:0/1171618841 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c406c2a0 con 0x7f61c415d350 2023-10-16T14:26:13.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7f6556e9a640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65500cd9d0 con 0x7f6550164910 2023-10-16T14:26:13.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7f6556e9a640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65500cc930 con 0x7f6550160480 2023-10-16T14:26:13.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.521+0000 7f6556e9a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65500ccc10 con 0x7f655006d900 2023-10-16T14:26:13.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.522+0000 7f6555e98640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6550164910 0x7f6550164cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45670/0 (socket says 172.21.15.59:45670) 2023-10-16T14:26:13.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.522+0000 7f6555e98640 1 -- 172.21.15.59:0/3486271522 learned_addr learned my addr 172.21.15.59:0/3486271522 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:13.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.522+0000 7f6554e96640 1 -- 172.21.15.59:0/3486271522 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 685175928 0 0) 0x7f65500cd9d0 con 0x7f6550164910 2023-10-16T14:26:13.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.522+0000 7f6554e96640 1 -- 172.21.15.59:0/3486271522 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f653c003520 con 0x7f6550164910 2023-10-16T14:26:13.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.522+0000 7f2667f68640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26600cc660 0x7f26600cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.522+0000 7f2667f68640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f26600cd960 0x7f26600cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.523+0000 7f2667f68640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26600cb8a0 con 0x7f266015ab10 2023-10-16T14:26:13.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.523+0000 7f2667f68640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26600cbb80 con 0x7f26600cd960 2023-10-16T14:26:13.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.523+0000 7f2667f68640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26600cbe60 con 0x7f26600cc660 2023-10-16T14:26:13.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.523+0000 7fe035cfb640 1 --2- 172.21.15.59:0/3662663849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0300cc990 0x7fe03014ecd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe02800cad0 tx=0x7fe02800cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.523+0000 7f2665d04640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f266015ab10 0x7f26600d1120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.59:54120/0 (socket says 172.21.15.59:54120) 2023-10-16T14:26:13.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.523+0000 7f2665d04640 1 -- 172.21.15.59:0/392353843 learned_addr learned my addr 172.21.15.59:0/392353843 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:13.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.523+0000 7f2666505640 1 --2- 172.21.15.59:0/392353843 >> v2:172.21.15.151:3300/0 conn(0x7f26600cd960 0x7f26600cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.523+0000 7f6554e96640 1 -- 172.21.15.59:0/3486271522 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2852866374 0 0) 0x7f653c003520 con 0x7f6550164910 2023-10-16T14:26:13.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.523+0000 7f6554e96640 1 -- 172.21.15.59:0/3486271522 >> v2:172.21.15.151:3300/0 conn(0x7f655006d900 msgr2=0x7f655006dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:13.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.523+0000 7f6556699640 1 --2- 172.21.15.59:0/3486271522 >> v2:172.21.15.59:3300/0 conn(0x7f6550160480 0x7f65501608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.523+0000 7f6555697640 1 --2- 172.21.15.59:0/3486271522 >> v2:172.21.15.151:3300/0 conn(0x7f655006d900 0x7f655006dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.523+0000 7f6554e96640 1 --2- 172.21.15.59:0/3486271522 >> v2:172.21.15.151:3300/0 conn(0x7f655006d900 0x7f655006dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.523+0000 7f6554e96640 1 -- 172.21.15.59:0/3486271522 >> v2:172.21.15.59:3300/0 conn(0x7f6550160480 msgr2=0x7f65501608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:13.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.523+0000 7f6554e96640 1 --2- 172.21.15.59:0/3486271522 >> v2:172.21.15.59:3300/0 conn(0x7f6550160480 0x7f65501608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.523+0000 7f6554e96640 1 -- 172.21.15.59:0/3486271522 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65500ccef0 con 0x7f6550164910 2023-10-16T14:26:13.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.523+0000 7f6554e96640 1 -- 172.21.15.59:0/3486271522 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f6540001670 con 0x7f6550164910 2023-10-16T14:26:13.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.523+0000 7f6554e96640 1 -- 172.21.15.59:0/3486271522 >> v1:172.21.15.59:6789/0 conn(0x7f6550164910 legacy=0x7f6550164cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.523+0000 7f2665503640 1 --2- 172.21.15.59:0/392353843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26600cc660 0x7f26600cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7f28ca7fc640 1 --2- 172.21.15.59:0/259967393 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f28b806ae70 0x7f28b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.523+0000 7f61c3fff640 1 --2- 172.21.15.59:0/1171618841 >> v2:172.21.15.151:3300/0 conn(0x7f61c40b06f0 0x7f61c40c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:26:13.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.522+0000 7fad9a7fc640 1 -- 172.21.15.59:0/1354756447 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9402db40 con 0x7fad9c0b08c0 2023-10-16T14:26:13.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.522+0000 7fad9a7fc640 1 -- 172.21.15.59:0/1354756447 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9402dca0 con 0x7fad9c0b08c0 2023-10-16T14:26:13.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.522+0000 7fad9a7fc640 1 -- 172.21.15.59:0/1354756447 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad94008660 con 0x7fad9c0b08c0 2023-10-16T14:26:13.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7fada1275640 1 -- 172.21.15.59:0/1354756447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad9c0b08c0 msgr2=0x7fad9c0ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7fada1275640 1 --2- 172.21.15.59:0/1354756447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad9c0b08c0 0x7fad9c0ccbe0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fad9400aed0 tx=0x7fad9402cfa0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7fada1275640 1 -- 172.21.15.59:0/1354756447 shutdown_connections 2023-10-16T14:26:13.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7fada1275640 1 --2- 172.21.15.59:0/1354756447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad9c0b08c0 0x7fad9c0ccbe0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7fada1275640 1 -- 172.21.15.59:0/1354756447 >> 172.21.15.59:0/1354756447 conn(0x7fad9c06a440 msgr2=0x7fad9c0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:13.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.523+0000 7f6554e96640 1 --2- 172.21.15.59:0/3486271522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f653c003970 0x7f653c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7fe02dffb640 1 -- 172.21.15.59:0/3662663849 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02800ab70 con 0x7fe0300cc990 2023-10-16T14:26:13.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7f2666505640 1 -- 172.21.15.59:0/392353843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26600cc660 msgr2=0x7f26600cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:13.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7f2666505640 1 --2- 172.21.15.59:0/392353843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26600cc660 0x7f26600cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7fe02dffb640 1 -- 172.21.15.59:0/3662663849 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02800acd0 con 0x7fe0300cc990 2023-10-16T14:26:13.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7fe02dffb640 1 -- 172.21.15.59:0/3662663849 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe028012600 con 0x7fe0300cc990 2023-10-16T14:26:13.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7f2666505640 1 -- 172.21.15.59:0/392353843 >> v1:172.21.15.151:6789/0 conn(0x7f266015ab10 legacy=0x7f26600d1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7f2666505640 1 -- 172.21.15.59:0/392353843 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26600cc140 con 0x7f26600cd960 2023-10-16T14:26:13.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7f28cb7fe640 1 --2- 172.21.15.59:0/259967393 >> [v2:172.21.15.59:6824/3017630955,v1:172.21.15.59:6825/3017630955] conn(0x7f28b80743b0 0x7f28b80767f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7fe03775e640 1 -- 172.21.15.59:0/3662663849 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03015c720 con 0x7fe0300cc990 2023-10-16T14:26:13.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7fe03775e640 1 -- 172.21.15.59:0/3662663849 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03015cce0 con 0x7fe0300cc990 2023-10-16T14:26:13.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7f61c2ffd640 1 --2- 172.21.15.59:0/1171618841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61c415d350 0x7f61c40b01b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f61c40cc2b0 tx=0x7f61b400a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf94834ae0202662 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.525+0000 7f61c27fc640 1 -- 172.21.15.59:0/1171618841 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b402cb00 con 0x7f61c415d350 2023-10-16T14:26:13.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.526+0000 7fada1275640 1 -- 172.21.15.59:0/1354756447 shutdown_connections 2023-10-16T14:26:13.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.526+0000 7f61c27fc640 1 -- 172.21.15.59:0/1171618841 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b4030070 con 0x7f61c415d350 2023-10-16T14:26:13.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.526+0000 7f61c27fc640 1 -- 172.21.15.59:0/1171618841 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b4036400 con 0x7f61c415d350 2023-10-16T14:26:13.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7f6554e96640 1 --2- 172.21.15.59:0/3486271522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f653c0047c0 0x7f653c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7f6554e96640 1 --2- 172.21.15.59:0/3486271522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f653c0052a0 0x7f653c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7f6554e96640 1 -- 172.21.15.59:0/3486271522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65500cc930 con 0x7f653c0047c0 2023-10-16T14:26:13.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7f6554e96640 1 -- 172.21.15.59:0/3486271522 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65500ccc10 con 0x7f653c003970 2023-10-16T14:26:13.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.524+0000 7f6554e96640 1 -- 172.21.15.59:0/3486271522 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653c00c220 con 0x7f653c0052a0 2023-10-16T14:26:13.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.525+0000 7f6555e98640 1 --2- 172.21.15.59:0/3486271522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f653c003970 0x7f653c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.525+0000 7f6556699640 1 --2- 172.21.15.59:0/3486271522 >> v2:172.21.15.59:3300/0 conn(0x7f6550160480 0x7f65501608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:13.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.525+0000 7f6555e98640 1 -- 172.21.15.59:0/3486271522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f653c0052a0 msgr2=0x7f653c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:13.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.525+0000 7f6555e98640 1 --2- 172.21.15.59:0/3486271522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f653c0052a0 0x7f653c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.525+0000 7f6555e98640 1 -- 172.21.15.59:0/3486271522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f653c0047c0 msgr2=0x7f653c004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-16T14:26:13.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.525+0000 7f6555e98640 1 --2- 172.21.15.59:0/3486271522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f653c0047c0 0x7f653c004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.525+0000 7f6555e98640 1 -- 172.21.15.59:0/3486271522 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65500ccef0 con 0x7f653c003970 2023-10-16T14:26:13.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.525+0000 7f6556699640 1 -- 172.21.15.59:0/3486271522 reap_dead start 2023-10-16T14:26:13.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.526+0000 7fada1275640 1 -- 172.21.15.59:0/1354756447 wait complete. 2023-10-16T14:26:13.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.526+0000 7f61c9b25640 1 -- 172.21.15.59:0/1171618841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61c415d350 msgr2=0x7f61c40b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.526+0000 7f61c9b25640 1 --2- 172.21.15.59:0/1171618841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61c415d350 0x7f61c40b01b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f61c40cc2b0 tx=0x7f61b400a250 comp rx=0 tx=0).stop 2023-10-16T14:26:13.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.527+0000 7f28b3fff640 1 -- 172.21.15.59:0/259967393 <== osd.0 v2:172.21.15.59:6824/3017630955 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f28b8076ec0 con 0x7f28b80743b0 2023-10-16T14:26:13.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.527+0000 7f2666505640 1 --2- 172.21.15.59:0/392353843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26600cd960 0x7f26600cf320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f26580097a0 tx=0x7f265802b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20c5df7eba913cb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.527+0000 7fe03775e640 1 -- 172.21.15.59:0/3662663849 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe010000fc0 con 0x7fe0300cc990 2023-10-16T14:26:13.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.527+0000 7f28ca7fc640 1 --2- 172.21.15.59:0/259967393 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f28b806ae70 0x7f28b806d330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0b8490 tx=0x7f28bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.527+0000 7f6555e98640 1 --2- 172.21.15.59:0/3486271522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f653c003970 0x7f653c003d90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f654000c240 tx=0x7f653c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5aaa3e63535d033 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.527+0000 7f61c9b25640 1 -- 172.21.15.59:0/1171618841 shutdown_connections 2023-10-16T14:26:13.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.528+0000 7f2664d02640 1 -- 172.21.15.59:0/392353843 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2658030800 con 0x7f26600cd960 2023-10-16T14:26:13.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.528+0000 7f2664d02640 1 -- 172.21.15.59:0/392353843 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2658030960 con 0x7f26600cd960 2023-10-16T14:26:13.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.528+0000 7f2664d02640 1 -- 172.21.15.59:0/392353843 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2658030cf0 con 0x7f26600cd960 2023-10-16T14:26:13.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.528+0000 7f6554e96640 1 -- 172.21.15.59:0/3486271522 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654002cb20 con 0x7f653c003970 2023-10-16T14:26:13.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.528+0000 7f6554e96640 1 -- 172.21.15.59:0/3486271522 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654002cca0 con 0x7f653c003970 2023-10-16T14:26:13.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.528+0000 7f6554e96640 1 -- 172.21.15.59:0/3486271522 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540005b10 con 0x7f653c003970 2023-10-16T14:26:13.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.528+0000 7f61c9b25640 1 --2- 172.21.15.59:0/1171618841 >> v2:172.21.15.151:3300/0 conn(0x7f61c40b06f0 0x7f61c40c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.528+0000 7f61c9b25640 1 --2- 172.21.15.59:0/1171618841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61c415d350 0x7f61c40b01b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.528+0000 7f61c9b25640 1 --2- 172.21.15.59:0/1171618841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61c415cf70 0x7f61c406d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.528+0000 7f61c9b25640 1 -- 172.21.15.59:0/1171618841 >> 172.21.15.59:0/1171618841 conn(0x7f61c40cb1b0 msgr2=0x7f61c40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:13.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.528+0000 7f61c9b25640 1 -- 172.21.15.59:0/1171618841 shutdown_connections 2023-10-16T14:26:13.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.528+0000 7f61c9b25640 1 -- 172.21.15.59:0/1171618841 wait complete. 2023-10-16T14:26:13.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.529+0000 7fe02dffb640 1 -- 172.21.15.59:0/3662663849 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe028012760 con 0x7fe0300cc990 2023-10-16T14:26:13.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.529+0000 7f2667f68640 1 -- 172.21.15.59:0/392353843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26600cd960 msgr2=0x7f26600cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.529+0000 7f2667f68640 1 --2- 172.21.15.59:0/392353843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26600cd960 0x7f26600cf320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f26580097a0 tx=0x7f265802b940 comp rx=0 tx=0).stop 2023-10-16T14:26:13.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.530+0000 7fada1275640 1 Processor -- start 2023-10-16T14:26:13.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.530+0000 7fada1275640 1 -- start start 2023-10-16T14:26:13.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.531+0000 7f6556e9a640 1 -- 172.21.15.59:0/3486271522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f653c003970 msgr2=0x7f653c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.531+0000 7f6556e9a640 1 --2- 172.21.15.59:0/3486271522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f653c003970 0x7f653c003d90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f654000c240 tx=0x7f653c0057f0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.529+0000 7f2667f68640 1 -- 172.21.15.59:0/392353843 shutdown_connections 2023-10-16T14:26:13.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.529+0000 7f2667f68640 1 --2- 172.21.15.59:0/392353843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26600cd960 0x7f26600cf320 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.529+0000 7f2667f68640 1 --2- 172.21.15.59:0/392353843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26600cc660 0x7f26600cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.529+0000 7f2667f68640 1 -- 172.21.15.59:0/392353843 >> 172.21.15.59:0/392353843 conn(0x7f2660099ad0 msgr2=0x7f26600d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:13.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.531+0000 7f61c9b25640 1 Processor -- start 2023-10-16T14:26:13.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.531+0000 7f61c9b25640 1 -- start start 2023-10-16T14:26:13.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.532+0000 7fada1275640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad9c0b08c0 0x7fad9c14e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.532+0000 7fada1275640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9c158b40 0x7fad9c14f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.532+0000 7fada1275640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c15bda0 0x7fad9c0c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.532+0000 7fada1275640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c14fbb0 con 0x7fad9c158b40 2023-10-16T14:26:13.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.532+0000 7fada1275640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c0c6780 con 0x7fad9c15bda0 2023-10-16T14:26:13.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.532+0000 7fada1275640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c0c5b70 con 0x7fad9c0b08c0 2023-10-16T14:26:13.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.529+0000 7f2667f68640 1 -- 172.21.15.59:0/392353843 shutdown_connections 2023-10-16T14:26:13.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.529+0000 7f2667f68640 1 -- 172.21.15.59:0/392353843 wait complete. 2023-10-16T14:26:13.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.532+0000 7f2667f68640 1 Processor -- start 2023-10-16T14:26:13.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.530+0000 7fe02dffb640 1 --2- 172.21.15.59:0/3662663849 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe01c06aec0 0x7fe01c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.530+0000 7fe02dffb640 1 -- 172.21.15.59:0/3662663849 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe028089530 con 0x7fe0300cc990 2023-10-16T14:26:13.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.531+0000 7fe02dffb640 1 --2- 172.21.15.59:0/3662663849 >> [v2:172.21.15.59:6800/1115424190,v1:172.21.15.59:6801/1115424190] conn(0x7fe01c074500 0x7fe01c076940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.531+0000 7fe02dffb640 1 -- 172.21.15.59:0/3662663849 --> [v2:172.21.15.59:6800/1115424190,v1:172.21.15.59:6801/1115424190] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe01c077010 con 0x7fe01c074500 2023-10-16T14:26:13.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.531+0000 7fe02dffb640 1 -- 172.21.15.59:0/3662663849 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe02808bc40 con 0x7fe0300cc990 2023-10-16T14:26:13.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.531+0000 7fe034cf9640 1 --2- 172.21.15.59:0/3662663849 >> [v2:172.21.15.59:6800/1115424190,v1:172.21.15.59:6801/1115424190] conn(0x7fe01c074500 0x7fe01c076940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.532+0000 7fad927fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9c158b40 0x7fad9c14f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.532+0000 7f2667f68640 1 -- start start 2023-10-16T14:26:13.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.532+0000 7fad927fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9c158b40 0x7fad9c14f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41828/0 (socket says 172.21.15.59:41828) 2023-10-16T14:26:13.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.533+0000 7fad9b7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c15bda0 0x7fad9c0c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.533+0000 7fe0354fa640 1 --2- 172.21.15.59:0/3662663849 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe01c06aec0 0x7fe01c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.533+0000 7fad9b7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c15bda0 0x7fad9c0c96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.59:58826/0 (socket says 172.21.15.59:58826) 2023-10-16T14:26:13.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.533+0000 7fad9b7fe640 1 -- 172.21.15.59:0/2881914898 learned_addr learned my addr 172.21.15.59:0/2881914898 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:13.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.533+0000 7fad9affd640 1 --2- 172.21.15.59:0/2881914898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad9c0b08c0 0x7fad9c14e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.533+0000 7f61c9b25640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61c40b06f0 0x7f61c40c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.533+0000 7fe034cf9640 1 --2- 172.21.15.59:0/3662663849 >> [v2:172.21.15.59:6800/1115424190,v1:172.21.15.59:6801/1115424190] conn(0x7fe01c074500 0x7fe01c076940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.534+0000 7fad927fc640 1 -- 172.21.15.59:0/2881914898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad9c0b08c0 msgr2=0x7fad9c14e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.703 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.534+0000 7fad927fc640 1 --2- 172.21.15.59:0/2881914898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad9c0b08c0 0x7fad9c14e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.534+0000 7f61c9b25640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61c415cf70 0x7f61c40cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.534+0000 7f61c9b25640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61c415d350 0x7f61c40cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.534+0000 7fad927fc640 1 -- 172.21.15.59:0/2881914898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c15bda0 msgr2=0x7fad9c0c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.534+0000 7fad927fc640 1 --2- 172.21.15.59:0/2881914898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c15bda0 0x7fad9c0c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.534+0000 7fad927fc640 1 -- 172.21.15.59:0/2881914898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9400ab80 con 0x7fad9c158b40 2023-10-16T14:26:13.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.534+0000 7fe0354fa640 1 --2- 172.21.15.59:0/3662663849 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe01c06aec0 0x7fe01c06d380 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe020009c00 tx=0x7fe020009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.534+0000 7f61c9b25640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c40c50b0 con 0x7f61c40b06f0 2023-10-16T14:26:13.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.534+0000 7f61c9b25640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c40c4dd0 con 0x7f61c415d350 2023-10-16T14:26:13.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.534+0000 7f61c2ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61c415cf70 0x7f61c40cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.534+0000 7f2667f68640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26600cc660 0x7f2660157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.534+0000 7f2667f68640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26600cd960 0x7f26601fed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.535+0000 7f2667f68640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f266015ab10 0x7f2660153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.535+0000 7f2667f68640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26600c4e60 con 0x7f26600cd960 2023-10-16T14:26:13.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.535+0000 7f2667f68640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26600c5370 con 0x7f266015ab10 2023-10-16T14:26:13.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.535+0000 7f2667f68640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26600c5630 con 0x7f26600cc660 2023-10-16T14:26:13.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.535+0000 7fe02dffb640 1 -- 172.21.15.59:0/3662663849 <== osd.1 v2:172.21.15.59:6800/1115424190 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fe01c077010 con 0x7fe01c074500 2023-10-16T14:26:13.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.535+0000 7f6556e9a640 1 -- 172.21.15.59:0/3486271522 shutdown_connections 2023-10-16T14:26:13.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.535+0000 7f6556e9a640 1 --2- 172.21.15.59:0/3486271522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f653c003970 0x7f653c003d90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.535+0000 7f6556e9a640 1 -- 172.21.15.59:0/3486271522 >> 172.21.15.59:0/3486271522 conn(0x7f65500cb420 msgr2=0x7f65500cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:13.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.534+0000 7f61c2ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61c415cf70 0x7f61c40cc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.59:39306/0 (socket says 172.21.15.59:39306) 2023-10-16T14:26:13.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.534+0000 7f61c2ffd640 1 -- 172.21.15.59:0/617451350 learned_addr learned my addr 172.21.15.59:0/617451350 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:13.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.535+0000 7f61c3fff640 1 --2- 172.21.15.59:0/617451350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61c415d350 0x7f61c40cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.535+0000 7f61c9b25640 1 -- 172.21.15.59:0/617451350 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c41476d0 con 0x7f61c415cf70 2023-10-16T14:26:13.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.535+0000 7f61c37fe640 1 --2- 172.21.15.59:0/617451350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61c40b06f0 0x7f61c40c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.535+0000 7f2665d04640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26600cc660 0x7f2660157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.535+0000 7f6556e9a640 1 -- 172.21.15.59:0/3486271522 shutdown_connections 2023-10-16T14:26:13.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.535+0000 7f2665d04640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26600cc660 0x7f2660157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.59:39320/0 (socket says 172.21.15.59:39320) 2023-10-16T14:26:13.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.535+0000 7f2665d04640 1 -- 172.21.15.59:0/2954937449 learned_addr learned my addr 172.21.15.59:0/2954937449 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:13.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.535+0000 7fad9b7fe640 1 --2- 172.21.15.59:0/2881914898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c15bda0 0x7fad9c0c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:26:13.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.535+0000 7f2665503640 1 --2- 172.21.15.59:0/2954937449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26600cd960 0x7f26601fed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.535+0000 7f2666505640 1 --2- 172.21.15.59:0/2954937449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f266015ab10 0x7f2660153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.536+0000 7f61c3fff640 1 -- 172.21.15.59:0/617451350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61c415cf70 msgr2=0x7f61c40cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.536+0000 7f61c3fff640 1 --2- 172.21.15.59:0/617451350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61c415cf70 0x7f61c40cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.536+0000 7f61c3fff640 1 -- 172.21.15.59:0/617451350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61c40b06f0 msgr2=0x7f61c40c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.536+0000 7f61c3fff640 1 --2- 172.21.15.59:0/617451350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61c40b06f0 0x7f61c40c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.536+0000 7f61c3fff640 1 -- 172.21.15.59:0/617451350 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc008200 con 0x7f61c415d350 2023-10-16T14:26:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.536+0000 7f2665503640 1 -- 172.21.15.59:0/2954937449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26600cc660 msgr2=0x7f2660157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.536+0000 7f2665503640 1 --2- 172.21.15.59:0/2954937449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26600cc660 0x7f2660157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.536+0000 7f2665503640 1 -- 172.21.15.59:0/2954937449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f266015ab10 msgr2=0x7f2660153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.536+0000 7f2665503640 1 --2- 172.21.15.59:0/2954937449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f266015ab10 0x7f2660153af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.536+0000 7f2665503640 1 -- 172.21.15.59:0/2954937449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2658009400 con 0x7f26600cd960 2023-10-16T14:26:13.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.536+0000 7fad927fc640 1 --2- 172.21.15.59:0/2881914898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9c158b40 0x7fad9c14f670 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00c850 tx=0x7fad8c00cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.537+0000 7f61c3fff640 1 --2- 172.21.15.59:0/617451350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61c415d350 0x7f61c40cce70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f61bc016e70 tx=0x7f61bc00bb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.537+0000 7f2665503640 1 --2- 172.21.15.59:0/2954937449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26600cd960 0x7f26601fed40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f264c00d520 tx=0x7f264c00d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.537+0000 7fad93fff640 1 -- 172.21.15.59:0/2881914898 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c007950 con 0x7fad9c158b40 2023-10-16T14:26:13.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.537+0000 7ffa186d7640 1 Processor -- start 2023-10-16T14:26:13.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.537+0000 7f265e7fc640 1 -- 172.21.15.59:0/2954937449 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c0125f0 con 0x7f26600cd960 2023-10-16T14:26:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.537+0000 7f265e7fc640 1 -- 172.21.15.59:0/2954937449 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264c012750 con 0x7f26600cd960 2023-10-16T14:26:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.537+0000 7f265e7fc640 1 -- 172.21.15.59:0/2954937449 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c012ae0 con 0x7f26600cd960 2023-10-16T14:26:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.537+0000 7f2667f68640 1 -- 172.21.15.59:0/2954937449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2660158b30 con 0x7f26600cd960 2023-10-16T14:26:13.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.538+0000 7f2667f68640 1 -- 172.21.15.59:0/2954937449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2660158570 con 0x7f26600cd960 2023-10-16T14:26:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.537+0000 7fad93fff640 1 -- 172.21.15.59:0/2881914898 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c007ab0 con 0x7fad9c158b40 2023-10-16T14:26:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.537+0000 7fad93fff640 1 -- 172.21.15.59:0/2881914898 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c007e80 con 0x7fad9c158b40 2023-10-16T14:26:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.538+0000 7fada1275640 1 -- 172.21.15.59:0/2881914898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9c0c5e50 con 0x7fad9c158b40 2023-10-16T14:26:13.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.538+0000 7fada1275640 1 -- 172.21.15.59:0/2881914898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9c0c6410 con 0x7fad9c158b40 2023-10-16T14:26:13.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.540+0000 7fad917fa640 1 -- 172.21.15.59:0/2881914898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fad9c15c980 con 0x7fad9c158b40 2023-10-16T14:26:13.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.539+0000 7f6556e9a640 1 -- 172.21.15.59:0/3486271522 wait complete. 2023-10-16T14:26:13.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.540+0000 7f61abfff640 1 -- 172.21.15.59:0/617451350 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc008c10 con 0x7f61c415d350 2023-10-16T14:26:13.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.540+0000 7f61abfff640 1 -- 172.21.15.59:0/617451350 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc008d70 con 0x7f61c415d350 2023-10-16T14:26:13.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.540+0000 7f61abfff640 1 -- 172.21.15.59:0/617451350 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc003bb0 con 0x7f61c415d350 2023-10-16T14:26:13.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.540+0000 7f61c9b25640 1 -- 172.21.15.59:0/617451350 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b400a570 con 0x7f61c415d350 2023-10-16T14:26:13.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.541+0000 7f61c9b25640 1 -- 172.21.15.59:0/617451350 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c4147c90 con 0x7f61c415d350 2023-10-16T14:26:13.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.537+0000 7ffa186d7640 1 -- start start 2023-10-16T14:26:13.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.539+0000 7ffa186d7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa100b83b0 0x7ffa100cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.540+0000 7ffa186d7640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa10161520 con 0x7ffa1015c9f0 2023-10-16T14:26:13.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.540+0000 7ffa16473640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffa1015c9f0 0x7ffa10160680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45672/0 (socket says 172.21.15.59:45672) 2023-10-16T14:26:13.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.540+0000 7ffa16473640 1 -- 172.21.15.59:0/3552741737 learned_addr learned my addr 172.21.15.59:0/3552741737 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:13.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.541+0000 7ffa15c72640 1 --2- 172.21.15.59:0/3552741737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa100b83b0 0x7ffa100cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.539+0000 7f2667f68640 1 -- 172.21.15.59:0/2954937449 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f266015aef0 con 0x7f26600cd960 2023-10-16T14:26:13.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.541+0000 7f265e7fc640 1 -- 172.21.15.59:0/2954937449 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f264c012c40 con 0x7f26600cd960 2023-10-16T14:26:13.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.541+0000 7ffa186d7640 1 -- 172.21.15.59:0/3552741737 --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa10160f60 con 0x7ffa100cdbc0 2023-10-16T14:26:13.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.541+0000 7ffa186d7640 1 -- 172.21.15.59:0/3552741737 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa100ce050 con 0x7ffa100b83b0 2023-10-16T14:26:13.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.541+0000 7f6556e9a640 1 Processor -- start 2023-10-16T14:26:13.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.542+0000 7f6556e9a640 1 -- start start 2023-10-16T14:26:13.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.542+0000 7f61c9b25640 1 -- 172.21.15.59:0/617451350 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f61a4000fc0 con 0x7f61c415d350 2023-10-16T14:26:13.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.543+0000 7ffa15471640 1 -- 172.21.15.59:0/3552741737 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263412142 0 0) 0x7ffa10160f60 con 0x7ffa100cdbc0 2023-10-16T14:26:13.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.543+0000 7f265e7fc640 1 --2- 172.21.15.59:0/2954937449 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f264406aec0 0x7f264406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.543+0000 7ffa15c72640 1 -- 172.21.15.59:0/3552741737 >> v1:172.21.15.151:6789/0 conn(0x7ffa100cdbc0 legacy=0x7ffa100d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.543+0000 7ffa15c72640 1 -- 172.21.15.59:0/3552741737 >> v1:172.21.15.59:6789/0 conn(0x7ffa1015c9f0 legacy=0x7ffa10160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.543+0000 7ffa15c72640 1 -- 172.21.15.59:0/3552741737 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa10161240 con 0x7ffa100b83b0 2023-10-16T14:26:13.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.543+0000 7f265e7fc640 1 -- 172.21.15.59:0/2954937449 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f264c089ae0 con 0x7f26600cd960 2023-10-16T14:26:13.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.543+0000 7f265e7fc640 1 --2- 172.21.15.59:0/2954937449 >> [v2:172.21.15.151:6802/2616669147,v1:172.21.15.151:6803/2616669147] conn(0x7f2644074480 0x7f26440768c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.543+0000 7f265e7fc640 1 -- 172.21.15.59:0/2954937449 --> [v2:172.21.15.151:6802/2616669147,v1:172.21.15.151:6803/2616669147] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2644076f90 con 0x7f2644074480 2023-10-16T14:26:13.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.543+0000 7fad93fff640 1 -- 172.21.15.59:0/2881914898 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fad8c00d040 con 0x7fad9c158b40 2023-10-16T14:26:13.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.544+0000 7f265e7fc640 1 -- 172.21.15.59:0/2954937449 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f264c012ef0 con 0x7f26600cd960 2023-10-16T14:26:13.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.544+0000 7f6556e9a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f653c003970 0x7f6550163c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.544+0000 7f6556e9a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65501f9ad0 0x7f6550158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.544+0000 7f6556e9a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6550159dd0 0x7f65500ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.544+0000 7f6556699640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6550159dd0 0x7f65500ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.544+0000 7f6556699640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6550159dd0 0x7f65500ae9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41846/0 (socket says 172.21.15.59:41846) 2023-10-16T14:26:13.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.544+0000 7f6556699640 1 -- 172.21.15.59:0/258519956 learned_addr learned my addr 172.21.15.59:0/258519956 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:13.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.544+0000 7f6556e9a640 1 -- 172.21.15.59:0/258519956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65501596a0 con 0x7f6550159dd0 2023-10-16T14:26:13.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.544+0000 7f6556e9a640 1 -- 172.21.15.59:0/258519956 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65501f9f30 con 0x7f653c003970 2023-10-16T14:26:13.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.544+0000 7f6555e98640 1 --2- 172.21.15.59:0/258519956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f653c003970 0x7f6550163c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.544+0000 7f6556e9a640 1 -- 172.21.15.59:0/258519956 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65501fa200 con 0x7f65501f9ad0 2023-10-16T14:26:13.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.545+0000 7ffa15c72640 1 --2- 172.21.15.59:0/3552741737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa100b83b0 0x7ffa100cd680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffa000097d0 tx=0x7ffa0002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b3f2fd315bf265e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.545+0000 7fad93fff640 1 --2- 172.21.15.59:0/2881914898 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fad7c06ae70 0x7fad7c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.545+0000 7f2666505640 1 --2- 172.21.15.59:0/2954937449 >> [v2:172.21.15.151:6802/2616669147,v1:172.21.15.151:6803/2616669147] conn(0x7f2644074480 0x7f26440768c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.545+0000 7f6556699640 1 -- 172.21.15.59:0/258519956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65501f9ad0 msgr2=0x7f6550158930 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-16T14:26:13.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.545+0000 7f6556699640 1 --2- 172.21.15.59:0/258519956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65501f9ad0 0x7f6550158930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.545+0000 7f6556699640 1 -- 172.21.15.59:0/258519956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f653c003970 msgr2=0x7f6550163c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.545+0000 7f6556699640 1 --2- 172.21.15.59:0/258519956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f653c003970 0x7f6550163c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.545+0000 7fad93fff640 1 -- 172.21.15.59:0/2881914898 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fad8c089900 con 0x7fad9c158b40 2023-10-16T14:26:13.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.545+0000 7f6556699640 1 -- 172.21.15.59:0/258519956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65501fa4e0 con 0x7f6550159dd0 2023-10-16T14:26:13.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.546+0000 7ffa15471640 1 -- 172.21.15.59:0/3552741737 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa00030800 con 0x7ffa100b83b0 2023-10-16T14:26:13.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.546+0000 7ffa15471640 1 -- 172.21.15.59:0/3552741737 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa00030960 con 0x7ffa100b83b0 2023-10-16T14:26:13.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.546+0000 7f6556699640 1 --2- 172.21.15.59:0/258519956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6550159dd0 0x7f65500ae9d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f655006e4c0 tx=0x7f654800a870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.546+0000 7fad93fff640 1 --2- 172.21.15.59:0/2881914898 >> [v2:172.21.15.59:6808/991070902,v1:172.21.15.59:6809/991070902] conn(0x7fad7c0743b0 0x7fad7c0767f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.546+0000 7fad93fff640 1 -- 172.21.15.59:0/2881914898 --> [v2:172.21.15.59:6808/991070902,v1:172.21.15.59:6809/991070902] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad7c076ec0 con 0x7fad7c0743b0 2023-10-16T14:26:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.546+0000 7fad93fff640 1 -- 172.21.15.59:0/2881914898 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad8c00a370 con 0x7fad9c158b40 2023-10-16T14:26:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.546+0000 7f2665d04640 1 --2- 172.21.15.59:0/2954937449 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f264406aec0 0x7f264406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.546+0000 7f61abfff640 1 -- 172.21.15.59:0/617451350 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f61bc029430 con 0x7f61c415d350 2023-10-16T14:26:13.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.546+0000 7ffa15471640 1 -- 172.21.15.59:0/3552741737 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa00030cf0 con 0x7ffa100b83b0 2023-10-16T14:26:13.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.547+0000 7f65467fc640 1 -- 172.21.15.59:0/258519956 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548022610 con 0x7f6550159dd0 2023-10-16T14:26:13.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.547+0000 7f2666505640 1 --2- 172.21.15.59:0/2954937449 >> [v2:172.21.15.151:6802/2616669147,v1:172.21.15.151:6803/2616669147] conn(0x7f2644074480 0x7f26440768c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.547+0000 7fad9b7fe640 1 --2- 172.21.15.59:0/2881914898 >> [v2:172.21.15.59:6808/991070902,v1:172.21.15.59:6809/991070902] conn(0x7fad7c0743b0 0x7fad7c0767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.547+0000 7ffa186d7640 1 -- 172.21.15.59:0/3552741737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa100b83b0 msgr2=0x7ffa100cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.547+0000 7f65467fc640 1 -- 172.21.15.59:0/258519956 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6548022770 con 0x7f6550159dd0 2023-10-16T14:26:13.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.547+0000 7ffa186d7640 1 --2- 172.21.15.59:0/3552741737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa100b83b0 0x7ffa100cd680 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffa000097d0 tx=0x7ffa0002b940 comp rx=0 tx=0).stop 2023-10-16T14:26:13.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.547+0000 7f2665d04640 1 --2- 172.21.15.59:0/2954937449 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f264406aec0 0x7f264406d380 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2654001f30 tx=0x7f2654001ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.547+0000 7f6556e9a640 1 -- 172.21.15.59:0/258519956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65501fa7c0 con 0x7f6550159dd0 2023-10-16T14:26:13.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.547+0000 7fad9affd640 1 --2- 172.21.15.59:0/2881914898 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fad7c06ae70 0x7fad7c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.547+0000 7f65467fc640 1 -- 172.21.15.59:0/258519956 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548022ae0 con 0x7f6550159dd0 2023-10-16T14:26:13.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.547+0000 7f6556e9a640 1 -- 172.21.15.59:0/258519956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6550158e70 con 0x7f6550159dd0 2023-10-16T14:26:13.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.548+0000 7ffa186d7640 1 -- 172.21.15.59:0/3552741737 shutdown_connections 2023-10-16T14:26:13.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.548+0000 7ffa186d7640 1 --2- 172.21.15.59:0/3552741737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa100b83b0 0x7ffa100cd680 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.548+0000 7ffa186d7640 1 -- 172.21.15.59:0/3552741737 >> 172.21.15.59:0/3552741737 conn(0x7ffa10071510 msgr2=0x7ffa10071920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:13.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.548+0000 7ffa186d7640 1 -- 172.21.15.59:0/3552741737 shutdown_connections 2023-10-16T14:26:13.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.548+0000 7ffa186d7640 1 -- 172.21.15.59:0/3552741737 wait complete. 2023-10-16T14:26:13.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.548+0000 7fad9b7fe640 1 --2- 172.21.15.59:0/2881914898 >> [v2:172.21.15.59:6808/991070902,v1:172.21.15.59:6809/991070902] conn(0x7fad7c0743b0 0x7fad7c0767f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.548+0000 7f6556e9a640 1 -- 172.21.15.59:0/258519956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f65500cd4b0 con 0x7f6550159dd0 2023-10-16T14:26:13.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.549+0000 7fad9affd640 1 --2- 172.21.15.59:0/2881914898 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fad7c06ae70 0x7fad7c06d330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fad9c0c89b0 tx=0x7fad84009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.550+0000 7fad93fff640 1 -- 172.21.15.59:0/2881914898 <== osd.3 v2:172.21.15.59:6808/991070902 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fad7c076ec0 con 0x7fad7c0743b0 2023-10-16T14:26:13.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.551+0000 7ffa186d7640 1 Processor -- start 2023-10-16T14:26:13.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.551+0000 7f265e7fc640 1 -- 172.21.15.59:0/2954937449 <== osd.5 v2:172.21.15.151:6802/2616669147 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f2644076f90 con 0x7f2644074480 2023-10-16T14:26:13.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.551+0000 7ffa186d7640 1 -- start start 2023-10-16T14:26:13.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.551+0000 7f61abfff640 1 --2- 172.21.15.59:0/617451350 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f61b006af40 0x7f61b006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.551+0000 7f61abfff640 1 -- 172.21.15.59:0/617451350 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f61bc092c70 con 0x7f61c415d350 2023-10-16T14:26:13.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.552+0000 7f61abfff640 1 --2- 172.21.15.59:0/617451350 >> [v2:172.21.15.151:6810/2667191375,v1:172.21.15.151:6811/2667191375] conn(0x7f61b0074580 0x7f61b00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.552+0000 7f61abfff640 1 -- 172.21.15.59:0/617451350 --> [v2:172.21.15.151:6810/2667191375,v1:172.21.15.151:6811/2667191375] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f61b0077090 con 0x7f61b0074580 2023-10-16T14:26:13.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.552+0000 7f61abfff640 1 -- 172.21.15.59:0/617451350 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61bc095290 con 0x7f61c415d350 2023-10-16T14:26:13.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.553+0000 7ffa186d7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa100b83b0 0x7ffa101f8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.554+0000 7f65467fc640 1 -- 172.21.15.59:0/258519956 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6548022c40 con 0x7f6550159dd0 2023-10-16T14:26:13.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.554+0000 7ffa186d7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa100cdbc0 0x7ffa100c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.554+0000 7ffa186d7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa1015c9f0 0x7ffa101fed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.554+0000 7f61c37fe640 1 --2- 172.21.15.59:0/617451350 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f61b006af40 0x7f61b006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.554+0000 7ffa16473640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa100b83b0 0x7ffa101f8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.554+0000 7ffa16c74640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa1015c9f0 0x7ffa101fed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.554+0000 7ffa15c72640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa100cdbc0 0x7ffa100c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.554+0000 7ffa16c74640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa1015c9f0 0x7ffa101fed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41854/0 (socket says 172.21.15.59:41854) 2023-10-16T14:26:13.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.554+0000 7ffa16c74640 1 -- 172.21.15.59:0/1229197631 learned_addr learned my addr 172.21.15.59:0/1229197631 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:13.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.554+0000 7ffa16473640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa100b83b0 0x7ffa101f8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.59:39338/0 (socket says 172.21.15.59:39338) 2023-10-16T14:26:13.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.554+0000 7ffa186d7640 1 -- 172.21.15.59:0/1229197631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa100b34f0 con 0x7ffa1015c9f0 2023-10-16T14:26:13.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.554+0000 7ffa186d7640 1 -- 172.21.15.59:0/1229197631 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa101f91e0 con 0x7ffa100cdbc0 2023-10-16T14:26:13.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.555+0000 7ffa186d7640 1 -- 172.21.15.59:0/1229197631 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa101ffc90 con 0x7ffa100b83b0 2023-10-16T14:26:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.555+0000 7f65467fc640 1 --2- 172.21.15.59:0/258519956 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f653406af70 0x7f653406d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.555+0000 7f65467fc640 1 -- 172.21.15.59:0/258519956 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f654809a750 con 0x7f6550159dd0 2023-10-16T14:26:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.556+0000 7f65467fc640 1 --2- 172.21.15.59:0/258519956 >> [v2:172.21.15.151:6826/2389221530,v1:172.21.15.151:6827/2389221530] conn(0x7f65340745b0 0x7f65340769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.556+0000 7f65467fc640 1 -- 172.21.15.59:0/258519956 --> [v2:172.21.15.151:6826/2389221530,v1:172.21.15.151:6827/2389221530] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f65340770c0 con 0x7f65340745b0 2023-10-16T14:26:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.556+0000 7f65467fc640 1 -- 172.21.15.59:0/258519956 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f654809ab00 con 0x7f6550159dd0 2023-10-16T14:26:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.556+0000 7ffa16c74640 1 -- 172.21.15.59:0/1229197631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa100b83b0 msgr2=0x7ffa101f8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.556+0000 7ffa16c74640 1 --2- 172.21.15.59:0/1229197631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa100b83b0 0x7ffa101f8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.556+0000 7ffa16c74640 1 -- 172.21.15.59:0/1229197631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa100cdbc0 msgr2=0x7ffa100c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.556+0000 7ffa16c74640 1 --2- 172.21.15.59:0/1229197631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa100cdbc0 0x7ffa100c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.556+0000 7ffa16c74640 1 -- 172.21.15.59:0/1229197631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa00009400 con 0x7ffa1015c9f0 2023-10-16T14:26:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.556+0000 7f61c2ffd640 1 --2- 172.21.15.59:0/617451350 >> [v2:172.21.15.151:6810/2667191375,v1:172.21.15.151:6811/2667191375] conn(0x7f61b0074580 0x7f61b00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.556+0000 7f61c37fe640 1 --2- 172.21.15.59:0/617451350 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f61b006af40 0x7f61b006d400 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f61b8006fd0 tx=0x7f61b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.556+0000 7f6555e98640 1 --2- 172.21.15.59:0/258519956 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f653406af70 0x7f653406d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.556+0000 7ffa15c72640 1 --2- 172.21.15.59:0/1229197631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa100cdbc0 0x7ffa100c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:26:13.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.556+0000 7ffa16473640 1 --2- 172.21.15.59:0/1229197631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa100b83b0 0x7ffa101f8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:26:13.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.556+0000 7f6555697640 1 --2- 172.21.15.59:0/258519956 >> [v2:172.21.15.151:6826/2389221530,v1:172.21.15.151:6827/2389221530] conn(0x7f65340745b0 0x7f65340769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.557+0000 7ffa16c74640 1 --2- 172.21.15.59:0/1229197631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa1015c9f0 0x7ffa101fed80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffa08001560 tx=0x7ffa0800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.557+0000 7ffa06ffd640 1 -- 172.21.15.59:0/1229197631 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa08003da0 con 0x7ffa1015c9f0 2023-10-16T14:26:13.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.557+0000 7ffa06ffd640 1 -- 172.21.15.59:0/1229197631 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa08005070 con 0x7ffa1015c9f0 2023-10-16T14:26:13.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.557+0000 7ffa06ffd640 1 -- 172.21.15.59:0/1229197631 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa08005420 con 0x7ffa1015c9f0 2023-10-16T14:26:13.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.557+0000 7f61c2ffd640 1 --2- 172.21.15.59:0/617451350 >> [v2:172.21.15.151:6810/2667191375,v1:172.21.15.151:6811/2667191375] conn(0x7f61b0074580 0x7f61b00769c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.558+0000 7f792d0d7640 1 -- 172.21.15.59:0/2011866708 --> [v2:172.21.15.59:6810/3082385432,v1:172.21.15.59:6812/3082385432] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7908002cb0 con 0x7f7914074540 2023-10-16T14:26:13.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.557+0000 7ffa186d7640 1 -- 172.21.15.59:0/1229197631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa101ff6d0 con 0x7ffa1015c9f0 2023-10-16T14:26:13.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.558+0000 7f6555697640 1 --2- 172.21.15.59:0/258519956 >> [v2:172.21.15.151:6826/2389221530,v1:172.21.15.151:6827/2389221530] conn(0x7f65340745b0 0x7f65340769f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.558+0000 7f28cbfff640 1 -- 172.21.15.59:0/259967393 --> [v2:172.21.15.59:6824/3017630955,v1:172.21.15.59:6825/3017630955] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f28cc0d1180 con 0x7f28b80743b0 2023-10-16T14:26:13.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.558+0000 7f790f7fe640 1 -- 172.21.15.59:0/2011866708 <== osd.2 v2:172.21.15.59:6810/3082385432 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7908002cb0 con 0x7f7914074540 2023-10-16T14:26:13.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.558+0000 7ffa186d7640 1 -- 172.21.15.59:0/1229197631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa100c7ff0 con 0x7ffa1015c9f0 2023-10-16T14:26:13.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.559+0000 7f28b3fff640 1 -- 172.21.15.59:0/259967393 <== osd.0 v2:172.21.15.59:6824/3017630955 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f28c40019d0 con 0x7f28b80743b0 2023-10-16T14:26:13.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.560+0000 7f28cbfff640 1 -- 172.21.15.59:0/259967393 >> [v2:172.21.15.59:6824/3017630955,v1:172.21.15.59:6825/3017630955] conn(0x7f28b80743b0 msgr2=0x7f28b80767f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.560+0000 7f28cbfff640 1 --2- 172.21.15.59:0/259967393 >> [v2:172.21.15.59:6824/3017630955,v1:172.21.15.59:6825/3017630955] conn(0x7f28b80743b0 0x7f28b80767f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.560+0000 7f61abfff640 1 -- 172.21.15.59:0/617451350 <== osd.6 v2:172.21.15.151:6810/2667191375 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f61b0077090 con 0x7f61b0074580 2023-10-16T14:26:13.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.560+0000 7f28cbfff640 1 -- 172.21.15.59:0/259967393 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f28b806ae70 msgr2=0x7f28b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.560+0000 7f28cbfff640 1 --2- 172.21.15.59:0/259967393 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f28b806ae70 0x7f28b806d330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0b8490 tx=0x7f28bc008040 comp rx=0 tx=0).stop 2023-10-16T14:26:13.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.560+0000 7f28cbfff640 1 -- 172.21.15.59:0/259967393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28cc0ce4d0 msgr2=0x7f28cc0c71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.560+0000 7f28cbfff640 1 --2- 172.21.15.59:0/259967393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28cc0ce4d0 0x7f28cc0c71a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f28c0000c00 tx=0x7f28c0004730 comp rx=0 tx=0).stop 2023-10-16T14:26:13.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.560+0000 7f28cb7fe640 1 -- 172.21.15.59:0/259967393 reap_dead start 2023-10-16T14:26:13.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.560+0000 7f28cbfff640 1 -- 172.21.15.59:0/259967393 shutdown_connections 2023-10-16T14:26:13.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.560+0000 7f28cbfff640 1 -- 172.21.15.59:0/259967393 >> 172.21.15.59:0/259967393 conn(0x7f28cc09bad0 msgr2=0x7f28cc0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:13.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.560+0000 7f792d0d7640 1 -- 172.21.15.59:0/2011866708 >> [v2:172.21.15.59:6810/3082385432,v1:172.21.15.59:6812/3082385432] conn(0x7f7914074540 msgr2=0x7f7914076980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.561+0000 7f792d0d7640 1 --2- 172.21.15.59:0/2011866708 >> [v2:172.21.15.59:6810/3082385432,v1:172.21.15.59:6812/3082385432] conn(0x7f7914074540 0x7f7914076980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.560+0000 7f6555e98640 1 --2- 172.21.15.59:0/258519956 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f653406af70 0x7f653406d430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6540034000 tx=0x7f6540009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.766 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.561+0000 7f792d0d7640 1 -- 172.21.15.59:0/2011866708 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f791406af00 msgr2=0x7f791406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.561+0000 7f792d0d7640 1 --2- 172.21.15.59:0/2011866708 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f791406af00 0x7f791406d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f79200085d0 tx=0x7f792806e030 comp rx=0 tx=0).stop 2023-10-16T14:26:13.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.561+0000 7f65467fc640 1 -- 172.21.15.59:0/258519956 <== osd.4 v2:172.21.15.151:6826/2389221530 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f65340770c0 con 0x7f65340745b0 2023-10-16T14:26:13.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.561+0000 7f792d0d7640 1 -- 172.21.15.59:0/2011866708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f792000aac0 msgr2=0x7f79200e5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.561+0000 7ffa186d7640 1 -- 172.21.15.59:0/1229197631 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffa100d0e50 con 0x7ffa1015c9f0 2023-10-16T14:26:13.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.561+0000 7ffa06ffd640 1 -- 172.21.15.59:0/1229197631 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffa08005580 con 0x7ffa1015c9f0 2023-10-16T14:26:13.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.562+0000 7ffa06ffd640 1 --2- 172.21.15.59:0/1229197631 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff9f406ae70 0x7ff9f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.562+0000 7ffa06ffd640 1 -- 172.21.15.59:0/1229197631 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffa08088e90 con 0x7ffa1015c9f0 2023-10-16T14:26:13.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.563+0000 7f792d0d7640 1 --2- 172.21.15.59:0/2011866708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f792000aac0 0x7f79200e5860 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f791c00c780 tx=0x7f791c00cc40 comp rx=0 tx=0).stop 2023-10-16T14:26:13.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.563+0000 7ffa06ffd640 1 --2- 172.21.15.59:0/1229197631 >> [v2:172.21.15.151:6818/2847259334,v1:172.21.15.151:6819/2847259334] conn(0x7ff9f40743b0 0x7ff9f40767f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:13.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.563+0000 7ffa06ffd640 1 -- 172.21.15.59:0/1229197631 --> [v2:172.21.15.151:6818/2847259334,v1:172.21.15.151:6819/2847259334] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff9f4076ec0 con 0x7ff9f40743b0 2023-10-16T14:26:13.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.563+0000 7ffa06ffd640 1 -- 172.21.15.59:0/1229197631 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa08005830 con 0x7ffa1015c9f0 2023-10-16T14:26:13.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.563+0000 7f792759e640 1 -- 172.21.15.59:0/2011866708 reap_dead start 2023-10-16T14:26:13.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.563+0000 7f792d0d7640 1 -- 172.21.15.59:0/2011866708 shutdown_connections 2023-10-16T14:26:13.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.563+0000 7f792d0d7640 1 -- 172.21.15.59:0/2011866708 >> 172.21.15.59:0/2011866708 conn(0x7f79200559c0 msgr2=0x7f7920037b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:13.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.563+0000 7f792d0d7640 1 -- 172.21.15.59:0/2011866708 shutdown_connections 2023-10-16T14:26:13.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.563+0000 7f28cbfff640 1 -- 172.21.15.59:0/259967393 shutdown_connections 2023-10-16T14:26:13.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.563+0000 7ffa15c72640 1 --2- 172.21.15.59:0/1229197631 >> [v2:172.21.15.151:6818/2847259334,v1:172.21.15.151:6819/2847259334] conn(0x7ff9f40743b0 0x7ff9f40767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.563+0000 7f28cbfff640 1 -- 172.21.15.59:0/259967393 wait complete. 2023-10-16T14:26:13.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.563+0000 7f792d0d7640 1 -- 172.21.15.59:0/2011866708 wait complete. 2023-10-16T14:26:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.564+0000 7ffa16473640 1 --2- 172.21.15.59:0/1229197631 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff9f406ae70 0x7ff9f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.564+0000 7ffa15c72640 1 --2- 172.21.15.59:0/1229197631 >> [v2:172.21.15.151:6818/2847259334,v1:172.21.15.151:6819/2847259334] conn(0x7ff9f40743b0 0x7ff9f40767f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.567+0000 7ffa06ffd640 1 -- 172.21.15.59:0/1229197631 <== osd.7 v2:172.21.15.151:6818/2847259334 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7ff9f4076ec0 con 0x7ff9f40743b0 2023-10-16T14:26:13.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.570+0000 7ffa16473640 1 --2- 172.21.15.59:0/1229197631 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff9f406ae70 0x7ff9f406d330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c005880 tx=0x7ffa0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:13.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.572+0000 7fe03775e640 1 -- 172.21.15.59:0/3662663849 --> [v2:172.21.15.59:6800/1115424190,v1:172.21.15.59:6801/1115424190] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe010002cb0 con 0x7fe01c074500 2023-10-16T14:26:13.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.575+0000 7fe02dffb640 1 -- 172.21.15.59:0/3662663849 <== osd.1 v2:172.21.15.59:6800/1115424190 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe010002cb0 con 0x7fe01c074500 2023-10-16T14:26:13.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.576+0000 7fe03775e640 1 -- 172.21.15.59:0/3662663849 >> [v2:172.21.15.59:6800/1115424190,v1:172.21.15.59:6801/1115424190] conn(0x7fe01c074500 msgr2=0x7fe01c076940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.576+0000 7fe03775e640 1 --2- 172.21.15.59:0/3662663849 >> [v2:172.21.15.59:6800/1115424190,v1:172.21.15.59:6801/1115424190] conn(0x7fe01c074500 0x7fe01c076940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.576+0000 7fe03775e640 1 -- 172.21.15.59:0/3662663849 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe01c06aec0 msgr2=0x7fe01c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.576+0000 7fe03775e640 1 --2- 172.21.15.59:0/3662663849 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe01c06aec0 0x7fe01c06d380 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe020009c00 tx=0x7fe020009190 comp rx=0 tx=0).stop 2023-10-16T14:26:13.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.576+0000 7fe03775e640 1 -- 172.21.15.59:0/3662663849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0300cc990 msgr2=0x7fe03014ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.576+0000 7fe03775e640 1 --2- 172.21.15.59:0/3662663849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0300cc990 0x7fe03014ecd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe02800cad0 tx=0x7fe02800cf90 comp rx=0 tx=0).stop 2023-10-16T14:26:13.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.577+0000 7fe035cfb640 1 -- 172.21.15.59:0/3662663849 reap_dead start 2023-10-16T14:26:13.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.577+0000 7fe03775e640 1 -- 172.21.15.59:0/3662663849 shutdown_connections 2023-10-16T14:26:13.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.577+0000 7fe03775e640 1 -- 172.21.15.59:0/3662663849 >> 172.21.15.59:0/3662663849 conn(0x7fe0300ce7d0 msgr2=0x7fe0300ab7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:13.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.577+0000 7fe03775e640 1 -- 172.21.15.59:0/3662663849 shutdown_connections 2023-10-16T14:26:13.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.577+0000 7fe03775e640 1 -- 172.21.15.59:0/3662663849 wait complete. 2023-10-16T14:26:13.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.586+0000 7f2667f68640 1 -- 172.21.15.59:0/2954937449 --> [v2:172.21.15.151:6802/2616669147,v1:172.21.15.151:6803/2616669147] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2660073ef0 con 0x7f2644074480 2023-10-16T14:26:13.780 INFO:teuthology.orchestra.run.smithi059.stdout:68719476746 2023-10-16T14:26:13.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.586+0000 7fad917fa640 1 -- 172.21.15.59:0/2881914898 --> [v2:172.21.15.59:6808/991070902,v1:172.21.15.59:6809/991070902] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fad9c06d400 con 0x7fad7c0743b0 2023-10-16T14:26:13.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.587+0000 7fad93fff640 1 -- 172.21.15.59:0/2881914898 <== osd.3 v2:172.21.15.59:6808/991070902 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fad7c076ec0 con 0x7fad7c0743b0 2023-10-16T14:26:13.781 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-16T14:26:13.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.588+0000 7f265e7fc640 1 -- 172.21.15.59:0/2954937449 <== osd.5 v2:172.21.15.151:6802/2616669147 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2660073ef0 con 0x7f2644074480 2023-10-16T14:26:13.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.588+0000 7fad917fa640 1 -- 172.21.15.59:0/2881914898 >> [v2:172.21.15.59:6808/991070902,v1:172.21.15.59:6809/991070902] conn(0x7fad7c0743b0 msgr2=0x7fad7c0767f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.588+0000 7fad917fa640 1 --2- 172.21.15.59:0/2881914898 >> [v2:172.21.15.59:6808/991070902,v1:172.21.15.59:6809/991070902] conn(0x7fad7c0743b0 0x7fad7c0767f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.588+0000 7fad917fa640 1 -- 172.21.15.59:0/2881914898 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fad7c06ae70 msgr2=0x7fad7c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.588+0000 7fad917fa640 1 --2- 172.21.15.59:0/2881914898 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fad7c06ae70 0x7fad7c06d330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fad9c0c89b0 tx=0x7fad84009060 comp rx=0 tx=0).stop 2023-10-16T14:26:13.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.588+0000 7fad917fa640 1 -- 172.21.15.59:0/2881914898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9c158b40 msgr2=0x7fad9c14f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.588+0000 7fad917fa640 1 --2- 172.21.15.59:0/2881914898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad9c158b40 0x7fad9c14f670 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00c850 tx=0x7fad8c00cd10 comp rx=0 tx=0).stop 2023-10-16T14:26:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.588+0000 7fad9b7fe640 1 -- 172.21.15.59:0/2881914898 reap_dead start 2023-10-16T14:26:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.589+0000 7fad917fa640 1 -- 172.21.15.59:0/2881914898 shutdown_connections 2023-10-16T14:26:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.589+0000 7fad917fa640 1 -- 172.21.15.59:0/2881914898 >> 172.21.15.59:0/2881914898 conn(0x7fad9c06a440 msgr2=0x7fad9c0ad950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:13.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.589+0000 7fad917fa640 1 -- 172.21.15.59:0/2881914898 shutdown_connections 2023-10-16T14:26:13.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.589+0000 7fad917fa640 1 -- 172.21.15.59:0/2881914898 wait complete. 2023-10-16T14:26:13.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.589+0000 7f2667f68640 1 -- 172.21.15.59:0/2954937449 >> [v2:172.21.15.151:6802/2616669147,v1:172.21.15.151:6803/2616669147] conn(0x7f2644074480 msgr2=0x7f26440768c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.589+0000 7f2667f68640 1 --2- 172.21.15.59:0/2954937449 >> [v2:172.21.15.151:6802/2616669147,v1:172.21.15.151:6803/2616669147] conn(0x7f2644074480 0x7f26440768c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.787 INFO:teuthology.orchestra.run.smithi059.stdout:68719476748 2023-10-16T14:26:13.787 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-16T14:26:13.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.589+0000 7f2667f68640 1 -- 172.21.15.59:0/2954937449 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f264406aec0 msgr2=0x7f264406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.589+0000 7f2667f68640 1 --2- 172.21.15.59:0/2954937449 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f264406aec0 0x7f264406d380 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2654001f30 tx=0x7f2654001ac0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.590+0000 7f2667f68640 1 -- 172.21.15.59:0/2954937449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26600cd960 msgr2=0x7f26601fed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.590+0000 7f2667f68640 1 --2- 172.21.15.59:0/2954937449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26600cd960 0x7f26601fed40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f264c00d520 tx=0x7f264c00d9e0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.590+0000 7f2666505640 1 -- 172.21.15.59:0/2954937449 reap_dead start 2023-10-16T14:26:13.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.590+0000 7f2667f68640 1 -- 172.21.15.59:0/2954937449 shutdown_connections 2023-10-16T14:26:13.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.590+0000 7f2667f68640 1 -- 172.21.15.59:0/2954937449 >> 172.21.15.59:0/2954937449 conn(0x7f2660099ad0 msgr2=0x7f266006f470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:13.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.591+0000 7f2667f68640 1 -- 172.21.15.59:0/2954937449 shutdown_connections 2023-10-16T14:26:13.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.591+0000 7f2667f68640 1 -- 172.21.15.59:0/2954937449 wait complete. 2023-10-16T14:26:13.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.591+0000 7f61c9b25640 1 -- 172.21.15.59:0/617451350 --> [v2:172.21.15.151:6810/2667191375,v1:172.21.15.151:6811/2667191375] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f61a4002cb0 con 0x7f61b0074580 2023-10-16T14:26:13.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.593+0000 7f61abfff640 1 -- 172.21.15.59:0/617451350 <== osd.6 v2:172.21.15.151:6810/2667191375 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f61a4002cb0 con 0x7f61b0074580 2023-10-16T14:26:13.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.593+0000 7f61c9b25640 1 -- 172.21.15.59:0/617451350 >> [v2:172.21.15.151:6810/2667191375,v1:172.21.15.151:6811/2667191375] conn(0x7f61b0074580 msgr2=0x7f61b00769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.593+0000 7f61c9b25640 1 --2- 172.21.15.59:0/617451350 >> [v2:172.21.15.151:6810/2667191375,v1:172.21.15.151:6811/2667191375] conn(0x7f61b0074580 0x7f61b00769c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.595+0000 7f61c9b25640 1 -- 172.21.15.59:0/617451350 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f61b006af40 msgr2=0x7f61b006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.595+0000 7f61c9b25640 1 --2- 172.21.15.59:0/617451350 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f61b006af40 0x7f61b006d400 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f61b8006fd0 tx=0x7f61b8008040 comp rx=0 tx=0).stop 2023-10-16T14:26:13.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.595+0000 7f61c9b25640 1 -- 172.21.15.59:0/617451350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61c415d350 msgr2=0x7f61c40cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.595+0000 7f61c9b25640 1 --2- 172.21.15.59:0/617451350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61c415d350 0x7f61c40cce70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f61bc016e70 tx=0x7f61bc00bb10 comp rx=0 tx=0).stop 2023-10-16T14:26:13.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.595+0000 7f61c3fff640 1 -- 172.21.15.59:0/617451350 reap_dead start 2023-10-16T14:26:13.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.595+0000 7f61c9b25640 1 -- 172.21.15.59:0/617451350 shutdown_connections 2023-10-16T14:26:13.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.595+0000 7f61c9b25640 1 -- 172.21.15.59:0/617451350 >> 172.21.15.59:0/617451350 conn(0x7f61c40cb1b0 msgr2=0x7f61c4070230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:13.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.596+0000 7f61c9b25640 1 -- 172.21.15.59:0/617451350 shutdown_connections 2023-10-16T14:26:13.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.596+0000 7f61c9b25640 1 -- 172.21.15.59:0/617451350 wait complete. 2023-10-16T14:26:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.597+0000 7ffa186d7640 1 -- 172.21.15.59:0/1229197631 --> [v2:172.21.15.151:6818/2847259334,v1:172.21.15.151:6819/2847259334] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffa100d0b70 con 0x7ff9f40743b0 2023-10-16T14:26:13.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.598+0000 7ffa06ffd640 1 -- 172.21.15.59:0/1229197631 <== osd.7 v2:172.21.15.151:6818/2847259334 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffa00039550 con 0x7ff9f40743b0 2023-10-16T14:26:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.599+0000 7ffa186d7640 1 -- 172.21.15.59:0/1229197631 >> [v2:172.21.15.151:6818/2847259334,v1:172.21.15.151:6819/2847259334] conn(0x7ff9f40743b0 msgr2=0x7ff9f40767f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.599+0000 7ffa186d7640 1 --2- 172.21.15.59:0/1229197631 >> [v2:172.21.15.151:6818/2847259334,v1:172.21.15.151:6819/2847259334] conn(0x7ff9f40743b0 0x7ff9f40767f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.599+0000 7ffa186d7640 1 -- 172.21.15.59:0/1229197631 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff9f406ae70 msgr2=0x7ff9f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.599+0000 7f6556e9a640 1 -- 172.21.15.59:0/258519956 --> [v2:172.21.15.151:6826/2389221530,v1:172.21.15.151:6827/2389221530] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f65500cd1d0 con 0x7f65340745b0 2023-10-16T14:26:13.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.599+0000 7ffa186d7640 1 --2- 172.21.15.59:0/1229197631 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff9f406ae70 0x7ff9f406d330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c005880 tx=0x7ffa0c009040 comp rx=0 tx=0).stop 2023-10-16T14:26:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.599+0000 7ffa186d7640 1 -- 172.21.15.59:0/1229197631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa1015c9f0 msgr2=0x7ffa101fed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.599+0000 7ffa186d7640 1 --2- 172.21.15.59:0/1229197631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa1015c9f0 0x7ffa101fed80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffa08001560 tx=0x7ffa0800cc70 comp rx=0 tx=0).stop 2023-10-16T14:26:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.599+0000 7ffa16c74640 1 -- 172.21.15.59:0/1229197631 reap_dead start 2023-10-16T14:26:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.599+0000 7ffa186d7640 1 -- 172.21.15.59:0/1229197631 shutdown_connections 2023-10-16T14:26:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.599+0000 7ffa186d7640 1 -- 172.21.15.59:0/1229197631 >> 172.21.15.59:0/1229197631 conn(0x7ffa10071510 msgr2=0x7ffa101591f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:13.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.600+0000 7ffa186d7640 1 -- 172.21.15.59:0/1229197631 shutdown_connections 2023-10-16T14:26:13.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.600+0000 7ffa186d7640 1 -- 172.21.15.59:0/1229197631 wait complete. 2023-10-16T14:26:13.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.600+0000 7f65467fc640 1 -- 172.21.15.59:0/258519956 <== osd.4 v2:172.21.15.151:6826/2389221530 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f654c007930 con 0x7f65340745b0 2023-10-16T14:26:13.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.601+0000 7f6556e9a640 1 -- 172.21.15.59:0/258519956 >> [v2:172.21.15.151:6826/2389221530,v1:172.21.15.151:6827/2389221530] conn(0x7f65340745b0 msgr2=0x7f65340769f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.601+0000 7f6556e9a640 1 --2- 172.21.15.59:0/258519956 >> [v2:172.21.15.151:6826/2389221530,v1:172.21.15.151:6827/2389221530] conn(0x7f65340745b0 0x7f65340769f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:13.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.601+0000 7f6556e9a640 1 -- 172.21.15.59:0/258519956 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f653406af70 msgr2=0x7f653406d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.601+0000 7f6556e9a640 1 --2- 172.21.15.59:0/258519956 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f653406af70 0x7f653406d430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6540034000 tx=0x7f6540009030 comp rx=0 tx=0).stop 2023-10-16T14:26:13.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.601+0000 7f6556e9a640 1 -- 172.21.15.59:0/258519956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6550159dd0 msgr2=0x7f65500ae9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:13.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.601+0000 7f6556e9a640 1 --2- 172.21.15.59:0/258519956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6550159dd0 0x7f65500ae9d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f655006e4c0 tx=0x7f654800a870 comp rx=0 tx=0).stop 2023-10-16T14:26:13.800 INFO:teuthology.orchestra.run.smithi059.stdout:68719476747 2023-10-16T14:26:13.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.601+0000 7f6556699640 1 -- 172.21.15.59:0/258519956 reap_dead start 2023-10-16T14:26:13.802 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-16T14:26:13.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.601+0000 7f6556e9a640 1 -- 172.21.15.59:0/258519956 shutdown_connections 2023-10-16T14:26:13.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.601+0000 7f6556e9a640 1 -- 172.21.15.59:0/258519956 >> 172.21.15.59:0/258519956 conn(0x7f65500cb420 msgr2=0x7f65500afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:13.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.602+0000 7f6556e9a640 1 -- 172.21.15.59:0/258519956 shutdown_connections 2023-10-16T14:26:13.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:13.602+0000 7f6556e9a640 1 -- 172.21.15.59:0/258519956 wait complete. 2023-10-16T14:26:13.804 INFO:teuthology.orchestra.run.smithi059.stdout:68719476746 2023-10-16T14:26:13.804 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-16T14:26:13.805 INFO:teuthology.orchestra.run.smithi059.stdout:60129542153 2023-10-16T14:26:13.805 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-16T14:26:13.806 INFO:teuthology.orchestra.run.smithi059.stdout:64424509451 2023-10-16T14:26:13.807 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-16T14:26:13.808 INFO:teuthology.orchestra.run.smithi059.stdout:64424509449 2023-10-16T14:26:13.808 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-16T14:26:13.809 INFO:teuthology.orchestra.run.smithi059.stdout:64424509449 2023-10-16T14:26:13.809 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-16T14:26:14.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.157+0000 7f67e1e0d640 1 Processor -- start 2023-10-16T14:26:14.162 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.157+0000 7f67e1e0d640 1 -- start start 2023-10-16T14:26:14.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.160+0000 7ffac470c640 1 Processor -- start 2023-10-16T14:26:14.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.159+0000 7f67e1e0d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67dc0d3300 0x7f67dc161290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.159+0000 7f67e1e0d640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67dc0ce260 con 0x7f67dc0d09e0 2023-10-16T14:26:14.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.159+0000 7f67e1e0d640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67dc0cdf30 con 0x7f67dc0c5e10 2023-10-16T14:26:14.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.159+0000 7f67e1e0d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc0d1440 con 0x7f67dc0d3300 2023-10-16T14:26:14.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.159+0000 7f67e0e0b640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f67dc0d09e0 0x7f67dc160b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45676/0 (socket says 172.21.15.59:45676) 2023-10-16T14:26:14.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.159+0000 7f67e0e0b640 1 -- 172.21.15.59:0/2022267094 learned_addr learned my addr 172.21.15.59:0/2022267094 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:14.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.160+0000 7f67e160c640 1 --2- 172.21.15.59:0/2022267094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67dc0d3300 0x7f67dc161290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.160+0000 7ffac470c640 1 -- start start 2023-10-16T14:26:14.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.161+0000 7f67db7fe640 1 -- 172.21.15.59:0/2022267094 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3343887319 0 0) 0x7f67dc0ce260 con 0x7f67dc0d09e0 2023-10-16T14:26:14.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.161+0000 7f67db7fe640 1 -- 172.21.15.59:0/2022267094 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67c4003520 con 0x7f67dc0d09e0 2023-10-16T14:26:14.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.161+0000 7f67db7fe640 1 -- 172.21.15.59:0/2022267094 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1627798541 0 0) 0x7f67c4003520 con 0x7f67dc0d09e0 2023-10-16T14:26:14.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.161+0000 7f67e160c640 1 -- 172.21.15.59:0/2022267094 >> v1:172.21.15.151:6789/0 conn(0x7f67dc0c5e10 legacy=0x7f67dc06af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.161+0000 7f67e160c640 1 -- 172.21.15.59:0/2022267094 >> v1:172.21.15.59:6789/0 conn(0x7f67dc0d09e0 legacy=0x7f67dc160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.161+0000 7f67e160c640 1 -- 172.21.15.59:0/2022267094 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc0d1720 con 0x7f67dc0d3300 2023-10-16T14:26:14.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.162+0000 7ffac470c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4006b70 0x7ffab4053c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.162+0000 7ffac470c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ffab4054190 0x7ffab4057720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.162+0000 7ffac470c640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab403c070 con 0x7ffab40e3070 2023-10-16T14:26:14.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.162+0000 7ffac470c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab4054620 con 0x7ffab4054190 2023-10-16T14:26:14.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.162+0000 7ffac470c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab40070f0 con 0x7ffab4006b70 2023-10-16T14:26:14.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.163+0000 7ffac24a8640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffab40e3070 0x7ffab403ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45686/0 (socket says 172.21.15.59:45686) 2023-10-16T14:26:14.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.163+0000 7ffac24a8640 1 -- 172.21.15.59:0/700811391 learned_addr learned my addr 172.21.15.59:0/700811391 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:14.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.163+0000 7ffac1ca7640 1 --2- 172.21.15.59:0/700811391 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4006b70 0x7ffab4053c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.163+0000 7ffac2ca9640 1 --2- 172.21.15.59:0/700811391 >> v2:172.21.15.151:3300/0 conn(0x7ffab4054190 0x7ffab4057720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.163+0000 7f67e160c640 1 --2- 172.21.15.59:0/2022267094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67dc0d3300 0x7f67dc161290 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009dc0 tx=0x7f67d402bd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25d4fbd76c70bce6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.164+0000 7ffac2ca9640 1 -- 172.21.15.59:0/700811391 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4006b70 msgr2=0x7ffab4053c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:14.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.164+0000 7ffac2ca9640 1 --2- 172.21.15.59:0/700811391 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4006b70 0x7ffab4053c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.164+0000 7ffac2ca9640 1 -- 172.21.15.59:0/700811391 >> v1:172.21.15.59:6789/0 conn(0x7ffab40e3070 legacy=0x7ffab403ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.164+0000 7ffac2ca9640 1 -- 172.21.15.59:0/700811391 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab40073b0 con 0x7ffab4054190 2023-10-16T14:26:14.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.165+0000 7f67db7fe640 1 -- 172.21.15.59:0/2022267094 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d0001670 con 0x7f67dc0d3300 2023-10-16T14:26:14.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.165+0000 7f67db7fe640 1 -- 172.21.15.59:0/2022267094 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d402c880 con 0x7f67dc0d3300 2023-10-16T14:26:14.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.165+0000 7f67db7fe640 1 -- 172.21.15.59:0/2022267094 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d402cc10 con 0x7f67dc0d3300 2023-10-16T14:26:14.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.166+0000 7f67e1e0d640 1 -- 172.21.15.59:0/2022267094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67dc0d3300 msgr2=0x7f67dc161290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.166+0000 7f67e1e0d640 1 --2- 172.21.15.59:0/2022267094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67dc0d3300 0x7f67dc161290 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009dc0 tx=0x7f67d402bd50 comp rx=0 tx=0).stop 2023-10-16T14:26:14.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.166+0000 7f67e1e0d640 1 -- 172.21.15.59:0/2022267094 shutdown_connections 2023-10-16T14:26:14.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.166+0000 7f67e1e0d640 1 --2- 172.21.15.59:0/2022267094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67dc0d3300 0x7f67dc161290 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.166+0000 7f67e1e0d640 1 -- 172.21.15.59:0/2022267094 >> 172.21.15.59:0/2022267094 conn(0x7f67dc0d27e0 msgr2=0x7f67dc0d2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:14.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.166+0000 7f67e1e0d640 1 -- 172.21.15.59:0/2022267094 shutdown_connections 2023-10-16T14:26:14.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.166+0000 7f67e1e0d640 1 -- 172.21.15.59:0/2022267094 wait complete. 2023-10-16T14:26:14.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.166+0000 7ffac2ca9640 1 --2- 172.21.15.59:0/700811391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab4054190 0x7ffab4057720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffabc04f940 tx=0x7ffabc0a5760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30fac4dc7b3a72c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.167+0000 7ffac14a6640 1 -- 172.21.15.59:0/700811391 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0ac600 con 0x7ffab4054190 2023-10-16T14:26:14.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.167+0000 7ffac14a6640 1 -- 172.21.15.59:0/700811391 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc0a8050 con 0x7ffab4054190 2023-10-16T14:26:14.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.167+0000 7ffac14a6640 1 -- 172.21.15.59:0/700811391 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0aca20 con 0x7ffab4054190 2023-10-16T14:26:14.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.168+0000 7ffac470c640 1 -- 172.21.15.59:0/700811391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab4054190 msgr2=0x7ffab4057720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.168+0000 7ffac470c640 1 --2- 172.21.15.59:0/700811391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab4054190 0x7ffab4057720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffabc04f940 tx=0x7ffabc0a5760 comp rx=0 tx=0).stop 2023-10-16T14:26:14.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.169+0000 7ffac470c640 1 -- 172.21.15.59:0/700811391 shutdown_connections 2023-10-16T14:26:14.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.170+0000 7f67e1e0d640 1 Processor -- start 2023-10-16T14:26:14.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.170+0000 7f6b0360e640 1 Processor -- start 2023-10-16T14:26:14.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.169+0000 7ffac470c640 1 --2- 172.21.15.59:0/700811391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab4054190 0x7ffab4057720 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.169+0000 7ffac470c640 1 --2- 172.21.15.59:0/700811391 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4006b70 0x7ffab4053c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.169+0000 7ffac470c640 1 -- 172.21.15.59:0/700811391 >> 172.21.15.59:0/700811391 conn(0x7ffab4055a90 msgr2=0x7ffab4055e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:14.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.170+0000 7f67e1e0d640 1 -- start start 2023-10-16T14:26:14.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.170+0000 7f6b0360e640 1 -- start start 2023-10-16T14:26:14.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.171+0000 7ffac470c640 1 -- 172.21.15.59:0/700811391 shutdown_connections 2023-10-16T14:26:14.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.171+0000 7ffac470c640 1 -- 172.21.15.59:0/700811391 wait complete. 2023-10-16T14:26:14.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.172+0000 7f67e1e0d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67dc0c5e10 0x7f67dc155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.172+0000 7f67e1e0d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67dc0d09e0 0x7f67dc15b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.173+0000 7f6b0360e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6afc161010 0x7f6afc0c3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.172+0000 7f67e1e0d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67dc0d3300 0x7f67dc0c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.173+0000 7f6b0360e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6afc070960 0x7f6afc0c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.174+0000 7ffac470c640 1 Processor -- start 2023-10-16T14:26:14.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.173+0000 7f67e1e0d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc0c9a70 con 0x7f67dc0d3300 2023-10-16T14:26:14.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.173+0000 7f67e1e0d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc156360 con 0x7f67dc0d09e0 2023-10-16T14:26:14.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.173+0000 7f67e1e0d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc15ca80 con 0x7f67dc0c5e10 2023-10-16T14:26:14.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.173+0000 7f67e160c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67dc0d3300 0x7f67dc0c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.173+0000 7f67dbfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67dc0d09e0 0x7f67dc15b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.173+0000 7f67dbfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67dc0d09e0 0x7f67dc15b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.59:58860/0 (socket says 172.21.15.59:58860) 2023-10-16T14:26:14.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.173+0000 7f67dbfff640 1 -- 172.21.15.59:0/1272709652 learned_addr learned my addr 172.21.15.59:0/1272709652 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:14.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.174+0000 7f67e0e0b640 1 --2- 172.21.15.59:0/1272709652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67dc0c5e10 0x7f67dc155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.175+0000 7f02c4444640 1 Processor -- start 2023-10-16T14:26:14.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.174+0000 7f6b0360e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6afc0704d0 con 0x7f6afc0b21d0 2023-10-16T14:26:14.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.174+0000 7f6b0360e640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6afc06cef0 con 0x7f6afc161010 2023-10-16T14:26:14.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.174+0000 7f6b0360e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6afc0ce0c0 con 0x7f6afc070960 2023-10-16T14:26:14.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.174+0000 7f6b01bab640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6afc0b21d0 0x7f6afc0b25e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45696/0 (socket says 172.21.15.59:45696) 2023-10-16T14:26:14.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.174+0000 7f6b01bab640 1 -- 172.21.15.59:0/4236132950 learned_addr learned my addr 172.21.15.59:0/4236132950 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:14.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.175+0000 7f02c4444640 1 -- start start 2023-10-16T14:26:14.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.175+0000 7f6b013aa640 1 --2- 172.21.15.59:0/4236132950 >> v2:172.21.15.59:3300/0 conn(0x7f6afc161010 0x7f6afc0c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.175+0000 7f67e160c640 1 -- 172.21.15.59:0/1272709652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67dc0c5e10 msgr2=0x7f67dc155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.175+0000 7f67e160c640 1 --2- 172.21.15.59:0/1272709652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67dc0c5e10 0x7f67dc155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.175+0000 7f67e160c640 1 -- 172.21.15.59:0/1272709652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67dc0d09e0 msgr2=0x7f67dc15b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.175+0000 7f67e160c640 1 --2- 172.21.15.59:0/1272709652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67dc0d09e0 0x7f67dc15b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.175+0000 7f67e160c640 1 -- 172.21.15.59:0/1272709652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d4009a70 con 0x7f67dc0d3300 2023-10-16T14:26:14.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.176+0000 7f6b00ba9640 1 --2- 172.21.15.59:0/4236132950 >> v2:172.21.15.151:3300/0 conn(0x7f6afc070960 0x7f6afc0c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.177+0000 7f6b00ba9640 1 -- 172.21.15.59:0/4236132950 >> v2:172.21.15.59:3300/0 conn(0x7f6afc161010 msgr2=0x7f6afc0c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.177+0000 7f02c4444640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02bc06a8f0 0x7f02bc0ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.177+0000 7f02c4444640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f02bc1588d0 0x7f02bc06c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.177+0000 7f02c4444640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02bc158d30 0x7f02bc06c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.177+0000 7f02c4444640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02bc06d6e0 con 0x7f02bc158d30 2023-10-16T14:26:14.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.177+0000 7f02c4444640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02bc0c8fb0 con 0x7f02bc1588d0 2023-10-16T14:26:14.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.177+0000 7f02c4444640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc06d120 con 0x7f02bc06a8f0 2023-10-16T14:26:14.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.178+0000 7f02c29e1640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02bc158d30 0x7f02bc06c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.178+0000 7f02c19df640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f02bc1588d0 0x7f02bc06c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.178+0000 7f02c29e1640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02bc158d30 0x7f02bc06c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41872/0 (socket says 172.21.15.59:41872) 2023-10-16T14:26:14.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.178+0000 7f02c29e1640 1 -- 172.21.15.59:0/3700738720 learned_addr learned my addr 172.21.15.59:0/3700738720 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:14.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.174+0000 7ffac470c640 1 -- start start 2023-10-16T14:26:14.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.176+0000 7ffac470c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4006b70 0x7ffab4039480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.176+0000 7ffac470c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab4054190 0x7ffab40da170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.176+0000 7ffac470c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab40e3070 0x7ffab404e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.176+0000 7ffac470c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab403a800 con 0x7ffab40e3070 2023-10-16T14:26:14.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.176+0000 7ffac470c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab4039b80 con 0x7ffab4054190 2023-10-16T14:26:14.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.176+0000 7ffac470c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab4039e60 con 0x7ffab4006b70 2023-10-16T14:26:14.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.176+0000 7ffac24a8640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4006b70 0x7ffab4039480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.176+0000 7ffac24a8640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4006b70 0x7ffab4039480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.59:39368/0 (socket says 172.21.15.59:39368) 2023-10-16T14:26:14.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.176+0000 7ffac24a8640 1 -- 172.21.15.59:0/678669046 learned_addr learned my addr 172.21.15.59:0/678669046 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:14.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.177+0000 7ffac2ca9640 1 --2- 172.21.15.59:0/678669046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab40e3070 0x7ffab404e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.177+0000 7ffac24a8640 1 -- 172.21.15.59:0/678669046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab4054190 msgr2=0x7ffab40da170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.177+0000 7ffac24a8640 1 --2- 172.21.15.59:0/678669046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab4054190 0x7ffab40da170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.177+0000 7ffac24a8640 1 -- 172.21.15.59:0/678669046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab40e3070 msgr2=0x7ffab404e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.177+0000 7ffac24a8640 1 --2- 172.21.15.59:0/678669046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab40e3070 0x7ffab404e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.177+0000 7ffac24a8640 1 -- 172.21.15.59:0/678669046 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab403a140 con 0x7ffab4006b70 2023-10-16T14:26:14.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.178+0000 7ffac2ca9640 1 --2- 172.21.15.59:0/678669046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab40e3070 0x7ffab404e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:14.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.178+0000 7ffac24a8640 1 --2- 172.21.15.59:0/678669046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4006b70 0x7ffab4039480 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00c4a0 tx=0x7ffaac00c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.176+0000 7f67e160c640 1 --2- 172.21.15.59:0/1272709652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67dc0d3300 0x7f67dc0c7ce0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f67d4033000 tx=0x7f67d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.177+0000 7f67d97fa640 1 -- 172.21.15.59:0/1272709652 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d402ce90 con 0x7f67dc0d3300 2023-10-16T14:26:14.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.177+0000 7f67d97fa640 1 -- 172.21.15.59:0/1272709652 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d4034c80 con 0x7f67dc0d3300 2023-10-16T14:26:14.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.177+0000 7f67d97fa640 1 -- 172.21.15.59:0/1272709652 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d403f420 con 0x7f67dc0d3300 2023-10-16T14:26:14.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.178+0000 7f67e1e0d640 1 -- 172.21.15.59:0/1272709652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67dc0ce9f0 con 0x7f67dc0d3300 2023-10-16T14:26:14.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.178+0000 7f67e1e0d640 1 -- 172.21.15.59:0/1272709652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67dc15c4c0 con 0x7f67dc0d3300 2023-10-16T14:26:14.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.178+0000 7f19b26d7640 1 Processor -- start 2023-10-16T14:26:14.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.178+0000 7f19b26d7640 1 -- start start 2023-10-16T14:26:14.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.177+0000 7f6b00ba9640 1 --2- 172.21.15.59:0/4236132950 >> v2:172.21.15.59:3300/0 conn(0x7f6afc161010 0x7f6afc0c3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.177+0000 7f6b00ba9640 1 -- 172.21.15.59:0/4236132950 >> v1:172.21.15.59:6789/0 conn(0x7f6afc0b21d0 legacy=0x7f6afc0b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.177+0000 7f6b00ba9640 1 -- 172.21.15.59:0/4236132950 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc06cc10 con 0x7f6afc070960 2023-10-16T14:26:14.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.178+0000 7ffab2ffd640 1 -- 172.21.15.59:0/678669046 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac005ce0 con 0x7ffab4006b70 2023-10-16T14:26:14.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.179+0000 7f02c29e1640 1 -- 172.21.15.59:0/3700738720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02bc06a8f0 msgr2=0x7f02bc0ccbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-16T14:26:14.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.179+0000 7ffab2ffd640 1 -- 172.21.15.59:0/678669046 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac005e40 con 0x7ffab4006b70 2023-10-16T14:26:14.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.179+0000 7ffab2ffd640 1 -- 172.21.15.59:0/678669046 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac007270 con 0x7ffab4006b70 2023-10-16T14:26:14.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.179+0000 7f6b013aa640 1 --2- 172.21.15.59:0/4236132950 >> v2:172.21.15.59:3300/0 conn(0x7f6afc161010 0x7f6afc0c3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:26:14.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.179+0000 7f02c29e1640 1 --2- 172.21.15.59:0/3700738720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02bc06a8f0 0x7f02bc0ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.179+0000 7f02c29e1640 1 -- 172.21.15.59:0/3700738720 >> v2:172.21.15.151:3300/0 conn(0x7f02bc1588d0 msgr2=0x7f02bc06c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:14.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.179+0000 7f02c29e1640 1 --2- 172.21.15.59:0/3700738720 >> v2:172.21.15.151:3300/0 conn(0x7f02bc1588d0 0x7f02bc06c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.179+0000 7f6b00ba9640 1 --2- 172.21.15.59:0/4236132950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6afc070960 0x7f6afc0c3bb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0ce560 tx=0x7f6aec02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=796f0ef6eec47d34 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.180+0000 7f19b26d7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19ac15c9f0 0x7f19ac160680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.180+0000 7f6af3fff640 1 -- 172.21.15.59:0/4236132950 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec030860 con 0x7f6afc070960 2023-10-16T14:26:14.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.180+0000 7f02c29e1640 1 -- 172.21.15.59:0/3700738720 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc06d400 con 0x7f02bc158d30 2023-10-16T14:26:14.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.180+0000 7f02c19df640 1 --2- 172.21.15.59:0/3700738720 >> v2:172.21.15.151:3300/0 conn(0x7f02bc1588d0 0x7f02bc06c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:26:14.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.181+0000 7f6af3fff640 1 -- 172.21.15.59:0/4236132950 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aec0309c0 con 0x7f6afc070960 2023-10-16T14:26:14.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.181+0000 7f6af3fff640 1 -- 172.21.15.59:0/4236132950 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec030d90 con 0x7f6afc070960 2023-10-16T14:26:14.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.180+0000 7ffac470c640 1 -- 172.21.15.59:0/678669046 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab403a420 con 0x7ffab4006b70 2023-10-16T14:26:14.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.181+0000 7ffac470c640 1 -- 172.21.15.59:0/678669046 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab404e8a0 con 0x7ffab4006b70 2023-10-16T14:26:14.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.181+0000 7f67e1e0d640 1 -- 172.21.15.59:0/1272709652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67dc0c9be0 con 0x7f67dc0d3300 2023-10-16T14:26:14.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.181+0000 7f19abfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19ac15c9f0 0x7f19ac160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.182+0000 7f19abfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19ac15c9f0 0x7f19ac160680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.59:39390/0 (socket says 172.21.15.59:39390) 2023-10-16T14:26:14.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.182+0000 7f19ab7fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f19ac0b83b0 0x7f19ac0cd680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45704/0 (socket says 172.21.15.59:45704) 2023-10-16T14:26:14.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.182+0000 7f19abfff640 1 -- 172.21.15.59:0/1770828723 learned_addr learned my addr 172.21.15.59:0/1770828723 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:14.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.182+0000 7f6b0360e640 1 -- 172.21.15.59:0/4236132950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6afc070960 msgr2=0x7f6afc0c3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.182+0000 7f6b0360e640 1 --2- 172.21.15.59:0/4236132950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6afc070960 0x7f6afc0c3bb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0ce560 tx=0x7f6aec02b9a0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.182+0000 7f19b26d7640 1 --2- 172.21.15.59:0/1770828723 >> v2:172.21.15.151:3300/0 conn(0x7f19ac0cdd90 0x7f19ac0d1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.182+0000 7f6b0360e640 1 -- 172.21.15.59:0/4236132950 shutdown_connections 2023-10-16T14:26:14.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.182+0000 7f6b0360e640 1 --2- 172.21.15.59:0/4236132950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6afc070960 0x7f6afc0c3bb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.182+0000 7f6b0360e640 1 --2- 172.21.15.59:0/4236132950 >> v2:172.21.15.59:3300/0 conn(0x7f6afc161010 0x7f6afc0c3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.182+0000 7f6b0360e640 1 -- 172.21.15.59:0/4236132950 >> 172.21.15.59:0/4236132950 conn(0x7f6afc0cd1d0 msgr2=0x7f6afc0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:14.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.182+0000 7ffab0ff9640 1 -- 172.21.15.59:0/678669046 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa98005250 con 0x7ffab4006b70 2023-10-16T14:26:14.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.182+0000 7f67d97fa640 1 -- 172.21.15.59:0/1272709652 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f67d403f580 con 0x7f67dc0d3300 2023-10-16T14:26:14.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.183+0000 7f6b0360e640 1 -- 172.21.15.59:0/4236132950 shutdown_connections 2023-10-16T14:26:14.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.183+0000 7f19b0c74640 1 --2- 172.21.15.59:0/1770828723 >> v2:172.21.15.151:3300/0 conn(0x7f19ac0cdd90 0x7f19ac0d1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.183+0000 7f02c29e1640 1 --2- 172.21.15.59:0/3700738720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02bc158d30 0x7f02bc06c7e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f02bc0cc2b0 tx=0x7f02b402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08a606357569022 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.183+0000 7f6b0360e640 1 -- 172.21.15.59:0/4236132950 wait complete. 2023-10-16T14:26:14.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.183+0000 7f19b26d7640 1 -- 172.21.15.59:0/1770828723 --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ac161520 con 0x7f19ac0b83b0 2023-10-16T14:26:14.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.184+0000 7f19b26d7640 1 -- 172.21.15.59:0/1770828723 --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19ac160f60 con 0x7f19ac0cdd90 2023-10-16T14:26:14.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.184+0000 7f19b26d7640 1 -- 172.21.15.59:0/1770828723 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac161240 con 0x7f19ac15c9f0 2023-10-16T14:26:14.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.184+0000 7f67d97fa640 1 --2- 172.21.15.59:0/1272709652 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f67c806aea0 0x7f67c806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.185+0000 7f67d97fa640 1 -- 172.21.15.59:0/1272709652 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f67d40abd80 con 0x7f67dc0d3300 2023-10-16T14:26:14.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.185+0000 7f67e0e0b640 1 --2- 172.21.15.59:0/1272709652 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f67c806aea0 0x7f67c806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.186+0000 7f6b0360e640 1 Processor -- start 2023-10-16T14:26:14.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.185+0000 7f19b0c74640 1 -- 172.21.15.59:0/1770828723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19ac15c9f0 msgr2=0x7f19ac160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:14.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.185+0000 7f19b0c74640 1 --2- 172.21.15.59:0/1770828723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19ac15c9f0 0x7f19ac160680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.185+0000 7f19b0c74640 1 -- 172.21.15.59:0/1770828723 >> v1:172.21.15.59:6789/0 conn(0x7f19ac0b83b0 legacy=0x7f19ac0cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.185+0000 7f19b0c74640 1 -- 172.21.15.59:0/1770828723 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac0d0b70 con 0x7f19ac0cdd90 2023-10-16T14:26:14.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.186+0000 7f67e0e0b640 1 --2- 172.21.15.59:0/1272709652 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f67c806aea0 0x7f67c806d360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f67d0001eb0 tx=0x7f67d0001a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.186+0000 7f6b0360e640 1 -- start start 2023-10-16T14:26:14.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.187+0000 7ffab2ffd640 1 -- 172.21.15.59:0/678669046 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffaac007490 con 0x7ffab4006b70 2023-10-16T14:26:14.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.187+0000 7f19b0c74640 1 --2- 172.21.15.59:0/1770828723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19ac0cdd90 0x7f19ac0d1370 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009d90 tx=0x7f19a402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e95a6d7eba530a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.187+0000 7f6b0360e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6afc070960 0x7f6afc0c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.187+0000 7f6b0360e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6afc0b21d0 0x7f6afc15ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.187+0000 7f6b0360e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6afc161010 0x7f6afc0c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.187+0000 7f6b0360e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc0c8500 con 0x7f6afc070960 2023-10-16T14:26:14.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.187+0000 7f6b0360e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc0c4f70 con 0x7f6afc161010 2023-10-16T14:26:14.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.187+0000 7f6b0360e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc0c5250 con 0x7f6afc0b21d0 2023-10-16T14:26:14.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.188+0000 7f6b013aa640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6afc070960 0x7f6afc0c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.188+0000 7f6b013aa640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6afc070960 0x7f6afc0c5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41882/0 (socket says 172.21.15.59:41882) 2023-10-16T14:26:14.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.188+0000 7f19aaffd640 1 -- 172.21.15.59:0/1770828723 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a402cc50 con 0x7f19ac0cdd90 2023-10-16T14:26:14.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.188+0000 7f6b013aa640 1 -- 172.21.15.59:0/74165366 learned_addr learned my addr 172.21.15.59:0/74165366 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:14.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.188+0000 7f6b00ba9640 1 --2- 172.21.15.59:0/74165366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6afc0b21d0 0x7f6afc15ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.188+0000 7f6b01bab640 1 --2- 172.21.15.59:0/74165366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6afc161010 0x7f6afc0c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.188+0000 7f6b013aa640 1 -- 172.21.15.59:0/74165366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6afc0b21d0 msgr2=0x7f6afc15ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.188+0000 7f6b013aa640 1 --2- 172.21.15.59:0/74165366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6afc0b21d0 0x7f6afc15ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.189+0000 7ffab2ffd640 1 --2- 172.21.15.59:0/678669046 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ffaa006af40 0x7ffaa006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.188+0000 7f6b013aa640 1 -- 172.21.15.59:0/74165366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6afc161010 msgr2=0x7f6afc0c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.188+0000 7f6b013aa640 1 --2- 172.21.15.59:0/74165366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6afc161010 0x7f6afc0c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.188+0000 7f6b013aa640 1 -- 172.21.15.59:0/74165366 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af8009400 con 0x7f6afc070960 2023-10-16T14:26:14.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.189+0000 7f19aaffd640 1 -- 172.21.15.59:0/1770828723 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a402cdb0 con 0x7f19ac0cdd90 2023-10-16T14:26:14.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.189+0000 7f19aaffd640 1 -- 172.21.15.59:0/1770828723 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4034660 con 0x7f19ac0cdd90 2023-10-16T14:26:14.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.189+0000 7ffab2ffd640 1 -- 172.21.15.59:0/678669046 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffaac089020 con 0x7ffab4006b70 2023-10-16T14:26:14.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.189+0000 7f6b013aa640 1 --2- 172.21.15.59:0/74165366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6afc070960 0x7f6afc0c5d30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6af800e960 tx=0x7f6af800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.189+0000 7ffac1ca7640 1 --2- 172.21.15.59:0/678669046 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ffaa006af40 0x7ffaa006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.190+0000 7f19b26d7640 1 -- 172.21.15.59:0/1770828723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19ac0cdd90 msgr2=0x7f19ac0d1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.190+0000 7f19b26d7640 1 --2- 172.21.15.59:0/1770828723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19ac0cdd90 0x7f19ac0d1370 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009d90 tx=0x7f19a402bea0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.190+0000 7f19b26d7640 1 -- 172.21.15.59:0/1770828723 shutdown_connections 2023-10-16T14:26:14.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.190+0000 7f19b26d7640 1 --2- 172.21.15.59:0/1770828723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19ac0cdd90 0x7f19ac0d1370 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.190+0000 7f19b26d7640 1 --2- 172.21.15.59:0/1770828723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19ac15c9f0 0x7f19ac160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.190+0000 7f19b26d7640 1 -- 172.21.15.59:0/1770828723 >> 172.21.15.59:0/1770828723 conn(0x7f19ac071510 msgr2=0x7f19ac071920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:14.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.190+0000 7f19b26d7640 1 -- 172.21.15.59:0/1770828723 shutdown_connections 2023-10-16T14:26:14.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.192+0000 7f6af1ffb640 1 -- 172.21.15.59:0/74165366 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af800ca00 con 0x7f6afc070960 2023-10-16T14:26:14.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.192+0000 7f6af1ffb640 1 -- 172.21.15.59:0/74165366 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af800cb60 con 0x7f6afc070960 2023-10-16T14:26:14.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.192+0000 7f6af1ffb640 1 -- 172.21.15.59:0/74165366 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af800ced0 con 0x7f6afc070960 2023-10-16T14:26:14.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.192+0000 7f6b0360e640 1 -- 172.21.15.59:0/74165366 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aec009400 con 0x7f6afc070960 2023-10-16T14:26:14.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.191+0000 7f02c11de640 1 -- 172.21.15.59:0/3700738720 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b402cb00 con 0x7f02bc158d30 2023-10-16T14:26:14.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.192+0000 7f02c11de640 1 -- 172.21.15.59:0/3700738720 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b402cc60 con 0x7f02bc158d30 2023-10-16T14:26:14.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.192+0000 7f02c11de640 1 -- 172.21.15.59:0/3700738720 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b40343f0 con 0x7f02bc158d30 2023-10-16T14:26:14.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.190+0000 7ffac1ca7640 1 --2- 172.21.15.59:0/678669046 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ffaa006af40 0x7ffaa006d400 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffab8006a90 tx=0x7ffab8006a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.190+0000 7f19b26d7640 1 -- 172.21.15.59:0/1770828723 wait complete. 2023-10-16T14:26:14.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.192+0000 7f19b26d7640 1 Processor -- start 2023-10-16T14:26:14.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.191+0000 7f591987c640 1 Processor -- start 2023-10-16T14:26:14.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.191+0000 7f591987c640 1 -- start start 2023-10-16T14:26:14.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.192+0000 7f67d97fa640 1 -- 172.21.15.59:0/1272709652 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f67d4076aa0 con 0x7f67dc0d3300 2023-10-16T14:26:14.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.193+0000 7f02c4444640 1 -- 172.21.15.59:0/3700738720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02bc158d30 msgr2=0x7f02bc06c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.193+0000 7f591987c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5914160e80 0x7f59140b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.193+0000 7f02c4444640 1 --2- 172.21.15.59:0/3700738720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02bc158d30 0x7f02bc06c7e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f02bc0cc2b0 tx=0x7f02b402bf60 comp rx=0 tx=0).stop 2023-10-16T14:26:14.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.193+0000 7f02c4444640 1 -- 172.21.15.59:0/3700738720 shutdown_connections 2023-10-16T14:26:14.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.193+0000 7f02c4444640 1 --2- 172.21.15.59:0/3700738720 >> v2:172.21.15.151:3300/0 conn(0x7f02bc1588d0 0x7f02bc06c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.193+0000 7f591987c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f59140ce0e0 0x7f59140b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.193+0000 7f591987c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59140c8f20 con 0x7f59141656a0 2023-10-16T14:26:14.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.193+0000 7f591987c640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5914165c10 con 0x7f59140ce0e0 2023-10-16T14:26:14.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.193+0000 7f591987c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59140c9200 con 0x7f5914160e80 2023-10-16T14:26:14.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.193+0000 7f02c4444640 1 --2- 172.21.15.59:0/3700738720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02bc158d30 0x7f02bc06c7e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.193+0000 7f59137fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f59140ce0e0 0x7f59140b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.193+0000 7f02c4444640 1 --2- 172.21.15.59:0/3700738720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02bc06a8f0 0x7f02bc0ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.193+0000 7f02c4444640 1 -- 172.21.15.59:0/3700738720 >> 172.21.15.59:0/3700738720 conn(0x7f02bc06a440 msgr2=0x7f02bc0cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:14.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.194+0000 7f02c4444640 1 -- 172.21.15.59:0/3700738720 shutdown_connections 2023-10-16T14:26:14.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.193+0000 7f6b0360e640 1 -- 172.21.15.59:0/74165366 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6afc0c5810 con 0x7f6afc070960 2023-10-16T14:26:14.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.192+0000 7f19b26d7640 1 -- start start 2023-10-16T14:26:14.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.194+0000 7f19b26d7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19ac0b83b0 0x7f19ac0c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.194+0000 7f19b26d7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19ac0cdd90 0x7f19ac155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.194+0000 7f19b26d7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19ac15c9f0 0x7f19ac155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.194+0000 7f19b26d7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac1f7550 con 0x7f19ac0b83b0 2023-10-16T14:26:14.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.194+0000 7f19b26d7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac0c7d90 con 0x7f19ac0cdd90 2023-10-16T14:26:14.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.194+0000 7f19b26d7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac0c8070 con 0x7f19ac15c9f0 2023-10-16T14:26:14.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.194+0000 7f59137fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f59140ce0e0 0x7f59140b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41894/0 (socket says 172.21.15.59:41894) 2023-10-16T14:26:14.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.194+0000 7f59137fe640 1 -- 172.21.15.59:0/2710467996 learned_addr learned my addr 172.21.15.59:0/2710467996 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:14.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.194+0000 7f5911ffb640 1 -- 172.21.15.59:0/2710467996 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758834199 0 0) 0x7f59140c8f20 con 0x7f59141656a0 2023-10-16T14:26:14.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.194+0000 7f5912ffd640 1 --2- 172.21.15.59:0/2710467996 >> v2:172.21.15.151:3300/0 conn(0x7f5914160e80 0x7f59140b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.194+0000 7f5911ffb640 1 -- 172.21.15.59:0/2710467996 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58fc003520 con 0x7f59141656a0 2023-10-16T14:26:14.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.195+0000 7f25b85d5640 1 Processor -- start 2023-10-16T14:26:14.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.195+0000 7f6b0360e640 1 -- 172.21.15.59:0/74165366 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6afc0c50b0 con 0x7f6afc070960 2023-10-16T14:26:14.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.194+0000 7f02c4444640 1 -- 172.21.15.59:0/3700738720 wait complete. 2023-10-16T14:26:14.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.195+0000 7f19ab7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19ac0cdd90 0x7f19ac155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.195+0000 7f19ab7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19ac0cdd90 0x7f19ac155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.59:58928/0 (socket says 172.21.15.59:58928) 2023-10-16T14:26:14.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.195+0000 7f19ab7fe640 1 -- 172.21.15.59:0/3473114513 learned_addr learned my addr 172.21.15.59:0/3473114513 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:14.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.196+0000 7f25b85d5640 1 -- start start 2023-10-16T14:26:14.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.196+0000 7f19abfff640 1 --2- 172.21.15.59:0/3473114513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19ac0b83b0 0x7f19ac0c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.196+0000 7f19ab7fe640 1 -- 172.21.15.59:0/3473114513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19ac15c9f0 msgr2=0x7f19ac155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.196+0000 7f19ab7fe640 1 --2- 172.21.15.59:0/3473114513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19ac15c9f0 0x7f19ac155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.196+0000 7f19ab7fe640 1 -- 172.21.15.59:0/3473114513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19ac0b83b0 msgr2=0x7f19ac0c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.195+0000 7f59137fe640 1 -- 172.21.15.59:0/2710467996 >> v2:172.21.15.151:3300/0 conn(0x7f5914160e80 msgr2=0x7f59140b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:14.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.195+0000 7f59137fe640 1 --2- 172.21.15.59:0/2710467996 >> v2:172.21.15.151:3300/0 conn(0x7f5914160e80 0x7f59140b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.195+0000 7f59137fe640 1 -- 172.21.15.59:0/2710467996 >> v1:172.21.15.151:6789/0 conn(0x7f59141656a0 legacy=0x7f5914070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.195+0000 7f59137fe640 1 -- 172.21.15.59:0/2710467996 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59140c94e0 con 0x7f59140ce0e0 2023-10-16T14:26:14.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.197+0000 7f02c4444640 1 Processor -- start 2023-10-16T14:26:14.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.197+0000 7f19ab7fe640 1 --2- 172.21.15.59:0/3473114513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19ac0b83b0 0x7f19ac0c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.197+0000 7f19ab7fe640 1 -- 172.21.15.59:0/3473114513 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a4009a70 con 0x7f19ac0cdd90 2023-10-16T14:26:14.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.197+0000 7f02c4444640 1 -- start start 2023-10-16T14:26:14.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.197+0000 7f19abfff640 1 --2- 172.21.15.59:0/3473114513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19ac0b83b0 0x7f19ac0c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:14.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.197+0000 7f59137fe640 1 --2- 172.21.15.59:0/2710467996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59140ce0e0 0x7f59140b06f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f59140cb110 tx=0x7f590c02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa243bced941d64 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.198+0000 7f6af1ffb640 1 -- 172.21.15.59:0/74165366 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6af8013470 con 0x7f6afc070960 2023-10-16T14:26:14.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.198+0000 7f25b85d5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b015cb60 0x7f25b00cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.198+0000 7f25b85d5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f25b006dd90 0x7f25b00b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.198+0000 7f25b85d5640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b015cf40 con 0x7f25b00b06f0 2023-10-16T14:26:14.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.198+0000 7f25b85d5640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b00b0b80 con 0x7f25b006dd90 2023-10-16T14:26:14.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.198+0000 7f25b85d5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b00c8d80 con 0x7f25b015cb60 2023-10-16T14:26:14.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.198+0000 7f19ab7fe640 1 --2- 172.21.15.59:0/3473114513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19ac0cdd90 0x7f19ac155150 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f199400c450 tx=0x7f199400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.198+0000 7f25b6b72640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f25b00b06f0 0x7f25b0070330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45714/0 (socket says 172.21.15.59:45714) 2023-10-16T14:26:14.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.198+0000 7f25b6b72640 1 -- 172.21.15.59:0/49868809 learned_addr learned my addr 172.21.15.59:0/49868809 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:14.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.198+0000 7f02c4444640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02bc06a8f0 0x7f02bc0a7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.199+0000 7f02c4444640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02bc1588d0 0x7f02bc0af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.198+0000 7f5911ffb640 1 -- 172.21.15.59:0/2710467996 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c02cbb0 con 0x7f59140ce0e0 2023-10-16T14:26:14.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.199+0000 7f5911ffb640 1 -- 172.21.15.59:0/2710467996 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590c02cd10 con 0x7f59140ce0e0 2023-10-16T14:26:14.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.199+0000 7f5911ffb640 1 -- 172.21.15.59:0/2710467996 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c034610 con 0x7f59140ce0e0 2023-10-16T14:26:14.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.199+0000 7f25b5b70640 1 --2- 172.21.15.59:0/49868809 >> v2:172.21.15.151:3300/0 conn(0x7f25b006dd90 0x7f25b00b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.199+0000 7f02c4444640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02bc158d30 0x7f02bc0af920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.199+0000 7f02c4444640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0a7dc0 con 0x7f02bc06a8f0 2023-10-16T14:26:14.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.199+0000 7f02c4444640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc15a2f0 con 0x7f02bc158d30 2023-10-16T14:26:14.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.199+0000 7f02c4444640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc15a5d0 con 0x7f02bc1588d0 2023-10-16T14:26:14.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.200+0000 7f25b6371640 1 --2- 172.21.15.59:0/49868809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b015cb60 0x7f25b00cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.200+0000 7f591987c640 1 -- 172.21.15.59:0/2710467996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59140ce0e0 msgr2=0x7f59140b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.200+0000 7f19a8ff9640 1 -- 172.21.15.59:0/3473114513 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994007480 con 0x7f19ac0cdd90 2023-10-16T14:26:14.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.200+0000 7f19a8ff9640 1 -- 172.21.15.59:0/3473114513 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19940075e0 con 0x7f19ac0cdd90 2023-10-16T14:26:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.200+0000 7f19a8ff9640 1 -- 172.21.15.59:0/3473114513 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994004a00 con 0x7f19ac0cdd90 2023-10-16T14:26:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.200+0000 7f02c21e0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02bc06a8f0 0x7f02bc0a7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.200+0000 7f02c21e0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02bc06a8f0 0x7f02bc0a7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41920/0 (socket says 172.21.15.59:41920) 2023-10-16T14:26:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.200+0000 7f02c21e0640 1 -- 172.21.15.59:0/1328044466 learned_addr learned my addr 172.21.15.59:0/1328044466 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:14.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.198+0000 7f3513432640 1 Processor -- start 2023-10-16T14:26:14.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.199+0000 7f3513432640 1 -- start start 2023-10-16T14:26:14.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.200+0000 7f19b26d7640 1 -- 172.21.15.59:0/3473114513 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ac0c8350 con 0x7f19ac0cdd90 2023-10-16T14:26:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.200+0000 7f591987c640 1 --2- 172.21.15.59:0/2710467996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59140ce0e0 0x7f59140b06f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f59140cb110 tx=0x7f590c02c010 comp rx=0 tx=0).stop 2023-10-16T14:26:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.200+0000 7f19b26d7640 1 -- 172.21.15.59:0/3473114513 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ac0b6080 con 0x7f19ac0cdd90 2023-10-16T14:26:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.200+0000 7f02c29e1640 1 --2- 172.21.15.59:0/1328044466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02bc158d30 0x7f02bc0af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.200+0000 7f02c21e0640 1 -- 172.21.15.59:0/1328044466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02bc1588d0 msgr2=0x7f02bc0af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.200+0000 7f02c21e0640 1 --2- 172.21.15.59:0/1328044466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02bc1588d0 0x7f02bc0af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.200+0000 7f02c21e0640 1 -- 172.21.15.59:0/1328044466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02bc158d30 msgr2=0x7f02bc0af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.200+0000 7f02c21e0640 1 --2- 172.21.15.59:0/1328044466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02bc158d30 0x7f02bc0af920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.200+0000 7f02c21e0640 1 -- 172.21.15.59:0/1328044466 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ac009400 con 0x7f02bc06a8f0 2023-10-16T14:26:14.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.199+0000 7f6af1ffb640 1 --2- 172.21.15.59:0/74165366 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6ae006af40 0x7f6ae006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.199+0000 7f6af1ffb640 1 -- 172.21.15.59:0/74165366 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6af8089f40 con 0x7f6afc070960 2023-10-16T14:26:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.200+0000 7f6b00ba9640 1 --2- 172.21.15.59:0/74165366 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6ae006af40 0x7f6ae006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.201+0000 7f3513432640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c06e3e0 0x7f350c159490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.201+0000 7f3513432640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f350c15d340 0x7f350c0b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.201+0000 7f3513432640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f350c06cb90 con 0x7f350c15cee0 2023-10-16T14:26:14.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.201+0000 7f3513432640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f350c15a040 con 0x7f350c15d340 2023-10-16T14:26:14.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.201+0000 7f3513432640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350c06d730 con 0x7f350c06e3e0 2023-10-16T14:26:14.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.201+0000 7f591987c640 1 -- 172.21.15.59:0/2710467996 shutdown_connections 2023-10-16T14:26:14.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.201+0000 7f591987c640 1 --2- 172.21.15.59:0/2710467996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59140ce0e0 0x7f59140b06f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.201+0000 7f591987c640 1 --2- 172.21.15.59:0/2710467996 >> v2:172.21.15.151:3300/0 conn(0x7f5914160e80 0x7f59140b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.201+0000 7f591987c640 1 -- 172.21.15.59:0/2710467996 >> 172.21.15.59:0/2710467996 conn(0x7f59140cb1b0 msgr2=0x7f59140cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:14.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.201+0000 7f02c21e0640 1 --2- 172.21.15.59:0/1328044466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02bc06a8f0 0x7f02bc0a7450 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f02b800b4a0 tx=0x7f02b800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.201+0000 7f25b5b70640 1 -- 172.21.15.59:0/49868809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b015cb60 msgr2=0x7f25b00cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:14.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.201+0000 7f25b5b70640 1 --2- 172.21.15.59:0/49868809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b015cb60 0x7f25b00cde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.202+0000 7f591987c640 1 -- 172.21.15.59:0/2710467996 shutdown_connections 2023-10-16T14:26:14.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.201+0000 7f25b5b70640 1 -- 172.21.15.59:0/49868809 >> v1:172.21.15.59:6789/0 conn(0x7f25b00b06f0 legacy=0x7f25b0070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.201+0000 7f25b5b70640 1 -- 172.21.15.59:0/49868809 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b00cd8d0 con 0x7f25b006dd90 2023-10-16T14:26:14.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.202+0000 7f35111ce640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c06e3e0 0x7f350c159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.202+0000 7f35111ce640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c06e3e0 0x7f350c159490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.59:39448/0 (socket says 172.21.15.59:39448) 2023-10-16T14:26:14.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.202+0000 7f35111ce640 1 -- 172.21.15.59:0/164098349 learned_addr learned my addr 172.21.15.59:0/164098349 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:14.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.202+0000 7f6b00ba9640 1 --2- 172.21.15.59:0/74165366 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6ae006af40 0x7f6ae006d400 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6aec036000 tx=0x7f6aec008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.202+0000 7f19b26d7640 1 -- 172.21.15.59:0/3473114513 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ac1f7690 con 0x7f19ac0cdd90 2023-10-16T14:26:14.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.202+0000 7f591987c640 1 -- 172.21.15.59:0/2710467996 wait complete. 2023-10-16T14:26:14.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.202+0000 7f35119cf640 1 --2- 172.21.15.59:0/164098349 >> v2:172.21.15.59:3300/0 conn(0x7f350c15d340 0x7f350c0b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.203+0000 7f35111ce640 1 -- 172.21.15.59:0/164098349 >> v2:172.21.15.59:3300/0 conn(0x7f350c15d340 msgr2=0x7f350c0b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:14.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.203+0000 7f35111ce640 1 --2- 172.21.15.59:0/164098349 >> v2:172.21.15.59:3300/0 conn(0x7f350c15d340 0x7f350c0b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.203+0000 7f35111ce640 1 -- 172.21.15.59:0/164098349 >> v1:172.21.15.151:6789/0 conn(0x7f350c15cee0 legacy=0x7f350c06d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.203+0000 7f25b5b70640 1 --2- 172.21.15.59:0/49868809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b006dd90 0x7f25b00b01b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f259c0097a0 tx=0x7f259c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a49f5afba1a1b540 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.204+0000 7f591987c640 1 Processor -- start 2023-10-16T14:26:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.204+0000 7f19a8ff9640 1 -- 172.21.15.59:0/3473114513 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1994004b60 con 0x7f19ac0cdd90 2023-10-16T14:26:14.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.204+0000 7ffab2ffd640 1 -- 172.21.15.59:0/678669046 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffaac053f00 con 0x7ffab4006b70 2023-10-16T14:26:14.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.203+0000 7f35111ce640 1 -- 172.21.15.59:0/164098349 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c06c2a0 con 0x7f350c06e3e0 2023-10-16T14:26:14.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.204+0000 7f591987c640 1 -- start start 2023-10-16T14:26:14.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.205+0000 7f35111ce640 1 --2- 172.21.15.59:0/164098349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c06e3e0 0x7f350c159490 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3508009870 tx=0x7f350802ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4c77461b239457d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.205+0000 7f19a8ff9640 1 --2- 172.21.15.59:0/3473114513 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f198c06aec0 0x7f198c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.206+0000 7f3503fff640 1 -- 172.21.15.59:0/164098349 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350802f830 con 0x7f350c06e3e0 2023-10-16T14:26:14.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.206+0000 7f3503fff640 1 -- 172.21.15.59:0/164098349 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350802f990 con 0x7f350c06e3e0 2023-10-16T14:26:14.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.206+0000 7f3503fff640 1 -- 172.21.15.59:0/164098349 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350802fd20 con 0x7f350c06e3e0 2023-10-16T14:26:14.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.206+0000 7f591987c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59140ce0e0 0x7f591414c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.206+0000 7f591987c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5914160e80 0x7f5914161260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.206+0000 7f591987c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59141656a0 0x7f59141617a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.206+0000 7f591987c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59140b2660 con 0x7f59141656a0 2023-10-16T14:26:14.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.206+0000 7f591987c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5914164360 con 0x7f59140ce0e0 2023-10-16T14:26:14.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.206+0000 7f591987c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5914164640 con 0x7f5914160e80 2023-10-16T14:26:14.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.206+0000 7f19a8ff9640 1 -- 172.21.15.59:0/3473114513 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1994088fd0 con 0x7f19ac0cdd90 2023-10-16T14:26:14.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.206+0000 7f02b2ffd640 1 -- 172.21.15.59:0/1328044466 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b8010610 con 0x7f02bc06a8f0 2023-10-16T14:26:14.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.206+0000 7f02b2ffd640 1 -- 172.21.15.59:0/1328044466 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b8010770 con 0x7f02bc06a8f0 2023-10-16T14:26:14.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.206+0000 7f02b2ffd640 1 -- 172.21.15.59:0/1328044466 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b8010b20 con 0x7f02bc06a8f0 2023-10-16T14:26:14.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.206+0000 7f6af1ffb640 1 -- 172.21.15.59:0/74165366 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6afc0c50b0 con 0x7f6afc070960 2023-10-16T14:26:14.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.206+0000 7f19abfff640 1 --2- 172.21.15.59:0/3473114513 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f198c06aec0 0x7f198c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.207+0000 7f5912ffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59140ce0e0 0x7f591414c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.207+0000 7f3513432640 1 -- 172.21.15.59:0/164098349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c06e3e0 msgr2=0x7f350c159490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.207+0000 7f3513432640 1 --2- 172.21.15.59:0/164098349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c06e3e0 0x7f350c159490 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3508009870 tx=0x7f350802ba10 comp rx=0 tx=0).stop 2023-10-16T14:26:14.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.207+0000 7f59127fc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5914160e80 0x7f5914161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.207+0000 7f5912ffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59140ce0e0 0x7f591414c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.59:58958/0 (socket says 172.21.15.59:58958) 2023-10-16T14:26:14.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.207+0000 7f5912ffd640 1 -- 172.21.15.59:0/750850844 learned_addr learned my addr 172.21.15.59:0/750850844 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:14.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.207+0000 7f02c4444640 1 -- 172.21.15.59:0/1328044466 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b4009b30 con 0x7f02bc06a8f0 2023-10-16T14:26:14.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.207+0000 7f3513432640 1 -- 172.21.15.59:0/164098349 shutdown_connections 2023-10-16T14:26:14.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.207+0000 7f3513432640 1 --2- 172.21.15.59:0/164098349 >> v2:172.21.15.59:3300/0 conn(0x7f350c15d340 0x7f350c0b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.207+0000 7f3513432640 1 --2- 172.21.15.59:0/164098349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c06e3e0 0x7f350c159490 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.207+0000 7f3513432640 1 -- 172.21.15.59:0/164098349 >> 172.21.15.59:0/164098349 conn(0x7f350c0cb1b0 msgr2=0x7f350c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:14.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.207+0000 7f59137fe640 1 --2- 172.21.15.59:0/750850844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59141656a0 0x7f59141617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.207+0000 7f3513432640 1 -- 172.21.15.59:0/164098349 shutdown_connections 2023-10-16T14:26:14.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.208+0000 7f02c4444640 1 -- 172.21.15.59:0/1328044466 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02bc15ab90 con 0x7f02bc06a8f0 2023-10-16T14:26:14.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.208+0000 7f3513432640 1 -- 172.21.15.59:0/164098349 wait complete. 2023-10-16T14:26:14.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.208+0000 7f19abfff640 1 --2- 172.21.15.59:0/3473114513 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f198c06aec0 0x7f198c06d380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f199c009a20 tx=0x7f199c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.210+0000 7f3513432640 1 Processor -- start 2023-10-16T14:26:14.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.209+0000 7f5912ffd640 1 -- 172.21.15.59:0/750850844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5914160e80 msgr2=0x7f5914161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.209+0000 7f5912ffd640 1 --2- 172.21.15.59:0/750850844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5914160e80 0x7f5914161260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.209+0000 7f5912ffd640 1 -- 172.21.15.59:0/750850844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59141656a0 msgr2=0x7f59141617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.209+0000 7f5912ffd640 1 --2- 172.21.15.59:0/750850844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59141656a0 0x7f59141617a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.209+0000 7f5912ffd640 1 -- 172.21.15.59:0/750850844 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c009b30 con 0x7f59140ce0e0 2023-10-16T14:26:14.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.209+0000 7f59127fc640 1 --2- 172.21.15.59:0/750850844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5914160e80 0x7f5914161260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:26:14.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.209+0000 7f5912ffd640 1 --2- 172.21.15.59:0/750850844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59140ce0e0 0x7f591414c060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f590400d800 tx=0x7f590400dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.210+0000 7f02b2ffd640 1 -- 172.21.15.59:0/1328044466 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f02b8010c80 con 0x7f02bc06a8f0 2023-10-16T14:26:14.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.210+0000 7f02c4444640 1 -- 172.21.15.59:0/1328044466 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02bc15adb0 con 0x7f02bc06a8f0 2023-10-16T14:26:14.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.210+0000 7f3513432640 1 -- start start 2023-10-16T14:26:14.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.212+0000 7f02b2ffd640 1 --2- 172.21.15.59:0/1328044466 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f02a006aea0 0x7f02a006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.212+0000 7f3513432640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c06e3e0 0x7f350c0c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.212+0000 7f02b2ffd640 1 -- 172.21.15.59:0/1328044466 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f02b8088970 con 0x7f02bc06a8f0 2023-10-16T14:26:14.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.212+0000 7f3513432640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f350c15cee0 0x7f350c14b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.213+0000 7f3513432640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350c15d340 0x7f350c0c2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.213+0000 7f35111ce640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c06e3e0 0x7f350c0c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.213+0000 7f3513432640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c0c5870 con 0x7f350c15d340 2023-10-16T14:26:14.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.213+0000 7f3513432640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c0c99d0 con 0x7f350c15cee0 2023-10-16T14:26:14.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.213+0000 7f3513432640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350c0af1e0 con 0x7f350c06e3e0 2023-10-16T14:26:14.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.213+0000 7f35111ce640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c06e3e0 0x7f350c0c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.59:39474/0 (socket says 172.21.15.59:39474) 2023-10-16T14:26:14.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.213+0000 7f35109cd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f350c15cee0 0x7f350c14b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.213+0000 7f35111ce640 1 -- 172.21.15.59:0/2913292134 learned_addr learned my addr 172.21.15.59:0/2913292134 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:14.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.214+0000 7f35119cf640 1 --2- 172.21.15.59:0/2913292134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350c15d340 0x7f350c0c2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.214+0000 7f02c19df640 1 --2- 172.21.15.59:0/1328044466 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f02a006aea0 0x7f02a006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.215+0000 7f35111ce640 1 -- 172.21.15.59:0/2913292134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f350c15cee0 msgr2=0x7f350c14b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.215+0000 7f35111ce640 1 --2- 172.21.15.59:0/2913292134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f350c15cee0 0x7f350c14b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.215+0000 7f35111ce640 1 -- 172.21.15.59:0/2913292134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350c15d340 msgr2=0x7f350c0c2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.215+0000 7f35111ce640 1 --2- 172.21.15.59:0/2913292134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350c15d340 0x7f350c0c2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.215+0000 7f35111ce640 1 -- 172.21.15.59:0/2913292134 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35080094d0 con 0x7f350c06e3e0 2023-10-16T14:26:14.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.215+0000 7f35119cf640 1 --2- 172.21.15.59:0/2913292134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350c15d340 0x7f350c0c2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:26:14.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.215+0000 7f02b2ffd640 1 -- 172.21.15.59:0/1328044466 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02b8053730 con 0x7f02bc06a8f0 2023-10-16T14:26:14.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.216+0000 7f35111ce640 1 --2- 172.21.15.59:0/2913292134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c06e3e0 0x7f350c0c93b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f35080090b0 tx=0x7f35080046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.216+0000 7f02c19df640 1 --2- 172.21.15.59:0/1328044466 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f02a006aea0 0x7f02a006d360 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f02ac006e80 tx=0x7f02ac006dd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.216+0000 7f3501ffb640 1 -- 172.21.15.59:0/2913292134 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508046070 con 0x7f350c06e3e0 2023-10-16T14:26:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.216+0000 7f3501ffb640 1 -- 172.21.15.59:0/2913292134 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3508037b00 con 0x7f350c06e3e0 2023-10-16T14:26:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.216+0000 7f3513432640 1 -- 172.21.15.59:0/2913292134 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350c0af4c0 con 0x7f350c06e3e0 2023-10-16T14:26:14.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.216+0000 7f3501ffb640 1 -- 172.21.15.59:0/2913292134 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350803b040 con 0x7f350c06e3e0 2023-10-16T14:26:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.216+0000 7f3513432640 1 -- 172.21.15.59:0/2913292134 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f350c0afa80 con 0x7f350c06e3e0 2023-10-16T14:26:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.218+0000 7f34f77fe640 1 -- 172.21.15.59:0/2913292134 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350c1669f0 con 0x7f350c06e3e0 2023-10-16T14:26:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.221+0000 7f3501ffb640 1 -- 172.21.15.59:0/2913292134 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3508042480 con 0x7f350c06e3e0 2023-10-16T14:26:14.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.221+0000 7f25b536f640 1 -- 172.21.15.59:0/49868809 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c02d040 con 0x7f25b006dd90 2023-10-16T14:26:14.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.221+0000 7f25b536f640 1 -- 172.21.15.59:0/49868809 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c031810 con 0x7f25b006dd90 2023-10-16T14:26:14.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.221+0000 7f25b536f640 1 -- 172.21.15.59:0/49868809 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c031ba0 con 0x7f25b006dd90 2023-10-16T14:26:14.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.222+0000 7f19a8ff9640 1 -- 172.21.15.59:0/3473114513 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1994053f00 con 0x7f19ac0cdd90 2023-10-16T14:26:14.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.223+0000 7f3501ffb640 1 --2- 172.21.15.59:0/2913292134 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f34f006ae70 0x7f34f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.223+0000 7f3501ffb640 1 -- 172.21.15.59:0/2913292134 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f35080ace10 con 0x7f350c06e3e0 2023-10-16T14:26:14.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.223+0000 7f25b85d5640 1 -- 172.21.15.59:0/49868809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b006dd90 msgr2=0x7f25b00b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.223+0000 7f25b85d5640 1 --2- 172.21.15.59:0/49868809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b006dd90 0x7f25b00b01b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f259c0097a0 tx=0x7f259c02b8b0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.224+0000 7f25b85d5640 1 -- 172.21.15.59:0/49868809 shutdown_connections 2023-10-16T14:26:14.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.224+0000 7f25b85d5640 1 --2- 172.21.15.59:0/49868809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b006dd90 0x7f25b00b01b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.224+0000 7f25b85d5640 1 --2- 172.21.15.59:0/49868809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b015cb60 0x7f25b00cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.224+0000 7f25b85d5640 1 -- 172.21.15.59:0/49868809 >> 172.21.15.59:0/49868809 conn(0x7f25b006a440 msgr2=0x7f25b00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:14.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.224+0000 7f58fbfff640 1 -- 172.21.15.59:0/750850844 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590400b6c0 con 0x7f59140ce0e0 2023-10-16T14:26:14.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.224+0000 7f58fbfff640 1 -- 172.21.15.59:0/750850844 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590400b820 con 0x7f59140ce0e0 2023-10-16T14:26:14.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.224+0000 7f58fbfff640 1 -- 172.21.15.59:0/750850844 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590400bbb0 con 0x7f59140ce0e0 2023-10-16T14:26:14.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.224+0000 7f35109cd640 1 --2- 172.21.15.59:0/2913292134 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f34f006ae70 0x7f34f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.224+0000 7f25b85d5640 1 -- 172.21.15.59:0/49868809 shutdown_connections 2023-10-16T14:26:14.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.224+0000 7f25b85d5640 1 -- 172.21.15.59:0/49868809 wait complete. 2023-10-16T14:26:14.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.225+0000 7f591987c640 1 -- 172.21.15.59:0/750850844 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59140b2010 con 0x7f59140ce0e0 2023-10-16T14:26:14.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.225+0000 7f35109cd640 1 --2- 172.21.15.59:0/2913292134 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f34f006ae70 0x7f34f006d330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f350c0cf360 tx=0x7f34fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.225+0000 7f591987c640 1 -- 172.21.15.59:0/750850844 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591414c7a0 con 0x7f59140ce0e0 2023-10-16T14:26:14.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.226+0000 7f591987c640 1 -- 172.21.15.59:0/750850844 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5914073ef0 con 0x7f59140ce0e0 2023-10-16T14:26:14.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.227+0000 7f25b85d5640 1 Processor -- start 2023-10-16T14:26:14.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.227+0000 7f25b85d5640 1 -- start start 2023-10-16T14:26:14.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.228+0000 7f25b85d5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b006dd90 0x7f25b00b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.229+0000 7f25b85d5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b00b06f0 0x7f25b00c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.229+0000 7f25b85d5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b015cb60 0x7f25b0155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.229+0000 7f25b85d5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b015dfe0 con 0x7f25b015cb60 2023-10-16T14:26:14.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.229+0000 7f25b85d5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b00c6410 con 0x7f25b00b06f0 2023-10-16T14:26:14.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.229+0000 7f25b85d5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b015e280 con 0x7f25b006dd90 2023-10-16T14:26:14.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.229+0000 7f25b6b72640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b015cb60 0x7f25b0155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.229+0000 7f25b6371640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b006dd90 0x7f25b00b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.229+0000 7f25b5b70640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b00b06f0 0x7f25b00c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.229+0000 7f25b6371640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b006dd90 0x7f25b00b3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.59:39478/0 (socket says 172.21.15.59:39478) 2023-10-16T14:26:14.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.229+0000 7f25b6371640 1 -- 172.21.15.59:0/2459349393 learned_addr learned my addr 172.21.15.59:0/2459349393 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:14.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.229+0000 7f58fbfff640 1 -- 172.21.15.59:0/750850844 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f590400bd10 con 0x7f59140ce0e0 2023-10-16T14:26:14.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.230+0000 7f25b6371640 1 -- 172.21.15.59:0/2459349393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b00b06f0 msgr2=0x7f25b00c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.230+0000 7f25b6371640 1 --2- 172.21.15.59:0/2459349393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b00b06f0 0x7f25b00c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.230+0000 7f25b6371640 1 -- 172.21.15.59:0/2459349393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b015cb60 msgr2=0x7f25b0155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.230+0000 7f25b6371640 1 --2- 172.21.15.59:0/2459349393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b015cb60 0x7f25b0155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.230+0000 7f25b6371640 1 -- 172.21.15.59:0/2459349393 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c009400 con 0x7f25b006dd90 2023-10-16T14:26:14.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.231+0000 7f58fbfff640 1 --2- 172.21.15.59:0/750850844 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f590006af70 0x7f590006d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.231+0000 7f25b6371640 1 --2- 172.21.15.59:0/2459349393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b006dd90 0x7f25b00b3e10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f25a800e870 tx=0x7f25a800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.231+0000 7f58fbfff640 1 -- 172.21.15.59:0/750850844 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5904089d10 con 0x7f59140ce0e0 2023-10-16T14:26:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.232+0000 7f59127fc640 1 --2- 172.21.15.59:0/750850844 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f590006af70 0x7f590006d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.233+0000 7f59127fc640 1 --2- 172.21.15.59:0/750850844 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f590006af70 0x7f590006d430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5908007fd0 tx=0x7f5908009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.234+0000 7f25aeffd640 1 -- 172.21.15.59:0/2459349393 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a80094f0 con 0x7f25b006dd90 2023-10-16T14:26:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.234+0000 7f25aeffd640 1 -- 172.21.15.59:0/2459349393 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a800c940 con 0x7f25b006dd90 2023-10-16T14:26:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.234+0000 7f25aeffd640 1 -- 172.21.15.59:0/2459349393 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a800ccf0 con 0x7f25b006dd90 2023-10-16T14:26:14.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.234+0000 7f25b85d5640 1 -- 172.21.15.59:0/2459349393 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b015e560 con 0x7f25b006dd90 2023-10-16T14:26:14.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.234+0000 7f3501ffb640 1 -- 172.21.15.59:0/2913292134 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3508077df0 con 0x7f350c06e3e0 2023-10-16T14:26:14.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.234+0000 7f25b85d5640 1 -- 172.21.15.59:0/2459349393 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b00b1350 con 0x7f25b006dd90 2023-10-16T14:26:14.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.235+0000 7f25b85d5640 1 -- 172.21.15.59:0/2459349393 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b0073ef0 con 0x7f25b006dd90 2023-10-16T14:26:14.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.238+0000 7f25aeffd640 1 -- 172.21.15.59:0/2459349393 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f25a8013470 con 0x7f25b006dd90 2023-10-16T14:26:14.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.240+0000 7f25aeffd640 1 --2- 172.21.15.59:0/2459349393 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f259406af40 0x7f259406d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.240+0000 7f25aeffd640 1 -- 172.21.15.59:0/2459349393 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f25a808a160 con 0x7f25b006dd90 2023-10-16T14:26:14.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.241+0000 7f25b5b70640 1 --2- 172.21.15.59:0/2459349393 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f259406af40 0x7f259406d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.242+0000 7f25b5b70640 1 --2- 172.21.15.59:0/2459349393 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f259406af40 0x7f259406d400 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f259c036000 tx=0x7f259c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.245+0000 7f58fbfff640 1 -- 172.21.15.59:0/750850844 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5904054b40 con 0x7f59140ce0e0 2023-10-16T14:26:14.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.251+0000 7f25aeffd640 1 -- 172.21.15.59:0/2459349393 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f25a8054fb0 con 0x7f25b006dd90 2023-10-16T14:26:14.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.609+0000 7f6b0360e640 1 -- 172.21.15.59:0/74165366 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6afc0c50b0 con 0x7f6afc070960 2023-10-16T14:26:14.616 INFO:teuthology.orchestra.run.smithi059.stdout:68719476747 2023-10-16T14:26:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.611+0000 7f6af1ffb640 1 -- 172.21.15.59:0/74165366 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6afc0c50b0 con 0x7f6afc070960 2023-10-16T14:26:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.614+0000 7f6b0360e640 1 -- 172.21.15.59:0/74165366 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6ae006af40 msgr2=0x7f6ae006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.614+0000 7f6b0360e640 1 --2- 172.21.15.59:0/74165366 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6ae006af40 0x7f6ae006d400 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6aec036000 tx=0x7f6aec008030 comp rx=0 tx=0).stop 2023-10-16T14:26:14.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.614+0000 7f6b0360e640 1 -- 172.21.15.59:0/74165366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6afc070960 msgr2=0x7f6afc0c5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.614+0000 7f6b0360e640 1 --2- 172.21.15.59:0/74165366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6afc070960 0x7f6afc0c5d30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6af800e960 tx=0x7f6af800ee20 comp rx=0 tx=0).stop 2023-10-16T14:26:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.615+0000 7f6b0360e640 1 -- 172.21.15.59:0/74165366 shutdown_connections 2023-10-16T14:26:14.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.615+0000 7f6b0360e640 1 --2- 172.21.15.59:0/74165366 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6ae006af40 0x7f6ae006d400 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.615+0000 7f6b0360e640 1 --2- 172.21.15.59:0/74165366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6afc161010 0x7f6afc0c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.615+0000 7f6b0360e640 1 --2- 172.21.15.59:0/74165366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6afc0b21d0 0x7f6afc15ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.615+0000 7f6b0360e640 1 --2- 172.21.15.59:0/74165366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6afc070960 0x7f6afc0c5d30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.615+0000 7f6b0360e640 1 -- 172.21.15.59:0/74165366 >> 172.21.15.59:0/74165366 conn(0x7f6afc0cd1d0 msgr2=0x7f6afc072a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.616+0000 7f6b0360e640 1 -- 172.21.15.59:0/74165366 shutdown_connections 2023-10-16T14:26:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.616+0000 7f6b0360e640 1 -- 172.21.15.59:0/74165366 wait complete. 2023-10-16T14:26:14.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.625+0000 7f67e1e0d640 1 -- 172.21.15.59:0/1272709652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f67dc04e9b0 con 0x7f67dc0d3300 2023-10-16T14:26:14.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.626+0000 7f67d97fa640 1 -- 172.21.15.59:0/1272709652 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f67d4043090 con 0x7f67dc0d3300 2023-10-16T14:26:14.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.627+0000 7ffab0ff9640 1 -- 172.21.15.59:0/678669046 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffa980057d0 con 0x7ffab4006b70 2023-10-16T14:26:14.631 INFO:teuthology.orchestra.run.smithi059.stdout:68719476748 2023-10-16T14:26:14.631 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.628+0000 7ffab2ffd640 1 -- 172.21.15.59:0/678669046 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffaac057520 con 0x7ffab4006b70 2023-10-16T14:26:14.635 INFO:teuthology.orchestra.run.smithi059.stdout:68719476746 2023-10-16T14:26:14.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.629+0000 7f67e1e0d640 1 -- 172.21.15.59:0/1272709652 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f67c806aea0 msgr2=0x7f67c806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.630+0000 7f67e1e0d640 1 --2- 172.21.15.59:0/1272709652 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f67c806aea0 0x7f67c806d360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f67d0001eb0 tx=0x7f67d0001a50 comp rx=0 tx=0).stop 2023-10-16T14:26:14.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.630+0000 7f67e1e0d640 1 -- 172.21.15.59:0/1272709652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67dc0d3300 msgr2=0x7f67dc0c7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.630+0000 7f67e1e0d640 1 --2- 172.21.15.59:0/1272709652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67dc0d3300 0x7f67dc0c7ce0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f67d4033000 tx=0x7f67d4004a40 comp rx=0 tx=0).stop 2023-10-16T14:26:14.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.630+0000 7f67e1e0d640 1 -- 172.21.15.59:0/1272709652 shutdown_connections 2023-10-16T14:26:14.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.630+0000 7f67e1e0d640 1 --2- 172.21.15.59:0/1272709652 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f67c806aea0 0x7f67c806d360 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.630+0000 7f67e1e0d640 1 --2- 172.21.15.59:0/1272709652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67dc0d3300 0x7f67dc0c7ce0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.630+0000 7f67e1e0d640 1 --2- 172.21.15.59:0/1272709652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67dc0d09e0 0x7f67dc15b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.630+0000 7f67e1e0d640 1 --2- 172.21.15.59:0/1272709652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f67dc0c5e10 0x7f67dc155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.630+0000 7f67e1e0d640 1 -- 172.21.15.59:0/1272709652 >> 172.21.15.59:0/1272709652 conn(0x7f67dc0d27e0 msgr2=0x7f67dc0d2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:14.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.631+0000 7f67e1e0d640 1 -- 172.21.15.59:0/1272709652 shutdown_connections 2023-10-16T14:26:14.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.631+0000 7f67e1e0d640 1 -- 172.21.15.59:0/1272709652 wait complete. 2023-10-16T14:26:14.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.632+0000 7ffab0ff9640 1 -- 172.21.15.59:0/678669046 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ffaa006af40 msgr2=0x7ffaa006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.632+0000 7ffab0ff9640 1 --2- 172.21.15.59:0/678669046 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ffaa006af40 0x7ffaa006d400 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffab8006a90 tx=0x7ffab8006a20 comp rx=0 tx=0).stop 2023-10-16T14:26:14.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.632+0000 7ffab0ff9640 1 -- 172.21.15.59:0/678669046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4006b70 msgr2=0x7ffab4039480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.632+0000 7ffab0ff9640 1 --2- 172.21.15.59:0/678669046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4006b70 0x7ffab4039480 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00c4a0 tx=0x7ffaac00c960 comp rx=0 tx=0).stop 2023-10-16T14:26:14.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.635+0000 7ffab0ff9640 1 -- 172.21.15.59:0/678669046 shutdown_connections 2023-10-16T14:26:14.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.635+0000 7ffab0ff9640 1 --2- 172.21.15.59:0/678669046 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ffaa006af40 0x7ffaa006d400 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.635+0000 7ffab0ff9640 1 --2- 172.21.15.59:0/678669046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffab40e3070 0x7ffab404e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.635+0000 7ffab0ff9640 1 --2- 172.21.15.59:0/678669046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab4054190 0x7ffab40da170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.635+0000 7ffab0ff9640 1 --2- 172.21.15.59:0/678669046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4006b70 0x7ffab4039480 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.635+0000 7ffab0ff9640 1 -- 172.21.15.59:0/678669046 >> 172.21.15.59:0/678669046 conn(0x7ffab4055a90 msgr2=0x7ffab4052740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:14.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.635+0000 7ffab0ff9640 1 -- 172.21.15.59:0/678669046 shutdown_connections 2023-10-16T14:26:14.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.636+0000 7f02c4444640 1 -- 172.21.15.59:0/1328044466 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f02bc073ef0 con 0x7f02bc06a8f0 2023-10-16T14:26:14.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.635+0000 7ffab0ff9640 1 -- 172.21.15.59:0/678669046 wait complete. 2023-10-16T14:26:14.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.637+0000 7f02b2ffd640 1 -- 172.21.15.59:0/1328044466 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f02b8014090 con 0x7f02bc06a8f0 2023-10-16T14:26:14.642 INFO:teuthology.orchestra.run.smithi059.stdout:68719476746 2023-10-16T14:26:14.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.641+0000 7f02c4444640 1 -- 172.21.15.59:0/1328044466 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f02a006aea0 msgr2=0x7f02a006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.641+0000 7f02c4444640 1 --2- 172.21.15.59:0/1328044466 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f02a006aea0 0x7f02a006d360 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f02ac006e80 tx=0x7f02ac006dd0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.641+0000 7f02c4444640 1 -- 172.21.15.59:0/1328044466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02bc06a8f0 msgr2=0x7f02bc0a7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.641+0000 7f02c4444640 1 --2- 172.21.15.59:0/1328044466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02bc06a8f0 0x7f02bc0a7450 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f02b800b4a0 tx=0x7f02b800b960 comp rx=0 tx=0).stop 2023-10-16T14:26:14.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.644+0000 7f02c4444640 1 -- 172.21.15.59:0/1328044466 shutdown_connections 2023-10-16T14:26:14.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.644+0000 7f02c4444640 1 --2- 172.21.15.59:0/1328044466 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f02a006aea0 0x7f02a006d360 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.644+0000 7f02c4444640 1 --2- 172.21.15.59:0/1328044466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02bc158d30 0x7f02bc0af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.644+0000 7f02c4444640 1 --2- 172.21.15.59:0/1328044466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02bc1588d0 0x7f02bc0af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.644+0000 7f02c4444640 1 --2- 172.21.15.59:0/1328044466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02bc06a8f0 0x7f02bc0a7450 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.644+0000 7f02c4444640 1 -- 172.21.15.59:0/1328044466 >> 172.21.15.59:0/1328044466 conn(0x7f02bc06a440 msgr2=0x7f02bc0adb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:14.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.645+0000 7f02c4444640 1 -- 172.21.15.59:0/1328044466 shutdown_connections 2023-10-16T14:26:14.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.645+0000 7f02c4444640 1 -- 172.21.15.59:0/1328044466 wait complete. 2023-10-16T14:26:14.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476747 got 68719476747 for osd.1 2023-10-16T14:26:14.650 DEBUG:teuthology.parallel:result is None 2023-10-16T14:26:14.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.647+0000 7f19b26d7640 1 -- 172.21.15.59:0/3473114513 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f19ac1f7690 con 0x7f19ac0cdd90 2023-10-16T14:26:14.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.648+0000 7f19a8ff9640 1 -- 172.21.15.59:0/3473114513 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f19ac1f7690 con 0x7f19ac0cdd90 2023-10-16T14:26:14.652 INFO:teuthology.orchestra.run.smithi059.stdout:60129542153 2023-10-16T14:26:14.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.651+0000 7f19b26d7640 1 -- 172.21.15.59:0/3473114513 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f198c06aec0 msgr2=0x7f198c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.651+0000 7f19b26d7640 1 --2- 172.21.15.59:0/3473114513 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f198c06aec0 0x7f198c06d380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f199c009a20 tx=0x7f199c008040 comp rx=0 tx=0).stop 2023-10-16T14:26:14.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.651+0000 7f19b26d7640 1 -- 172.21.15.59:0/3473114513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19ac0cdd90 msgr2=0x7f19ac155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.651+0000 7f19b26d7640 1 --2- 172.21.15.59:0/3473114513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19ac0cdd90 0x7f19ac155150 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f199400c450 tx=0x7f199400c910 comp rx=0 tx=0).stop 2023-10-16T14:26:14.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.653+0000 7f19b26d7640 1 -- 172.21.15.59:0/3473114513 shutdown_connections 2023-10-16T14:26:14.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.653+0000 7f19b26d7640 1 --2- 172.21.15.59:0/3473114513 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f198c06aec0 0x7f198c06d380 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.653+0000 7f19b26d7640 1 --2- 172.21.15.59:0/3473114513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19ac15c9f0 0x7f19ac155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.653+0000 7f19b26d7640 1 --2- 172.21.15.59:0/3473114513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19ac0cdd90 0x7f19ac155150 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.653+0000 7f19b26d7640 1 --2- 172.21.15.59:0/3473114513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19ac0b83b0 0x7f19ac0c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.653+0000 7f19b26d7640 1 -- 172.21.15.59:0/3473114513 >> 172.21.15.59:0/3473114513 conn(0x7f19ac071510 msgr2=0x7f19ac15b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:14.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.654+0000 7f19b26d7640 1 -- 172.21.15.59:0/3473114513 shutdown_connections 2023-10-16T14:26:14.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.654+0000 7f19b26d7640 1 -- 172.21.15.59:0/3473114513 wait complete. 2023-10-16T14:26:14.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476748 got 68719476748 for osd.0 2023-10-16T14:26:14.660 DEBUG:teuthology.parallel:result is None 2023-10-16T14:26:14.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.659+0000 7f25b85d5640 1 -- 172.21.15.59:0/2459349393 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f25b015e3c0 con 0x7f25b006dd90 2023-10-16T14:26:14.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.660+0000 7f25aeffd640 1 -- 172.21.15.59:0/2459349393 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f25b015e3c0 con 0x7f25b006dd90 2023-10-16T14:26:14.663 INFO:teuthology.orchestra.run.smithi059.stdout:64424509449 2023-10-16T14:26:14.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.662+0000 7f25b85d5640 1 -- 172.21.15.59:0/2459349393 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f259406af40 msgr2=0x7f259406d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.662+0000 7f25b85d5640 1 --2- 172.21.15.59:0/2459349393 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f259406af40 0x7f259406d400 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f259c036000 tx=0x7f259c03c040 comp rx=0 tx=0).stop 2023-10-16T14:26:14.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.662+0000 7f25b85d5640 1 -- 172.21.15.59:0/2459349393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b006dd90 msgr2=0x7f25b00b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.662+0000 7f25b85d5640 1 --2- 172.21.15.59:0/2459349393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b006dd90 0x7f25b00b3e10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f25a800e870 tx=0x7f25a800ed30 comp rx=0 tx=0).stop 2023-10-16T14:26:14.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.663+0000 7f25b85d5640 1 -- 172.21.15.59:0/2459349393 shutdown_connections 2023-10-16T14:26:14.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.663+0000 7f25b85d5640 1 --2- 172.21.15.59:0/2459349393 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f259406af40 0x7f259406d400 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.663+0000 7f25b85d5640 1 --2- 172.21.15.59:0/2459349393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25b015cb60 0x7f25b0155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.663+0000 7f25b85d5640 1 --2- 172.21.15.59:0/2459349393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25b00b06f0 0x7f25b00c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.663+0000 7f25b85d5640 1 --2- 172.21.15.59:0/2459349393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25b006dd90 0x7f25b00b3e10 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f25a800e870 tx=0x7f25a800ed30 comp rx=0 tx=0).stop 2023-10-16T14:26:14.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.663+0000 7f25b85d5640 1 -- 172.21.15.59:0/2459349393 >> 172.21.15.59:0/2459349393 conn(0x7f25b006a440 msgr2=0x7f25b006c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:14.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.663+0000 7f25b85d5640 1 -- 172.21.15.59:0/2459349393 shutdown_connections 2023-10-16T14:26:14.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.663+0000 7f25b85d5640 1 -- 172.21.15.59:0/2459349393 wait complete. 2023-10-16T14:26:14.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.663+0000 7f34f77fe640 1 -- 172.21.15.59:0/2913292134 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f350c073ef0 con 0x7f350c06e3e0 2023-10-16T14:26:14.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476746 got 68719476746 for osd.2 2023-10-16T14:26:14.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.664+0000 7f591987c640 1 -- 172.21.15.59:0/750850844 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f59141647b0 con 0x7f59140ce0e0 2023-10-16T14:26:14.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.664+0000 7f3501ffb640 1 -- 172.21.15.59:0/2913292134 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f350807b410 con 0x7f350c06e3e0 2023-10-16T14:26:14.673 DEBUG:teuthology.parallel:result is None 2023-10-16T14:26:14.674 INFO:teuthology.orchestra.run.smithi059.stdout:64424509451 2023-10-16T14:26:14.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.665+0000 7f58fbfff640 1 -- 172.21.15.59:0/750850844 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5904058160 con 0x7f59140ce0e0 2023-10-16T14:26:14.675 INFO:teuthology.orchestra.run.smithi059.stdout:64424509449 2023-10-16T14:26:14.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.667+0000 7f591987c640 1 -- 172.21.15.59:0/750850844 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f590006af70 msgr2=0x7f590006d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.667+0000 7f34f77fe640 1 -- 172.21.15.59:0/2913292134 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f34f006ae70 msgr2=0x7f34f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.667+0000 7f34f77fe640 1 --2- 172.21.15.59:0/2913292134 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f34f006ae70 0x7f34f006d330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f350c0cf360 tx=0x7f34fc009040 comp rx=0 tx=0).stop 2023-10-16T14:26:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.667+0000 7f34f77fe640 1 -- 172.21.15.59:0/2913292134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c06e3e0 msgr2=0x7f350c0c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.667+0000 7f34f77fe640 1 --2- 172.21.15.59:0/2913292134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c06e3e0 0x7f350c0c93b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f35080090b0 tx=0x7f35080046c0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.667+0000 7f591987c640 1 --2- 172.21.15.59:0/750850844 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f590006af70 0x7f590006d430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5908007fd0 tx=0x7f5908009040 comp rx=0 tx=0).stop 2023-10-16T14:26:14.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.667+0000 7f591987c640 1 -- 172.21.15.59:0/750850844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59140ce0e0 msgr2=0x7f591414c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.667+0000 7f591987c640 1 --2- 172.21.15.59:0/750850844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59140ce0e0 0x7f591414c060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f590400d800 tx=0x7f590400dcc0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.668+0000 7f591987c640 1 -- 172.21.15.59:0/750850844 shutdown_connections 2023-10-16T14:26:14.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.668+0000 7f591987c640 1 --2- 172.21.15.59:0/750850844 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f590006af70 0x7f590006d430 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.668+0000 7f591987c640 1 --2- 172.21.15.59:0/750850844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59141656a0 0x7f59141617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.668+0000 7f591987c640 1 --2- 172.21.15.59:0/750850844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5914160e80 0x7f5914161260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.668+0000 7f591987c640 1 --2- 172.21.15.59:0/750850844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59140ce0e0 0x7f591414c060 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.668+0000 7f591987c640 1 -- 172.21.15.59:0/750850844 >> 172.21.15.59:0/750850844 conn(0x7f59140cb1b0 msgr2=0x7f591415d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:14.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.668+0000 7f34f77fe640 1 -- 172.21.15.59:0/2913292134 shutdown_connections 2023-10-16T14:26:14.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.668+0000 7f34f77fe640 1 --2- 172.21.15.59:0/2913292134 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f34f006ae70 0x7f34f006d330 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.668+0000 7f34f77fe640 1 --2- 172.21.15.59:0/2913292134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350c15d340 0x7f350c0c2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.668+0000 7f34f77fe640 1 --2- 172.21.15.59:0/2913292134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f350c15cee0 0x7f350c14b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.668+0000 7f34f77fe640 1 --2- 172.21.15.59:0/2913292134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c06e3e0 0x7f350c0c93b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.668+0000 7f34f77fe640 1 -- 172.21.15.59:0/2913292134 >> 172.21.15.59:0/2913292134 conn(0x7f350c0cb1b0 msgr2=0x7f350c0c4510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:14.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.668+0000 7f591987c640 1 -- 172.21.15.59:0/750850844 shutdown_connections 2023-10-16T14:26:14.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.668+0000 7f591987c640 1 -- 172.21.15.59:0/750850844 wait complete. 2023-10-16T14:26:14.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.668+0000 7f34f77fe640 1 -- 172.21.15.59:0/2913292134 shutdown_connections 2023-10-16T14:26:14.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.668+0000 7f34f77fe640 1 -- 172.21.15.59:0/2913292134 wait complete. 2023-10-16T14:26:14.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476746 got 68719476746 for osd.3 2023-10-16T14:26:14.683 DEBUG:teuthology.parallel:result is None 2023-10-16T14:26:14.684 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.5 2023-10-16T14:26:14.684 DEBUG:teuthology.parallel:result is None 2023-10-16T14:26:14.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.7 2023-10-16T14:26:14.686 DEBUG:teuthology.parallel:result is None 2023-10-16T14:26:14.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.4 2023-10-16T14:26:14.690 DEBUG:teuthology.parallel:result is None 2023-10-16T14:26:14.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.6 2023-10-16T14:26:14.692 DEBUG:teuthology.parallel:result is None 2023-10-16T14:26:14.692 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-16T14:26:14.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T14:26:14.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.945+0000 7fa6848fc640 1 Processor -- start 2023-10-16T14:26:14.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.946+0000 7fa6848fc640 1 -- start start 2023-10-16T14:26:14.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.947+0000 7fa6848fc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6800affa0 0x7fa68006b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.947+0000 7fa6848fc640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa68006be40 0x7fa68015c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.947+0000 7fa6848fc640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6800cac90 con 0x7fa6800af8f0 2023-10-16T14:26:14.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.947+0000 7fa6848fc640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68006c2d0 con 0x7fa68006be40 2023-10-16T14:26:14.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.947+0000 7fa6848fc640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6800cb810 con 0x7fa6800affa0 2023-10-16T14:26:14.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.947+0000 7fa67ffff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa68006be40 0x7fa68015c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.947+0000 7fa67ffff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa68006be40 0x7fa68015c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41992/0 (socket says 172.21.15.59:41992) 2023-10-16T14:26:14.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.947+0000 7fa67ffff640 1 -- 172.21.15.59:0/59831441 learned_addr learned my addr 172.21.15.59:0/59831441 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:14.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.948+0000 7fa67effd640 1 --2- 172.21.15.59:0/59831441 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6800affa0 0x7fa68006b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.948+0000 7fa67ffff640 1 -- 172.21.15.59:0/59831441 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6800affa0 msgr2=0x7fa68006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:14.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.948+0000 7fa67ffff640 1 --2- 172.21.15.59:0/59831441 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6800affa0 0x7fa68006b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.948+0000 7fa67ffff640 1 -- 172.21.15.59:0/59831441 >> v1:172.21.15.151:6789/0 conn(0x7fa6800af8f0 legacy=0x7fa6800cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:14.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.948+0000 7fa67ffff640 1 -- 172.21.15.59:0/59831441 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6800caee0 con 0x7fa68006be40 2023-10-16T14:26:14.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.949+0000 7fa67ffff640 1 --2- 172.21.15.59:0/59831441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa68006be40 0x7fa68015c2b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa678009e50 tx=0x7fa67802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e300ceae8802c4ed server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.949+0000 7fa67e7fc640 1 -- 172.21.15.59:0/59831441 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67802ca70 con 0x7fa68006be40 2023-10-16T14:26:14.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.949+0000 7fa67e7fc640 1 -- 172.21.15.59:0/59831441 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67802cbd0 con 0x7fa68006be40 2023-10-16T14:26:14.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.949+0000 7fa67e7fc640 1 -- 172.21.15.59:0/59831441 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6780343f0 con 0x7fa68006be40 2023-10-16T14:26:14.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.950+0000 7fa6848fc640 1 -- 172.21.15.59:0/59831441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa68006be40 msgr2=0x7fa68015c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.950+0000 7fa6848fc640 1 --2- 172.21.15.59:0/59831441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa68006be40 0x7fa68015c2b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa678009e50 tx=0x7fa67802bed0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.950+0000 7fa6848fc640 1 -- 172.21.15.59:0/59831441 shutdown_connections 2023-10-16T14:26:14.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.950+0000 7fa6848fc640 1 --2- 172.21.15.59:0/59831441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa68006be40 0x7fa68015c2b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.950+0000 7fa6848fc640 1 --2- 172.21.15.59:0/59831441 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6800affa0 0x7fa68006b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.950+0000 7fa6848fc640 1 -- 172.21.15.59:0/59831441 >> 172.21.15.59:0/59831441 conn(0x7fa6800d0640 msgr2=0x7fa6800d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:14.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.950+0000 7fa6848fc640 1 -- 172.21.15.59:0/59831441 shutdown_connections 2023-10-16T14:26:14.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.950+0000 7fa6848fc640 1 -- 172.21.15.59:0/59831441 wait complete. 2023-10-16T14:26:14.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.952+0000 7fa6848fc640 1 Processor -- start 2023-10-16T14:26:14.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.952+0000 7fa6848fc640 1 -- start start 2023-10-16T14:26:14.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.953+0000 7fa6848fc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa68006be40 0x7fa680155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.953+0000 7fa6848fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6800af8f0 0x7fa6800ad4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.953+0000 7fa6848fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6800affa0 0x7fa68015e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.953+0000 7fa6848fc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6800adfb0 con 0x7fa6800affa0 2023-10-16T14:26:14.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.953+0000 7fa6848fc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6800ae290 con 0x7fa6800af8f0 2023-10-16T14:26:14.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.953+0000 7fa6848fc640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6800ae570 con 0x7fa68006be40 2023-10-16T14:26:14.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.953+0000 7fa67ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6800affa0 0x7fa68015e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.953+0000 7fa67ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6800affa0 0x7fa68015e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42004/0 (socket says 172.21.15.59:42004) 2023-10-16T14:26:14.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.953+0000 7fa67ffff640 1 -- 172.21.15.59:0/3646738411 learned_addr learned my addr 172.21.15.59:0/3646738411 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:14.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.953+0000 7fa67effd640 1 --2- 172.21.15.59:0/3646738411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6800af8f0 0x7fa6800ad4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.953+0000 7fa67f7fe640 1 --2- 172.21.15.59:0/3646738411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa68006be40 0x7fa680155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.954+0000 7fa67ffff640 1 -- 172.21.15.59:0/3646738411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa68006be40 msgr2=0x7fa680155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.954+0000 7fa67ffff640 1 --2- 172.21.15.59:0/3646738411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa68006be40 0x7fa680155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.954+0000 7fa67ffff640 1 -- 172.21.15.59:0/3646738411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6800af8f0 msgr2=0x7fa6800ad4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:14.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.954+0000 7fa67ffff640 1 --2- 172.21.15.59:0/3646738411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6800af8f0 0x7fa6800ad4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:14.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.954+0000 7fa67ffff640 1 -- 172.21.15.59:0/3646738411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa678009b30 con 0x7fa6800affa0 2023-10-16T14:26:14.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.954+0000 7fa67ffff640 1 --2- 172.21.15.59:0/3646738411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6800affa0 0x7fa68015e7a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa678009e50 tx=0x7fa678004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.954+0000 7fa667fff640 1 -- 172.21.15.59:0/3646738411 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa678009510 con 0x7fa6800affa0 2023-10-16T14:26:14.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.954+0000 7fa667fff640 1 -- 172.21.15.59:0/3646738411 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67803e450 con 0x7fa6800affa0 2023-10-16T14:26:14.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.954+0000 7fa667fff640 1 -- 172.21.15.59:0/3646738411 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67803e800 con 0x7fa6800affa0 2023-10-16T14:26:14.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.954+0000 7fa6848fc640 1 -- 172.21.15.59:0/3646738411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6800ae850 con 0x7fa6800affa0 2023-10-16T14:26:14.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.954+0000 7fa6848fc640 1 -- 172.21.15.59:0/3646738411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68015e100 con 0x7fa6800affa0 2023-10-16T14:26:14.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.956+0000 7fa6848fc640 1 -- 172.21.15.59:0/3646738411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6800aed10 con 0x7fa6800affa0 2023-10-16T14:26:14.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.957+0000 7fa667fff640 1 -- 172.21.15.59:0/3646738411 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa67803e960 con 0x7fa6800affa0 2023-10-16T14:26:14.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.957+0000 7fa667fff640 1 --2- 172.21.15.59:0/3646738411 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa66c06aea0 0x7fa66c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:14.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.957+0000 7fa667fff640 1 -- 172.21.15.59:0/3646738411 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa6780ac710 con 0x7fa6800affa0 2023-10-16T14:26:14.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.958+0000 7fa67f7fe640 1 --2- 172.21.15.59:0/3646738411 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa66c06aea0 0x7fa66c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:14.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.959+0000 7fa67f7fe640 1 --2- 172.21.15.59:0/3646738411 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa66c06aea0 0x7fa66c06d360 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa670004ea0 tx=0x7fa670009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:14.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:14.962+0000 7fa667fff640 1 -- 172.21.15.59:0/3646738411 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa678077570 con 0x7fa6800affa0 2023-10-16T14:26:15.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.146+0000 7fa6848fc640 1 -- 172.21.15.59:0/3646738411 --> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa6800ae400 con 0x7fa66c06aea0 2023-10-16T14:26:15.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.173+0000 7fa667fff640 1 -- 172.21.15.59:0/3646738411 <== mgr.4100 v2:172.21.15.151:6800/518957627 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344970 (secure 0 0 0) 0x7fa6800ae400 con 0x7fa66c06aea0 2023-10-16T14:26:15.181 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:15.183 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-16T14:26:15.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.180+0000 7fa6848fc640 1 -- 172.21.15.59:0/3646738411 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa66c06aea0 msgr2=0x7fa66c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:15.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.180+0000 7fa6848fc640 1 --2- 172.21.15.59:0/3646738411 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa66c06aea0 0x7fa66c06d360 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa670004ea0 tx=0x7fa670009040 comp rx=0 tx=0).stop 2023-10-16T14:26:15.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.180+0000 7fa6848fc640 1 -- 172.21.15.59:0/3646738411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6800affa0 msgr2=0x7fa68015e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:15.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.180+0000 7fa6848fc640 1 --2- 172.21.15.59:0/3646738411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6800affa0 0x7fa68015e7a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa678009e50 tx=0x7fa678004a40 comp rx=0 tx=0).stop 2023-10-16T14:26:15.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.180+0000 7fa6848fc640 1 -- 172.21.15.59:0/3646738411 shutdown_connections 2023-10-16T14:26:15.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.180+0000 7fa6848fc640 1 --2- 172.21.15.59:0/3646738411 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa66c06aea0 0x7fa66c06d360 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:15.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.180+0000 7fa6848fc640 1 --2- 172.21.15.59:0/3646738411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6800affa0 0x7fa68015e7a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:15.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.180+0000 7fa6848fc640 1 --2- 172.21.15.59:0/3646738411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6800af8f0 0x7fa6800ad4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:15.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.180+0000 7fa6848fc640 1 --2- 172.21.15.59:0/3646738411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa68006be40 0x7fa680155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:15.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.180+0000 7fa6848fc640 1 -- 172.21.15.59:0/3646738411 >> 172.21.15.59:0/3646738411 conn(0x7fa6800d0640 msgr2=0x7fa68015f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:15.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.181+0000 7fa6848fc640 1 -- 172.21.15.59:0/3646738411 shutdown_connections 2023-10-16T14:26:15.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.181+0000 7fa6848fc640 1 -- 172.21.15.59:0/3646738411 wait complete. 2023-10-16T14:26:15.205 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-10-16T14:26:13.875119+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219492,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755228,"statfs":{"total":773094113280,"available":772869353472,"internally_reserved":0,"allocated":3383296,"data_stored":2022094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005484"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.740143+0000","last_change":"2023-10-16T14:25:47.673909+0000","last_active":"2023-10-16T14:25:52.740143+0000","last_peered":"2023-10-16T14:25:52.740143+0000","last_clean":"2023-10-16T14:25:52.740143+0000","last_became_active":"2023-10-16T14:25:47.672564+0000","last_became_peered":"2023-10-16T14:25:47.672564+0000","last_unstale":"2023-10-16T14:25:52.740143+0000","last_undegraded":"2023-10-16T14:25:52.740143+0000","last_fullsized":"2023-10-16T14:25:52.740143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:08:41.557287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.753608+0000","last_change":"2023-10-16T14:25:48.712086+0000","last_active":"2023-10-16T14:25:52.753608+0000","last_peered":"2023-10-16T14:25:52.753608+0000","last_clean":"2023-10-16T14:25:52.753608+0000","last_became_active":"2023-10-16T14:25:48.711422+0000","last_became_peered":"2023-10-16T14:25:48.711422+0000","last_unstale":"2023-10-16T14:25:52.753608+0000","last_undegraded":"2023-10-16T14:25:52.753608+0000","last_fullsized":"2023-10-16T14:25:52.753608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:15.110757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.089049+0000","last_change":"2023-10-16T14:25:52.777768+0000","last_active":"2023-10-16T14:25:54.089049+0000","last_peered":"2023-10-16T14:25:54.089049+0000","last_clean":"2023-10-16T14:25:54.089049+0000","last_became_active":"2023-10-16T14:25:52.777201+0000","last_became_peered":"2023-10-16T14:25:52.777201+0000","last_unstale":"2023-10-16T14:25:54.089049+0000","last_undegraded":"2023-10-16T14:25:54.089049+0000","last_fullsized":"2023-10-16T14:25:54.089049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:11:19.880188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.753780+0000","last_change":"2023-10-16T14:25:47.687110+0000","last_active":"2023-10-16T14:25:52.753780+0000","last_peered":"2023-10-16T14:25:52.753780+0000","last_clean":"2023-10-16T14:25:52.753780+0000","last_became_active":"2023-10-16T14:25:47.685070+0000","last_became_peered":"2023-10-16T14:25:47.685070+0000","last_unstale":"2023-10-16T14:25:52.753780+0000","last_undegraded":"2023-10-16T14:25:52.753780+0000","last_fullsized":"2023-10-16T14:25:52.753780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:23:12.328185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.751791+0000","last_change":"2023-10-16T14:25:48.698409+0000","last_active":"2023-10-16T14:25:52.751791+0000","last_peered":"2023-10-16T14:25:52.751791+0000","last_clean":"2023-10-16T14:25:52.751791+0000","last_became_active":"2023-10-16T14:25:48.697726+0000","last_became_peered":"2023-10-16T14:25:48.697726+0000","last_unstale":"2023-10-16T14:25:52.751791+0000","last_undegraded":"2023-10-16T14:25:52.751791+0000","last_fullsized":"2023-10-16T14:25:52.751791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:31.708932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.085749+0000","last_change":"2023-10-16T14:25:52.761817+0000","last_active":"2023-10-16T14:25:54.085749+0000","last_peered":"2023-10-16T14:25:54.085749+0000","last_clean":"2023-10-16T14:25:54.085749+0000","last_became_active":"2023-10-16T14:25:52.761162+0000","last_became_peered":"2023-10-16T14:25:52.761162+0000","last_unstale":"2023-10-16T14:25:54.085749+0000","last_undegraded":"2023-10-16T14:25:54.085749+0000","last_fullsized":"2023-10-16T14:25:54.085749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:12:32.541889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742426+0000","last_change":"2023-10-16T14:25:47.688476+0000","last_active":"2023-10-16T14:25:52.742426+0000","last_peered":"2023-10-16T14:25:52.742426+0000","last_clean":"2023-10-16T14:25:52.742426+0000","last_became_active":"2023-10-16T14:25:47.684107+0000","last_became_peered":"2023-10-16T14:25:47.684107+0000","last_unstale":"2023-10-16T14:25:52.742426+0000","last_undegraded":"2023-10-16T14:25:52.742426+0000","last_fullsized":"2023-10-16T14:25:52.742426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:02.376389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.730675+0000","last_change":"2023-10-16T14:25:48.698904+0000","last_active":"2023-10-16T14:25:52.730675+0000","last_peered":"2023-10-16T14:25:52.730675+0000","last_clean":"2023-10-16T14:25:52.730675+0000","last_became_active":"2023-10-16T14:25:48.698533+0000","last_became_peered":"2023-10-16T14:25:48.698533+0000","last_unstale":"2023-10-16T14:25:52.730675+0000","last_undegraded":"2023-10-16T14:25:52.730675+0000","last_fullsized":"2023-10-16T14:25:52.730675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:55:50.448443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.090560+0000","last_change":"2023-10-16T14:25:52.762960+0000","last_active":"2023-10-16T14:25:54.090560+0000","last_peered":"2023-10-16T14:25:54.090560+0000","last_clean":"2023-10-16T14:25:54.090560+0000","last_became_active":"2023-10-16T14:25:52.762507+0000","last_became_peered":"2023-10-16T14:25:52.762507+0000","last_unstale":"2023-10-16T14:25:54.090560+0000","last_undegraded":"2023-10-16T14:25:54.090560+0000","last_fullsized":"2023-10-16T14:25:54.090560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:35:03.884337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742081+0000","last_change":"2023-10-16T14:25:47.684937+0000","last_active":"2023-10-16T14:25:52.742081+0000","last_peered":"2023-10-16T14:25:52.742081+0000","last_clean":"2023-10-16T14:25:52.742081+0000","last_became_active":"2023-10-16T14:25:47.684625+0000","last_became_peered":"2023-10-16T14:25:47.684625+0000","last_unstale":"2023-10-16T14:25:52.742081+0000","last_undegraded":"2023-10-16T14:25:52.742081+0000","last_fullsized":"2023-10-16T14:25:52.742081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:05.381585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734783+0000","last_change":"2023-10-16T14:25:48.707706+0000","last_active":"2023-10-16T14:25:52.734783+0000","last_peered":"2023-10-16T14:25:52.734783+0000","last_clean":"2023-10-16T14:25:52.734783+0000","last_became_active":"2023-10-16T14:25:48.707434+0000","last_became_peered":"2023-10-16T14:25:48.707434+0000","last_unstale":"2023-10-16T14:25:52.734783+0000","last_undegraded":"2023-10-16T14:25:52.734783+0000","last_fullsized":"2023-10-16T14:25:52.734783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:25:48.053924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086892+0000","last_change":"2023-10-16T14:25:52.775947+0000","last_active":"2023-10-16T14:25:54.086892+0000","last_peered":"2023-10-16T14:25:54.086892+0000","last_clean":"2023-10-16T14:25:54.086892+0000","last_became_active":"2023-10-16T14:25:52.771892+0000","last_became_peered":"2023-10-16T14:25:52.771892+0000","last_unstale":"2023-10-16T14:25:54.086892+0000","last_undegraded":"2023-10-16T14:25:54.086892+0000","last_fullsized":"2023-10-16T14:25:54.086892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:13:27.830565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734432+0000","last_change":"2023-10-16T14:25:48.702028+0000","last_active":"2023-10-16T14:25:52.734432+0000","last_peered":"2023-10-16T14:25:52.734432+0000","last_clean":"2023-10-16T14:25:52.734432+0000","last_became_active":"2023-10-16T14:25:48.701734+0000","last_became_peered":"2023-10-16T14:25:48.701734+0000","last_unstale":"2023-10-16T14:25:52.734432+0000","last_undegraded":"2023-10-16T14:25:52.734432+0000","last_fullsized":"2023-10-16T14:25:52.734432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:27:03.907713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734923+0000","last_change":"2023-10-16T14:25:47.675386+0000","last_active":"2023-10-16T14:25:52.734923+0000","last_peered":"2023-10-16T14:25:52.734923+0000","last_clean":"2023-10-16T14:25:52.734923+0000","last_became_active":"2023-10-16T14:25:47.673235+0000","last_became_peered":"2023-10-16T14:25:47.673235+0000","last_unstale":"2023-10-16T14:25:52.734923+0000","last_undegraded":"2023-10-16T14:25:52.734923+0000","last_fullsized":"2023-10-16T14:25:52.734923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:08:41.557287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.726707+0000","last_change":"2023-10-16T14:25:52.761060+0000","last_active":"2023-10-16T14:25:53.726707+0000","last_peered":"2023-10-16T14:25:53.726707+0000","last_clean":"2023-10-16T14:25:53.726707+0000","last_became_active":"2023-10-16T14:25:52.760368+0000","last_became_peered":"2023-10-16T14:25:52.760368+0000","last_unstale":"2023-10-16T14:25:53.726707+0000","last_undegraded":"2023-10-16T14:25:53.726707+0000","last_fullsized":"2023-10-16T14:25:53.726707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:22:11.797676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.755837+0000","last_change":"2023-10-16T14:25:48.711084+0000","last_active":"2023-10-16T14:25:52.755837+0000","last_peered":"2023-10-16T14:25:52.755837+0000","last_clean":"2023-10-16T14:25:52.755837+0000","last_became_active":"2023-10-16T14:25:48.710802+0000","last_became_peered":"2023-10-16T14:25:48.710802+0000","last_unstale":"2023-10-16T14:25:52.755837+0000","last_undegraded":"2023-10-16T14:25:52.755837+0000","last_fullsized":"2023-10-16T14:25:52.755837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:06.393767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.764948+0000","last_change":"2023-10-16T14:25:47.688614+0000","last_active":"2023-10-16T14:25:52.764948+0000","last_peered":"2023-10-16T14:25:52.764948+0000","last_clean":"2023-10-16T14:25:52.764948+0000","last_became_active":"2023-10-16T14:25:47.686187+0000","last_became_peered":"2023-10-16T14:25:47.686187+0000","last_unstale":"2023-10-16T14:25:52.764948+0000","last_undegraded":"2023-10-16T14:25:52.764948+0000","last_fullsized":"2023-10-16T14:25:52.764948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:55:49.436260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.084971+0000","last_change":"2023-10-16T14:25:52.773158+0000","last_active":"2023-10-16T14:25:54.084971+0000","last_peered":"2023-10-16T14:25:54.084971+0000","last_clean":"2023-10-16T14:25:54.084971+0000","last_became_active":"2023-10-16T14:25:52.772200+0000","last_became_peered":"2023-10-16T14:25:52.772200+0000","last_unstale":"2023-10-16T14:25:54.084971+0000","last_undegraded":"2023-10-16T14:25:54.084971+0000","last_fullsized":"2023-10-16T14:25:54.084971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:01.082527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734700+0000","last_change":"2023-10-16T14:25:48.696802+0000","last_active":"2023-10-16T14:25:52.734700+0000","last_peered":"2023-10-16T14:25:52.734700+0000","last_clean":"2023-10-16T14:25:52.734700+0000","last_became_active":"2023-10-16T14:25:48.695664+0000","last_became_peered":"2023-10-16T14:25:48.695664+0000","last_unstale":"2023-10-16T14:25:52.734700+0000","last_undegraded":"2023-10-16T14:25:52.734700+0000","last_fullsized":"2023-10-16T14:25:52.734700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:44:58.603248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735333+0000","last_change":"2023-10-16T14:25:47.690959+0000","last_active":"2023-10-16T14:25:52.735333+0000","last_peered":"2023-10-16T14:25:52.735333+0000","last_clean":"2023-10-16T14:25:52.735333+0000","last_became_active":"2023-10-16T14:25:47.690583+0000","last_became_peered":"2023-10-16T14:25:47.690583+0000","last_unstale":"2023-10-16T14:25:52.735333+0000","last_undegraded":"2023-10-16T14:25:52.735333+0000","last_fullsized":"2023-10-16T14:25:52.735333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:05.381585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.090752+0000","last_change":"2023-10-16T14:25:52.774636+0000","last_active":"2023-10-16T14:25:54.090752+0000","last_peered":"2023-10-16T14:25:54.090752+0000","last_clean":"2023-10-16T14:25:54.090752+0000","last_became_active":"2023-10-16T14:25:52.771832+0000","last_became_peered":"2023-10-16T14:25:52.771832+0000","last_unstale":"2023-10-16T14:25:54.090752+0000","last_undegraded":"2023-10-16T14:25:54.090752+0000","last_fullsized":"2023-10-16T14:25:54.090752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:20.646849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735106+0000","last_change":"2023-10-16T14:25:48.704071+0000","last_active":"2023-10-16T14:25:52.735106+0000","last_peered":"2023-10-16T14:25:52.735106+0000","last_clean":"2023-10-16T14:25:52.735106+0000","last_became_active":"2023-10-16T14:25:48.703786+0000","last_became_peered":"2023-10-16T14:25:48.703786+0000","last_unstale":"2023-10-16T14:25:52.735106+0000","last_undegraded":"2023-10-16T14:25:52.735106+0000","last_fullsized":"2023-10-16T14:25:52.735106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:01:09.957934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.740520+0000","last_change":"2023-10-16T14:25:47.684412+0000","last_active":"2023-10-16T14:25:52.740520+0000","last_peered":"2023-10-16T14:25:52.740520+0000","last_clean":"2023-10-16T14:25:52.740520+0000","last_became_active":"2023-10-16T14:25:47.684067+0000","last_became_peered":"2023-10-16T14:25:47.684067+0000","last_unstale":"2023-10-16T14:25:52.740520+0000","last_undegraded":"2023-10-16T14:25:52.740520+0000","last_fullsized":"2023-10-16T14:25:52.740520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:33.359003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.091066+0000","last_change":"2023-10-16T14:25:52.760002+0000","last_active":"2023-10-16T14:25:54.091066+0000","last_peered":"2023-10-16T14:25:54.091066+0000","last_clean":"2023-10-16T14:25:54.091066+0000","last_became_active":"2023-10-16T14:25:52.759113+0000","last_became_peered":"2023-10-16T14:25:52.759113+0000","last_unstale":"2023-10-16T14:25:54.091066+0000","last_undegraded":"2023-10-16T14:25:54.091066+0000","last_fullsized":"2023-10-16T14:25:54.091066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:53.190625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.739919+0000","last_change":"2023-10-16T14:25:48.697052+0000","last_active":"2023-10-16T14:25:52.739919+0000","last_peered":"2023-10-16T14:25:52.739919+0000","last_clean":"2023-10-16T14:25:52.739919+0000","last_became_active":"2023-10-16T14:25:48.695195+0000","last_became_peered":"2023-10-16T14:25:48.695195+0000","last_unstale":"2023-10-16T14:25:52.739919+0000","last_undegraded":"2023-10-16T14:25:52.739919+0000","last_fullsized":"2023-10-16T14:25:52.739919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:34.371186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735823+0000","last_change":"2023-10-16T14:25:47.690567+0000","last_active":"2023-10-16T14:25:52.735823+0000","last_peered":"2023-10-16T14:25:52.735823+0000","last_clean":"2023-10-16T14:25:52.735823+0000","last_became_active":"2023-10-16T14:25:47.690306+0000","last_became_peered":"2023-10-16T14:25:47.690306+0000","last_unstale":"2023-10-16T14:25:52.735823+0000","last_undegraded":"2023-10-16T14:25:52.735823+0000","last_fullsized":"2023-10-16T14:25:52.735823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:18.948353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086866+0000","last_change":"2023-10-16T14:25:52.762012+0000","last_active":"2023-10-16T14:25:54.086866+0000","last_peered":"2023-10-16T14:25:54.086866+0000","last_clean":"2023-10-16T14:25:54.086866+0000","last_became_active":"2023-10-16T14:25:52.761553+0000","last_became_peered":"2023-10-16T14:25:52.761553+0000","last_unstale":"2023-10-16T14:25:54.086866+0000","last_undegraded":"2023-10-16T14:25:54.086866+0000","last_fullsized":"2023-10-16T14:25:54.086866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:57.876480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.739718+0000","last_change":"2023-10-16T14:25:48.713472+0000","last_active":"2023-10-16T14:25:52.739718+0000","last_peered":"2023-10-16T14:25:52.739718+0000","last_clean":"2023-10-16T14:25:52.739718+0000","last_became_active":"2023-10-16T14:25:48.713019+0000","last_became_peered":"2023-10-16T14:25:48.713019+0000","last_unstale":"2023-10-16T14:25:52.739718+0000","last_undegraded":"2023-10-16T14:25:52.739718+0000","last_fullsized":"2023-10-16T14:25:52.739718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:08.080421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.287222+0000","last_change":"2023-10-16T14:25:47.690820+0000","last_active":"2023-10-16T14:25:53.287222+0000","last_peered":"2023-10-16T14:25:53.287222+0000","last_clean":"2023-10-16T14:25:53.287222+0000","last_became_active":"2023-10-16T14:25:47.690554+0000","last_became_peered":"2023-10-16T14:25:47.690554+0000","last_unstale":"2023-10-16T14:25:53.287222+0000","last_undegraded":"2023-10-16T14:25:53.287222+0000","last_fullsized":"2023-10-16T14:25:53.287222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:48:55.264157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.728903+0000","last_change":"2023-10-16T14:25:52.765122+0000","last_active":"2023-10-16T14:25:53.728903+0000","last_peered":"2023-10-16T14:25:53.728903+0000","last_clean":"2023-10-16T14:25:53.728903+0000","last_became_active":"2023-10-16T14:25:52.764663+0000","last_became_peered":"2023-10-16T14:25:52.764663+0000","last_unstale":"2023-10-16T14:25:53.728903+0000","last_undegraded":"2023-10-16T14:25:53.728903+0000","last_fullsized":"2023-10-16T14:25:53.728903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:02.278979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.769095+0000","last_change":"2023-10-16T14:25:48.717743+0000","last_active":"2023-10-16T14:25:52.769095+0000","last_peered":"2023-10-16T14:25:52.769095+0000","last_clean":"2023-10-16T14:25:52.769095+0000","last_became_active":"2023-10-16T14:25:48.717468+0000","last_became_peered":"2023-10-16T14:25:48.717468+0000","last_unstale":"2023-10-16T14:25:52.769095+0000","last_undegraded":"2023-10-16T14:25:52.769095+0000","last_fullsized":"2023-10-16T14:25:52.769095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:44:58.603248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734870+0000","last_change":"2023-10-16T14:25:47.676947+0000","last_active":"2023-10-16T14:25:52.734870+0000","last_peered":"2023-10-16T14:25:52.734870+0000","last_clean":"2023-10-16T14:25:52.734870+0000","last_became_active":"2023-10-16T14:25:47.676630+0000","last_became_peered":"2023-10-16T14:25:47.676630+0000","last_unstale":"2023-10-16T14:25:52.734870+0000","last_undegraded":"2023-10-16T14:25:52.734870+0000","last_fullsized":"2023-10-16T14:25:52.734870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:33.359003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.088211+0000","last_change":"2023-10-16T14:25:52.764074+0000","last_active":"2023-10-16T14:25:54.088211+0000","last_peered":"2023-10-16T14:25:54.088211+0000","last_clean":"2023-10-16T14:25:54.088211+0000","last_became_active":"2023-10-16T14:25:52.763641+0000","last_became_peered":"2023-10-16T14:25:52.763641+0000","last_unstale":"2023-10-16T14:25:54.088211+0000","last_undegraded":"2023-10-16T14:25:54.088211+0000","last_fullsized":"2023-10-16T14:25:54.088211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:21:41.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.724375+0000","last_change":"2023-10-16T14:25:48.710134+0000","last_active":"2023-10-16T14:25:52.724375+0000","last_peered":"2023-10-16T14:25:52.724375+0000","last_clean":"2023-10-16T14:25:52.724375+0000","last_became_active":"2023-10-16T14:25:48.709462+0000","last_became_peered":"2023-10-16T14:25:48.709462+0000","last_unstale":"2023-10-16T14:25:52.724375+0000","last_undegraded":"2023-10-16T14:25:52.724375+0000","last_fullsized":"2023-10-16T14:25:52.724375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:06.393767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.752412+0000","last_change":"2023-10-16T14:25:47.687252+0000","last_active":"2023-10-16T14:25:52.752412+0000","last_peered":"2023-10-16T14:25:52.752412+0000","last_clean":"2023-10-16T14:25:52.752412+0000","last_became_active":"2023-10-16T14:25:47.685825+0000","last_became_peered":"2023-10-16T14:25:47.685825+0000","last_unstale":"2023-10-16T14:25:52.752412+0000","last_undegraded":"2023-10-16T14:25:52.752412+0000","last_fullsized":"2023-10-16T14:25:52.752412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:01.814630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.087296+0000","last_change":"2023-10-16T14:25:52.767900+0000","last_active":"2023-10-16T14:25:54.087296+0000","last_peered":"2023-10-16T14:25:54.087296+0000","last_clean":"2023-10-16T14:25:54.087296+0000","last_became_active":"2023-10-16T14:25:52.767212+0000","last_became_peered":"2023-10-16T14:25:52.767212+0000","last_unstale":"2023-10-16T14:25:54.087296+0000","last_undegraded":"2023-10-16T14:25:54.087296+0000","last_fullsized":"2023-10-16T14:25:54.087296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:35:03.884337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741846+0000","last_change":"2023-10-16T14:25:48.722313+0000","last_active":"2023-10-16T14:25:52.741846+0000","last_peered":"2023-10-16T14:25:52.741846+0000","last_clean":"2023-10-16T14:25:52.741846+0000","last_became_active":"2023-10-16T14:25:48.718701+0000","last_became_peered":"2023-10-16T14:25:48.718701+0000","last_unstale":"2023-10-16T14:25:52.741846+0000","last_undegraded":"2023-10-16T14:25:52.741846+0000","last_fullsized":"2023-10-16T14:25:52.741846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:53.816510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734713+0000","last_change":"2023-10-16T14:25:47.685303+0000","last_active":"2023-10-16T14:25:52.734713+0000","last_peered":"2023-10-16T14:25:52.734713+0000","last_clean":"2023-10-16T14:25:52.734713+0000","last_became_active":"2023-10-16T14:25:47.682721+0000","last_became_peered":"2023-10-16T14:25:47.682721+0000","last_unstale":"2023-10-16T14:25:52.734713+0000","last_undegraded":"2023-10-16T14:25:52.734713+0000","last_fullsized":"2023-10-16T14:25:52.734713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:38:16.755159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086122+0000","last_change":"2023-10-16T14:25:52.772956+0000","last_active":"2023-10-16T14:25:54.086122+0000","last_peered":"2023-10-16T14:25:54.086122+0000","last_clean":"2023-10-16T14:25:54.086122+0000","last_became_active":"2023-10-16T14:25:52.772590+0000","last_became_peered":"2023-10-16T14:25:52.772590+0000","last_unstale":"2023-10-16T14:25:54.086122+0000","last_undegraded":"2023-10-16T14:25:54.086122+0000","last_fullsized":"2023-10-16T14:25:54.086122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:13:27.830565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.748440+0000","last_change":"2023-10-16T14:25:48.695306+0000","last_active":"2023-10-16T14:25:52.748440+0000","last_peered":"2023-10-16T14:25:52.748440+0000","last_clean":"2023-10-16T14:25:52.748440+0000","last_became_active":"2023-10-16T14:25:48.694997+0000","last_became_peered":"2023-10-16T14:25:48.694997+0000","last_unstale":"2023-10-16T14:25:52.748440+0000","last_undegraded":"2023-10-16T14:25:52.748440+0000","last_fullsized":"2023-10-16T14:25:52.748440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:10:11.346850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.755114+0000","last_change":"2023-10-16T14:25:47.684999+0000","last_active":"2023-10-16T14:25:52.755114+0000","last_peered":"2023-10-16T14:25:52.755114+0000","last_clean":"2023-10-16T14:25:52.755114+0000","last_became_active":"2023-10-16T14:25:47.684456+0000","last_became_peered":"2023-10-16T14:25:47.684456+0000","last_unstale":"2023-10-16T14:25:52.755114+0000","last_undegraded":"2023-10-16T14:25:52.755114+0000","last_fullsized":"2023-10-16T14:25:52.755114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:13:52.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086890+0000","last_change":"2023-10-16T14:25:52.771370+0000","last_active":"2023-10-16T14:25:54.086890+0000","last_peered":"2023-10-16T14:25:54.086890+0000","last_clean":"2023-10-16T14:25:54.086890+0000","last_became_active":"2023-10-16T14:25:52.770704+0000","last_became_peered":"2023-10-16T14:25:52.770704+0000","last_unstale":"2023-10-16T14:25:54.086890+0000","last_undegraded":"2023-10-16T14:25:54.086890+0000","last_fullsized":"2023-10-16T14:25:54.086890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:38:21.827312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.765178+0000","last_change":"2023-10-16T14:25:48.722957+0000","last_active":"2023-10-16T14:25:52.765178+0000","last_peered":"2023-10-16T14:25:52.765178+0000","last_clean":"2023-10-16T14:25:52.765178+0000","last_became_active":"2023-10-16T14:25:48.722644+0000","last_became_peered":"2023-10-16T14:25:48.722644+0000","last_unstale":"2023-10-16T14:25:52.765178+0000","last_undegraded":"2023-10-16T14:25:52.765178+0000","last_fullsized":"2023-10-16T14:25:52.765178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:48:56.276340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.733321+0000","last_change":"2023-10-16T14:25:47.686726+0000","last_active":"2023-10-16T14:25:52.733321+0000","last_peered":"2023-10-16T14:25:52.733321+0000","last_clean":"2023-10-16T14:25:52.733321+0000","last_became_active":"2023-10-16T14:25:47.686380+0000","last_became_peered":"2023-10-16T14:25:47.686380+0000","last_unstale":"2023-10-16T14:25:52.733321+0000","last_undegraded":"2023-10-16T14:25:52.733321+0000","last_fullsized":"2023-10-16T14:25:52.733321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:11:14.808035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.088884+0000","last_change":"2023-10-16T14:25:52.775875+0000","last_active":"2023-10-16T14:25:54.088884+0000","last_peered":"2023-10-16T14:25:54.088884+0000","last_clean":"2023-10-16T14:25:54.088884+0000","last_became_active":"2023-10-16T14:25:52.774845+0000","last_became_peered":"2023-10-16T14:25:52.774845+0000","last_unstale":"2023-10-16T14:25:54.088884+0000","last_undegraded":"2023-10-16T14:25:54.088884+0000","last_fullsized":"2023-10-16T14:25:54.088884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:14:32.299751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735654+0000","last_change":"2023-10-16T14:25:48.694170+0000","last_active":"2023-10-16T14:25:52.735654+0000","last_peered":"2023-10-16T14:25:52.735654+0000","last_clean":"2023-10-16T14:25:52.735654+0000","last_became_active":"2023-10-16T14:25:48.693887+0000","last_became_peered":"2023-10-16T14:25:48.693887+0000","last_unstale":"2023-10-16T14:25:52.735654+0000","last_undegraded":"2023-10-16T14:25:52.735654+0000","last_fullsized":"2023-10-16T14:25:52.735654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:11:15.820218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735010+0000","last_change":"2023-10-16T14:25:47.672195+0000","last_active":"2023-10-16T14:25:52.735010+0000","last_peered":"2023-10-16T14:25:52.735010+0000","last_clean":"2023-10-16T14:25:52.735010+0000","last_became_active":"2023-10-16T14:25:47.671904+0000","last_became_peered":"2023-10-16T14:25:47.671904+0000","last_unstale":"2023-10-16T14:25:52.735010+0000","last_undegraded":"2023-10-16T14:25:52.735010+0000","last_fullsized":"2023-10-16T14:25:52.735010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:44:57.591065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.728977+0000","last_change":"2023-10-16T14:25:37.824419+0000","last_active":"2023-10-16T14:25:52.728977+0000","last_peered":"2023-10-16T14:25:52.728977+0000","last_clean":"2023-10-16T14:25:52.728977+0000","last_became_active":"2023-10-16T14:25:37.821909+0000","last_became_peered":"2023-10-16T14:25:37.821909+0000","last_unstale":"2023-10-16T14:25:52.728977+0000","last_undegraded":"2023-10-16T14:25:52.728977+0000","last_fullsized":"2023-10-16T14:25:52.728977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:36.449944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:36.449944+0000","last_clean_scrub_stamp":"2023-10-16T14:25:36.449944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:37:42.457821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.727527+0000","last_change":"2023-10-16T14:25:52.743776+0000","last_active":"2023-10-16T14:25:53.727527+0000","last_peered":"2023-10-16T14:25:53.727527+0000","last_clean":"2023-10-16T14:25:53.727527+0000","last_became_active":"2023-10-16T14:25:52.743307+0000","last_became_peered":"2023-10-16T14:25:52.743307+0000","last_unstale":"2023-10-16T14:25:53.727527+0000","last_undegraded":"2023-10-16T14:25:53.727527+0000","last_fullsized":"2023-10-16T14:25:53.727527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:44:03.308638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734705+0000","last_change":"2023-10-16T14:25:48.698529+0000","last_active":"2023-10-16T14:25:52.734705+0000","last_peered":"2023-10-16T14:25:52.734705+0000","last_clean":"2023-10-16T14:25:52.734705+0000","last_became_active":"2023-10-16T14:25:48.698220+0000","last_became_peered":"2023-10-16T14:25:48.698220+0000","last_unstale":"2023-10-16T14:25:52.734705+0000","last_undegraded":"2023-10-16T14:25:52.734705+0000","last_fullsized":"2023-10-16T14:25:52.734705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:24:18.840113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.769078+0000","last_change":"2023-10-16T14:25:47.689827+0000","last_active":"2023-10-16T14:25:52.769078+0000","last_peered":"2023-10-16T14:25:52.769078+0000","last_clean":"2023-10-16T14:25:52.769078+0000","last_became_active":"2023-10-16T14:25:47.689464+0000","last_became_peered":"2023-10-16T14:25:47.689464+0000","last_unstale":"2023-10-16T14:25:52.769078+0000","last_undegraded":"2023-10-16T14:25:52.769078+0000","last_fullsized":"2023-10-16T14:25:52.769078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:13:52.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.090293+0000","last_change":"2023-10-16T14:25:52.752794+0000","last_active":"2023-10-16T14:25:54.090293+0000","last_peered":"2023-10-16T14:25:54.090293+0000","last_clean":"2023-10-16T14:25:54.090293+0000","last_became_active":"2023-10-16T14:25:52.751655+0000","last_became_peered":"2023-10-16T14:25:52.751655+0000","last_unstale":"2023-10-16T14:25:54.090293+0000","last_undegraded":"2023-10-16T14:25:54.090293+0000","last_fullsized":"2023-10-16T14:25:54.090293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:38:21.827312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742050+0000","last_change":"2023-10-16T14:25:48.697393+0000","last_active":"2023-10-16T14:25:52.742050+0000","last_peered":"2023-10-16T14:25:52.742050+0000","last_clean":"2023-10-16T14:25:52.742050+0000","last_became_active":"2023-10-16T14:25:48.697054+0000","last_became_peered":"2023-10-16T14:25:48.697054+0000","last_unstale":"2023-10-16T14:25:52.742050+0000","last_undegraded":"2023-10-16T14:25:52.742050+0000","last_fullsized":"2023-10-16T14:25:52.742050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:49.130655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.750852+0000","last_change":"2023-10-16T14:25:47.684985+0000","last_active":"2023-10-16T14:25:52.750852+0000","last_peered":"2023-10-16T14:25:52.750852+0000","last_clean":"2023-10-16T14:25:52.750852+0000","last_became_active":"2023-10-16T14:25:47.684330+0000","last_became_peered":"2023-10-16T14:25:47.684330+0000","last_unstale":"2023-10-16T14:25:52.750852+0000","last_undegraded":"2023-10-16T14:25:52.750852+0000","last_fullsized":"2023-10-16T14:25:52.750852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:30:15.114400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086956+0000","last_change":"2023-10-16T14:25:52.757607+0000","last_active":"2023-10-16T14:25:54.086956+0000","last_peered":"2023-10-16T14:25:54.086956+0000","last_clean":"2023-10-16T14:25:54.086956+0000","last_became_active":"2023-10-16T14:25:52.757210+0000","last_became_peered":"2023-10-16T14:25:52.757210+0000","last_unstale":"2023-10-16T14:25:54.086956+0000","last_undegraded":"2023-10-16T14:25:54.086956+0000","last_fullsized":"2023-10-16T14:25:54.086956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:04:13.493245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742186+0000","last_change":"2023-10-16T14:25:48.706248+0000","last_active":"2023-10-16T14:25:52.742186+0000","last_peered":"2023-10-16T14:25:52.742186+0000","last_clean":"2023-10-16T14:25:52.742186+0000","last_became_active":"2023-10-16T14:25:48.705245+0000","last_became_peered":"2023-10-16T14:25:48.705245+0000","last_unstale":"2023-10-16T14:25:52.742186+0000","last_undegraded":"2023-10-16T14:25:52.742186+0000","last_fullsized":"2023-10-16T14:25:52.742186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:13:23.770595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.740182+0000","last_change":"2023-10-16T14:25:47.689189+0000","last_active":"2023-10-16T14:25:52.740182+0000","last_peered":"2023-10-16T14:25:52.740182+0000","last_clean":"2023-10-16T14:25:52.740182+0000","last_became_active":"2023-10-16T14:25:47.688019+0000","last_became_peered":"2023-10-16T14:25:47.688019+0000","last_unstale":"2023-10-16T14:25:52.740182+0000","last_undegraded":"2023-10-16T14:25:52.740182+0000","last_fullsized":"2023-10-16T14:25:52.740182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:02.376389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.725983+0000","last_change":"2023-10-16T14:25:52.743545+0000","last_active":"2023-10-16T14:25:53.725983+0000","last_peered":"2023-10-16T14:25:53.725983+0000","last_clean":"2023-10-16T14:25:53.725983+0000","last_became_active":"2023-10-16T14:25:52.743011+0000","last_became_peered":"2023-10-16T14:25:52.743011+0000","last_unstale":"2023-10-16T14:25:53.725983+0000","last_undegraded":"2023-10-16T14:25:53.725983+0000","last_fullsized":"2023-10-16T14:25:53.725983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:44:58.353984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.726324+0000","last_change":"2023-10-16T14:25:48.718247+0000","last_active":"2023-10-16T14:25:52.726324+0000","last_peered":"2023-10-16T14:25:52.726324+0000","last_clean":"2023-10-16T14:25:52.726324+0000","last_became_active":"2023-10-16T14:25:48.717927+0000","last_became_peered":"2023-10-16T14:25:48.717927+0000","last_unstale":"2023-10-16T14:25:52.726324+0000","last_undegraded":"2023-10-16T14:25:52.726324+0000","last_fullsized":"2023-10-16T14:25:52.726324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:08:42.569470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742310+0000","last_change":"2023-10-16T14:25:47.689833+0000","last_active":"2023-10-16T14:25:52.742310+0000","last_peered":"2023-10-16T14:25:52.742310+0000","last_clean":"2023-10-16T14:25:52.742310+0000","last_became_active":"2023-10-16T14:25:47.689476+0000","last_became_peered":"2023-10-16T14:25:47.689476+0000","last_unstale":"2023-10-16T14:25:52.742310+0000","last_undegraded":"2023-10-16T14:25:52.742310+0000","last_fullsized":"2023-10-16T14:25:52.742310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:15.574696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.087293+0000","last_change":"2023-10-16T14:25:52.751674+0000","last_active":"2023-10-16T14:25:54.087293+0000","last_peered":"2023-10-16T14:25:54.087293+0000","last_clean":"2023-10-16T14:25:54.087293+0000","last_became_active":"2023-10-16T14:25:52.751135+0000","last_became_peered":"2023-10-16T14:25:52.751135+0000","last_unstale":"2023-10-16T14:25:54.087293+0000","last_undegraded":"2023-10-16T14:25:54.087293+0000","last_fullsized":"2023-10-16T14:25:54.087293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:49:00.336310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.733096+0000","last_change":"2023-10-16T14:25:48.713856+0000","last_active":"2023-10-16T14:25:52.733096+0000","last_peered":"2023-10-16T14:25:52.733096+0000","last_clean":"2023-10-16T14:25:52.733096+0000","last_became_active":"2023-10-16T14:25:48.713593+0000","last_became_peered":"2023-10-16T14:25:48.713593+0000","last_unstale":"2023-10-16T14:25:52.733096+0000","last_undegraded":"2023-10-16T14:25:52.733096+0000","last_fullsized":"2023-10-16T14:25:52.733096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:32.458956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734709+0000","last_change":"2023-10-16T14:25:47.670890+0000","last_active":"2023-10-16T14:25:52.734709+0000","last_peered":"2023-10-16T14:25:52.734709+0000","last_clean":"2023-10-16T14:25:52.734709+0000","last_became_active":"2023-10-16T14:25:47.670394+0000","last_became_peered":"2023-10-16T14:25:47.670394+0000","last_unstale":"2023-10-16T14:25:52.734709+0000","last_undegraded":"2023-10-16T14:25:52.734709+0000","last_fullsized":"2023-10-16T14:25:52.734709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:05:41.428042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.089075+0000","last_change":"2023-10-16T14:25:52.766516+0000","last_active":"2023-10-16T14:25:54.089075+0000","last_peered":"2023-10-16T14:25:54.089075+0000","last_clean":"2023-10-16T14:25:54.089075+0000","last_became_active":"2023-10-16T14:25:52.766073+0000","last_became_peered":"2023-10-16T14:25:52.766073+0000","last_unstale":"2023-10-16T14:25:54.089075+0000","last_undegraded":"2023-10-16T14:25:54.089075+0000","last_fullsized":"2023-10-16T14:25:54.089075+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:58.114992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.728872+0000","last_change":"2023-10-16T14:25:48.696048+0000","last_active":"2023-10-16T14:25:52.728872+0000","last_peered":"2023-10-16T14:25:52.728872+0000","last_clean":"2023-10-16T14:25:52.728872+0000","last_became_active":"2023-10-16T14:25:48.695762+0000","last_became_peered":"2023-10-16T14:25:48.695762+0000","last_unstale":"2023-10-16T14:25:52.728872+0000","last_undegraded":"2023-10-16T14:25:52.728872+0000","last_fullsized":"2023-10-16T14:25:52.728872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:23:02.569007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741599+0000","last_change":"2023-10-16T14:25:47.688476+0000","last_active":"2023-10-16T14:25:52.741599+0000","last_peered":"2023-10-16T14:25:52.741599+0000","last_clean":"2023-10-16T14:25:52.741599+0000","last_became_active":"2023-10-16T14:25:47.688163+0000","last_became_peered":"2023-10-16T14:25:47.688163+0000","last_unstale":"2023-10-16T14:25:52.741599+0000","last_undegraded":"2023-10-16T14:25:52.741599+0000","last_fullsized":"2023-10-16T14:25:52.741599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:07:28.689085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.090941+0000","last_change":"2023-10-16T14:25:52.768793+0000","last_active":"2023-10-16T14:25:54.090941+0000","last_peered":"2023-10-16T14:25:54.090941+0000","last_clean":"2023-10-16T14:25:54.090941+0000","last_became_active":"2023-10-16T14:25:52.765782+0000","last_became_peered":"2023-10-16T14:25:52.765782+0000","last_unstale":"2023-10-16T14:25:54.090941+0000","last_undegraded":"2023-10-16T14:25:54.090941+0000","last_fullsized":"2023-10-16T14:25:54.090941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:48:18.923566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734835+0000","last_change":"2023-10-16T14:25:48.706114+0000","last_active":"2023-10-16T14:25:52.734835+0000","last_peered":"2023-10-16T14:25:52.734835+0000","last_clean":"2023-10-16T14:25:52.734835+0000","last_became_active":"2023-10-16T14:25:48.705841+0000","last_became_peered":"2023-10-16T14:25:48.705841+0000","last_unstale":"2023-10-16T14:25:52.734835+0000","last_undegraded":"2023-10-16T14:25:52.734835+0000","last_fullsized":"2023-10-16T14:25:52.734835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:23:57.022557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734625+0000","last_change":"2023-10-16T14:25:47.672757+0000","last_active":"2023-10-16T14:25:52.734625+0000","last_peered":"2023-10-16T14:25:52.734625+0000","last_clean":"2023-10-16T14:25:52.734625+0000","last_became_active":"2023-10-16T14:25:47.671677+0000","last_became_peered":"2023-10-16T14:25:47.671677+0000","last_unstale":"2023-10-16T14:25:52.734625+0000","last_undegraded":"2023-10-16T14:25:52.734625+0000","last_fullsized":"2023-10-16T14:25:52.734625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:13:22.758413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086002+0000","last_change":"2023-10-16T14:25:52.772092+0000","last_active":"2023-10-16T14:25:54.086002+0000","last_peered":"2023-10-16T14:25:54.086002+0000","last_clean":"2023-10-16T14:25:54.086002+0000","last_became_active":"2023-10-16T14:25:52.771630+0000","last_became_peered":"2023-10-16T14:25:52.771630+0000","last_unstale":"2023-10-16T14:25:54.086002+0000","last_undegraded":"2023-10-16T14:25:54.086002+0000","last_fullsized":"2023-10-16T14:25:54.086002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:57.876480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.764800+0000","last_change":"2023-10-16T14:25:48.716516+0000","last_active":"2023-10-16T14:25:52.764800+0000","last_peered":"2023-10-16T14:25:52.764800+0000","last_clean":"2023-10-16T14:25:52.764800+0000","last_became_active":"2023-10-16T14:25:48.716176+0000","last_became_peered":"2023-10-16T14:25:48.716176+0000","last_unstale":"2023-10-16T14:25:52.764800+0000","last_undegraded":"2023-10-16T14:25:52.764800+0000","last_fullsized":"2023-10-16T14:25:52.764800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:03.388572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.757734+0000","last_change":"2023-10-16T14:25:47.689971+0000","last_active":"2023-10-16T14:25:52.757734+0000","last_peered":"2023-10-16T14:25:52.757734+0000","last_clean":"2023-10-16T14:25:52.757734+0000","last_became_active":"2023-10-16T14:25:47.689597+0000","last_became_peered":"2023-10-16T14:25:47.689597+0000","last_unstale":"2023-10-16T14:25:52.757734+0000","last_undegraded":"2023-10-16T14:25:52.757734+0000","last_fullsized":"2023-10-16T14:25:52.757734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:48:33.689068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.727072+0000","last_change":"2023-10-16T14:25:52.770776+0000","last_active":"2023-10-16T14:25:53.727072+0000","last_peered":"2023-10-16T14:25:53.727072+0000","last_clean":"2023-10-16T14:25:53.727072+0000","last_became_active":"2023-10-16T14:25:52.769836+0000","last_became_peered":"2023-10-16T14:25:52.769836+0000","last_unstale":"2023-10-16T14:25:53.727072+0000","last_undegraded":"2023-10-16T14:25:53.727072+0000","last_fullsized":"2023-10-16T14:25:53.727072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:11:16.574099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742318+0000","last_change":"2023-10-16T14:25:48.713120+0000","last_active":"2023-10-16T14:25:52.742318+0000","last_peered":"2023-10-16T14:25:52.742318+0000","last_clean":"2023-10-16T14:25:52.742318+0000","last_became_active":"2023-10-16T14:25:48.712749+0000","last_became_peered":"2023-10-16T14:25:48.712749+0000","last_unstale":"2023-10-16T14:25:52.742318+0000","last_undegraded":"2023-10-16T14:25:52.742318+0000","last_fullsized":"2023-10-16T14:25:52.742318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:38:17.767342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:26:06.790145+0000","last_change":"2023-10-16T14:25:47.677057+0000","last_active":"2023-10-16T14:26:06.790145+0000","last_peered":"2023-10-16T14:26:06.790145+0000","last_clean":"2023-10-16T14:26:06.790145+0000","last_became_active":"2023-10-16T14:25:47.676793+0000","last_became_peered":"2023-10-16T14:25:47.676793+0000","last_unstale":"2023-10-16T14:26:06.790145+0000","last_undegraded":"2023-10-16T14:26:06.790145+0000","last_fullsized":"2023-10-16T14:26:06.790145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:27:37.655811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.727776+0000","last_change":"2023-10-16T14:25:52.749720+0000","last_active":"2023-10-16T14:25:53.727776+0000","last_peered":"2023-10-16T14:25:53.727776+0000","last_clean":"2023-10-16T14:25:53.727776+0000","last_became_active":"2023-10-16T14:25:52.749259+0000","last_became_peered":"2023-10-16T14:25:52.749259+0000","last_unstale":"2023-10-16T14:25:53.727776+0000","last_undegraded":"2023-10-16T14:25:53.727776+0000","last_fullsized":"2023-10-16T14:25:53.727776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:21:41.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.733638+0000","last_change":"2023-10-16T14:25:48.713531+0000","last_active":"2023-10-16T14:25:52.733638+0000","last_peered":"2023-10-16T14:25:52.733638+0000","last_clean":"2023-10-16T14:25:52.733638+0000","last_became_active":"2023-10-16T14:25:48.713160+0000","last_became_peered":"2023-10-16T14:25:48.713160+0000","last_unstale":"2023-10-16T14:25:52.733638+0000","last_undegraded":"2023-10-16T14:25:52.733638+0000","last_fullsized":"2023-10-16T14:25:52.733638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:32:51.782302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.762449+0000","last_change":"2023-10-16T14:25:47.685499+0000","last_active":"2023-10-16T14:25:52.762449+0000","last_peered":"2023-10-16T14:25:52.762449+0000","last_clean":"2023-10-16T14:25:52.762449+0000","last_became_active":"2023-10-16T14:25:47.685151+0000","last_became_peered":"2023-10-16T14:25:47.685151+0000","last_unstale":"2023-10-16T14:25:52.762449+0000","last_undegraded":"2023-10-16T14:25:52.762449+0000","last_fullsized":"2023-10-16T14:25:52.762449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:54.472297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.090819+0000","last_change":"2023-10-16T14:25:52.764063+0000","last_active":"2023-10-16T14:25:54.090819+0000","last_peered":"2023-10-16T14:25:54.090819+0000","last_clean":"2023-10-16T14:25:54.090819+0000","last_became_active":"2023-10-16T14:25:52.763641+0000","last_became_peered":"2023-10-16T14:25:52.763641+0000","last_unstale":"2023-10-16T14:25:54.090819+0000","last_undegraded":"2023-10-16T14:25:54.090819+0000","last_fullsized":"2023-10-16T14:25:54.090819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:21:41.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.751879+0000","last_change":"2023-10-16T14:25:48.703305+0000","last_active":"2023-10-16T14:25:52.751879+0000","last_peered":"2023-10-16T14:25:52.751879+0000","last_clean":"2023-10-16T14:25:52.751879+0000","last_became_active":"2023-10-16T14:25:48.702978+0000","last_became_peered":"2023-10-16T14:25:48.702978+0000","last_unstale":"2023-10-16T14:25:52.751879+0000","last_undegraded":"2023-10-16T14:25:52.751879+0000","last_fullsized":"2023-10-16T14:25:52.751879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:08.702138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742225+0000","last_change":"2023-10-16T14:25:47.688400+0000","last_active":"2023-10-16T14:25:52.742225+0000","last_peered":"2023-10-16T14:25:52.742225+0000","last_clean":"2023-10-16T14:25:52.742225+0000","last_became_active":"2023-10-16T14:25:47.688066+0000","last_became_peered":"2023-10-16T14:25:47.688066+0000","last_unstale":"2023-10-16T14:25:52.742225+0000","last_undegraded":"2023-10-16T14:25:52.742225+0000","last_fullsized":"2023-10-16T14:25:52.742225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:18.948353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.085217+0000","last_change":"2023-10-16T14:25:52.761062+0000","last_active":"2023-10-16T14:25:54.085217+0000","last_peered":"2023-10-16T14:25:54.085217+0000","last_clean":"2023-10-16T14:25:54.085217+0000","last_became_active":"2023-10-16T14:25:52.759852+0000","last_became_peered":"2023-10-16T14:25:52.759852+0000","last_unstale":"2023-10-16T14:25:54.085217+0000","last_undegraded":"2023-10-16T14:25:54.085217+0000","last_fullsized":"2023-10-16T14:25:54.085217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:45:02.663218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.726232+0000","last_change":"2023-10-16T14:25:48.712154+0000","last_active":"2023-10-16T14:25:52.726232+0000","last_peered":"2023-10-16T14:25:52.726232+0000","last_clean":"2023-10-16T14:25:52.726232+0000","last_became_active":"2023-10-16T14:25:48.711510+0000","last_became_peered":"2023-10-16T14:25:48.711510+0000","last_unstale":"2023-10-16T14:25:52.726232+0000","last_undegraded":"2023-10-16T14:25:52.726232+0000","last_fullsized":"2023-10-16T14:25:52.726232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:48:56.276340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.729439+0000","last_change":"2023-10-16T14:25:47.668179+0000","last_active":"2023-10-16T14:25:52.729439+0000","last_peered":"2023-10-16T14:25:52.729439+0000","last_clean":"2023-10-16T14:25:52.729439+0000","last_became_active":"2023-10-16T14:25:47.667021+0000","last_became_peered":"2023-10-16T14:25:47.667021+0000","last_unstale":"2023-10-16T14:25:52.729439+0000","last_undegraded":"2023-10-16T14:25:52.729439+0000","last_fullsized":"2023-10-16T14:25:52.729439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:35:07.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.727768+0000","last_change":"2023-10-16T14:25:52.756998+0000","last_active":"2023-10-16T14:25:53.727768+0000","last_peered":"2023-10-16T14:25:53.727768+0000","last_clean":"2023-10-16T14:25:53.727768+0000","last_became_active":"2023-10-16T14:25:52.756551+0000","last_became_peered":"2023-10-16T14:25:52.756551+0000","last_unstale":"2023-10-16T14:25:53.727768+0000","last_undegraded":"2023-10-16T14:25:53.727768+0000","last_fullsized":"2023-10-16T14:25:53.727768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:53.190625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.729124+0000","last_change":"2023-10-16T14:25:52.770650+0000","last_active":"2023-10-16T14:25:53.729124+0000","last_peered":"2023-10-16T14:25:53.729124+0000","last_clean":"2023-10-16T14:25:53.729124+0000","last_became_active":"2023-10-16T14:25:52.769652+0000","last_became_peered":"2023-10-16T14:25:52.769652+0000","last_unstale":"2023-10-16T14:25:53.729124+0000","last_undegraded":"2023-10-16T14:25:53.729124+0000","last_fullsized":"2023-10-16T14:25:53.729124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:01:14.017904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735103+0000","last_change":"2023-10-16T14:25:48.679714+0000","last_active":"2023-10-16T14:25:52.735103+0000","last_peered":"2023-10-16T14:25:52.735103+0000","last_clean":"2023-10-16T14:25:52.735103+0000","last_became_active":"2023-10-16T14:25:48.678913+0000","last_became_peered":"2023-10-16T14:25:48.678913+0000","last_unstale":"2023-10-16T14:25:52.735103+0000","last_undegraded":"2023-10-16T14:25:52.735103+0000","last_fullsized":"2023-10-16T14:25:52.735103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:43.182462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.736001+0000","last_change":"2023-10-16T14:25:47.670716+0000","last_active":"2023-10-16T14:25:52.736001+0000","last_peered":"2023-10-16T14:25:52.736001+0000","last_clean":"2023-10-16T14:25:52.736001+0000","last_became_active":"2023-10-16T14:25:47.669479+0000","last_became_peered":"2023-10-16T14:25:47.669479+0000","last_unstale":"2023-10-16T14:25:52.736001+0000","last_undegraded":"2023-10-16T14:25:52.736001+0000","last_fullsized":"2023-10-16T14:25:52.736001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:07:28.689085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.727220+0000","last_change":"2023-10-16T14:25:52.766844+0000","last_active":"2023-10-16T14:25:53.727220+0000","last_peered":"2023-10-16T14:25:53.727220+0000","last_clean":"2023-10-16T14:25:53.727220+0000","last_became_active":"2023-10-16T14:25:52.766324+0000","last_became_peered":"2023-10-16T14:25:52.766324+0000","last_unstale":"2023-10-16T14:25:53.727220+0000","last_undegraded":"2023-10-16T14:25:53.727220+0000","last_fullsized":"2023-10-16T14:25:53.727220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:23:27.304235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.748605+0000","last_change":"2023-10-16T14:25:48.707865+0000","last_active":"2023-10-16T14:25:52.748605+0000","last_peered":"2023-10-16T14:25:52.748605+0000","last_clean":"2023-10-16T14:25:52.748605+0000","last_became_active":"2023-10-16T14:25:48.707590+0000","last_became_peered":"2023-10-16T14:25:48.707590+0000","last_unstale":"2023-10-16T14:25:52.748605+0000","last_undegraded":"2023-10-16T14:25:52.748605+0000","last_fullsized":"2023-10-16T14:25:52.748605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:09.386851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.765286+0000","last_change":"2023-10-16T14:25:47.689952+0000","last_active":"2023-10-16T14:25:52.765286+0000","last_peered":"2023-10-16T14:25:52.765286+0000","last_clean":"2023-10-16T14:25:52.765286+0000","last_became_active":"2023-10-16T14:25:47.689569+0000","last_became_peered":"2023-10-16T14:25:47.689569+0000","last_unstale":"2023-10-16T14:25:52.765286+0000","last_undegraded":"2023-10-16T14:25:52.765286+0000","last_fullsized":"2023-10-16T14:25:52.765286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:33.258222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734526+0000","last_change":"2023-10-16T14:25:47.684407+0000","last_active":"2023-10-16T14:25:52.734526+0000","last_peered":"2023-10-16T14:25:52.734526+0000","last_clean":"2023-10-16T14:25:52.734526+0000","last_became_active":"2023-10-16T14:25:47.683112+0000","last_became_peered":"2023-10-16T14:25:47.683112+0000","last_unstale":"2023-10-16T14:25:52.734526+0000","last_undegraded":"2023-10-16T14:25:52.734526+0000","last_fullsized":"2023-10-16T14:25:52.734526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:58.812184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.736192+0000","last_change":"2023-10-16T14:25:48.707553+0000","last_active":"2023-10-16T14:25:52.736192+0000","last_peered":"2023-10-16T14:25:52.736192+0000","last_clean":"2023-10-16T14:25:52.736192+0000","last_became_active":"2023-10-16T14:25:48.707287+0000","last_became_peered":"2023-10-16T14:25:48.707287+0000","last_unstale":"2023-10-16T14:25:52.736192+0000","last_undegraded":"2023-10-16T14:25:52.736192+0000","last_fullsized":"2023-10-16T14:25:52.736192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:16.586879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.728065+0000","last_change":"2023-10-16T14:25:52.772152+0000","last_active":"2023-10-16T14:25:53.728065+0000","last_peered":"2023-10-16T14:25:53.728065+0000","last_clean":"2023-10-16T14:25:53.728065+0000","last_became_active":"2023-10-16T14:25:52.771782+0000","last_became_peered":"2023-10-16T14:25:52.771782+0000","last_unstale":"2023-10-16T14:25:53.728065+0000","last_undegraded":"2023-10-16T14:25:53.728065+0000","last_fullsized":"2023-10-16T14:25:53.728065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:36.518926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.750890+0000","last_change":"2023-10-16T14:25:47.686396+0000","last_active":"2023-10-16T14:25:52.750890+0000","last_peered":"2023-10-16T14:25:52.750890+0000","last_clean":"2023-10-16T14:25:52.750890+0000","last_became_active":"2023-10-16T14:25:47.685837+0000","last_became_peered":"2023-10-16T14:25:47.685837+0000","last_unstale":"2023-10-16T14:25:52.750890+0000","last_undegraded":"2023-10-16T14:25:52.750890+0000","last_fullsized":"2023-10-16T14:25:52.750890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:59:01.867434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.729122+0000","last_change":"2023-10-16T14:25:48.699469+0000","last_active":"2023-10-16T14:25:52.729122+0000","last_peered":"2023-10-16T14:25:52.729122+0000","last_clean":"2023-10-16T14:25:52.729122+0000","last_became_active":"2023-10-16T14:25:48.697897+0000","last_became_peered":"2023-10-16T14:25:48.697897+0000","last_unstale":"2023-10-16T14:25:52.729122+0000","last_undegraded":"2023-10-16T14:25:52.729122+0000","last_fullsized":"2023-10-16T14:25:52.729122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:06.393767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.089865+0000","last_change":"2023-10-16T14:25:52.769049+0000","last_active":"2023-10-16T14:25:54.089865+0000","last_peered":"2023-10-16T14:25:54.089865+0000","last_clean":"2023-10-16T14:25:54.089865+0000","last_became_active":"2023-10-16T14:25:52.768002+0000","last_became_peered":"2023-10-16T14:25:52.768002+0000","last_unstale":"2023-10-16T14:25:54.089865+0000","last_undegraded":"2023-10-16T14:25:54.089865+0000","last_fullsized":"2023-10-16T14:25:54.089865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:24.020506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.722319+0000","last_change":"2023-10-16T14:25:48.710638+0000","last_active":"2023-10-16T14:25:52.722319+0000","last_peered":"2023-10-16T14:25:52.722319+0000","last_clean":"2023-10-16T14:25:52.722319+0000","last_became_active":"2023-10-16T14:25:48.710317+0000","last_became_peered":"2023-10-16T14:25:48.710317+0000","last_unstale":"2023-10-16T14:25:52.722319+0000","last_undegraded":"2023-10-16T14:25:52.722319+0000","last_fullsized":"2023-10-16T14:25:52.722319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:55:50.448443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.754813+0000","last_change":"2023-10-16T14:25:48.697149+0000","last_active":"2023-10-16T14:25:52.754813+0000","last_peered":"2023-10-16T14:25:52.754813+0000","last_clean":"2023-10-16T14:25:52.754813+0000","last_became_active":"2023-10-16T14:25:48.696842+0000","last_became_peered":"2023-10-16T14:25:48.696842+0000","last_unstale":"2023-10-16T14:25:52.754813+0000","last_undegraded":"2023-10-16T14:25:52.754813+0000","last_fullsized":"2023-10-16T14:25:52.754813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:55:50.448443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734336+0000","last_change":"2023-10-16T14:25:48.703113+0000","last_active":"2023-10-16T14:25:52.734336+0000","last_peered":"2023-10-16T14:25:52.734336+0000","last_clean":"2023-10-16T14:25:52.734336+0000","last_became_active":"2023-10-16T14:25:48.702819+0000","last_became_peered":"2023-10-16T14:25:48.702819+0000","last_unstale":"2023-10-16T14:25:52.734336+0000","last_undegraded":"2023-10-16T14:25:52.734336+0000","last_fullsized":"2023-10-16T14:25:52.734336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:11:43.934469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.750660+0000","last_change":"2023-10-16T14:25:48.698637+0000","last_active":"2023-10-16T14:25:52.750660+0000","last_peered":"2023-10-16T14:25:52.750660+0000","last_clean":"2023-10-16T14:25:52.750660+0000","last_became_active":"2023-10-16T14:25:48.698315+0000","last_became_peered":"2023-10-16T14:25:48.698315+0000","last_unstale":"2023-10-16T14:25:52.750660+0000","last_undegraded":"2023-10-16T14:25:52.750660+0000","last_fullsized":"2023-10-16T14:25:52.750660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:40:17.879871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.766726+0000","last_change":"2023-10-16T14:25:48.718882+0000","last_active":"2023-10-16T14:25:52.766726+0000","last_peered":"2023-10-16T14:25:52.766726+0000","last_clean":"2023-10-16T14:25:52.766726+0000","last_became_active":"2023-10-16T14:25:48.718101+0000","last_became_peered":"2023-10-16T14:25:48.718101+0000","last_unstale":"2023-10-16T14:25:52.766726+0000","last_undegraded":"2023-10-16T14:25:52.766726+0000","last_fullsized":"2023-10-16T14:25:52.766726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:07:29.701267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.775872+0000","last_change":"2023-10-16T14:25:48.720844+0000","last_active":"2023-10-16T14:25:52.775872+0000","last_peered":"2023-10-16T14:25:52.775872+0000","last_clean":"2023-10-16T14:25:52.775872+0000","last_became_active":"2023-10-16T14:25:48.719311+0000","last_became_peered":"2023-10-16T14:25:48.719311+0000","last_unstale":"2023-10-16T14:25:52.775872+0000","last_undegraded":"2023-10-16T14:25:52.775872+0000","last_fullsized":"2023-10-16T14:25:52.775872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:19.960536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.726182+0000","last_change":"2023-10-16T14:25:48.712401+0000","last_active":"2023-10-16T14:25:52.726182+0000","last_peered":"2023-10-16T14:25:52.726182+0000","last_clean":"2023-10-16T14:25:52.726182+0000","last_became_active":"2023-10-16T14:25:48.711895+0000","last_became_peered":"2023-10-16T14:25:48.711895+0000","last_unstale":"2023-10-16T14:25:52.726182+0000","last_undegraded":"2023-10-16T14:25:52.726182+0000","last_fullsized":"2023-10-16T14:25:52.726182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:03.388572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.751689+0000","last_change":"2023-10-16T14:25:48.698610+0000","last_active":"2023-10-16T14:25:52.751689+0000","last_peered":"2023-10-16T14:25:52.751689+0000","last_clean":"2023-10-16T14:25:52.751689+0000","last_became_active":"2023-10-16T14:25:48.698036+0000","last_became_peered":"2023-10-16T14:25:48.698036+0000","last_unstale":"2023-10-16T14:25:52.751689+0000","last_undegraded":"2023-10-16T14:25:52.751689+0000","last_fullsized":"2023-10-16T14:25:52.751689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:21:35.715486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.733105+0000","last_change":"2023-10-16T14:25:48.698898+0000","last_active":"2023-10-16T14:25:52.733105+0000","last_peered":"2023-10-16T14:25:52.733105+0000","last_clean":"2023-10-16T14:25:52.733105+0000","last_became_active":"2023-10-16T14:25:48.698683+0000","last_became_peered":"2023-10-16T14:25:48.698683+0000","last_unstale":"2023-10-16T14:25:52.733105+0000","last_undegraded":"2023-10-16T14:25:52.733105+0000","last_fullsized":"2023-10-16T14:25:52.733105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:38:58.219009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.748894+0000","last_change":"2023-10-16T14:25:48.705464+0000","last_active":"2023-10-16T14:25:52.748894+0000","last_peered":"2023-10-16T14:25:52.748894+0000","last_clean":"2023-10-16T14:25:52.748894+0000","last_became_active":"2023-10-16T14:25:48.704985+0000","last_became_peered":"2023-10-16T14:25:48.704985+0000","last_unstale":"2023-10-16T14:25:52.748894+0000","last_undegraded":"2023-10-16T14:25:52.748894+0000","last_fullsized":"2023-10-16T14:25:52.748894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:56:45.547392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.729034+0000","last_change":"2023-10-16T14:25:48.712431+0000","last_active":"2023-10-16T14:25:52.729034+0000","last_peered":"2023-10-16T14:25:52.729034+0000","last_clean":"2023-10-16T14:25:52.729034+0000","last_became_active":"2023-10-16T14:25:48.711943+0000","last_became_peered":"2023-10-16T14:25:48.711943+0000","last_unstale":"2023-10-16T14:25:52.729034+0000","last_undegraded":"2023-10-16T14:25:52.729034+0000","last_fullsized":"2023-10-16T14:25:52.729034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:27:38.667994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.736054+0000","last_change":"2023-10-16T14:25:48.696594+0000","last_active":"2023-10-16T14:25:52.736054+0000","last_peered":"2023-10-16T14:25:52.736054+0000","last_clean":"2023-10-16T14:25:52.736054+0000","last_became_active":"2023-10-16T14:25:48.696094+0000","last_became_peered":"2023-10-16T14:25:48.696094+0000","last_unstale":"2023-10-16T14:25:52.736054+0000","last_undegraded":"2023-10-16T14:25:52.736054+0000","last_fullsized":"2023-10-16T14:25:52.736054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:19.960536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741992+0000","last_change":"2023-10-16T14:25:48.696032+0000","last_active":"2023-10-16T14:25:52.741992+0000","last_peered":"2023-10-16T14:25:52.741992+0000","last_clean":"2023-10-16T14:25:52.741992+0000","last_became_active":"2023-10-16T14:25:48.695395+0000","last_became_peered":"2023-10-16T14:25:48.695395+0000","last_unstale":"2023-10-16T14:25:52.741992+0000","last_undegraded":"2023-10-16T14:25:52.741992+0000","last_fullsized":"2023-10-16T14:25:52.741992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:32.458956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734829+0000","last_change":"2023-10-16T14:25:48.709380+0000","last_active":"2023-10-16T14:25:52.734829+0000","last_peered":"2023-10-16T14:25:52.734829+0000","last_clean":"2023-10-16T14:25:52.734829+0000","last_became_active":"2023-10-16T14:25:48.708997+0000","last_became_peered":"2023-10-16T14:25:48.708997+0000","last_unstale":"2023-10-16T14:25:52.734829+0000","last_undegraded":"2023-10-16T14:25:52.734829+0000","last_fullsized":"2023-10-16T14:25:52.734829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:02:54.594118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.761766+0000","last_change":"2023-10-16T14:25:48.705638+0000","last_active":"2023-10-16T14:25:52.761766+0000","last_peered":"2023-10-16T14:25:52.761766+0000","last_clean":"2023-10-16T14:25:52.761766+0000","last_became_active":"2023-10-16T14:25:48.705345+0000","last_became_peered":"2023-10-16T14:25:48.705345+0000","last_unstale":"2023-10-16T14:25:52.761766+0000","last_undegraded":"2023-10-16T14:25:52.761766+0000","last_fullsized":"2023-10-16T14:25:52.761766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:34.270405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735728+0000","last_change":"2023-10-16T14:25:48.713557+0000","last_active":"2023-10-16T14:25:52.735728+0000","last_peered":"2023-10-16T14:25:52.735728+0000","last_clean":"2023-10-16T14:25:52.735728+0000","last_became_active":"2023-10-16T14:25:48.712873+0000","last_became_peered":"2023-10-16T14:25:48.712873+0000","last_unstale":"2023-10-16T14:25:52.735728+0000","last_undegraded":"2023-10-16T14:25:52.735728+0000","last_fullsized":"2023-10-16T14:25:52.735728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:50:37.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.733005+0000","last_change":"2023-10-16T14:25:48.710840+0000","last_active":"2023-10-16T14:25:52.733005+0000","last_peered":"2023-10-16T14:25:52.733005+0000","last_clean":"2023-10-16T14:25:52.733005+0000","last_became_active":"2023-10-16T14:25:48.710547+0000","last_became_peered":"2023-10-16T14:25:48.710547+0000","last_unstale":"2023-10-16T14:25:52.733005+0000","last_undegraded":"2023-10-16T14:25:52.733005+0000","last_fullsized":"2023-10-16T14:25:52.733005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:49.130655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.748159+0000","last_change":"2023-10-16T14:25:48.705260+0000","last_active":"2023-10-16T14:25:52.748159+0000","last_peered":"2023-10-16T14:25:52.748159+0000","last_clean":"2023-10-16T14:25:52.748159+0000","last_became_active":"2023-10-16T14:25:48.704600+0000","last_became_peered":"2023-10-16T14:25:48.704600+0000","last_unstale":"2023-10-16T14:25:52.748159+0000","last_undegraded":"2023-10-16T14:25:52.748159+0000","last_fullsized":"2023-10-16T14:25:52.748159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:31:37.405710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.764712+0000","last_change":"2023-10-16T14:25:48.718876+0000","last_active":"2023-10-16T14:25:52.764712+0000","last_peered":"2023-10-16T14:25:52.764712+0000","last_clean":"2023-10-16T14:25:52.764712+0000","last_became_active":"2023-10-16T14:25:48.718576+0000","last_became_peered":"2023-10-16T14:25:48.718576+0000","last_unstale":"2023-10-16T14:25:52.764712+0000","last_undegraded":"2023-10-16T14:25:52.764712+0000","last_fullsized":"2023-10-16T14:25:52.764712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:08:42.569470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.765953+0000","last_change":"2023-10-16T14:25:48.724429+0000","last_active":"2023-10-16T14:25:52.765953+0000","last_peered":"2023-10-16T14:25:52.765953+0000","last_clean":"2023-10-16T14:25:52.765953+0000","last_became_active":"2023-10-16T14:25:48.724125+0000","last_became_peered":"2023-10-16T14:25:48.724125+0000","last_unstale":"2023-10-16T14:25:52.765953+0000","last_undegraded":"2023-10-16T14:25:52.765953+0000","last_fullsized":"2023-10-16T14:25:52.765953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:11:15.820218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741965+0000","last_change":"2023-10-16T14:25:48.696219+0000","last_active":"2023-10-16T14:25:52.741965+0000","last_peered":"2023-10-16T14:25:52.741965+0000","last_clean":"2023-10-16T14:25:52.741965+0000","last_became_active":"2023-10-16T14:25:48.695737+0000","last_became_peered":"2023-10-16T14:25:48.695737+0000","last_unstale":"2023-10-16T14:25:52.741965+0000","last_undegraded":"2023-10-16T14:25:52.741965+0000","last_fullsized":"2023-10-16T14:25:52.741965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:21:37.481107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742197+0000","last_change":"2023-10-16T14:25:48.710966+0000","last_active":"2023-10-16T14:25:52.742197+0000","last_peered":"2023-10-16T14:25:52.742197+0000","last_clean":"2023-10-16T14:25:52.742197+0000","last_became_active":"2023-10-16T14:25:48.709590+0000","last_became_peered":"2023-10-16T14:25:48.709590+0000","last_unstale":"2023-10-16T14:25:52.742197+0000","last_undegraded":"2023-10-16T14:25:52.742197+0000","last_fullsized":"2023-10-16T14:25:52.742197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:12:28.481919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742091+0000","last_change":"2023-10-16T14:25:48.717832+0000","last_active":"2023-10-16T14:25:52.742091+0000","last_peered":"2023-10-16T14:25:52.742091+0000","last_clean":"2023-10-16T14:25:52.742091+0000","last_became_active":"2023-10-16T14:25:48.716501+0000","last_became_peered":"2023-10-16T14:25:48.716501+0000","last_unstale":"2023-10-16T14:25:52.742091+0000","last_undegraded":"2023-10-16T14:25:52.742091+0000","last_fullsized":"2023-10-16T14:25:52.742091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:59.824367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.729329+0000","last_change":"2023-10-16T14:25:48.705714+0000","last_active":"2023-10-16T14:25:52.729329+0000","last_peered":"2023-10-16T14:25:52.729329+0000","last_clean":"2023-10-16T14:25:52.729329+0000","last_became_active":"2023-10-16T14:25:48.705423+0000","last_became_peered":"2023-10-16T14:25:48.705423+0000","last_unstale":"2023-10-16T14:25:52.729329+0000","last_undegraded":"2023-10-16T14:25:52.729329+0000","last_fullsized":"2023-10-16T14:25:52.729329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:34.270405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.748340+0000","last_change":"2023-10-16T14:25:48.716492+0000","last_active":"2023-10-16T14:25:52.748340+0000","last_peered":"2023-10-16T14:25:52.748340+0000","last_clean":"2023-10-16T14:25:52.748340+0000","last_became_active":"2023-10-16T14:25:48.716196+0000","last_became_peered":"2023-10-16T14:25:48.716196+0000","last_unstale":"2023-10-16T14:25:52.748340+0000","last_undegraded":"2023-10-16T14:25:52.748340+0000","last_fullsized":"2023-10-16T14:25:52.748340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:20:54.230056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741582+0000","last_change":"2023-10-16T14:25:48.707726+0000","last_active":"2023-10-16T14:25:52.741582+0000","last_peered":"2023-10-16T14:25:52.741582+0000","last_clean":"2023-10-16T14:25:52.741582+0000","last_became_active":"2023-10-16T14:25:48.707504+0000","last_became_peered":"2023-10-16T14:25:48.707504+0000","last_unstale":"2023-10-16T14:25:52.741582+0000","last_undegraded":"2023-10-16T14:25:52.741582+0000","last_fullsized":"2023-10-16T14:25:52.741582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:08.080421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.723283+0000","last_change":"2023-10-16T14:25:48.702028+0000","last_active":"2023-10-16T14:25:52.723283+0000","last_peered":"2023-10-16T14:25:52.723283+0000","last_clean":"2023-10-16T14:25:52.723283+0000","last_became_active":"2023-10-16T14:25:48.701713+0000","last_became_peered":"2023-10-16T14:25:48.701713+0000","last_unstale":"2023-10-16T14:25:52.723283+0000","last_undegraded":"2023-10-16T14:25:52.723283+0000","last_fullsized":"2023-10-16T14:25:52.723283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:05:42.440225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741959+0000","last_change":"2023-10-16T14:25:48.700619+0000","last_active":"2023-10-16T14:25:52.741959+0000","last_peered":"2023-10-16T14:25:52.741959+0000","last_clean":"2023-10-16T14:25:52.741959+0000","last_became_active":"2023-10-16T14:25:48.700374+0000","last_became_peered":"2023-10-16T14:25:48.700374+0000","last_unstale":"2023-10-16T14:25:52.741959+0000","last_undegraded":"2023-10-16T14:25:52.741959+0000","last_fullsized":"2023-10-16T14:25:52.741959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:38:58.219009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.725459+0000","last_change":"2023-10-16T14:25:48.699642+0000","last_active":"2023-10-16T14:25:52.725459+0000","last_peered":"2023-10-16T14:25:52.725459+0000","last_clean":"2023-10-16T14:25:52.725459+0000","last_became_active":"2023-10-16T14:25:48.698763+0000","last_became_peered":"2023-10-16T14:25:48.698763+0000","last_unstale":"2023-10-16T14:25:52.725459+0000","last_undegraded":"2023-10-16T14:25:52.725459+0000","last_fullsized":"2023-10-16T14:25:52.725459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:34.270405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.750728+0000","last_change":"2023-10-16T14:25:48.701810+0000","last_active":"2023-10-16T14:25:52.750728+0000","last_peered":"2023-10-16T14:25:52.750728+0000","last_clean":"2023-10-16T14:25:52.750728+0000","last_became_active":"2023-10-16T14:25:48.701531+0000","last_became_peered":"2023-10-16T14:25:48.701531+0000","last_unstale":"2023-10-16T14:25:52.750728+0000","last_undegraded":"2023-10-16T14:25:52.750728+0000","last_fullsized":"2023-10-16T14:25:52.750728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:02:15.116385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.753502+0000","last_change":"2023-10-16T14:25:48.705687+0000","last_active":"2023-10-16T14:25:52.753502+0000","last_peered":"2023-10-16T14:25:52.753502+0000","last_clean":"2023-10-16T14:25:52.753502+0000","last_became_active":"2023-10-16T14:25:48.705392+0000","last_became_peered":"2023-10-16T14:25:48.705392+0000","last_unstale":"2023-10-16T14:25:52.753502+0000","last_undegraded":"2023-10-16T14:25:52.753502+0000","last_fullsized":"2023-10-16T14:25:52.753502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:04.130129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742180+0000","last_change":"2023-10-16T14:25:48.705631+0000","last_active":"2023-10-16T14:25:52.742180+0000","last_peered":"2023-10-16T14:25:52.742180+0000","last_clean":"2023-10-16T14:25:52.742180+0000","last_became_active":"2023-10-16T14:25:48.705344+0000","last_became_peered":"2023-10-16T14:25:48.705344+0000","last_unstale":"2023-10-16T14:25:52.742180+0000","last_undegraded":"2023-10-16T14:25:52.742180+0000","last_fullsized":"2023-10-16T14:25:52.742180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:43.182462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476746,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":104592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]}]},{"osd":2,"up_from":16,"seq":68719476746,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":107851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.734}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.825}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5680000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.796}]}]},{"osd":1,"up_from":16,"seq":68719476747,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":694448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.776}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]}]},{"osd":0,"up_from":16,"seq":68719476748,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":104066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5289999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]}]},{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":104134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.661}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.46}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.877}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9410000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.52}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":108523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2919999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.069}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T14:26:15.212 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T14:26:15.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.469+0000 7f7b8e143640 1 Processor -- start 2023-10-16T14:26:15.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.469+0000 7f7b8e143640 1 -- start start 2023-10-16T14:26:15.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.470+0000 7f7b8e143640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b8815c9d0 0x7f7b880cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:15.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.470+0000 7f7b8e143640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7b880d16a0 0x7f7b880cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:15.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.471+0000 7f7b8e143640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b880b2f90 con 0x7f7b880ce4d0 2023-10-16T14:26:15.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.471+0000 7f7b8e143640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b880d0320 con 0x7f7b880d16a0 2023-10-16T14:26:15.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.471+0000 7f7b8e143640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b880d0600 con 0x7f7b8815c9d0 2023-10-16T14:26:15.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.471+0000 7f7b8d141640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b8815c9d0 0x7f7b880cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:15.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.471+0000 7f7b8c940640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7b880d16a0 0x7f7b880cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:15.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.471+0000 7f7b8d141640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b8815c9d0 0x7f7b880cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.59:39502/0 (socket says 172.21.15.59:39502) 2023-10-16T14:26:15.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.471+0000 7f7b8d141640 1 -- 172.21.15.59:0/2452771206 learned_addr learned my addr 172.21.15.59:0/2452771206 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:15.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.472+0000 7f7b8c940640 1 -- 172.21.15.59:0/2452771206 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b8815c9d0 msgr2=0x7f7b880cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:15.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.472+0000 7f7b8c940640 1 --2- 172.21.15.59:0/2452771206 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b8815c9d0 0x7f7b880cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:15.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.472+0000 7f7b8c940640 1 -- 172.21.15.59:0/2452771206 >> v1:172.21.15.151:6789/0 conn(0x7f7b880ce4d0 legacy=0x7f7b88160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:15.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.472+0000 7f7b8c940640 1 -- 172.21.15.59:0/2452771206 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b880d08e0 con 0x7f7b880d16a0 2023-10-16T14:26:15.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.472+0000 7f7b8d141640 1 --2- 172.21.15.59:0/2452771206 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b8815c9d0 0x7f7b880cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:26:15.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.473+0000 7f7b8c940640 1 --2- 172.21.15.59:0/2452771206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b880d16a0 0x7f7b880cf140 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0097a0 tx=0x7f7b7c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17f136ce5ac5dd67 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:15.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.474+0000 7f7b87fff640 1 -- 172.21.15.59:0/2452771206 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c02d040 con 0x7f7b880d16a0 2023-10-16T14:26:15.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.474+0000 7f7b87fff640 1 -- 172.21.15.59:0/2452771206 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7c031810 con 0x7f7b880d16a0 2023-10-16T14:26:15.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.474+0000 7f7b87fff640 1 -- 172.21.15.59:0/2452771206 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c031ba0 con 0x7f7b880d16a0 2023-10-16T14:26:15.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.475+0000 7f7b8e143640 1 -- 172.21.15.59:0/2452771206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b880d16a0 msgr2=0x7f7b880cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:15.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.475+0000 7f7b8e143640 1 --2- 172.21.15.59:0/2452771206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b880d16a0 0x7f7b880cf140 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0097a0 tx=0x7f7b7c02b8b0 comp rx=0 tx=0).stop 2023-10-16T14:26:15.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.475+0000 7f7b8e143640 1 -- 172.21.15.59:0/2452771206 shutdown_connections 2023-10-16T14:26:15.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.475+0000 7f7b8e143640 1 --2- 172.21.15.59:0/2452771206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b880d16a0 0x7f7b880cf140 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:15.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.475+0000 7f7b8e143640 1 --2- 172.21.15.59:0/2452771206 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b8815c9d0 0x7f7b880cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:15.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.475+0000 7f7b8e143640 1 -- 172.21.15.59:0/2452771206 >> 172.21.15.59:0/2452771206 conn(0x7f7b8809bad0 msgr2=0x7f7b880d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:15.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.475+0000 7f7b8e143640 1 -- 172.21.15.59:0/2452771206 shutdown_connections 2023-10-16T14:26:15.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.475+0000 7f7b8e143640 1 -- 172.21.15.59:0/2452771206 wait complete. 2023-10-16T14:26:15.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.477+0000 7f7b8e143640 1 Processor -- start 2023-10-16T14:26:15.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.478+0000 7f7b8e143640 1 -- start start 2023-10-16T14:26:15.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.479+0000 7f7b8e143640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b880ce4d0 0x7f7b88149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:15.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.479+0000 7f7b8e143640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b880d16a0 0x7f7b880b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:15.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.479+0000 7f7b8e143640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b8815c9d0 0x7f7b880b7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:15.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.479+0000 7f7b8e143640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b880b7830 con 0x7f7b880d16a0 2023-10-16T14:26:15.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.479+0000 7f7b8e143640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b880b7b10 con 0x7f7b880ce4d0 2023-10-16T14:26:15.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.479+0000 7f7b8e143640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b880b7df0 con 0x7f7b8815c9d0 2023-10-16T14:26:15.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.479+0000 7f7b8c940640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b880d16a0 0x7f7b880b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:15.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.479+0000 7f7b8c940640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b880d16a0 0x7f7b880b6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42008/0 (socket says 172.21.15.59:42008) 2023-10-16T14:26:15.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.479+0000 7f7b8c940640 1 -- 172.21.15.59:0/3869455677 learned_addr learned my addr 172.21.15.59:0/3869455677 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:15.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.480+0000 7f7b8d141640 1 --2- 172.21.15.59:0/3869455677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b880ce4d0 0x7f7b88149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:15.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.480+0000 7f7b8d942640 1 --2- 172.21.15.59:0/3869455677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b8815c9d0 0x7f7b880b7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:15.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.480+0000 7f7b8c940640 1 -- 172.21.15.59:0/3869455677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b8815c9d0 msgr2=0x7f7b880b7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:15.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.480+0000 7f7b8c940640 1 --2- 172.21.15.59:0/3869455677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b8815c9d0 0x7f7b880b7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:15.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.480+0000 7f7b8c940640 1 -- 172.21.15.59:0/3869455677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b880ce4d0 msgr2=0x7f7b88149ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:15.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.480+0000 7f7b8c940640 1 --2- 172.21.15.59:0/3869455677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b880ce4d0 0x7f7b88149ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:15.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.480+0000 7f7b8c940640 1 -- 172.21.15.59:0/3869455677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b78009b30 con 0x7f7b880d16a0 2023-10-16T14:26:15.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.481+0000 7f7b8c940640 1 --2- 172.21.15.59:0/3869455677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b880d16a0 0x7f7b880b6cc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0098c0 tx=0x7f7b7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:15.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.481+0000 7f7b85ffb640 1 -- 172.21.15.59:0/3869455677 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c006e10 con 0x7f7b880d16a0 2023-10-16T14:26:15.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.481+0000 7f7b85ffb640 1 -- 172.21.15.59:0/3869455677 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7c03ad60 con 0x7f7b880d16a0 2023-10-16T14:26:15.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.481+0000 7f7b85ffb640 1 -- 172.21.15.59:0/3869455677 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c044620 con 0x7f7b880d16a0 2023-10-16T14:26:15.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.481+0000 7f7b8e143640 1 -- 172.21.15.59:0/3869455677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b7c009400 con 0x7f7b880d16a0 2023-10-16T14:26:15.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.481+0000 7f7b8e143640 1 -- 172.21.15.59:0/3869455677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b880c6560 con 0x7f7b880d16a0 2023-10-16T14:26:15.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.482+0000 7f7b8e143640 1 -- 172.21.15.59:0/3869455677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8804e9b0 con 0x7f7b880d16a0 2023-10-16T14:26:15.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.483+0000 7f7b85ffb640 1 -- 172.21.15.59:0/3869455677 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7b7c04d440 con 0x7f7b880d16a0 2023-10-16T14:26:15.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.484+0000 7f7b85ffb640 1 --2- 172.21.15.59:0/3869455677 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7b7406ae70 0x7f7b7406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:15.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.484+0000 7f7b85ffb640 1 -- 172.21.15.59:0/3869455677 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7b7c0abac0 con 0x7f7b880d16a0 2023-10-16T14:26:15.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.485+0000 7f7b8d141640 1 --2- 172.21.15.59:0/3869455677 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7b7406ae70 0x7f7b7406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:15.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.486+0000 7f7b8d141640 1 --2- 172.21.15.59:0/3869455677 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7b7406ae70 0x7f7b7406d330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7b780072c0 tx=0x7f7b7800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:15.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.488+0000 7f7b85ffb640 1 -- 172.21.15.59:0/3869455677 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7b7c0769c0 con 0x7f7b880d16a0 2023-10-16T14:26:15.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.672+0000 7f7b8e143640 1 -- 172.21.15.59:0/3869455677 --> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b880d0ea0 con 0x7f7b7406ae70 2023-10-16T14:26:15.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.698+0000 7f7b85ffb640 1 -- 172.21.15.59:0/3869455677 <== mgr.4100 v2:172.21.15.151:6800/518957627 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344970 (secure 0 0 0) 0x7f7b7800f040 con 0x7f7b7406ae70 2023-10-16T14:26:15.706 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:15.709 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-16T14:26:15.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.704+0000 7f7b8e143640 1 -- 172.21.15.59:0/3869455677 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7b7406ae70 msgr2=0x7f7b7406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:15.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.704+0000 7f7b8e143640 1 --2- 172.21.15.59:0/3869455677 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7b7406ae70 0x7f7b7406d330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7b780072c0 tx=0x7f7b7800b040 comp rx=0 tx=0).stop 2023-10-16T14:26:15.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.705+0000 7f7b8e143640 1 -- 172.21.15.59:0/3869455677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b880d16a0 msgr2=0x7f7b880b6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:15.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.705+0000 7f7b8e143640 1 --2- 172.21.15.59:0/3869455677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b880d16a0 0x7f7b880b6cc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0098c0 tx=0x7f7b7c0046c0 comp rx=0 tx=0).stop 2023-10-16T14:26:15.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.705+0000 7f7b8e143640 1 -- 172.21.15.59:0/3869455677 shutdown_connections 2023-10-16T14:26:15.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.705+0000 7f7b8e143640 1 --2- 172.21.15.59:0/3869455677 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7b7406ae70 0x7f7b7406d330 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:15.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.705+0000 7f7b8e143640 1 --2- 172.21.15.59:0/3869455677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b8815c9d0 0x7f7b880b7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:15.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.705+0000 7f7b8e143640 1 --2- 172.21.15.59:0/3869455677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b880d16a0 0x7f7b880b6cc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:15.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.705+0000 7f7b8e143640 1 --2- 172.21.15.59:0/3869455677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b880ce4d0 0x7f7b88149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:15.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.705+0000 7f7b8e143640 1 -- 172.21.15.59:0/3869455677 >> 172.21.15.59:0/3869455677 conn(0x7f7b8809bad0 msgr2=0x7f7b880b4870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:15.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.705+0000 7f7b8e143640 1 -- 172.21.15.59:0/3869455677 shutdown_connections 2023-10-16T14:26:15.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.705+0000 7f7b8e143640 1 -- 172.21.15.59:0/3869455677 wait complete. 2023-10-16T14:26:15.727 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-10-16T14:26:13.875119+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219492,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755228,"statfs":{"total":773094113280,"available":772869353472,"internally_reserved":0,"allocated":3383296,"data_stored":2022094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005484"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.740143+0000","last_change":"2023-10-16T14:25:47.673909+0000","last_active":"2023-10-16T14:25:52.740143+0000","last_peered":"2023-10-16T14:25:52.740143+0000","last_clean":"2023-10-16T14:25:52.740143+0000","last_became_active":"2023-10-16T14:25:47.672564+0000","last_became_peered":"2023-10-16T14:25:47.672564+0000","last_unstale":"2023-10-16T14:25:52.740143+0000","last_undegraded":"2023-10-16T14:25:52.740143+0000","last_fullsized":"2023-10-16T14:25:52.740143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:08:41.557287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.753608+0000","last_change":"2023-10-16T14:25:48.712086+0000","last_active":"2023-10-16T14:25:52.753608+0000","last_peered":"2023-10-16T14:25:52.753608+0000","last_clean":"2023-10-16T14:25:52.753608+0000","last_became_active":"2023-10-16T14:25:48.711422+0000","last_became_peered":"2023-10-16T14:25:48.711422+0000","last_unstale":"2023-10-16T14:25:52.753608+0000","last_undegraded":"2023-10-16T14:25:52.753608+0000","last_fullsized":"2023-10-16T14:25:52.753608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:15.110757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.089049+0000","last_change":"2023-10-16T14:25:52.777768+0000","last_active":"2023-10-16T14:25:54.089049+0000","last_peered":"2023-10-16T14:25:54.089049+0000","last_clean":"2023-10-16T14:25:54.089049+0000","last_became_active":"2023-10-16T14:25:52.777201+0000","last_became_peered":"2023-10-16T14:25:52.777201+0000","last_unstale":"2023-10-16T14:25:54.089049+0000","last_undegraded":"2023-10-16T14:25:54.089049+0000","last_fullsized":"2023-10-16T14:25:54.089049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:11:19.880188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.753780+0000","last_change":"2023-10-16T14:25:47.687110+0000","last_active":"2023-10-16T14:25:52.753780+0000","last_peered":"2023-10-16T14:25:52.753780+0000","last_clean":"2023-10-16T14:25:52.753780+0000","last_became_active":"2023-10-16T14:25:47.685070+0000","last_became_peered":"2023-10-16T14:25:47.685070+0000","last_unstale":"2023-10-16T14:25:52.753780+0000","last_undegraded":"2023-10-16T14:25:52.753780+0000","last_fullsized":"2023-10-16T14:25:52.753780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:23:12.328185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.751791+0000","last_change":"2023-10-16T14:25:48.698409+0000","last_active":"2023-10-16T14:25:52.751791+0000","last_peered":"2023-10-16T14:25:52.751791+0000","last_clean":"2023-10-16T14:25:52.751791+0000","last_became_active":"2023-10-16T14:25:48.697726+0000","last_became_peered":"2023-10-16T14:25:48.697726+0000","last_unstale":"2023-10-16T14:25:52.751791+0000","last_undegraded":"2023-10-16T14:25:52.751791+0000","last_fullsized":"2023-10-16T14:25:52.751791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:51:31.708932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.085749+0000","last_change":"2023-10-16T14:25:52.761817+0000","last_active":"2023-10-16T14:25:54.085749+0000","last_peered":"2023-10-16T14:25:54.085749+0000","last_clean":"2023-10-16T14:25:54.085749+0000","last_became_active":"2023-10-16T14:25:52.761162+0000","last_became_peered":"2023-10-16T14:25:52.761162+0000","last_unstale":"2023-10-16T14:25:54.085749+0000","last_undegraded":"2023-10-16T14:25:54.085749+0000","last_fullsized":"2023-10-16T14:25:54.085749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:12:32.541889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742426+0000","last_change":"2023-10-16T14:25:47.688476+0000","last_active":"2023-10-16T14:25:52.742426+0000","last_peered":"2023-10-16T14:25:52.742426+0000","last_clean":"2023-10-16T14:25:52.742426+0000","last_became_active":"2023-10-16T14:25:47.684107+0000","last_became_peered":"2023-10-16T14:25:47.684107+0000","last_unstale":"2023-10-16T14:25:52.742426+0000","last_undegraded":"2023-10-16T14:25:52.742426+0000","last_fullsized":"2023-10-16T14:25:52.742426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:02.376389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.730675+0000","last_change":"2023-10-16T14:25:48.698904+0000","last_active":"2023-10-16T14:25:52.730675+0000","last_peered":"2023-10-16T14:25:52.730675+0000","last_clean":"2023-10-16T14:25:52.730675+0000","last_became_active":"2023-10-16T14:25:48.698533+0000","last_became_peered":"2023-10-16T14:25:48.698533+0000","last_unstale":"2023-10-16T14:25:52.730675+0000","last_undegraded":"2023-10-16T14:25:52.730675+0000","last_fullsized":"2023-10-16T14:25:52.730675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:55:50.448443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.090560+0000","last_change":"2023-10-16T14:25:52.762960+0000","last_active":"2023-10-16T14:25:54.090560+0000","last_peered":"2023-10-16T14:25:54.090560+0000","last_clean":"2023-10-16T14:25:54.090560+0000","last_became_active":"2023-10-16T14:25:52.762507+0000","last_became_peered":"2023-10-16T14:25:52.762507+0000","last_unstale":"2023-10-16T14:25:54.090560+0000","last_undegraded":"2023-10-16T14:25:54.090560+0000","last_fullsized":"2023-10-16T14:25:54.090560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:35:03.884337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742081+0000","last_change":"2023-10-16T14:25:47.684937+0000","last_active":"2023-10-16T14:25:52.742081+0000","last_peered":"2023-10-16T14:25:52.742081+0000","last_clean":"2023-10-16T14:25:52.742081+0000","last_became_active":"2023-10-16T14:25:47.684625+0000","last_became_peered":"2023-10-16T14:25:47.684625+0000","last_unstale":"2023-10-16T14:25:52.742081+0000","last_undegraded":"2023-10-16T14:25:52.742081+0000","last_fullsized":"2023-10-16T14:25:52.742081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:05.381585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734783+0000","last_change":"2023-10-16T14:25:48.707706+0000","last_active":"2023-10-16T14:25:52.734783+0000","last_peered":"2023-10-16T14:25:52.734783+0000","last_clean":"2023-10-16T14:25:52.734783+0000","last_became_active":"2023-10-16T14:25:48.707434+0000","last_became_peered":"2023-10-16T14:25:48.707434+0000","last_unstale":"2023-10-16T14:25:52.734783+0000","last_undegraded":"2023-10-16T14:25:52.734783+0000","last_fullsized":"2023-10-16T14:25:52.734783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:25:48.053924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086892+0000","last_change":"2023-10-16T14:25:52.775947+0000","last_active":"2023-10-16T14:25:54.086892+0000","last_peered":"2023-10-16T14:25:54.086892+0000","last_clean":"2023-10-16T14:25:54.086892+0000","last_became_active":"2023-10-16T14:25:52.771892+0000","last_became_peered":"2023-10-16T14:25:52.771892+0000","last_unstale":"2023-10-16T14:25:54.086892+0000","last_undegraded":"2023-10-16T14:25:54.086892+0000","last_fullsized":"2023-10-16T14:25:54.086892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:13:27.830565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734432+0000","last_change":"2023-10-16T14:25:48.702028+0000","last_active":"2023-10-16T14:25:52.734432+0000","last_peered":"2023-10-16T14:25:52.734432+0000","last_clean":"2023-10-16T14:25:52.734432+0000","last_became_active":"2023-10-16T14:25:48.701734+0000","last_became_peered":"2023-10-16T14:25:48.701734+0000","last_unstale":"2023-10-16T14:25:52.734432+0000","last_undegraded":"2023-10-16T14:25:52.734432+0000","last_fullsized":"2023-10-16T14:25:52.734432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:27:03.907713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734923+0000","last_change":"2023-10-16T14:25:47.675386+0000","last_active":"2023-10-16T14:25:52.734923+0000","last_peered":"2023-10-16T14:25:52.734923+0000","last_clean":"2023-10-16T14:25:52.734923+0000","last_became_active":"2023-10-16T14:25:47.673235+0000","last_became_peered":"2023-10-16T14:25:47.673235+0000","last_unstale":"2023-10-16T14:25:52.734923+0000","last_undegraded":"2023-10-16T14:25:52.734923+0000","last_fullsized":"2023-10-16T14:25:52.734923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:08:41.557287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.726707+0000","last_change":"2023-10-16T14:25:52.761060+0000","last_active":"2023-10-16T14:25:53.726707+0000","last_peered":"2023-10-16T14:25:53.726707+0000","last_clean":"2023-10-16T14:25:53.726707+0000","last_became_active":"2023-10-16T14:25:52.760368+0000","last_became_peered":"2023-10-16T14:25:52.760368+0000","last_unstale":"2023-10-16T14:25:53.726707+0000","last_undegraded":"2023-10-16T14:25:53.726707+0000","last_fullsized":"2023-10-16T14:25:53.726707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:22:11.797676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.755837+0000","last_change":"2023-10-16T14:25:48.711084+0000","last_active":"2023-10-16T14:25:52.755837+0000","last_peered":"2023-10-16T14:25:52.755837+0000","last_clean":"2023-10-16T14:25:52.755837+0000","last_became_active":"2023-10-16T14:25:48.710802+0000","last_became_peered":"2023-10-16T14:25:48.710802+0000","last_unstale":"2023-10-16T14:25:52.755837+0000","last_undegraded":"2023-10-16T14:25:52.755837+0000","last_fullsized":"2023-10-16T14:25:52.755837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:06.393767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.764948+0000","last_change":"2023-10-16T14:25:47.688614+0000","last_active":"2023-10-16T14:25:52.764948+0000","last_peered":"2023-10-16T14:25:52.764948+0000","last_clean":"2023-10-16T14:25:52.764948+0000","last_became_active":"2023-10-16T14:25:47.686187+0000","last_became_peered":"2023-10-16T14:25:47.686187+0000","last_unstale":"2023-10-16T14:25:52.764948+0000","last_undegraded":"2023-10-16T14:25:52.764948+0000","last_fullsized":"2023-10-16T14:25:52.764948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:55:49.436260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.084971+0000","last_change":"2023-10-16T14:25:52.773158+0000","last_active":"2023-10-16T14:25:54.084971+0000","last_peered":"2023-10-16T14:25:54.084971+0000","last_clean":"2023-10-16T14:25:54.084971+0000","last_became_active":"2023-10-16T14:25:52.772200+0000","last_became_peered":"2023-10-16T14:25:52.772200+0000","last_unstale":"2023-10-16T14:25:54.084971+0000","last_undegraded":"2023-10-16T14:25:54.084971+0000","last_fullsized":"2023-10-16T14:25:54.084971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:01.082527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734700+0000","last_change":"2023-10-16T14:25:48.696802+0000","last_active":"2023-10-16T14:25:52.734700+0000","last_peered":"2023-10-16T14:25:52.734700+0000","last_clean":"2023-10-16T14:25:52.734700+0000","last_became_active":"2023-10-16T14:25:48.695664+0000","last_became_peered":"2023-10-16T14:25:48.695664+0000","last_unstale":"2023-10-16T14:25:52.734700+0000","last_undegraded":"2023-10-16T14:25:52.734700+0000","last_fullsized":"2023-10-16T14:25:52.734700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:44:58.603248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735333+0000","last_change":"2023-10-16T14:25:47.690959+0000","last_active":"2023-10-16T14:25:52.735333+0000","last_peered":"2023-10-16T14:25:52.735333+0000","last_clean":"2023-10-16T14:25:52.735333+0000","last_became_active":"2023-10-16T14:25:47.690583+0000","last_became_peered":"2023-10-16T14:25:47.690583+0000","last_unstale":"2023-10-16T14:25:52.735333+0000","last_undegraded":"2023-10-16T14:25:52.735333+0000","last_fullsized":"2023-10-16T14:25:52.735333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:05.381585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.090752+0000","last_change":"2023-10-16T14:25:52.774636+0000","last_active":"2023-10-16T14:25:54.090752+0000","last_peered":"2023-10-16T14:25:54.090752+0000","last_clean":"2023-10-16T14:25:54.090752+0000","last_became_active":"2023-10-16T14:25:52.771832+0000","last_became_peered":"2023-10-16T14:25:52.771832+0000","last_unstale":"2023-10-16T14:25:54.090752+0000","last_undegraded":"2023-10-16T14:25:54.090752+0000","last_fullsized":"2023-10-16T14:25:54.090752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:20.646849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735106+0000","last_change":"2023-10-16T14:25:48.704071+0000","last_active":"2023-10-16T14:25:52.735106+0000","last_peered":"2023-10-16T14:25:52.735106+0000","last_clean":"2023-10-16T14:25:52.735106+0000","last_became_active":"2023-10-16T14:25:48.703786+0000","last_became_peered":"2023-10-16T14:25:48.703786+0000","last_unstale":"2023-10-16T14:25:52.735106+0000","last_undegraded":"2023-10-16T14:25:52.735106+0000","last_fullsized":"2023-10-16T14:25:52.735106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:01:09.957934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.740520+0000","last_change":"2023-10-16T14:25:47.684412+0000","last_active":"2023-10-16T14:25:52.740520+0000","last_peered":"2023-10-16T14:25:52.740520+0000","last_clean":"2023-10-16T14:25:52.740520+0000","last_became_active":"2023-10-16T14:25:47.684067+0000","last_became_peered":"2023-10-16T14:25:47.684067+0000","last_unstale":"2023-10-16T14:25:52.740520+0000","last_undegraded":"2023-10-16T14:25:52.740520+0000","last_fullsized":"2023-10-16T14:25:52.740520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:33.359003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.091066+0000","last_change":"2023-10-16T14:25:52.760002+0000","last_active":"2023-10-16T14:25:54.091066+0000","last_peered":"2023-10-16T14:25:54.091066+0000","last_clean":"2023-10-16T14:25:54.091066+0000","last_became_active":"2023-10-16T14:25:52.759113+0000","last_became_peered":"2023-10-16T14:25:52.759113+0000","last_unstale":"2023-10-16T14:25:54.091066+0000","last_undegraded":"2023-10-16T14:25:54.091066+0000","last_fullsized":"2023-10-16T14:25:54.091066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:53.190625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.739919+0000","last_change":"2023-10-16T14:25:48.697052+0000","last_active":"2023-10-16T14:25:52.739919+0000","last_peered":"2023-10-16T14:25:52.739919+0000","last_clean":"2023-10-16T14:25:52.739919+0000","last_became_active":"2023-10-16T14:25:48.695195+0000","last_became_peered":"2023-10-16T14:25:48.695195+0000","last_unstale":"2023-10-16T14:25:52.739919+0000","last_undegraded":"2023-10-16T14:25:52.739919+0000","last_fullsized":"2023-10-16T14:25:52.739919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:34.371186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735823+0000","last_change":"2023-10-16T14:25:47.690567+0000","last_active":"2023-10-16T14:25:52.735823+0000","last_peered":"2023-10-16T14:25:52.735823+0000","last_clean":"2023-10-16T14:25:52.735823+0000","last_became_active":"2023-10-16T14:25:47.690306+0000","last_became_peered":"2023-10-16T14:25:47.690306+0000","last_unstale":"2023-10-16T14:25:52.735823+0000","last_undegraded":"2023-10-16T14:25:52.735823+0000","last_fullsized":"2023-10-16T14:25:52.735823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:18.948353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086866+0000","last_change":"2023-10-16T14:25:52.762012+0000","last_active":"2023-10-16T14:25:54.086866+0000","last_peered":"2023-10-16T14:25:54.086866+0000","last_clean":"2023-10-16T14:25:54.086866+0000","last_became_active":"2023-10-16T14:25:52.761553+0000","last_became_peered":"2023-10-16T14:25:52.761553+0000","last_unstale":"2023-10-16T14:25:54.086866+0000","last_undegraded":"2023-10-16T14:25:54.086866+0000","last_fullsized":"2023-10-16T14:25:54.086866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:57.876480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.739718+0000","last_change":"2023-10-16T14:25:48.713472+0000","last_active":"2023-10-16T14:25:52.739718+0000","last_peered":"2023-10-16T14:25:52.739718+0000","last_clean":"2023-10-16T14:25:52.739718+0000","last_became_active":"2023-10-16T14:25:48.713019+0000","last_became_peered":"2023-10-16T14:25:48.713019+0000","last_unstale":"2023-10-16T14:25:52.739718+0000","last_undegraded":"2023-10-16T14:25:52.739718+0000","last_fullsized":"2023-10-16T14:25:52.739718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:08.080421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.287222+0000","last_change":"2023-10-16T14:25:47.690820+0000","last_active":"2023-10-16T14:25:53.287222+0000","last_peered":"2023-10-16T14:25:53.287222+0000","last_clean":"2023-10-16T14:25:53.287222+0000","last_became_active":"2023-10-16T14:25:47.690554+0000","last_became_peered":"2023-10-16T14:25:47.690554+0000","last_unstale":"2023-10-16T14:25:53.287222+0000","last_undegraded":"2023-10-16T14:25:53.287222+0000","last_fullsized":"2023-10-16T14:25:53.287222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:48:55.264157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.728903+0000","last_change":"2023-10-16T14:25:52.765122+0000","last_active":"2023-10-16T14:25:53.728903+0000","last_peered":"2023-10-16T14:25:53.728903+0000","last_clean":"2023-10-16T14:25:53.728903+0000","last_became_active":"2023-10-16T14:25:52.764663+0000","last_became_peered":"2023-10-16T14:25:52.764663+0000","last_unstale":"2023-10-16T14:25:53.728903+0000","last_undegraded":"2023-10-16T14:25:53.728903+0000","last_fullsized":"2023-10-16T14:25:53.728903+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:39:02.278979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.769095+0000","last_change":"2023-10-16T14:25:48.717743+0000","last_active":"2023-10-16T14:25:52.769095+0000","last_peered":"2023-10-16T14:25:52.769095+0000","last_clean":"2023-10-16T14:25:52.769095+0000","last_became_active":"2023-10-16T14:25:48.717468+0000","last_became_peered":"2023-10-16T14:25:48.717468+0000","last_unstale":"2023-10-16T14:25:52.769095+0000","last_undegraded":"2023-10-16T14:25:52.769095+0000","last_fullsized":"2023-10-16T14:25:52.769095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:44:58.603248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734870+0000","last_change":"2023-10-16T14:25:47.676947+0000","last_active":"2023-10-16T14:25:52.734870+0000","last_peered":"2023-10-16T14:25:52.734870+0000","last_clean":"2023-10-16T14:25:52.734870+0000","last_became_active":"2023-10-16T14:25:47.676630+0000","last_became_peered":"2023-10-16T14:25:47.676630+0000","last_unstale":"2023-10-16T14:25:52.734870+0000","last_undegraded":"2023-10-16T14:25:52.734870+0000","last_fullsized":"2023-10-16T14:25:52.734870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:58:33.359003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.088211+0000","last_change":"2023-10-16T14:25:52.764074+0000","last_active":"2023-10-16T14:25:54.088211+0000","last_peered":"2023-10-16T14:25:54.088211+0000","last_clean":"2023-10-16T14:25:54.088211+0000","last_became_active":"2023-10-16T14:25:52.763641+0000","last_became_peered":"2023-10-16T14:25:52.763641+0000","last_unstale":"2023-10-16T14:25:54.088211+0000","last_undegraded":"2023-10-16T14:25:54.088211+0000","last_fullsized":"2023-10-16T14:25:54.088211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:21:41.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.724375+0000","last_change":"2023-10-16T14:25:48.710134+0000","last_active":"2023-10-16T14:25:52.724375+0000","last_peered":"2023-10-16T14:25:52.724375+0000","last_clean":"2023-10-16T14:25:52.724375+0000","last_became_active":"2023-10-16T14:25:48.709462+0000","last_became_peered":"2023-10-16T14:25:48.709462+0000","last_unstale":"2023-10-16T14:25:52.724375+0000","last_undegraded":"2023-10-16T14:25:52.724375+0000","last_fullsized":"2023-10-16T14:25:52.724375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:06.393767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.752412+0000","last_change":"2023-10-16T14:25:47.687252+0000","last_active":"2023-10-16T14:25:52.752412+0000","last_peered":"2023-10-16T14:25:52.752412+0000","last_clean":"2023-10-16T14:25:52.752412+0000","last_became_active":"2023-10-16T14:25:47.685825+0000","last_became_peered":"2023-10-16T14:25:47.685825+0000","last_unstale":"2023-10-16T14:25:52.752412+0000","last_undegraded":"2023-10-16T14:25:52.752412+0000","last_fullsized":"2023-10-16T14:25:52.752412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:19:01.814630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.087296+0000","last_change":"2023-10-16T14:25:52.767900+0000","last_active":"2023-10-16T14:25:54.087296+0000","last_peered":"2023-10-16T14:25:54.087296+0000","last_clean":"2023-10-16T14:25:54.087296+0000","last_became_active":"2023-10-16T14:25:52.767212+0000","last_became_peered":"2023-10-16T14:25:52.767212+0000","last_unstale":"2023-10-16T14:25:54.087296+0000","last_undegraded":"2023-10-16T14:25:54.087296+0000","last_fullsized":"2023-10-16T14:25:54.087296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:35:03.884337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741846+0000","last_change":"2023-10-16T14:25:48.722313+0000","last_active":"2023-10-16T14:25:52.741846+0000","last_peered":"2023-10-16T14:25:52.741846+0000","last_clean":"2023-10-16T14:25:52.741846+0000","last_became_active":"2023-10-16T14:25:48.718701+0000","last_became_peered":"2023-10-16T14:25:48.718701+0000","last_unstale":"2023-10-16T14:25:52.741846+0000","last_undegraded":"2023-10-16T14:25:52.741846+0000","last_fullsized":"2023-10-16T14:25:52.741846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:53.816510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734713+0000","last_change":"2023-10-16T14:25:47.685303+0000","last_active":"2023-10-16T14:25:52.734713+0000","last_peered":"2023-10-16T14:25:52.734713+0000","last_clean":"2023-10-16T14:25:52.734713+0000","last_became_active":"2023-10-16T14:25:47.682721+0000","last_became_peered":"2023-10-16T14:25:47.682721+0000","last_unstale":"2023-10-16T14:25:52.734713+0000","last_undegraded":"2023-10-16T14:25:52.734713+0000","last_fullsized":"2023-10-16T14:25:52.734713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:38:16.755159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086122+0000","last_change":"2023-10-16T14:25:52.772956+0000","last_active":"2023-10-16T14:25:54.086122+0000","last_peered":"2023-10-16T14:25:54.086122+0000","last_clean":"2023-10-16T14:25:54.086122+0000","last_became_active":"2023-10-16T14:25:52.772590+0000","last_became_peered":"2023-10-16T14:25:52.772590+0000","last_unstale":"2023-10-16T14:25:54.086122+0000","last_undegraded":"2023-10-16T14:25:54.086122+0000","last_fullsized":"2023-10-16T14:25:54.086122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:13:27.830565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.748440+0000","last_change":"2023-10-16T14:25:48.695306+0000","last_active":"2023-10-16T14:25:52.748440+0000","last_peered":"2023-10-16T14:25:52.748440+0000","last_clean":"2023-10-16T14:25:52.748440+0000","last_became_active":"2023-10-16T14:25:48.694997+0000","last_became_peered":"2023-10-16T14:25:48.694997+0000","last_unstale":"2023-10-16T14:25:52.748440+0000","last_undegraded":"2023-10-16T14:25:52.748440+0000","last_fullsized":"2023-10-16T14:25:52.748440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:10:11.346850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.755114+0000","last_change":"2023-10-16T14:25:47.684999+0000","last_active":"2023-10-16T14:25:52.755114+0000","last_peered":"2023-10-16T14:25:52.755114+0000","last_clean":"2023-10-16T14:25:52.755114+0000","last_became_active":"2023-10-16T14:25:47.684456+0000","last_became_peered":"2023-10-16T14:25:47.684456+0000","last_unstale":"2023-10-16T14:25:52.755114+0000","last_undegraded":"2023-10-16T14:25:52.755114+0000","last_fullsized":"2023-10-16T14:25:52.755114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:13:52.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086890+0000","last_change":"2023-10-16T14:25:52.771370+0000","last_active":"2023-10-16T14:25:54.086890+0000","last_peered":"2023-10-16T14:25:54.086890+0000","last_clean":"2023-10-16T14:25:54.086890+0000","last_became_active":"2023-10-16T14:25:52.770704+0000","last_became_peered":"2023-10-16T14:25:52.770704+0000","last_unstale":"2023-10-16T14:25:54.086890+0000","last_undegraded":"2023-10-16T14:25:54.086890+0000","last_fullsized":"2023-10-16T14:25:54.086890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:38:21.827312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.765178+0000","last_change":"2023-10-16T14:25:48.722957+0000","last_active":"2023-10-16T14:25:52.765178+0000","last_peered":"2023-10-16T14:25:52.765178+0000","last_clean":"2023-10-16T14:25:52.765178+0000","last_became_active":"2023-10-16T14:25:48.722644+0000","last_became_peered":"2023-10-16T14:25:48.722644+0000","last_unstale":"2023-10-16T14:25:52.765178+0000","last_undegraded":"2023-10-16T14:25:52.765178+0000","last_fullsized":"2023-10-16T14:25:52.765178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:48:56.276340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.733321+0000","last_change":"2023-10-16T14:25:47.686726+0000","last_active":"2023-10-16T14:25:52.733321+0000","last_peered":"2023-10-16T14:25:52.733321+0000","last_clean":"2023-10-16T14:25:52.733321+0000","last_became_active":"2023-10-16T14:25:47.686380+0000","last_became_peered":"2023-10-16T14:25:47.686380+0000","last_unstale":"2023-10-16T14:25:52.733321+0000","last_undegraded":"2023-10-16T14:25:52.733321+0000","last_fullsized":"2023-10-16T14:25:52.733321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:11:14.808035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.088884+0000","last_change":"2023-10-16T14:25:52.775875+0000","last_active":"2023-10-16T14:25:54.088884+0000","last_peered":"2023-10-16T14:25:54.088884+0000","last_clean":"2023-10-16T14:25:54.088884+0000","last_became_active":"2023-10-16T14:25:52.774845+0000","last_became_peered":"2023-10-16T14:25:52.774845+0000","last_unstale":"2023-10-16T14:25:54.088884+0000","last_undegraded":"2023-10-16T14:25:54.088884+0000","last_fullsized":"2023-10-16T14:25:54.088884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:14:32.299751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735654+0000","last_change":"2023-10-16T14:25:48.694170+0000","last_active":"2023-10-16T14:25:52.735654+0000","last_peered":"2023-10-16T14:25:52.735654+0000","last_clean":"2023-10-16T14:25:52.735654+0000","last_became_active":"2023-10-16T14:25:48.693887+0000","last_became_peered":"2023-10-16T14:25:48.693887+0000","last_unstale":"2023-10-16T14:25:52.735654+0000","last_undegraded":"2023-10-16T14:25:52.735654+0000","last_fullsized":"2023-10-16T14:25:52.735654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:11:15.820218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735010+0000","last_change":"2023-10-16T14:25:47.672195+0000","last_active":"2023-10-16T14:25:52.735010+0000","last_peered":"2023-10-16T14:25:52.735010+0000","last_clean":"2023-10-16T14:25:52.735010+0000","last_became_active":"2023-10-16T14:25:47.671904+0000","last_became_peered":"2023-10-16T14:25:47.671904+0000","last_unstale":"2023-10-16T14:25:52.735010+0000","last_undegraded":"2023-10-16T14:25:52.735010+0000","last_fullsized":"2023-10-16T14:25:52.735010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:44:57.591065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.728977+0000","last_change":"2023-10-16T14:25:37.824419+0000","last_active":"2023-10-16T14:25:52.728977+0000","last_peered":"2023-10-16T14:25:52.728977+0000","last_clean":"2023-10-16T14:25:52.728977+0000","last_became_active":"2023-10-16T14:25:37.821909+0000","last_became_peered":"2023-10-16T14:25:37.821909+0000","last_unstale":"2023-10-16T14:25:52.728977+0000","last_undegraded":"2023-10-16T14:25:52.728977+0000","last_fullsized":"2023-10-16T14:25:52.728977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:36.449944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:36.449944+0000","last_clean_scrub_stamp":"2023-10-16T14:25:36.449944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:37:42.457821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.727527+0000","last_change":"2023-10-16T14:25:52.743776+0000","last_active":"2023-10-16T14:25:53.727527+0000","last_peered":"2023-10-16T14:25:53.727527+0000","last_clean":"2023-10-16T14:25:53.727527+0000","last_became_active":"2023-10-16T14:25:52.743307+0000","last_became_peered":"2023-10-16T14:25:52.743307+0000","last_unstale":"2023-10-16T14:25:53.727527+0000","last_undegraded":"2023-10-16T14:25:53.727527+0000","last_fullsized":"2023-10-16T14:25:53.727527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:44:03.308638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734705+0000","last_change":"2023-10-16T14:25:48.698529+0000","last_active":"2023-10-16T14:25:52.734705+0000","last_peered":"2023-10-16T14:25:52.734705+0000","last_clean":"2023-10-16T14:25:52.734705+0000","last_became_active":"2023-10-16T14:25:48.698220+0000","last_became_peered":"2023-10-16T14:25:48.698220+0000","last_unstale":"2023-10-16T14:25:52.734705+0000","last_undegraded":"2023-10-16T14:25:52.734705+0000","last_fullsized":"2023-10-16T14:25:52.734705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:24:18.840113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.769078+0000","last_change":"2023-10-16T14:25:47.689827+0000","last_active":"2023-10-16T14:25:52.769078+0000","last_peered":"2023-10-16T14:25:52.769078+0000","last_clean":"2023-10-16T14:25:52.769078+0000","last_became_active":"2023-10-16T14:25:47.689464+0000","last_became_peered":"2023-10-16T14:25:47.689464+0000","last_unstale":"2023-10-16T14:25:52.769078+0000","last_undegraded":"2023-10-16T14:25:52.769078+0000","last_fullsized":"2023-10-16T14:25:52.769078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:13:52.313169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.090293+0000","last_change":"2023-10-16T14:25:52.752794+0000","last_active":"2023-10-16T14:25:54.090293+0000","last_peered":"2023-10-16T14:25:54.090293+0000","last_clean":"2023-10-16T14:25:54.090293+0000","last_became_active":"2023-10-16T14:25:52.751655+0000","last_became_peered":"2023-10-16T14:25:52.751655+0000","last_unstale":"2023-10-16T14:25:54.090293+0000","last_undegraded":"2023-10-16T14:25:54.090293+0000","last_fullsized":"2023-10-16T14:25:54.090293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:38:21.827312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742050+0000","last_change":"2023-10-16T14:25:48.697393+0000","last_active":"2023-10-16T14:25:52.742050+0000","last_peered":"2023-10-16T14:25:52.742050+0000","last_clean":"2023-10-16T14:25:52.742050+0000","last_became_active":"2023-10-16T14:25:48.697054+0000","last_became_peered":"2023-10-16T14:25:48.697054+0000","last_unstale":"2023-10-16T14:25:52.742050+0000","last_undegraded":"2023-10-16T14:25:52.742050+0000","last_fullsized":"2023-10-16T14:25:52.742050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:49.130655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.750852+0000","last_change":"2023-10-16T14:25:47.684985+0000","last_active":"2023-10-16T14:25:52.750852+0000","last_peered":"2023-10-16T14:25:52.750852+0000","last_clean":"2023-10-16T14:25:52.750852+0000","last_became_active":"2023-10-16T14:25:47.684330+0000","last_became_peered":"2023-10-16T14:25:47.684330+0000","last_unstale":"2023-10-16T14:25:52.750852+0000","last_undegraded":"2023-10-16T14:25:52.750852+0000","last_fullsized":"2023-10-16T14:25:52.750852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:30:15.114400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086956+0000","last_change":"2023-10-16T14:25:52.757607+0000","last_active":"2023-10-16T14:25:54.086956+0000","last_peered":"2023-10-16T14:25:54.086956+0000","last_clean":"2023-10-16T14:25:54.086956+0000","last_became_active":"2023-10-16T14:25:52.757210+0000","last_became_peered":"2023-10-16T14:25:52.757210+0000","last_unstale":"2023-10-16T14:25:54.086956+0000","last_undegraded":"2023-10-16T14:25:54.086956+0000","last_fullsized":"2023-10-16T14:25:54.086956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:04:13.493245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742186+0000","last_change":"2023-10-16T14:25:48.706248+0000","last_active":"2023-10-16T14:25:52.742186+0000","last_peered":"2023-10-16T14:25:52.742186+0000","last_clean":"2023-10-16T14:25:52.742186+0000","last_became_active":"2023-10-16T14:25:48.705245+0000","last_became_peered":"2023-10-16T14:25:48.705245+0000","last_unstale":"2023-10-16T14:25:52.742186+0000","last_undegraded":"2023-10-16T14:25:52.742186+0000","last_fullsized":"2023-10-16T14:25:52.742186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:13:23.770595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.740182+0000","last_change":"2023-10-16T14:25:47.689189+0000","last_active":"2023-10-16T14:25:52.740182+0000","last_peered":"2023-10-16T14:25:52.740182+0000","last_clean":"2023-10-16T14:25:52.740182+0000","last_became_active":"2023-10-16T14:25:47.688019+0000","last_became_peered":"2023-10-16T14:25:47.688019+0000","last_unstale":"2023-10-16T14:25:52.740182+0000","last_undegraded":"2023-10-16T14:25:52.740182+0000","last_fullsized":"2023-10-16T14:25:52.740182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:02.376389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.725983+0000","last_change":"2023-10-16T14:25:52.743545+0000","last_active":"2023-10-16T14:25:53.725983+0000","last_peered":"2023-10-16T14:25:53.725983+0000","last_clean":"2023-10-16T14:25:53.725983+0000","last_became_active":"2023-10-16T14:25:52.743011+0000","last_became_peered":"2023-10-16T14:25:52.743011+0000","last_unstale":"2023-10-16T14:25:53.725983+0000","last_undegraded":"2023-10-16T14:25:53.725983+0000","last_fullsized":"2023-10-16T14:25:53.725983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:44:58.353984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.726324+0000","last_change":"2023-10-16T14:25:48.718247+0000","last_active":"2023-10-16T14:25:52.726324+0000","last_peered":"2023-10-16T14:25:52.726324+0000","last_clean":"2023-10-16T14:25:52.726324+0000","last_became_active":"2023-10-16T14:25:48.717927+0000","last_became_peered":"2023-10-16T14:25:48.717927+0000","last_unstale":"2023-10-16T14:25:52.726324+0000","last_undegraded":"2023-10-16T14:25:52.726324+0000","last_fullsized":"2023-10-16T14:25:52.726324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:08:42.569470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742310+0000","last_change":"2023-10-16T14:25:47.689833+0000","last_active":"2023-10-16T14:25:52.742310+0000","last_peered":"2023-10-16T14:25:52.742310+0000","last_clean":"2023-10-16T14:25:52.742310+0000","last_became_active":"2023-10-16T14:25:47.689476+0000","last_became_peered":"2023-10-16T14:25:47.689476+0000","last_unstale":"2023-10-16T14:25:52.742310+0000","last_undegraded":"2023-10-16T14:25:52.742310+0000","last_fullsized":"2023-10-16T14:25:52.742310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:15.574696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.087293+0000","last_change":"2023-10-16T14:25:52.751674+0000","last_active":"2023-10-16T14:25:54.087293+0000","last_peered":"2023-10-16T14:25:54.087293+0000","last_clean":"2023-10-16T14:25:54.087293+0000","last_became_active":"2023-10-16T14:25:52.751135+0000","last_became_peered":"2023-10-16T14:25:52.751135+0000","last_unstale":"2023-10-16T14:25:54.087293+0000","last_undegraded":"2023-10-16T14:25:54.087293+0000","last_fullsized":"2023-10-16T14:25:54.087293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:49:00.336310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.733096+0000","last_change":"2023-10-16T14:25:48.713856+0000","last_active":"2023-10-16T14:25:52.733096+0000","last_peered":"2023-10-16T14:25:52.733096+0000","last_clean":"2023-10-16T14:25:52.733096+0000","last_became_active":"2023-10-16T14:25:48.713593+0000","last_became_peered":"2023-10-16T14:25:48.713593+0000","last_unstale":"2023-10-16T14:25:52.733096+0000","last_undegraded":"2023-10-16T14:25:52.733096+0000","last_fullsized":"2023-10-16T14:25:52.733096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:32.458956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734709+0000","last_change":"2023-10-16T14:25:47.670890+0000","last_active":"2023-10-16T14:25:52.734709+0000","last_peered":"2023-10-16T14:25:52.734709+0000","last_clean":"2023-10-16T14:25:52.734709+0000","last_became_active":"2023-10-16T14:25:47.670394+0000","last_became_peered":"2023-10-16T14:25:47.670394+0000","last_unstale":"2023-10-16T14:25:52.734709+0000","last_undegraded":"2023-10-16T14:25:52.734709+0000","last_fullsized":"2023-10-16T14:25:52.734709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:05:41.428042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.089075+0000","last_change":"2023-10-16T14:25:52.766516+0000","last_active":"2023-10-16T14:25:54.089075+0000","last_peered":"2023-10-16T14:25:54.089075+0000","last_clean":"2023-10-16T14:25:54.089075+0000","last_became_active":"2023-10-16T14:25:52.766073+0000","last_became_peered":"2023-10-16T14:25:52.766073+0000","last_unstale":"2023-10-16T14:25:54.089075+0000","last_undegraded":"2023-10-16T14:25:54.089075+0000","last_fullsized":"2023-10-16T14:25:54.089075+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:14:58.114992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.728872+0000","last_change":"2023-10-16T14:25:48.696048+0000","last_active":"2023-10-16T14:25:52.728872+0000","last_peered":"2023-10-16T14:25:52.728872+0000","last_clean":"2023-10-16T14:25:52.728872+0000","last_became_active":"2023-10-16T14:25:48.695762+0000","last_became_peered":"2023-10-16T14:25:48.695762+0000","last_unstale":"2023-10-16T14:25:52.728872+0000","last_undegraded":"2023-10-16T14:25:52.728872+0000","last_fullsized":"2023-10-16T14:25:52.728872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:23:02.569007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741599+0000","last_change":"2023-10-16T14:25:47.688476+0000","last_active":"2023-10-16T14:25:52.741599+0000","last_peered":"2023-10-16T14:25:52.741599+0000","last_clean":"2023-10-16T14:25:52.741599+0000","last_became_active":"2023-10-16T14:25:47.688163+0000","last_became_peered":"2023-10-16T14:25:47.688163+0000","last_unstale":"2023-10-16T14:25:52.741599+0000","last_undegraded":"2023-10-16T14:25:52.741599+0000","last_fullsized":"2023-10-16T14:25:52.741599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:07:28.689085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.090941+0000","last_change":"2023-10-16T14:25:52.768793+0000","last_active":"2023-10-16T14:25:54.090941+0000","last_peered":"2023-10-16T14:25:54.090941+0000","last_clean":"2023-10-16T14:25:54.090941+0000","last_became_active":"2023-10-16T14:25:52.765782+0000","last_became_peered":"2023-10-16T14:25:52.765782+0000","last_unstale":"2023-10-16T14:25:54.090941+0000","last_undegraded":"2023-10-16T14:25:54.090941+0000","last_fullsized":"2023-10-16T14:25:54.090941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:48:18.923566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734835+0000","last_change":"2023-10-16T14:25:48.706114+0000","last_active":"2023-10-16T14:25:52.734835+0000","last_peered":"2023-10-16T14:25:52.734835+0000","last_clean":"2023-10-16T14:25:52.734835+0000","last_became_active":"2023-10-16T14:25:48.705841+0000","last_became_peered":"2023-10-16T14:25:48.705841+0000","last_unstale":"2023-10-16T14:25:52.734835+0000","last_undegraded":"2023-10-16T14:25:52.734835+0000","last_fullsized":"2023-10-16T14:25:52.734835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:23:57.022557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734625+0000","last_change":"2023-10-16T14:25:47.672757+0000","last_active":"2023-10-16T14:25:52.734625+0000","last_peered":"2023-10-16T14:25:52.734625+0000","last_clean":"2023-10-16T14:25:52.734625+0000","last_became_active":"2023-10-16T14:25:47.671677+0000","last_became_peered":"2023-10-16T14:25:47.671677+0000","last_unstale":"2023-10-16T14:25:52.734625+0000","last_undegraded":"2023-10-16T14:25:52.734625+0000","last_fullsized":"2023-10-16T14:25:52.734625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:13:22.758413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.086002+0000","last_change":"2023-10-16T14:25:52.772092+0000","last_active":"2023-10-16T14:25:54.086002+0000","last_peered":"2023-10-16T14:25:54.086002+0000","last_clean":"2023-10-16T14:25:54.086002+0000","last_became_active":"2023-10-16T14:25:52.771630+0000","last_became_peered":"2023-10-16T14:25:52.771630+0000","last_unstale":"2023-10-16T14:25:54.086002+0000","last_undegraded":"2023-10-16T14:25:54.086002+0000","last_fullsized":"2023-10-16T14:25:54.086002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:57.876480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.764800+0000","last_change":"2023-10-16T14:25:48.716516+0000","last_active":"2023-10-16T14:25:52.764800+0000","last_peered":"2023-10-16T14:25:52.764800+0000","last_clean":"2023-10-16T14:25:52.764800+0000","last_became_active":"2023-10-16T14:25:48.716176+0000","last_became_peered":"2023-10-16T14:25:48.716176+0000","last_unstale":"2023-10-16T14:25:52.764800+0000","last_undegraded":"2023-10-16T14:25:52.764800+0000","last_fullsized":"2023-10-16T14:25:52.764800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:03.388572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.757734+0000","last_change":"2023-10-16T14:25:47.689971+0000","last_active":"2023-10-16T14:25:52.757734+0000","last_peered":"2023-10-16T14:25:52.757734+0000","last_clean":"2023-10-16T14:25:52.757734+0000","last_became_active":"2023-10-16T14:25:47.689597+0000","last_became_peered":"2023-10-16T14:25:47.689597+0000","last_unstale":"2023-10-16T14:25:52.757734+0000","last_undegraded":"2023-10-16T14:25:52.757734+0000","last_fullsized":"2023-10-16T14:25:52.757734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:48:33.689068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.727072+0000","last_change":"2023-10-16T14:25:52.770776+0000","last_active":"2023-10-16T14:25:53.727072+0000","last_peered":"2023-10-16T14:25:53.727072+0000","last_clean":"2023-10-16T14:25:53.727072+0000","last_became_active":"2023-10-16T14:25:52.769836+0000","last_became_peered":"2023-10-16T14:25:52.769836+0000","last_unstale":"2023-10-16T14:25:53.727072+0000","last_undegraded":"2023-10-16T14:25:53.727072+0000","last_fullsized":"2023-10-16T14:25:53.727072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:11:16.574099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742318+0000","last_change":"2023-10-16T14:25:48.713120+0000","last_active":"2023-10-16T14:25:52.742318+0000","last_peered":"2023-10-16T14:25:52.742318+0000","last_clean":"2023-10-16T14:25:52.742318+0000","last_became_active":"2023-10-16T14:25:48.712749+0000","last_became_peered":"2023-10-16T14:25:48.712749+0000","last_unstale":"2023-10-16T14:25:52.742318+0000","last_undegraded":"2023-10-16T14:25:52.742318+0000","last_fullsized":"2023-10-16T14:25:52.742318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:38:17.767342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:26:06.790145+0000","last_change":"2023-10-16T14:25:47.677057+0000","last_active":"2023-10-16T14:26:06.790145+0000","last_peered":"2023-10-16T14:26:06.790145+0000","last_clean":"2023-10-16T14:26:06.790145+0000","last_became_active":"2023-10-16T14:25:47.676793+0000","last_became_peered":"2023-10-16T14:25:47.676793+0000","last_unstale":"2023-10-16T14:26:06.790145+0000","last_undegraded":"2023-10-16T14:26:06.790145+0000","last_fullsized":"2023-10-16T14:26:06.790145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:27:37.655811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.727776+0000","last_change":"2023-10-16T14:25:52.749720+0000","last_active":"2023-10-16T14:25:53.727776+0000","last_peered":"2023-10-16T14:25:53.727776+0000","last_clean":"2023-10-16T14:25:53.727776+0000","last_became_active":"2023-10-16T14:25:52.749259+0000","last_became_peered":"2023-10-16T14:25:52.749259+0000","last_unstale":"2023-10-16T14:25:53.727776+0000","last_undegraded":"2023-10-16T14:25:53.727776+0000","last_fullsized":"2023-10-16T14:25:53.727776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:21:41.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.733638+0000","last_change":"2023-10-16T14:25:48.713531+0000","last_active":"2023-10-16T14:25:52.733638+0000","last_peered":"2023-10-16T14:25:52.733638+0000","last_clean":"2023-10-16T14:25:52.733638+0000","last_became_active":"2023-10-16T14:25:48.713160+0000","last_became_peered":"2023-10-16T14:25:48.713160+0000","last_unstale":"2023-10-16T14:25:52.733638+0000","last_undegraded":"2023-10-16T14:25:52.733638+0000","last_fullsized":"2023-10-16T14:25:52.733638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:32:51.782302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.762449+0000","last_change":"2023-10-16T14:25:47.685499+0000","last_active":"2023-10-16T14:25:52.762449+0000","last_peered":"2023-10-16T14:25:52.762449+0000","last_clean":"2023-10-16T14:25:52.762449+0000","last_became_active":"2023-10-16T14:25:47.685151+0000","last_became_peered":"2023-10-16T14:25:47.685151+0000","last_unstale":"2023-10-16T14:25:52.762449+0000","last_undegraded":"2023-10-16T14:25:52.762449+0000","last_fullsized":"2023-10-16T14:25:52.762449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:54.472297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.090819+0000","last_change":"2023-10-16T14:25:52.764063+0000","last_active":"2023-10-16T14:25:54.090819+0000","last_peered":"2023-10-16T14:25:54.090819+0000","last_clean":"2023-10-16T14:25:54.090819+0000","last_became_active":"2023-10-16T14:25:52.763641+0000","last_became_peered":"2023-10-16T14:25:52.763641+0000","last_unstale":"2023-10-16T14:25:54.090819+0000","last_undegraded":"2023-10-16T14:25:54.090819+0000","last_fullsized":"2023-10-16T14:25:54.090819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:21:41.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.751879+0000","last_change":"2023-10-16T14:25:48.703305+0000","last_active":"2023-10-16T14:25:52.751879+0000","last_peered":"2023-10-16T14:25:52.751879+0000","last_clean":"2023-10-16T14:25:52.751879+0000","last_became_active":"2023-10-16T14:25:48.702978+0000","last_became_peered":"2023-10-16T14:25:48.702978+0000","last_unstale":"2023-10-16T14:25:52.751879+0000","last_undegraded":"2023-10-16T14:25:52.751879+0000","last_fullsized":"2023-10-16T14:25:52.751879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:54:08.702138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742225+0000","last_change":"2023-10-16T14:25:47.688400+0000","last_active":"2023-10-16T14:25:52.742225+0000","last_peered":"2023-10-16T14:25:52.742225+0000","last_clean":"2023-10-16T14:25:52.742225+0000","last_became_active":"2023-10-16T14:25:47.688066+0000","last_became_peered":"2023-10-16T14:25:47.688066+0000","last_unstale":"2023-10-16T14:25:52.742225+0000","last_undegraded":"2023-10-16T14:25:52.742225+0000","last_fullsized":"2023-10-16T14:25:52.742225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:18.948353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.085217+0000","last_change":"2023-10-16T14:25:52.761062+0000","last_active":"2023-10-16T14:25:54.085217+0000","last_peered":"2023-10-16T14:25:54.085217+0000","last_clean":"2023-10-16T14:25:54.085217+0000","last_became_active":"2023-10-16T14:25:52.759852+0000","last_became_peered":"2023-10-16T14:25:52.759852+0000","last_unstale":"2023-10-16T14:25:54.085217+0000","last_undegraded":"2023-10-16T14:25:54.085217+0000","last_fullsized":"2023-10-16T14:25:54.085217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:45:02.663218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.726232+0000","last_change":"2023-10-16T14:25:48.712154+0000","last_active":"2023-10-16T14:25:52.726232+0000","last_peered":"2023-10-16T14:25:52.726232+0000","last_clean":"2023-10-16T14:25:52.726232+0000","last_became_active":"2023-10-16T14:25:48.711510+0000","last_became_peered":"2023-10-16T14:25:48.711510+0000","last_unstale":"2023-10-16T14:25:52.726232+0000","last_undegraded":"2023-10-16T14:25:52.726232+0000","last_fullsized":"2023-10-16T14:25:52.726232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:48:56.276340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.729439+0000","last_change":"2023-10-16T14:25:47.668179+0000","last_active":"2023-10-16T14:25:52.729439+0000","last_peered":"2023-10-16T14:25:52.729439+0000","last_clean":"2023-10-16T14:25:52.729439+0000","last_became_active":"2023-10-16T14:25:47.667021+0000","last_became_peered":"2023-10-16T14:25:47.667021+0000","last_unstale":"2023-10-16T14:25:52.729439+0000","last_undegraded":"2023-10-16T14:25:52.729439+0000","last_fullsized":"2023-10-16T14:25:52.729439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:35:07.451724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.727768+0000","last_change":"2023-10-16T14:25:52.756998+0000","last_active":"2023-10-16T14:25:53.727768+0000","last_peered":"2023-10-16T14:25:53.727768+0000","last_clean":"2023-10-16T14:25:53.727768+0000","last_became_active":"2023-10-16T14:25:52.756551+0000","last_became_peered":"2023-10-16T14:25:52.756551+0000","last_unstale":"2023-10-16T14:25:53.727768+0000","last_undegraded":"2023-10-16T14:25:53.727768+0000","last_fullsized":"2023-10-16T14:25:53.727768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:53.190625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.729124+0000","last_change":"2023-10-16T14:25:52.770650+0000","last_active":"2023-10-16T14:25:53.729124+0000","last_peered":"2023-10-16T14:25:53.729124+0000","last_clean":"2023-10-16T14:25:53.729124+0000","last_became_active":"2023-10-16T14:25:52.769652+0000","last_became_peered":"2023-10-16T14:25:52.769652+0000","last_unstale":"2023-10-16T14:25:53.729124+0000","last_undegraded":"2023-10-16T14:25:53.729124+0000","last_fullsized":"2023-10-16T14:25:53.729124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:01:14.017904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735103+0000","last_change":"2023-10-16T14:25:48.679714+0000","last_active":"2023-10-16T14:25:52.735103+0000","last_peered":"2023-10-16T14:25:52.735103+0000","last_clean":"2023-10-16T14:25:52.735103+0000","last_became_active":"2023-10-16T14:25:48.678913+0000","last_became_peered":"2023-10-16T14:25:48.678913+0000","last_unstale":"2023-10-16T14:25:52.735103+0000","last_undegraded":"2023-10-16T14:25:52.735103+0000","last_fullsized":"2023-10-16T14:25:52.735103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:43.182462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.736001+0000","last_change":"2023-10-16T14:25:47.670716+0000","last_active":"2023-10-16T14:25:52.736001+0000","last_peered":"2023-10-16T14:25:52.736001+0000","last_clean":"2023-10-16T14:25:52.736001+0000","last_became_active":"2023-10-16T14:25:47.669479+0000","last_became_peered":"2023-10-16T14:25:47.669479+0000","last_unstale":"2023-10-16T14:25:52.736001+0000","last_undegraded":"2023-10-16T14:25:52.736001+0000","last_fullsized":"2023-10-16T14:25:52.736001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:07:28.689085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.727220+0000","last_change":"2023-10-16T14:25:52.766844+0000","last_active":"2023-10-16T14:25:53.727220+0000","last_peered":"2023-10-16T14:25:53.727220+0000","last_clean":"2023-10-16T14:25:53.727220+0000","last_became_active":"2023-10-16T14:25:52.766324+0000","last_became_peered":"2023-10-16T14:25:52.766324+0000","last_unstale":"2023-10-16T14:25:53.727220+0000","last_undegraded":"2023-10-16T14:25:53.727220+0000","last_fullsized":"2023-10-16T14:25:53.727220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:23:27.304235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.748605+0000","last_change":"2023-10-16T14:25:48.707865+0000","last_active":"2023-10-16T14:25:52.748605+0000","last_peered":"2023-10-16T14:25:52.748605+0000","last_clean":"2023-10-16T14:25:52.748605+0000","last_became_active":"2023-10-16T14:25:48.707590+0000","last_became_peered":"2023-10-16T14:25:48.707590+0000","last_unstale":"2023-10-16T14:25:52.748605+0000","last_undegraded":"2023-10-16T14:25:52.748605+0000","last_fullsized":"2023-10-16T14:25:52.748605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:47:09.386851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.765286+0000","last_change":"2023-10-16T14:25:47.689952+0000","last_active":"2023-10-16T14:25:52.765286+0000","last_peered":"2023-10-16T14:25:52.765286+0000","last_clean":"2023-10-16T14:25:52.765286+0000","last_became_active":"2023-10-16T14:25:47.689569+0000","last_became_peered":"2023-10-16T14:25:47.689569+0000","last_unstale":"2023-10-16T14:25:52.765286+0000","last_undegraded":"2023-10-16T14:25:52.765286+0000","last_fullsized":"2023-10-16T14:25:52.765286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:33.258222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734526+0000","last_change":"2023-10-16T14:25:47.684407+0000","last_active":"2023-10-16T14:25:52.734526+0000","last_peered":"2023-10-16T14:25:52.734526+0000","last_clean":"2023-10-16T14:25:52.734526+0000","last_became_active":"2023-10-16T14:25:47.683112+0000","last_became_peered":"2023-10-16T14:25:47.683112+0000","last_unstale":"2023-10-16T14:25:52.734526+0000","last_undegraded":"2023-10-16T14:25:52.734526+0000","last_fullsized":"2023-10-16T14:25:52.734526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:58.812184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.736192+0000","last_change":"2023-10-16T14:25:48.707553+0000","last_active":"2023-10-16T14:25:52.736192+0000","last_peered":"2023-10-16T14:25:52.736192+0000","last_clean":"2023-10-16T14:25:52.736192+0000","last_became_active":"2023-10-16T14:25:48.707287+0000","last_became_peered":"2023-10-16T14:25:48.707287+0000","last_unstale":"2023-10-16T14:25:52.736192+0000","last_undegraded":"2023-10-16T14:25:52.736192+0000","last_fullsized":"2023-10-16T14:25:52.736192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:04:16.586879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:53.728065+0000","last_change":"2023-10-16T14:25:52.772152+0000","last_active":"2023-10-16T14:25:53.728065+0000","last_peered":"2023-10-16T14:25:53.728065+0000","last_clean":"2023-10-16T14:25:53.728065+0000","last_became_active":"2023-10-16T14:25:52.771782+0000","last_became_peered":"2023-10-16T14:25:52.771782+0000","last_unstale":"2023-10-16T14:25:53.728065+0000","last_undegraded":"2023-10-16T14:25:53.728065+0000","last_fullsized":"2023-10-16T14:25:53.728065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:36.518926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.750890+0000","last_change":"2023-10-16T14:25:47.686396+0000","last_active":"2023-10-16T14:25:52.750890+0000","last_peered":"2023-10-16T14:25:52.750890+0000","last_clean":"2023-10-16T14:25:52.750890+0000","last_became_active":"2023-10-16T14:25:47.685837+0000","last_became_peered":"2023-10-16T14:25:47.685837+0000","last_unstale":"2023-10-16T14:25:52.750890+0000","last_undegraded":"2023-10-16T14:25:52.750890+0000","last_fullsized":"2023-10-16T14:25:52.750890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:46.624444+0000","last_clean_scrub_stamp":"2023-10-16T14:25:46.624444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:59:01.867434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.729122+0000","last_change":"2023-10-16T14:25:48.699469+0000","last_active":"2023-10-16T14:25:52.729122+0000","last_peered":"2023-10-16T14:25:52.729122+0000","last_clean":"2023-10-16T14:25:52.729122+0000","last_became_active":"2023-10-16T14:25:48.697897+0000","last_became_peered":"2023-10-16T14:25:48.697897+0000","last_unstale":"2023-10-16T14:25:52.729122+0000","last_undegraded":"2023-10-16T14:25:52.729122+0000","last_fullsized":"2023-10-16T14:25:52.729122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:06.393767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-16T14:25:54.089865+0000","last_change":"2023-10-16T14:25:52.769049+0000","last_active":"2023-10-16T14:25:54.089865+0000","last_peered":"2023-10-16T14:25:54.089865+0000","last_clean":"2023-10-16T14:25:54.089865+0000","last_became_active":"2023-10-16T14:25:52.768002+0000","last_became_peered":"2023-10-16T14:25:52.768002+0000","last_unstale":"2023-10-16T14:25:54.089865+0000","last_undegraded":"2023-10-16T14:25:54.089865+0000","last_fullsized":"2023-10-16T14:25:54.089865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:51.696597+0000","last_clean_scrub_stamp":"2023-10-16T14:25:51.696597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:24.020506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.722319+0000","last_change":"2023-10-16T14:25:48.710638+0000","last_active":"2023-10-16T14:25:52.722319+0000","last_peered":"2023-10-16T14:25:52.722319+0000","last_clean":"2023-10-16T14:25:52.722319+0000","last_became_active":"2023-10-16T14:25:48.710317+0000","last_became_peered":"2023-10-16T14:25:48.710317+0000","last_unstale":"2023-10-16T14:25:52.722319+0000","last_undegraded":"2023-10-16T14:25:52.722319+0000","last_fullsized":"2023-10-16T14:25:52.722319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:55:50.448443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.754813+0000","last_change":"2023-10-16T14:25:48.697149+0000","last_active":"2023-10-16T14:25:52.754813+0000","last_peered":"2023-10-16T14:25:52.754813+0000","last_clean":"2023-10-16T14:25:52.754813+0000","last_became_active":"2023-10-16T14:25:48.696842+0000","last_became_peered":"2023-10-16T14:25:48.696842+0000","last_unstale":"2023-10-16T14:25:52.754813+0000","last_undegraded":"2023-10-16T14:25:52.754813+0000","last_fullsized":"2023-10-16T14:25:52.754813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:55:50.448443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734336+0000","last_change":"2023-10-16T14:25:48.703113+0000","last_active":"2023-10-16T14:25:52.734336+0000","last_peered":"2023-10-16T14:25:52.734336+0000","last_clean":"2023-10-16T14:25:52.734336+0000","last_became_active":"2023-10-16T14:25:48.702819+0000","last_became_peered":"2023-10-16T14:25:48.702819+0000","last_unstale":"2023-10-16T14:25:52.734336+0000","last_undegraded":"2023-10-16T14:25:52.734336+0000","last_fullsized":"2023-10-16T14:25:52.734336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:11:43.934469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.750660+0000","last_change":"2023-10-16T14:25:48.698637+0000","last_active":"2023-10-16T14:25:52.750660+0000","last_peered":"2023-10-16T14:25:52.750660+0000","last_clean":"2023-10-16T14:25:52.750660+0000","last_became_active":"2023-10-16T14:25:48.698315+0000","last_became_peered":"2023-10-16T14:25:48.698315+0000","last_unstale":"2023-10-16T14:25:52.750660+0000","last_undegraded":"2023-10-16T14:25:52.750660+0000","last_fullsized":"2023-10-16T14:25:52.750660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:40:17.879871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.766726+0000","last_change":"2023-10-16T14:25:48.718882+0000","last_active":"2023-10-16T14:25:52.766726+0000","last_peered":"2023-10-16T14:25:52.766726+0000","last_clean":"2023-10-16T14:25:52.766726+0000","last_became_active":"2023-10-16T14:25:48.718101+0000","last_became_peered":"2023-10-16T14:25:48.718101+0000","last_unstale":"2023-10-16T14:25:52.766726+0000","last_undegraded":"2023-10-16T14:25:52.766726+0000","last_fullsized":"2023-10-16T14:25:52.766726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:07:29.701267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.775872+0000","last_change":"2023-10-16T14:25:48.720844+0000","last_active":"2023-10-16T14:25:52.775872+0000","last_peered":"2023-10-16T14:25:52.775872+0000","last_clean":"2023-10-16T14:25:52.775872+0000","last_became_active":"2023-10-16T14:25:48.719311+0000","last_became_peered":"2023-10-16T14:25:48.719311+0000","last_unstale":"2023-10-16T14:25:52.775872+0000","last_undegraded":"2023-10-16T14:25:52.775872+0000","last_fullsized":"2023-10-16T14:25:52.775872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:19.960536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.726182+0000","last_change":"2023-10-16T14:25:48.712401+0000","last_active":"2023-10-16T14:25:52.726182+0000","last_peered":"2023-10-16T14:25:52.726182+0000","last_clean":"2023-10-16T14:25:52.726182+0000","last_became_active":"2023-10-16T14:25:48.711895+0000","last_became_peered":"2023-10-16T14:25:48.711895+0000","last_unstale":"2023-10-16T14:25:52.726182+0000","last_undegraded":"2023-10-16T14:25:52.726182+0000","last_fullsized":"2023-10-16T14:25:52.726182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:19:03.388572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.751689+0000","last_change":"2023-10-16T14:25:48.698610+0000","last_active":"2023-10-16T14:25:52.751689+0000","last_peered":"2023-10-16T14:25:52.751689+0000","last_clean":"2023-10-16T14:25:52.751689+0000","last_became_active":"2023-10-16T14:25:48.698036+0000","last_became_peered":"2023-10-16T14:25:48.698036+0000","last_unstale":"2023-10-16T14:25:52.751689+0000","last_undegraded":"2023-10-16T14:25:52.751689+0000","last_fullsized":"2023-10-16T14:25:52.751689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:21:35.715486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.733105+0000","last_change":"2023-10-16T14:25:48.698898+0000","last_active":"2023-10-16T14:25:52.733105+0000","last_peered":"2023-10-16T14:25:52.733105+0000","last_clean":"2023-10-16T14:25:52.733105+0000","last_became_active":"2023-10-16T14:25:48.698683+0000","last_became_peered":"2023-10-16T14:25:48.698683+0000","last_unstale":"2023-10-16T14:25:52.733105+0000","last_undegraded":"2023-10-16T14:25:52.733105+0000","last_fullsized":"2023-10-16T14:25:52.733105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:38:58.219009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.748894+0000","last_change":"2023-10-16T14:25:48.705464+0000","last_active":"2023-10-16T14:25:52.748894+0000","last_peered":"2023-10-16T14:25:52.748894+0000","last_clean":"2023-10-16T14:25:52.748894+0000","last_became_active":"2023-10-16T14:25:48.704985+0000","last_became_peered":"2023-10-16T14:25:48.704985+0000","last_unstale":"2023-10-16T14:25:52.748894+0000","last_undegraded":"2023-10-16T14:25:52.748894+0000","last_fullsized":"2023-10-16T14:25:52.748894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T14:56:45.547392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.729034+0000","last_change":"2023-10-16T14:25:48.712431+0000","last_active":"2023-10-16T14:25:52.729034+0000","last_peered":"2023-10-16T14:25:52.729034+0000","last_clean":"2023-10-16T14:25:52.729034+0000","last_became_active":"2023-10-16T14:25:48.711943+0000","last_became_peered":"2023-10-16T14:25:48.711943+0000","last_unstale":"2023-10-16T14:25:52.729034+0000","last_undegraded":"2023-10-16T14:25:52.729034+0000","last_fullsized":"2023-10-16T14:25:52.729034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:27:38.667994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.736054+0000","last_change":"2023-10-16T14:25:48.696594+0000","last_active":"2023-10-16T14:25:52.736054+0000","last_peered":"2023-10-16T14:25:52.736054+0000","last_clean":"2023-10-16T14:25:52.736054+0000","last_became_active":"2023-10-16T14:25:48.696094+0000","last_became_peered":"2023-10-16T14:25:48.696094+0000","last_unstale":"2023-10-16T14:25:52.736054+0000","last_undegraded":"2023-10-16T14:25:52.736054+0000","last_fullsized":"2023-10-16T14:25:52.736054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:22:19.960536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741992+0000","last_change":"2023-10-16T14:25:48.696032+0000","last_active":"2023-10-16T14:25:52.741992+0000","last_peered":"2023-10-16T14:25:52.741992+0000","last_clean":"2023-10-16T14:25:52.741992+0000","last_became_active":"2023-10-16T14:25:48.695395+0000","last_became_peered":"2023-10-16T14:25:48.695395+0000","last_unstale":"2023-10-16T14:25:52.741992+0000","last_undegraded":"2023-10-16T14:25:52.741992+0000","last_fullsized":"2023-10-16T14:25:52.741992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:32.458956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.734829+0000","last_change":"2023-10-16T14:25:48.709380+0000","last_active":"2023-10-16T14:25:52.734829+0000","last_peered":"2023-10-16T14:25:52.734829+0000","last_clean":"2023-10-16T14:25:52.734829+0000","last_became_active":"2023-10-16T14:25:48.708997+0000","last_became_peered":"2023-10-16T14:25:48.708997+0000","last_unstale":"2023-10-16T14:25:52.734829+0000","last_undegraded":"2023-10-16T14:25:52.734829+0000","last_fullsized":"2023-10-16T14:25:52.734829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:02:54.594118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.761766+0000","last_change":"2023-10-16T14:25:48.705638+0000","last_active":"2023-10-16T14:25:52.761766+0000","last_peered":"2023-10-16T14:25:52.761766+0000","last_clean":"2023-10-16T14:25:52.761766+0000","last_became_active":"2023-10-16T14:25:48.705345+0000","last_became_peered":"2023-10-16T14:25:48.705345+0000","last_unstale":"2023-10-16T14:25:52.761766+0000","last_undegraded":"2023-10-16T14:25:52.761766+0000","last_fullsized":"2023-10-16T14:25:52.761766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:34.270405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.735728+0000","last_change":"2023-10-16T14:25:48.713557+0000","last_active":"2023-10-16T14:25:52.735728+0000","last_peered":"2023-10-16T14:25:52.735728+0000","last_clean":"2023-10-16T14:25:52.735728+0000","last_became_active":"2023-10-16T14:25:48.712873+0000","last_became_peered":"2023-10-16T14:25:48.712873+0000","last_unstale":"2023-10-16T14:25:52.735728+0000","last_undegraded":"2023-10-16T14:25:52.735728+0000","last_fullsized":"2023-10-16T14:25:52.735728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:50:37.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.733005+0000","last_change":"2023-10-16T14:25:48.710840+0000","last_active":"2023-10-16T14:25:52.733005+0000","last_peered":"2023-10-16T14:25:52.733005+0000","last_clean":"2023-10-16T14:25:52.733005+0000","last_became_active":"2023-10-16T14:25:48.710547+0000","last_became_peered":"2023-10-16T14:25:48.710547+0000","last_unstale":"2023-10-16T14:25:52.733005+0000","last_undegraded":"2023-10-16T14:25:52.733005+0000","last_fullsized":"2023-10-16T14:25:52.733005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:49.130655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.748159+0000","last_change":"2023-10-16T14:25:48.705260+0000","last_active":"2023-10-16T14:25:52.748159+0000","last_peered":"2023-10-16T14:25:52.748159+0000","last_clean":"2023-10-16T14:25:52.748159+0000","last_became_active":"2023-10-16T14:25:48.704600+0000","last_became_peered":"2023-10-16T14:25:48.704600+0000","last_unstale":"2023-10-16T14:25:52.748159+0000","last_undegraded":"2023-10-16T14:25:52.748159+0000","last_fullsized":"2023-10-16T14:25:52.748159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:31:37.405710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.764712+0000","last_change":"2023-10-16T14:25:48.718876+0000","last_active":"2023-10-16T14:25:52.764712+0000","last_peered":"2023-10-16T14:25:52.764712+0000","last_clean":"2023-10-16T14:25:52.764712+0000","last_became_active":"2023-10-16T14:25:48.718576+0000","last_became_peered":"2023-10-16T14:25:48.718576+0000","last_unstale":"2023-10-16T14:25:52.764712+0000","last_undegraded":"2023-10-16T14:25:52.764712+0000","last_fullsized":"2023-10-16T14:25:52.764712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:08:42.569470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.765953+0000","last_change":"2023-10-16T14:25:48.724429+0000","last_active":"2023-10-16T14:25:52.765953+0000","last_peered":"2023-10-16T14:25:52.765953+0000","last_clean":"2023-10-16T14:25:52.765953+0000","last_became_active":"2023-10-16T14:25:48.724125+0000","last_became_peered":"2023-10-16T14:25:48.724125+0000","last_unstale":"2023-10-16T14:25:52.765953+0000","last_undegraded":"2023-10-16T14:25:52.765953+0000","last_fullsized":"2023-10-16T14:25:52.765953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:11:15.820218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741965+0000","last_change":"2023-10-16T14:25:48.696219+0000","last_active":"2023-10-16T14:25:52.741965+0000","last_peered":"2023-10-16T14:25:52.741965+0000","last_clean":"2023-10-16T14:25:52.741965+0000","last_became_active":"2023-10-16T14:25:48.695737+0000","last_became_peered":"2023-10-16T14:25:48.695737+0000","last_unstale":"2023-10-16T14:25:52.741965+0000","last_undegraded":"2023-10-16T14:25:52.741965+0000","last_fullsized":"2023-10-16T14:25:52.741965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:21:37.481107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742197+0000","last_change":"2023-10-16T14:25:48.710966+0000","last_active":"2023-10-16T14:25:52.742197+0000","last_peered":"2023-10-16T14:25:52.742197+0000","last_clean":"2023-10-16T14:25:52.742197+0000","last_became_active":"2023-10-16T14:25:48.709590+0000","last_became_peered":"2023-10-16T14:25:48.709590+0000","last_unstale":"2023-10-16T14:25:52.742197+0000","last_undegraded":"2023-10-16T14:25:52.742197+0000","last_fullsized":"2023-10-16T14:25:52.742197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T02:12:28.481919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742091+0000","last_change":"2023-10-16T14:25:48.717832+0000","last_active":"2023-10-16T14:25:52.742091+0000","last_peered":"2023-10-16T14:25:52.742091+0000","last_clean":"2023-10-16T14:25:52.742091+0000","last_became_active":"2023-10-16T14:25:48.716501+0000","last_became_peered":"2023-10-16T14:25:48.716501+0000","last_unstale":"2023-10-16T14:25:52.742091+0000","last_undegraded":"2023-10-16T14:25:52.742091+0000","last_fullsized":"2023-10-16T14:25:52.742091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:34:59.824367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.729329+0000","last_change":"2023-10-16T14:25:48.705714+0000","last_active":"2023-10-16T14:25:52.729329+0000","last_peered":"2023-10-16T14:25:52.729329+0000","last_clean":"2023-10-16T14:25:52.729329+0000","last_became_active":"2023-10-16T14:25:48.705423+0000","last_became_peered":"2023-10-16T14:25:48.705423+0000","last_unstale":"2023-10-16T14:25:52.729329+0000","last_undegraded":"2023-10-16T14:25:52.729329+0000","last_fullsized":"2023-10-16T14:25:52.729329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:34.270405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.748340+0000","last_change":"2023-10-16T14:25:48.716492+0000","last_active":"2023-10-16T14:25:52.748340+0000","last_peered":"2023-10-16T14:25:52.748340+0000","last_clean":"2023-10-16T14:25:52.748340+0000","last_became_active":"2023-10-16T14:25:48.716196+0000","last_became_peered":"2023-10-16T14:25:48.716196+0000","last_unstale":"2023-10-16T14:25:52.748340+0000","last_undegraded":"2023-10-16T14:25:52.748340+0000","last_fullsized":"2023-10-16T14:25:52.748340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:20:54.230056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741582+0000","last_change":"2023-10-16T14:25:48.707726+0000","last_active":"2023-10-16T14:25:52.741582+0000","last_peered":"2023-10-16T14:25:52.741582+0000","last_clean":"2023-10-16T14:25:52.741582+0000","last_became_active":"2023-10-16T14:25:48.707504+0000","last_became_peered":"2023-10-16T14:25:48.707504+0000","last_unstale":"2023-10-16T14:25:52.741582+0000","last_undegraded":"2023-10-16T14:25:52.741582+0000","last_fullsized":"2023-10-16T14:25:52.741582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:27:08.080421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.723283+0000","last_change":"2023-10-16T14:25:48.702028+0000","last_active":"2023-10-16T14:25:52.723283+0000","last_peered":"2023-10-16T14:25:52.723283+0000","last_clean":"2023-10-16T14:25:52.723283+0000","last_became_active":"2023-10-16T14:25:48.701713+0000","last_became_peered":"2023-10-16T14:25:48.701713+0000","last_unstale":"2023-10-16T14:25:52.723283+0000","last_undegraded":"2023-10-16T14:25:52.723283+0000","last_fullsized":"2023-10-16T14:25:52.723283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:05:42.440225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.741959+0000","last_change":"2023-10-16T14:25:48.700619+0000","last_active":"2023-10-16T14:25:52.741959+0000","last_peered":"2023-10-16T14:25:52.741959+0000","last_clean":"2023-10-16T14:25:52.741959+0000","last_became_active":"2023-10-16T14:25:48.700374+0000","last_became_peered":"2023-10-16T14:25:48.700374+0000","last_unstale":"2023-10-16T14:25:52.741959+0000","last_undegraded":"2023-10-16T14:25:52.741959+0000","last_fullsized":"2023-10-16T14:25:52.741959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:38:58.219009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.725459+0000","last_change":"2023-10-16T14:25:48.699642+0000","last_active":"2023-10-16T14:25:52.725459+0000","last_peered":"2023-10-16T14:25:52.725459+0000","last_clean":"2023-10-16T14:25:52.725459+0000","last_became_active":"2023-10-16T14:25:48.698763+0000","last_became_peered":"2023-10-16T14:25:48.698763+0000","last_unstale":"2023-10-16T14:25:52.725459+0000","last_undegraded":"2023-10-16T14:25:52.725459+0000","last_fullsized":"2023-10-16T14:25:52.725459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:02:34.270405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.750728+0000","last_change":"2023-10-16T14:25:48.701810+0000","last_active":"2023-10-16T14:25:52.750728+0000","last_peered":"2023-10-16T14:25:52.750728+0000","last_clean":"2023-10-16T14:25:52.750728+0000","last_became_active":"2023-10-16T14:25:48.701531+0000","last_became_peered":"2023-10-16T14:25:48.701531+0000","last_unstale":"2023-10-16T14:25:52.750728+0000","last_undegraded":"2023-10-16T14:25:52.750728+0000","last_fullsized":"2023-10-16T14:25:52.750728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:02:15.116385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.753502+0000","last_change":"2023-10-16T14:25:48.705687+0000","last_active":"2023-10-16T14:25:52.753502+0000","last_peered":"2023-10-16T14:25:52.753502+0000","last_clean":"2023-10-16T14:25:52.753502+0000","last_became_active":"2023-10-16T14:25:48.705392+0000","last_became_peered":"2023-10-16T14:25:48.705392+0000","last_unstale":"2023-10-16T14:25:52.753502+0000","last_undegraded":"2023-10-16T14:25:52.753502+0000","last_fullsized":"2023-10-16T14:25:52.753502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:53:04.130129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-16T14:25:52.742180+0000","last_change":"2023-10-16T14:25:48.705631+0000","last_active":"2023-10-16T14:25:52.742180+0000","last_peered":"2023-10-16T14:25:52.742180+0000","last_clean":"2023-10-16T14:25:52.742180+0000","last_became_active":"2023-10-16T14:25:48.705344+0000","last_became_peered":"2023-10-16T14:25:48.705344+0000","last_unstale":"2023-10-16T14:25:52.742180+0000","last_undegraded":"2023-10-16T14:25:52.742180+0000","last_fullsized":"2023-10-16T14:25:52.742180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:47.636627+0000","last_clean_scrub_stamp":"2023-10-16T14:25:47.636627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:10:43.182462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476746,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":104592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4339999999999999}]}]},{"osd":2,"up_from":16,"seq":68719476746,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":107851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.734}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.825}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5680000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.796}]}]},{"osd":1,"up_from":16,"seq":68719476747,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":694448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.776}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]}]},{"osd":0,"up_from":16,"seq":68719476748,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":104066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5289999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]}]},{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":104134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.661}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.46}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.877}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9410000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.52}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":108523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2919999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.069}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T14:26:15.734 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-16T14:26:15.734 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-16T14:26:15.735 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-16T14:26:15.735 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-16T14:26:15.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.993+0000 7f5a15ba5640 1 Processor -- start 2023-10-16T14:26:15.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.993+0000 7f5a15ba5640 1 -- start start 2023-10-16T14:26:15.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.994+0000 7f5a15ba5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a10070400 0x7f5a1015e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:15.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.995+0000 7f5a15ba5640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a100c8e40 con 0x7f5a100cb400 2023-10-16T14:26:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.995+0000 7f5a15ba5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a100c9090 con 0x7f5a100c8930 2023-10-16T14:26:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.995+0000 7f5a15ba5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a100c9370 con 0x7f5a10070400 2023-10-16T14:26:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.995+0000 7f5a153a4640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5a100cb400 0x7f5a1015af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45722/0 (socket says 172.21.15.59:45722) 2023-10-16T14:26:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.995+0000 7f5a153a4640 1 -- 172.21.15.59:0/109559544 learned_addr learned my addr 172.21.15.59:0/109559544 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.995+0000 7f5a14ba3640 1 --2- 172.21.15.59:0/109559544 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a10070400 0x7f5a1015e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.996+0000 7f5a14ba3640 1 -- 172.21.15.59:0/109559544 >> v1:172.21.15.151:6789/0 conn(0x7f5a100c8930 legacy=0x7f5a100cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.996+0000 7f5a14ba3640 1 -- 172.21.15.59:0/109559544 >> v1:172.21.15.59:6789/0 conn(0x7f5a100cb400 legacy=0x7f5a1015af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.996+0000 7f5a14ba3640 1 -- 172.21.15.59:0/109559544 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a100c9650 con 0x7f5a10070400 2023-10-16T14:26:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:15.997+0000 7f5a14ba3640 1 --2- 172.21.15.59:0/109559544 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a10070400 0x7f5a1015e210 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5a000097d0 tx=0x7f5a0002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e647d265d170802f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.001+0000 7f5a0f7fe640 1 -- 172.21.15.59:0/109559544 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a00030800 con 0x7f5a10070400 2023-10-16T14:26:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.001+0000 7f5a0f7fe640 1 -- 172.21.15.59:0/109559544 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a00030960 con 0x7f5a10070400 2023-10-16T14:26:16.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.001+0000 7f5a0f7fe640 1 -- 172.21.15.59:0/109559544 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a00030cf0 con 0x7f5a10070400 2023-10-16T14:26:16.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.002+0000 7f5a15ba5640 1 -- 172.21.15.59:0/109559544 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a10070400 msgr2=0x7f5a1015e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:16.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.002+0000 7f5a15ba5640 1 --2- 172.21.15.59:0/109559544 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a10070400 0x7f5a1015e210 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5a000097d0 tx=0x7f5a0002b940 comp rx=0 tx=0).stop 2023-10-16T14:26:16.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.002+0000 7f5a15ba5640 1 -- 172.21.15.59:0/109559544 shutdown_connections 2023-10-16T14:26:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.002+0000 7f5a15ba5640 1 --2- 172.21.15.59:0/109559544 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a10070400 0x7f5a1015e210 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.002+0000 7f5a15ba5640 1 -- 172.21.15.59:0/109559544 >> 172.21.15.59:0/109559544 conn(0x7f5a1006a470 msgr2=0x7f5a100afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.002+0000 7f5a15ba5640 1 -- 172.21.15.59:0/109559544 shutdown_connections 2023-10-16T14:26:16.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.002+0000 7f5a15ba5640 1 -- 172.21.15.59:0/109559544 wait complete. 2023-10-16T14:26:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.004+0000 7f5a15ba5640 1 Processor -- start 2023-10-16T14:26:16.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.004+0000 7f5a15ba5640 1 -- start start 2023-10-16T14:26:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.005+0000 7f5a15ba5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a10070400 0x7f5a10147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.005+0000 7f5a15ba5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a100c8930 0x7f5a1015ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:16.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.005+0000 7f5a15ba5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a100cb400 0x7f5a1015d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.005+0000 7f5a15ba5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a10147c50 con 0x7f5a100cb400 2023-10-16T14:26:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.005+0000 7f5a15ba5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a100c67d0 con 0x7f5a10070400 2023-10-16T14:26:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.005+0000 7f5a15ba5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a100c2d70 con 0x7f5a100c8930 2023-10-16T14:26:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.005+0000 7f5a153a4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a100cb400 0x7f5a1015d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:16.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.006+0000 7f5a153a4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a100cb400 0x7f5a1015d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42012/0 (socket says 172.21.15.59:42012) 2023-10-16T14:26:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.006+0000 7f5a153a4640 1 -- 172.21.15.59:0/21537098 learned_addr learned my addr 172.21.15.59:0/21537098 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.006+0000 7f5a0ffff640 1 --2- 172.21.15.59:0/21537098 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a100c8930 0x7f5a1015ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.006+0000 7f5a14ba3640 1 --2- 172.21.15.59:0/21537098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a10070400 0x7f5a10147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:16.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.006+0000 7f5a153a4640 1 -- 172.21.15.59:0/21537098 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a100c8930 msgr2=0x7f5a1015ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.006+0000 7f5a153a4640 1 --2- 172.21.15.59:0/21537098 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a100c8930 0x7f5a1015ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.006+0000 7f5a153a4640 1 -- 172.21.15.59:0/21537098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a10070400 msgr2=0x7f5a10147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.006+0000 7f5a153a4640 1 --2- 172.21.15.59:0/21537098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a10070400 0x7f5a10147710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.006+0000 7f5a153a4640 1 -- 172.21.15.59:0/21537098 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a00009400 con 0x7f5a100cb400 2023-10-16T14:26:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.006+0000 7f5a153a4640 1 --2- 172.21.15.59:0/21537098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a100cb400 0x7f5a1015d3c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800c340 tx=0x7f5a0800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:16.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.007+0000 7f5a0d7fa640 1 -- 172.21.15.59:0/21537098 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08005ce0 con 0x7f5a100cb400 2023-10-16T14:26:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.007+0000 7f5a0d7fa640 1 -- 172.21.15.59:0/21537098 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a08005e40 con 0x7f5a100cb400 2023-10-16T14:26:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.007+0000 7f5a0d7fa640 1 -- 172.21.15.59:0/21537098 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a080072d0 con 0x7f5a100cb400 2023-10-16T14:26:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.007+0000 7f5a15ba5640 1 -- 172.21.15.59:0/21537098 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a100c3050 con 0x7f5a100cb400 2023-10-16T14:26:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.007+0000 7f5a15ba5640 1 -- 172.21.15.59:0/21537098 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a100c3610 con 0x7f5a100cb400 2023-10-16T14:26:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.008+0000 7f5a15ba5640 1 -- 172.21.15.59:0/21537098 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a100c69d0 con 0x7f5a100cb400 2023-10-16T14:26:16.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.009+0000 7f5a0d7fa640 1 -- 172.21.15.59:0/21537098 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5a080074f0 con 0x7f5a100cb400 2023-10-16T14:26:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.010+0000 7f5a0d7fa640 1 --2- 172.21.15.59:0/21537098 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f59fc06ae70 0x7f59fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.010+0000 7f5a0d7fa640 1 -- 172.21.15.59:0/21537098 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5a08088d50 con 0x7f5a100cb400 2023-10-16T14:26:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.010+0000 7f5a14ba3640 1 --2- 172.21.15.59:0/21537098 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f59fc06ae70 0x7f59fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.012+0000 7f5a14ba3640 1 --2- 172.21.15.59:0/21537098 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f59fc06ae70 0x7f59fc06d330 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5a00036000 tx=0x7f5a00008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.014+0000 7f5a0d7fa640 1 -- 172.21.15.59:0/21537098 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5a100c69d0 con 0x7f5a100cb400 2023-10-16T14:26:16.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.235+0000 7f5a15ba5640 1 -- 172.21.15.59:0/21537098 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5a100c6990 con 0x7f5a100cb400 2023-10-16T14:26:16.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.236+0000 7f5a0d7fa640 1 -- 172.21.15.59:0/21537098 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f5a08017040 con 0x7f5a100cb400 2023-10-16T14:26:16.240 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:16.240 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-16T14:26:16.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.239+0000 7f5a15ba5640 1 -- 172.21.15.59:0/21537098 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f59fc06ae70 msgr2=0x7f59fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:16.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.239+0000 7f5a15ba5640 1 --2- 172.21.15.59:0/21537098 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f59fc06ae70 0x7f59fc06d330 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5a00036000 tx=0x7f5a00008030 comp rx=0 tx=0).stop 2023-10-16T14:26:16.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.239+0000 7f5a15ba5640 1 -- 172.21.15.59:0/21537098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a100cb400 msgr2=0x7f5a1015d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:16.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.239+0000 7f5a15ba5640 1 --2- 172.21.15.59:0/21537098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a100cb400 0x7f5a1015d3c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800c340 tx=0x7f5a0800c800 comp rx=0 tx=0).stop 2023-10-16T14:26:16.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.239+0000 7f5a15ba5640 1 -- 172.21.15.59:0/21537098 shutdown_connections 2023-10-16T14:26:16.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.239+0000 7f5a15ba5640 1 --2- 172.21.15.59:0/21537098 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f59fc06ae70 0x7f59fc06d330 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.239+0000 7f5a15ba5640 1 --2- 172.21.15.59:0/21537098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a100cb400 0x7f5a1015d3c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.239+0000 7f5a15ba5640 1 --2- 172.21.15.59:0/21537098 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a100c8930 0x7f5a1015ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.239+0000 7f5a15ba5640 1 --2- 172.21.15.59:0/21537098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a10070400 0x7f5a10147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.239+0000 7f5a15ba5640 1 -- 172.21.15.59:0/21537098 >> 172.21.15.59:0/21537098 conn(0x7f5a1006a470 msgr2=0x7f5a10072770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:16.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.240+0000 7f5a15ba5640 1 -- 172.21.15.59:0/21537098 shutdown_connections 2023-10-16T14:26:16.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.240+0000 7f5a15ba5640 1 -- 172.21.15.59:0/21537098 wait complete. 2023-10-16T14:26:16.259 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-16T14:26:16.259 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:26:16.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.471+0000 7f4dbf035640 1 Processor -- start 2023-10-16T14:26:16.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.471+0000 7f4dbf035640 1 -- start start 2023-10-16T14:26:16.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.473+0000 7f4dbf035640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4db815cba0 0x7f4db815da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:16.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.473+0000 7f4dbf035640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4db80cdd90 0x7f4db80cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:16.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.473+0000 7f4dbf035640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db815d570 con 0x7f4db80cad30 2023-10-16T14:26:16.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.473+0000 7f4dbf035640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db815cf80 con 0x7f4db815cba0 2023-10-16T14:26:16.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.473+0000 7f4dbf035640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db815df40 con 0x7f4db80cdd90 2023-10-16T14:26:16.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.473+0000 7f4dbe033640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4db815cba0 0x7f4db815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:16.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.474+0000 7f4dbe033640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4db815cba0 0x7f4db815da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42022/0 (socket says 172.21.15.59:42022) 2023-10-16T14:26:16.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.474+0000 7f4dbe033640 1 -- 172.21.15.59:0/1545749517 learned_addr learned my addr 172.21.15.59:0/1545749517 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:16.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.474+0000 7f4dbd832640 1 --2- 172.21.15.59:0/1545749517 >> v2:172.21.15.151:3300/0 conn(0x7f4db80cdd90 0x7f4db80cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:16.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.474+0000 7f4dbe033640 1 -- 172.21.15.59:0/1545749517 >> v2:172.21.15.151:3300/0 conn(0x7f4db80cdd90 msgr2=0x7f4db80cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:16.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.474+0000 7f4dbe033640 1 --2- 172.21.15.59:0/1545749517 >> v2:172.21.15.151:3300/0 conn(0x7f4db80cdd90 0x7f4db80cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.474+0000 7f4dbe033640 1 -- 172.21.15.59:0/1545749517 >> v1:172.21.15.151:6789/0 conn(0x7f4db80cad30 legacy=0x7f4db81605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:16.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.474+0000 7f4dbe033640 1 -- 172.21.15.59:0/1545749517 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db80ccfc0 con 0x7f4db815cba0 2023-10-16T14:26:16.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.476+0000 7f4dbe033640 1 --2- 172.21.15.59:0/1545749517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4db815cba0 0x7f4db815da00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4db80ca620 tx=0x7f4db402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373e048f34437bf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:16.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.476+0000 7f4dbd031640 1 -- 172.21.15.59:0/1545749517 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4031870 con 0x7f4db815cba0 2023-10-16T14:26:16.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.476+0000 7f4dbd031640 1 -- 172.21.15.59:0/1545749517 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db40319d0 con 0x7f4db815cba0 2023-10-16T14:26:16.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.476+0000 7f4dbd031640 1 -- 172.21.15.59:0/1545749517 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4031d60 con 0x7f4db815cba0 2023-10-16T14:26:16.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.476+0000 7f4dbf035640 1 -- 172.21.15.59:0/1545749517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4db815cba0 msgr2=0x7f4db815da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:16.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.476+0000 7f4dbf035640 1 --2- 172.21.15.59:0/1545749517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4db815cba0 0x7f4db815da00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4db80ca620 tx=0x7f4db402b910 comp rx=0 tx=0).stop 2023-10-16T14:26:16.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.477+0000 7f4dbf035640 1 -- 172.21.15.59:0/1545749517 shutdown_connections 2023-10-16T14:26:16.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.477+0000 7f4dbf035640 1 --2- 172.21.15.59:0/1545749517 >> v2:172.21.15.151:3300/0 conn(0x7f4db80cdd90 0x7f4db80cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.477+0000 7f4dbf035640 1 --2- 172.21.15.59:0/1545749517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4db815cba0 0x7f4db815da00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.477+0000 7f4dbf035640 1 -- 172.21.15.59:0/1545749517 >> 172.21.15.59:0/1545749517 conn(0x7f4db806a470 msgr2=0x7f4db80afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:16.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.477+0000 7f4dbf035640 1 -- 172.21.15.59:0/1545749517 shutdown_connections 2023-10-16T14:26:16.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.477+0000 7f4dbf035640 1 -- 172.21.15.59:0/1545749517 wait complete. 2023-10-16T14:26:16.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.479+0000 7f4dbf035640 1 Processor -- start 2023-10-16T14:26:16.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.479+0000 7f4dbf035640 1 -- start start 2023-10-16T14:26:16.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.480+0000 7f4dbf035640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4db80cad30 0x7f4db81f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:16.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.480+0000 7f4dbf035640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4db80cdd90 0x7f4db80c1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:16.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.480+0000 7f4dbf035640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4db815cba0 0x7f4db815ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:16.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.480+0000 7f4dbf035640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db815e080 con 0x7f4db80cad30 2023-10-16T14:26:16.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.480+0000 7f4dbf035640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db814acf0 con 0x7f4db815cba0 2023-10-16T14:26:16.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.480+0000 7f4dbf035640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db815e290 con 0x7f4db80cdd90 2023-10-16T14:26:16.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.480+0000 7f4dbe033640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4db80cad30 0x7f4db81f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:16.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.480+0000 7f4dbe033640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4db80cad30 0x7f4db81f1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42032/0 (socket says 172.21.15.59:42032) 2023-10-16T14:26:16.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.480+0000 7f4dbe033640 1 -- 172.21.15.59:0/530702232 learned_addr learned my addr 172.21.15.59:0/530702232 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:16.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.480+0000 7f4dbe033640 1 -- 172.21.15.59:0/530702232 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4db80cdd90 msgr2=0x7f4db80c1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:16.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.480+0000 7f4dbe033640 1 --2- 172.21.15.59:0/530702232 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4db80cdd90 0x7f4db80c1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.480+0000 7f4dbe033640 1 -- 172.21.15.59:0/530702232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4db815cba0 msgr2=0x7f4db815ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:16.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.480+0000 7f4dbe033640 1 --2- 172.21.15.59:0/530702232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4db815cba0 0x7f4db815ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.480+0000 7f4dbe033640 1 -- 172.21.15.59:0/530702232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db4009470 con 0x7f4db80cad30 2023-10-16T14:26:16.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.481+0000 7f4dbe033640 1 --2- 172.21.15.59:0/530702232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4db80cad30 0x7f4db81f1a50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4db402b950 tx=0x7f4db40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:16.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.481+0000 7f4daeffd640 1 -- 172.21.15.59:0/530702232 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db403ad30 con 0x7f4db80cad30 2023-10-16T14:26:16.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.481+0000 7f4daeffd640 1 -- 172.21.15.59:0/530702232 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db403ae90 con 0x7f4db80cad30 2023-10-16T14:26:16.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.481+0000 7f4daeffd640 1 -- 172.21.15.59:0/530702232 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4044630 con 0x7f4db80cad30 2023-10-16T14:26:16.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.481+0000 7f4dbf035640 1 -- 172.21.15.59:0/530702232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db815e570 con 0x7f4db80cad30 2023-10-16T14:26:16.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.481+0000 7f4dbf035640 1 -- 172.21.15.59:0/530702232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db814b230 con 0x7f4db80cad30 2023-10-16T14:26:16.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.482+0000 7f4dbf035640 1 -- 172.21.15.59:0/530702232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db804e9b0 con 0x7f4db80cad30 2023-10-16T14:26:16.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.483+0000 7f4daeffd640 1 -- 172.21.15.59:0/530702232 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4db404d450 con 0x7f4db80cad30 2023-10-16T14:26:16.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.484+0000 7f4daeffd640 1 --2- 172.21.15.59:0/530702232 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4d9c06ae70 0x7f4d9c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:16.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.484+0000 7f4daeffd640 1 -- 172.21.15.59:0/530702232 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4db402d040 con 0x7f4db80cad30 2023-10-16T14:26:16.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.485+0000 7f4dbd832640 1 --2- 172.21.15.59:0/530702232 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4d9c06ae70 0x7f4d9c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:16.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.486+0000 7f4dbd832640 1 --2- 172.21.15.59:0/530702232 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4d9c06ae70 0x7f4d9c06d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4da8006fd0 tx=0x7f4da8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:16.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.489+0000 7f4daeffd640 1 -- 172.21.15.59:0/530702232 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4db40af030 con 0x7f4db80cad30 2023-10-16T14:26:16.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.680+0000 7f4dbf035640 1 -- 172.21.15.59:0/530702232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4db80b42f0 con 0x7f4db80cad30 2023-10-16T14:26:16.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.682+0000 7f4daeffd640 1 -- 172.21.15.59:0/530702232 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f4db4035030 con 0x7f4db80cad30 2023-10-16T14:26:16.686 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:16.687 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:25:53.209862+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:26:16.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.685+0000 7f4dbf035640 1 -- 172.21.15.59:0/530702232 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4d9c06ae70 msgr2=0x7f4d9c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:16.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.685+0000 7f4dbf035640 1 --2- 172.21.15.59:0/530702232 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4d9c06ae70 0x7f4d9c06d330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4da8006fd0 tx=0x7f4da8008040 comp rx=0 tx=0).stop 2023-10-16T14:26:16.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.685+0000 7f4dbf035640 1 -- 172.21.15.59:0/530702232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4db80cad30 msgr2=0x7f4db81f1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:16.689 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.685+0000 7f4dbf035640 1 --2- 172.21.15.59:0/530702232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4db80cad30 0x7f4db81f1a50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4db402b950 tx=0x7f4db40046c0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.685+0000 7f4dbf035640 1 -- 172.21.15.59:0/530702232 shutdown_connections 2023-10-16T14:26:16.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.685+0000 7f4dbf035640 1 --2- 172.21.15.59:0/530702232 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4d9c06ae70 0x7f4d9c06d330 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.685+0000 7f4dbf035640 1 --2- 172.21.15.59:0/530702232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4db815cba0 0x7f4db815ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.685+0000 7f4dbf035640 1 --2- 172.21.15.59:0/530702232 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4db80cdd90 0x7f4db80c1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.685+0000 7f4dbf035640 1 --2- 172.21.15.59:0/530702232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4db80cad30 0x7f4db81f1a50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.690 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.685+0000 7f4dbf035640 1 -- 172.21.15.59:0/530702232 >> 172.21.15.59:0/530702232 conn(0x7f4db806a470 msgr2=0x7f4db80ac160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:16.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.685+0000 7f4dbf035640 1 -- 172.21.15.59:0/530702232 shutdown_connections 2023-10-16T14:26:16.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.685+0000 7f4dbf035640 1 -- 172.21.15.59:0/530702232 wait complete. 2023-10-16T14:26:16.707 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T14:25:46.371818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T14:25:47.145341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T14:25:50.758038+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T14:26:16.708 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:26:16.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.933+0000 7f862b275640 1 Processor -- start 2023-10-16T14:26:16.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.933+0000 7f862b275640 1 -- start start 2023-10-16T14:26:16.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.935+0000 7f862b275640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f86240cb400 0x7f862415e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:16.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.935+0000 7f862b275640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f86240c8930 0x7f86240707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:16.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.935+0000 7f862b275640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86240c8e40 con 0x7f8624070400 2023-10-16T14:26:16.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.935+0000 7f862b275640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86240c9090 con 0x7f86240c8930 2023-10-16T14:26:16.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.935+0000 7f862b275640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86240c9370 con 0x7f86240cb400 2023-10-16T14:26:16.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.935+0000 7f862a273640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8624070400 0x7f86240cacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45738/0 (socket says 172.21.15.59:45738) 2023-10-16T14:26:16.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.935+0000 7f862a273640 1 -- 172.21.15.59:0/177055818 learned_addr learned my addr 172.21.15.59:0/177055818 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:16.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.935+0000 7f862aa74640 1 --2- 172.21.15.59:0/177055818 >> v2:172.21.15.59:3300/0 conn(0x7f86240c8930 0x7f86240707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:16.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.936+0000 7f8629a72640 1 --2- 172.21.15.59:0/177055818 >> v2:172.21.15.151:3300/0 conn(0x7f86240cb400 0x7f862415e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:16.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.936+0000 7f8629271640 1 -- 172.21.15.59:0/177055818 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923676398 0 0) 0x7f86240c8e40 con 0x7f8624070400 2023-10-16T14:26:16.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.936+0000 7f8629271640 1 -- 172.21.15.59:0/177055818 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8610003520 con 0x7f8624070400 2023-10-16T14:26:16.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.936+0000 7f862aa74640 1 -- 172.21.15.59:0/177055818 >> v2:172.21.15.151:3300/0 conn(0x7f86240cb400 msgr2=0x7f862415e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:16.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.936+0000 7f862aa74640 1 --2- 172.21.15.59:0/177055818 >> v2:172.21.15.151:3300/0 conn(0x7f86240cb400 0x7f862415e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.936+0000 7f862aa74640 1 -- 172.21.15.59:0/177055818 >> v1:172.21.15.59:6789/0 conn(0x7f8624070400 legacy=0x7f86240cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:16.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.936+0000 7f862aa74640 1 -- 172.21.15.59:0/177055818 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86240c9650 con 0x7f86240c8930 2023-10-16T14:26:16.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.937+0000 7f862aa74640 1 --2- 172.21.15.59:0/177055818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86240c8930 0x7f86240707e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f86240cb8d0 tx=0x7f861c02bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7c305026a3638 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:16.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.937+0000 7f8629271640 1 -- 172.21.15.59:0/177055818 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c02cc70 con 0x7f86240c8930 2023-10-16T14:26:16.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.937+0000 7f8629271640 1 -- 172.21.15.59:0/177055818 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861c02cdd0 con 0x7f86240c8930 2023-10-16T14:26:16.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.937+0000 7f8629271640 1 -- 172.21.15.59:0/177055818 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c034660 con 0x7f86240c8930 2023-10-16T14:26:16.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.938+0000 7f862b275640 1 -- 172.21.15.59:0/177055818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86240c8930 msgr2=0x7f86240707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:16.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.938+0000 7f862b275640 1 --2- 172.21.15.59:0/177055818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86240c8930 0x7f86240707e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f86240cb8d0 tx=0x7f861c02bec0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.938+0000 7f862b275640 1 -- 172.21.15.59:0/177055818 shutdown_connections 2023-10-16T14:26:16.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.938+0000 7f862b275640 1 --2- 172.21.15.59:0/177055818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86240c8930 0x7f86240707e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.938+0000 7f862b275640 1 --2- 172.21.15.59:0/177055818 >> v2:172.21.15.151:3300/0 conn(0x7f86240cb400 0x7f862415e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.938+0000 7f862b275640 1 -- 172.21.15.59:0/177055818 >> 172.21.15.59:0/177055818 conn(0x7f862406a470 msgr2=0x7f86240afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:16.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.938+0000 7f862b275640 1 -- 172.21.15.59:0/177055818 shutdown_connections 2023-10-16T14:26:16.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.938+0000 7f862b275640 1 -- 172.21.15.59:0/177055818 wait complete. 2023-10-16T14:26:16.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.940+0000 7f862b275640 1 Processor -- start 2023-10-16T14:26:16.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.940+0000 7f862b275640 1 -- start start 2023-10-16T14:26:16.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.941+0000 7f862b275640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8624070400 0x7f86240b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:16.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.941+0000 7f862b275640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86240c8930 0x7f86240b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:16.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.941+0000 7f862b275640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86240cb400 0x7f86241594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:16.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.941+0000 7f862b275640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8624152060 con 0x7f86240cb400 2023-10-16T14:26:16.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.941+0000 7f862b275640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86241f5750 con 0x7f8624070400 2023-10-16T14:26:16.948 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.941+0000 7f862b275640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86241f5a30 con 0x7f86240c8930 2023-10-16T14:26:16.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.941+0000 7f862aa74640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86240cb400 0x7f86241594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:16.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.941+0000 7f862aa74640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86240cb400 0x7f86241594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42056/0 (socket says 172.21.15.59:42056) 2023-10-16T14:26:16.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.941+0000 7f862aa74640 1 -- 172.21.15.59:0/913346512 learned_addr learned my addr 172.21.15.59:0/913346512 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:16.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.941+0000 7f8629a72640 1 --2- 172.21.15.59:0/913346512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86240c8930 0x7f86240b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:16.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.941+0000 7f862a273640 1 --2- 172.21.15.59:0/913346512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8624070400 0x7f86240b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:16.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.941+0000 7f862aa74640 1 -- 172.21.15.59:0/913346512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86240c8930 msgr2=0x7f86240b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:16.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.941+0000 7f862aa74640 1 --2- 172.21.15.59:0/913346512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86240c8930 0x7f86240b38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.941+0000 7f862aa74640 1 -- 172.21.15.59:0/913346512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8624070400 msgr2=0x7f86240b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:16.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.941+0000 7f862aa74640 1 --2- 172.21.15.59:0/913346512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8624070400 0x7f86240b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:16.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.941+0000 7f862aa74640 1 -- 172.21.15.59:0/913346512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c009a70 con 0x7f86240cb400 2023-10-16T14:26:16.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.941+0000 7f862a273640 1 --2- 172.21.15.59:0/913346512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8624070400 0x7f86240b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:16.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.942+0000 7f862aa74640 1 --2- 172.21.15.59:0/913346512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86240cb400 0x7f86241594a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f861c009e80 tx=0x7f861c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:16.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.942+0000 7f861affd640 1 -- 172.21.15.59:0/913346512 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c040650 con 0x7f86240cb400 2023-10-16T14:26:16.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.942+0000 7f861affd640 1 -- 172.21.15.59:0/913346512 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861c0407b0 con 0x7f86240cb400 2023-10-16T14:26:16.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.942+0000 7f861affd640 1 -- 172.21.15.59:0/913346512 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c040b60 con 0x7f86240cb400 2023-10-16T14:26:16.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.942+0000 7f862b275640 1 -- 172.21.15.59:0/913346512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86241f5d10 con 0x7f86240cb400 2023-10-16T14:26:16.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.942+0000 7f862b275640 1 -- 172.21.15.59:0/913346512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86241f62d0 con 0x7f86240cb400 2023-10-16T14:26:16.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.943+0000 7f862b275640 1 -- 172.21.15.59:0/913346512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86240c2e60 con 0x7f86240cb400 2023-10-16T14:26:16.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.944+0000 7f861affd640 1 -- 172.21.15.59:0/913346512 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f861c040cc0 con 0x7f86240cb400 2023-10-16T14:26:16.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.945+0000 7f861affd640 1 --2- 172.21.15.59:0/913346512 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f860806ae70 0x7f860806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:16.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.945+0000 7f861affd640 1 -- 172.21.15.59:0/913346512 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f861c0ac6a0 con 0x7f86240cb400 2023-10-16T14:26:16.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.946+0000 7f862a273640 1 --2- 172.21.15.59:0/913346512 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f860806ae70 0x7f860806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:16.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.947+0000 7f862a273640 1 --2- 172.21.15.59:0/913346512 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f860806ae70 0x7f860806d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8620007fd0 tx=0x7f8620009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:16.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:16.950+0000 7f861affd640 1 -- 172.21.15.59:0/913346512 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f86240c2e60 con 0x7f86240cb400 2023-10-16T14:26:17.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.144+0000 7f862b275640 1 -- 172.21.15.59:0/913346512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86240c2e60 con 0x7f86240cb400 2023-10-16T14:26:17.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.145+0000 7f861affd640 1 -- 172.21.15.59:0/913346512 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86240c2e60 con 0x7f86240cb400 2023-10-16T14:26:17.149 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:26:17.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.147+0000 7f862b275640 1 -- 172.21.15.59:0/913346512 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f860806ae70 msgr2=0x7f860806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:17.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.147+0000 7f862b275640 1 --2- 172.21.15.59:0/913346512 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f860806ae70 0x7f860806d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8620007fd0 tx=0x7f8620009040 comp rx=0 tx=0).stop 2023-10-16T14:26:17.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.147+0000 7f862b275640 1 -- 172.21.15.59:0/913346512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86240cb400 msgr2=0x7f86241594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:17.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.147+0000 7f862b275640 1 --2- 172.21.15.59:0/913346512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86240cb400 0x7f86241594a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f861c009e80 tx=0x7f861c004a40 comp rx=0 tx=0).stop 2023-10-16T14:26:17.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.147+0000 7f862b275640 1 -- 172.21.15.59:0/913346512 shutdown_connections 2023-10-16T14:26:17.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.147+0000 7f862b275640 1 --2- 172.21.15.59:0/913346512 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f860806ae70 0x7f860806d330 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:17.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.147+0000 7f862b275640 1 --2- 172.21.15.59:0/913346512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86240cb400 0x7f86241594a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:17.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.147+0000 7f862b275640 1 --2- 172.21.15.59:0/913346512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86240c8930 0x7f86240b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:17.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.147+0000 7f862b275640 1 --2- 172.21.15.59:0/913346512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8624070400 0x7f86240b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:17.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.147+0000 7f862b275640 1 -- 172.21.15.59:0/913346512 >> 172.21.15.59:0/913346512 conn(0x7f862406a470 msgr2=0x7f86240ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:17.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.147+0000 7f862b275640 1 -- 172.21.15.59:0/913346512 shutdown_connections 2023-10-16T14:26:17.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.148+0000 7f862b275640 1 -- 172.21.15.59:0/913346512 wait complete. 2023-10-16T14:26:17.169 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T14:26:17.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.395+0000 7fc32c87b640 1 Processor -- start 2023-10-16T14:26:17.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.395+0000 7fc32c87b640 1 -- start start 2023-10-16T14:26:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.397+0000 7fc32c87b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3280cf0c0 0x7fc32815d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.397+0000 7fc32c87b640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc328159ca0 con 0x7fc3280ca3a0 2023-10-16T14:26:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.397+0000 7fc32c87b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3280cac20 con 0x7fc3280ad940 2023-10-16T14:26:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.397+0000 7fc32c87b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280b34c0 con 0x7fc3280cf0c0 2023-10-16T14:26:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.397+0000 7fc31ffff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc3280ca3a0 0x7fc3280ce9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45746/0 (socket says 172.21.15.59:45746) 2023-10-16T14:26:17.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.397+0000 7fc31ffff640 1 -- 172.21.15.59:0/2907617996 learned_addr learned my addr 172.21.15.59:0/2907617996 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:17.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.398+0000 7fc32759e640 1 --2- 172.21.15.59:0/2907617996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3280cf0c0 0x7fc32815d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.398+0000 7fc32659c640 1 -- 172.21.15.59:0/2907617996 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485005302 0 0) 0x7fc328159ca0 con 0x7fc3280ca3a0 2023-10-16T14:26:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.398+0000 7fc32659c640 1 -- 172.21.15.59:0/2907617996 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc314005730 con 0x7fc3280ca3a0 2023-10-16T14:26:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.398+0000 7fc32659c640 1 -- 172.21.15.59:0/2907617996 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2626847379 0 0) 0x7fc314005730 con 0x7fc3280ca3a0 2023-10-16T14:26:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.398+0000 7fc32659c640 1 -- 172.21.15.59:0/2907617996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3280cf0c0 msgr2=0x7fc32815d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.398+0000 7fc32659c640 1 --2- 172.21.15.59:0/2907617996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3280cf0c0 0x7fc32815d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.398+0000 7fc32659c640 1 -- 172.21.15.59:0/2907617996 >> v1:172.21.15.151:6789/0 conn(0x7fc3280ad940 legacy=0x7fc32806c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.398+0000 7fc32659c640 1 -- 172.21.15.59:0/2907617996 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32806cdc0 con 0x7fc3280ca3a0 2023-10-16T14:26:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.398+0000 7fc32659c640 1 -- 172.21.15.59:0/2907617996 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7fc310001670 con 0x7fc3280ca3a0 2023-10-16T14:26:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.398+0000 7fc32659c640 1 -- 172.21.15.59:0/2907617996 >> v1:172.21.15.59:6789/0 conn(0x7fc3280ca3a0 legacy=0x7fc3280ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.399+0000 7fc32659c640 1 --2- 172.21.15.59:0/2907617996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc314005c20 0x7fc314006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.399+0000 7fc32659c640 1 --2- 172.21.15.59:0/2907617996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3140069d0 0x7fc314006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.399+0000 7fc32659c640 1 --2- 172.21.15.59:0/2907617996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3280cf0c0 0x7fc3140073f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.399+0000 7fc32659c640 1 -- 172.21.15.59:0/2907617996 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280b34c0 con 0x7fc3140069d0 2023-10-16T14:26:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.399+0000 7fc32659c640 1 -- 172.21.15.59:0/2907617996 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31400dd80 con 0x7fc314005c20 2023-10-16T14:26:17.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.399+0000 7fc32659c640 1 -- 172.21.15.59:0/2907617996 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31400df40 con 0x7fc3280cf0c0 2023-10-16T14:26:17.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.399+0000 7fc31ffff640 1 --2- 172.21.15.59:0/2907617996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3140069d0 0x7fc314006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:17.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.399+0000 7fc326d9d640 1 --2- 172.21.15.59:0/2907617996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc314005c20 0x7fc314006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:17.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.399+0000 7fc32759e640 1 --2- 172.21.15.59:0/2907617996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3280cf0c0 0x7fc3140073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:17.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.400+0000 7fc31ffff640 1 -- 172.21.15.59:0/2907617996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3280cf0c0 msgr2=0x7fc3140073f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:17.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.400+0000 7fc31ffff640 1 --2- 172.21.15.59:0/2907617996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3280cf0c0 0x7fc3140073f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:17.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.400+0000 7fc31ffff640 1 -- 172.21.15.59:0/2907617996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc314005c20 msgr2=0x7fc314006040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:17.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.400+0000 7fc31ffff640 1 --2- 172.21.15.59:0/2907617996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc314005c20 0x7fc314006040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:17.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.400+0000 7fc31ffff640 1 -- 172.21.15.59:0/2907617996 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc314005730 con 0x7fc3140069d0 2023-10-16T14:26:17.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.401+0000 7fc31ffff640 1 --2- 172.21.15.59:0/2907617996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3140069d0 0x7fc314006e50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc31000c0e0 tx=0x7fc314007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9461a3795ae2d15e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:17.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.401+0000 7fc32659c640 1 -- 172.21.15.59:0/2907617996 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310005ad0 con 0x7fc3140069d0 2023-10-16T14:26:17.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.401+0000 7fc32659c640 1 -- 172.21.15.59:0/2907617996 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc310005c30 con 0x7fc3140069d0 2023-10-16T14:26:17.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.401+0000 7fc32659c640 1 -- 172.21.15.59:0/2907617996 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31002c810 con 0x7fc3140069d0 2023-10-16T14:26:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.402+0000 7fc32c87b640 1 -- 172.21.15.59:0/2907617996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3140069d0 msgr2=0x7fc314006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.402+0000 7fc32c87b640 1 --2- 172.21.15.59:0/2907617996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3140069d0 0x7fc314006e50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc31000c0e0 tx=0x7fc314007a00 comp rx=0 tx=0).stop 2023-10-16T14:26:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.402+0000 7fc32759e640 1 -- 172.21.15.59:0/2907617996 reap_dead start 2023-10-16T14:26:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.402+0000 7fc32c87b640 1 -- 172.21.15.59:0/2907617996 shutdown_connections 2023-10-16T14:26:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.402+0000 7fc32c87b640 1 -- 172.21.15.59:0/2907617996 >> 172.21.15.59:0/2907617996 conn(0x7fc32806a200 msgr2=0x7fc32806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.402+0000 7fc32c87b640 1 -- 172.21.15.59:0/2907617996 shutdown_connections 2023-10-16T14:26:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.402+0000 7fc32c87b640 1 -- 172.21.15.59:0/2907617996 wait complete. 2023-10-16T14:26:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.404+0000 7fc32c87b640 1 Processor -- start 2023-10-16T14:26:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.404+0000 7fc32c87b640 1 -- start start 2023-10-16T14:26:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.405+0000 7fc32c87b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3140069d0 0x7fc3280ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:17.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.405+0000 7fc32c87b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3280c1060 0x7fc328070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:17.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.405+0000 7fc32c87b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc328157cd0 0x7fc328158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:17.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.405+0000 7fc32c87b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280afb10 con 0x7fc328157cd0 2023-10-16T14:26:17.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.405+0000 7fc32c87b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc328158690 con 0x7fc3140069d0 2023-10-16T14:26:17.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.405+0000 7fc32c87b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3281f5500 con 0x7fc3280c1060 2023-10-16T14:26:17.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.406+0000 7fc32759e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc328157cd0 0x7fc328158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:17.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.406+0000 7fc32759e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc328157cd0 0x7fc328158150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42070/0 (socket says 172.21.15.59:42070) 2023-10-16T14:26:17.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.406+0000 7fc32759e640 1 -- 172.21.15.59:0/2906784480 learned_addr learned my addr 172.21.15.59:0/2906784480 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:17.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.406+0000 7fc326d9d640 1 --2- 172.21.15.59:0/2906784480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3140069d0 0x7fc3280ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:17.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.406+0000 7fc31ffff640 1 --2- 172.21.15.59:0/2906784480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3280c1060 0x7fc328070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:17.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.406+0000 7fc32759e640 1 -- 172.21.15.59:0/2906784480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3280c1060 msgr2=0x7fc328070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:17.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.406+0000 7fc32759e640 1 --2- 172.21.15.59:0/2906784480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3280c1060 0x7fc328070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:17.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.406+0000 7fc32759e640 1 -- 172.21.15.59:0/2906784480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3140069d0 msgr2=0x7fc3280ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:17.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.406+0000 7fc32759e640 1 --2- 172.21.15.59:0/2906784480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3140069d0 0x7fc3280ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:17.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.406+0000 7fc32759e640 1 -- 172.21.15.59:0/2906784480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3280c14e0 con 0x7fc328157cd0 2023-10-16T14:26:17.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.407+0000 7fc32759e640 1 --2- 172.21.15.59:0/2906784480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc328157cd0 0x7fc328158150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc32806fff0 tx=0x7fc3200115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:17.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.407+0000 7fc31f7fe640 1 -- 172.21.15.59:0/2906784480 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32000e070 con 0x7fc328157cd0 2023-10-16T14:26:17.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.407+0000 7fc31f7fe640 1 -- 172.21.15.59:0/2906784480 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc320011db0 con 0x7fc328157cd0 2023-10-16T14:26:17.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.407+0000 7fc32c87b640 1 -- 172.21.15.59:0/2906784480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3280708b0 con 0x7fc328157cd0 2023-10-16T14:26:17.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.407+0000 7fc31f7fe640 1 -- 172.21.15.59:0/2906784480 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320003990 con 0x7fc328157cd0 2023-10-16T14:26:17.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.407+0000 7fc32c87b640 1 -- 172.21.15.59:0/2906784480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3280af170 con 0x7fc328157cd0 2023-10-16T14:26:17.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.408+0000 7fc32c87b640 1 -- 172.21.15.59:0/2906784480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32815aea0 con 0x7fc328157cd0 2023-10-16T14:26:17.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.409+0000 7fc31f7fe640 1 -- 172.21.15.59:0/2906784480 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc320003af0 con 0x7fc328157cd0 2023-10-16T14:26:17.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.410+0000 7fc31f7fe640 1 --2- 172.21.15.59:0/2906784480 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc30806aea0 0x7fc30806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:17.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.410+0000 7fc31f7fe640 1 -- 172.21.15.59:0/2906784480 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc320089f50 con 0x7fc328157cd0 2023-10-16T14:26:17.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.411+0000 7fc326d9d640 1 --2- 172.21.15.59:0/2906784480 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc30806aea0 0x7fc30806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:17.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.412+0000 7fc326d9d640 1 --2- 172.21.15.59:0/2906784480 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc30806aea0 0x7fc30806d360 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc318000c00 tx=0x7fc318009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:17.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.414+0000 7fc31f7fe640 1 -- 172.21.15.59:0/2906784480 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc32815aea0 con 0x7fc328157cd0 2023-10-16T14:26:17.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.607+0000 7fc32c87b640 1 -- 172.21.15.59:0/2906784480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc32815aea0 con 0x7fc328157cd0 2023-10-16T14:26:17.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.608+0000 7fc31f7fe640 1 -- 172.21.15.59:0/2906784480 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc32815aea0 con 0x7fc328157cd0 2023-10-16T14:26:17.611 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:17.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.611+0000 7fc32c87b640 1 -- 172.21.15.59:0/2906784480 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc30806aea0 msgr2=0x7fc30806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:17.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.611+0000 7fc32c87b640 1 --2- 172.21.15.59:0/2906784480 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc30806aea0 0x7fc30806d360 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc318000c00 tx=0x7fc318009040 comp rx=0 tx=0).stop 2023-10-16T14:26:17.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.611+0000 7fc32c87b640 1 -- 172.21.15.59:0/2906784480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc328157cd0 msgr2=0x7fc328158150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:17.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.611+0000 7fc32c87b640 1 --2- 172.21.15.59:0/2906784480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc328157cd0 0x7fc328158150 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc32806fff0 tx=0x7fc3200115a0 comp rx=0 tx=0).stop 2023-10-16T14:26:17.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.611+0000 7fc32c87b640 1 -- 172.21.15.59:0/2906784480 shutdown_connections 2023-10-16T14:26:17.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.611+0000 7fc32c87b640 1 --2- 172.21.15.59:0/2906784480 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc30806aea0 0x7fc30806d360 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:17.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.611+0000 7fc32c87b640 1 --2- 172.21.15.59:0/2906784480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc328157cd0 0x7fc328158150 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:17.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.611+0000 7fc32c87b640 1 --2- 172.21.15.59:0/2906784480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3280c1060 0x7fc328070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:17.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.611+0000 7fc32c87b640 1 --2- 172.21.15.59:0/2906784480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3140069d0 0x7fc3280ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:17.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.611+0000 7fc32c87b640 1 -- 172.21.15.59:0/2906784480 >> 172.21.15.59:0/2906784480 conn(0x7fc32806a200 msgr2=0x7fc3280ab150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:17.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.611+0000 7fc32c87b640 1 -- 172.21.15.59:0/2906784480 shutdown_connections 2023-10-16T14:26:17.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.611+0000 7fc32c87b640 1 -- 172.21.15.59:0/2906784480 wait complete. 2023-10-16T14:26:17.633 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T14:26:17.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.861+0000 7f74ea975640 1 Processor -- start 2023-10-16T14:26:17.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.861+0000 7f74ea975640 1 -- start start 2023-10-16T14:26:17.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.863+0000 7f74ea975640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f74e40d0d80 0x7f74e40d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:17.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.863+0000 7f74ea975640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f74e40b5fd0 0x7f74e40b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:17.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.863+0000 7f74ea975640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e40ce810 con 0x7f74e415c940 2023-10-16T14:26:17.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.863+0000 7f74ea975640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e40d1740 con 0x7f74e40b5fd0 2023-10-16T14:26:17.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.863+0000 7f74ea975640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e40b5b40 con 0x7f74e40d0d80 2023-10-16T14:26:17.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.863+0000 7f74e9973640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f74e415c940 0x7f74e40d0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45750/0 (socket says 172.21.15.59:45750) 2023-10-16T14:26:17.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.863+0000 7f74e9973640 1 -- 172.21.15.59:0/3337340046 learned_addr learned my addr 172.21.15.59:0/3337340046 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:17.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.863+0000 7f74ea174640 1 --2- 172.21.15.59:0/3337340046 >> v2:172.21.15.59:3300/0 conn(0x7f74e40b5fd0 0x7f74e40b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:17.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.863+0000 7f74e9172640 1 --2- 172.21.15.59:0/3337340046 >> v2:172.21.15.151:3300/0 conn(0x7f74e40d0d80 0x7f74e40d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:17.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.864+0000 7f74e8971640 1 -- 172.21.15.59:0/3337340046 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924405858 0 0) 0x7f74e40ce810 con 0x7f74e415c940 2023-10-16T14:26:17.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.864+0000 7f74e8971640 1 -- 172.21.15.59:0/3337340046 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74d0003520 con 0x7f74e415c940 2023-10-16T14:26:17.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.864+0000 7f74ea174640 1 -- 172.21.15.59:0/3337340046 >> v2:172.21.15.151:3300/0 conn(0x7f74e40d0d80 msgr2=0x7f74e40d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:17.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.864+0000 7f74ea174640 1 --2- 172.21.15.59:0/3337340046 >> v2:172.21.15.151:3300/0 conn(0x7f74e40d0d80 0x7f74e40d1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.864+0000 7f74ea174640 1 -- 172.21.15.59:0/3337340046 >> v1:172.21.15.59:6789/0 conn(0x7f74e415c940 legacy=0x7f74e40d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.864+0000 7f74ea174640 1 -- 172.21.15.59:0/3337340046 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e40d0b10 con 0x7f74e40b5fd0 2023-10-16T14:26:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.865+0000 7f74ea174640 1 --2- 172.21.15.59:0/3337340046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74e40b5fd0 0x7f74e40b6420 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f74e40b88e0 tx=0x7f74dc02be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca57bad561faa242 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:17.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.865+0000 7f74e8971640 1 -- 172.21.15.59:0/3337340046 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc02cbe0 con 0x7f74e40b5fd0 2023-10-16T14:26:17.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.865+0000 7f74e8971640 1 -- 172.21.15.59:0/3337340046 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74dc02cd40 con 0x7f74e40b5fd0 2023-10-16T14:26:17.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.865+0000 7f74e8971640 1 -- 172.21.15.59:0/3337340046 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc034640 con 0x7f74e40b5fd0 2023-10-16T14:26:17.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.866+0000 7f74ea975640 1 -- 172.21.15.59:0/3337340046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74e40b5fd0 msgr2=0x7f74e40b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:17.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.866+0000 7f74ea975640 1 --2- 172.21.15.59:0/3337340046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74e40b5fd0 0x7f74e40b6420 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f74e40b88e0 tx=0x7f74dc02be30 comp rx=0 tx=0).stop 2023-10-16T14:26:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.866+0000 7f74ea975640 1 -- 172.21.15.59:0/3337340046 shutdown_connections 2023-10-16T14:26:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.866+0000 7f74ea975640 1 --2- 172.21.15.59:0/3337340046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74e40b5fd0 0x7f74e40b6420 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.866+0000 7f74ea975640 1 --2- 172.21.15.59:0/3337340046 >> v2:172.21.15.151:3300/0 conn(0x7f74e40d0d80 0x7f74e40d1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.866+0000 7f74ea975640 1 -- 172.21.15.59:0/3337340046 >> 172.21.15.59:0/3337340046 conn(0x7f74e409bb30 msgr2=0x7f74e40d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:17.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.866+0000 7f74ea975640 1 -- 172.21.15.59:0/3337340046 shutdown_connections 2023-10-16T14:26:17.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.866+0000 7f74ea975640 1 -- 172.21.15.59:0/3337340046 wait complete. 2023-10-16T14:26:17.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.868+0000 7f74ea975640 1 Processor -- start 2023-10-16T14:26:17.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.868+0000 7f74ea975640 1 -- start start 2023-10-16T14:26:17.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.869+0000 7f74ea975640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e40b5fd0 0x7f74e4157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:17.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.869+0000 7f74ea975640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e40d0d80 0x7f74e4142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:17.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.869+0000 7f74ea975640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74e415c940 0x7f74e4142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:17.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.869+0000 7f74ea975640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e40cbe50 con 0x7f74e415c940 2023-10-16T14:26:17.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.869+0000 7f74ea975640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e40cb2a0 con 0x7f74e40d0d80 2023-10-16T14:26:17.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.869+0000 7f74ea975640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e41578a0 con 0x7f74e40b5fd0 2023-10-16T14:26:17.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.869+0000 7f74ea174640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74e415c940 0x7f74e4142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:17.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.869+0000 7f74ea174640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74e415c940 0x7f74e4142d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42086/0 (socket says 172.21.15.59:42086) 2023-10-16T14:26:17.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.869+0000 7f74ea174640 1 -- 172.21.15.59:0/2618244071 learned_addr learned my addr 172.21.15.59:0/2618244071 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:17.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.870+0000 7f74e9172640 1 --2- 172.21.15.59:0/2618244071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e40d0d80 0x7f74e4142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:17.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.870+0000 7f74e9973640 1 --2- 172.21.15.59:0/2618244071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e40b5fd0 0x7f74e4157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.870+0000 7f74ea174640 1 -- 172.21.15.59:0/2618244071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e40b5fd0 msgr2=0x7f74e4157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.870+0000 7f74ea174640 1 --2- 172.21.15.59:0/2618244071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e40b5fd0 0x7f74e4157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.870+0000 7f74ea174640 1 -- 172.21.15.59:0/2618244071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e40d0d80 msgr2=0x7f74e4142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.870+0000 7f74ea174640 1 --2- 172.21.15.59:0/2618244071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e40d0d80 0x7f74e4142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.870+0000 7f74ea174640 1 -- 172.21.15.59:0/2618244071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc009a70 con 0x7f74e415c940 2023-10-16T14:26:17.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.870+0000 7f74ea174640 1 --2- 172.21.15.59:0/2618244071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74e415c940 0x7f74e4142d90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f74dc02c440 tx=0x7f74dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:17.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.871+0000 7f74da7fc640 1 -- 172.21.15.59:0/2618244071 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc03e610 con 0x7f74e415c940 2023-10-16T14:26:17.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.871+0000 7f74da7fc640 1 -- 172.21.15.59:0/2618244071 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74dc03e770 con 0x7f74e415c940 2023-10-16T14:26:17.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.871+0000 7f74da7fc640 1 -- 172.21.15.59:0/2618244071 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc03eb60 con 0x7f74e415c940 2023-10-16T14:26:17.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.871+0000 7f74ea975640 1 -- 172.21.15.59:0/2618244071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e41f2190 con 0x7f74e415c940 2023-10-16T14:26:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.871+0000 7f74ea975640 1 -- 172.21.15.59:0/2618244071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e40cb790 con 0x7f74e415c940 2023-10-16T14:26:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.872+0000 7f74ea975640 1 -- 172.21.15.59:0/2618244071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e40cbf90 con 0x7f74e415c940 2023-10-16T14:26:17.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.873+0000 7f74da7fc640 1 -- 172.21.15.59:0/2618244071 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f74dc03b050 con 0x7f74e415c940 2023-10-16T14:26:17.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.874+0000 7f74da7fc640 1 --2- 172.21.15.59:0/2618244071 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f74c806ae70 0x7f74c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:17.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.874+0000 7f74da7fc640 1 -- 172.21.15.59:0/2618244071 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f74dc0aba60 con 0x7f74e415c940 2023-10-16T14:26:17.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.875+0000 7f74e9973640 1 --2- 172.21.15.59:0/2618244071 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f74c806ae70 0x7f74c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:17.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.876+0000 7f74e9973640 1 --2- 172.21.15.59:0/2618244071 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f74c806ae70 0x7f74c806d330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f74e0005880 tx=0x7f74e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:17.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:17.879+0000 7f74da7fc640 1 -- 172.21.15.59:0/2618244071 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f74e40cbf90 con 0x7f74e415c940 2023-10-16T14:26:18.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.072+0000 7f74ea975640 1 -- 172.21.15.59:0/2618244071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f74e40cbf90 con 0x7f74e415c940 2023-10-16T14:26:18.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.073+0000 7f74da7fc640 1 -- 172.21.15.59:0/2618244071 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f74e40cbf90 con 0x7f74e415c940 2023-10-16T14:26:18.077 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-16T14:26:18.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.075+0000 7f74ea975640 1 -- 172.21.15.59:0/2618244071 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f74c806ae70 msgr2=0x7f74c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:18.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.075+0000 7f74ea975640 1 --2- 172.21.15.59:0/2618244071 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f74c806ae70 0x7f74c806d330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f74e0005880 tx=0x7f74e0009040 comp rx=0 tx=0).stop 2023-10-16T14:26:18.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.075+0000 7f74ea975640 1 -- 172.21.15.59:0/2618244071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74e415c940 msgr2=0x7f74e4142d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:18.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.075+0000 7f74ea975640 1 --2- 172.21.15.59:0/2618244071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74e415c940 0x7f74e4142d90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f74dc02c440 tx=0x7f74dc004a40 comp rx=0 tx=0).stop 2023-10-16T14:26:18.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.076+0000 7f74ea975640 1 -- 172.21.15.59:0/2618244071 shutdown_connections 2023-10-16T14:26:18.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.076+0000 7f74ea975640 1 --2- 172.21.15.59:0/2618244071 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f74c806ae70 0x7f74c806d330 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.076+0000 7f74ea975640 1 --2- 172.21.15.59:0/2618244071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74e415c940 0x7f74e4142d90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.076+0000 7f74ea975640 1 --2- 172.21.15.59:0/2618244071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e40d0d80 0x7f74e4142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.076+0000 7f74ea975640 1 --2- 172.21.15.59:0/2618244071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e40b5fd0 0x7f74e4157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.076+0000 7f74ea975640 1 -- 172.21.15.59:0/2618244071 >> 172.21.15.59:0/2618244071 conn(0x7f74e409bb30 msgr2=0x7f74e406afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.076+0000 7f74ea975640 1 -- 172.21.15.59:0/2618244071 shutdown_connections 2023-10-16T14:26:18.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.076+0000 7f74ea975640 1 -- 172.21.15.59:0/2618244071 wait complete. 2023-10-16T14:26:18.100 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T14:26:18.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.320+0000 7fc586260640 1 Processor -- start 2023-10-16T14:26:18.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.320+0000 7fc586260640 1 -- start start 2023-10-16T14:26:18.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.321+0000 7fc586260640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc580154d10 0x7fc5800ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:18.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.321+0000 7fc586260640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc5800cee60 0x7fc58006ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:18.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.322+0000 7fc586260640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc58006d360 0x7fc5800ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:18.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.322+0000 7fc586260640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5800cf2e0 con 0x7fc58006d360 2023-10-16T14:26:18.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.322+0000 7fc586260640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5801550f0 con 0x7fc5800cee60 2023-10-16T14:26:18.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.322+0000 7fc586260640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58006db50 con 0x7fc580154d10 2023-10-16T14:26:18.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.322+0000 7fc585a5f640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc58006d360 0x7fc5800ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:18.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.322+0000 7fc585a5f640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc58006d360 0x7fc5800ac1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42096/0 (socket says 172.21.15.59:42096) 2023-10-16T14:26:18.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.322+0000 7fc585a5f640 1 -- 172.21.15.59:0/1959769240 learned_addr learned my addr 172.21.15.59:0/1959769240 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:18.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.322+0000 7fc58525e640 1 --2- 172.21.15.59:0/1959769240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc580154d10 0x7fc5800ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:18.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.322+0000 7fc584a5d640 1 --2- 172.21.15.59:0/1959769240 >> v2:172.21.15.151:3300/0 conn(0x7fc5800cee60 0x7fc58006ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:18.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.323+0000 7fc585a5f640 1 -- 172.21.15.59:0/1959769240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc580154d10 msgr2=0x7fc5800ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:18.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.323+0000 7fc585a5f640 1 --2- 172.21.15.59:0/1959769240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc580154d10 0x7fc5800ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:18.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.323+0000 7fc585a5f640 1 -- 172.21.15.59:0/1959769240 >> v2:172.21.15.151:3300/0 conn(0x7fc5800cee60 msgr2=0x7fc58006ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:18.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.323+0000 7fc585a5f640 1 --2- 172.21.15.59:0/1959769240 >> v2:172.21.15.151:3300/0 conn(0x7fc5800cee60 0x7fc58006ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:18.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.323+0000 7fc585a5f640 1 -- 172.21.15.59:0/1959769240 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5800b13f0 con 0x7fc58006d360 2023-10-16T14:26:18.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.324+0000 7fc585a5f640 1 --2- 172.21.15.59:0/1959769240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc58006d360 0x7fc5800ac1d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc5800b1080 tx=0x7fc57802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ecc8679aff0c584 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:18.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.324+0000 7fc57ffff640 1 -- 172.21.15.59:0/1959769240 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578031870 con 0x7fc58006d360 2023-10-16T14:26:18.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.324+0000 7fc57ffff640 1 -- 172.21.15.59:0/1959769240 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5780319d0 con 0x7fc58006d360 2023-10-16T14:26:18.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.324+0000 7fc57ffff640 1 -- 172.21.15.59:0/1959769240 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc578031d60 con 0x7fc58006d360 2023-10-16T14:26:18.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.325+0000 7fc586260640 1 -- 172.21.15.59:0/1959769240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc58006d360 msgr2=0x7fc5800ac1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:18.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.325+0000 7fc586260640 1 --2- 172.21.15.59:0/1959769240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc58006d360 0x7fc5800ac1d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc5800b1080 tx=0x7fc57802b910 comp rx=0 tx=0).stop 2023-10-16T14:26:18.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.325+0000 7fc586260640 1 -- 172.21.15.59:0/1959769240 shutdown_connections 2023-10-16T14:26:18.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.325+0000 7fc586260640 1 --2- 172.21.15.59:0/1959769240 >> v2:172.21.15.151:3300/0 conn(0x7fc5800cee60 0x7fc58006ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:18.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.325+0000 7fc586260640 1 --2- 172.21.15.59:0/1959769240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc58006d360 0x7fc5800ac1d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:18.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.325+0000 7fc586260640 1 --2- 172.21.15.59:0/1959769240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc580154d10 0x7fc5800ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:18.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.325+0000 7fc586260640 1 -- 172.21.15.59:0/1959769240 >> 172.21.15.59:0/1959769240 conn(0x7fc58006a200 msgr2=0x7fc58006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:18.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.325+0000 7fc586260640 1 -- 172.21.15.59:0/1959769240 shutdown_connections 2023-10-16T14:26:18.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.325+0000 7fc586260640 1 -- 172.21.15.59:0/1959769240 wait complete. 2023-10-16T14:26:18.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.327+0000 7fc586260640 1 Processor -- start 2023-10-16T14:26:18.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.327+0000 7fc586260640 1 -- start start 2023-10-16T14:26:18.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.328+0000 7fc586260640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc58006d360 0x7fc58015e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:18.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.328+0000 7fc586260640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5800cee60 0x7fc5800ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:18.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.328+0000 7fc586260640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc580154d10 0x7fc58014f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:18.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.328+0000 7fc586260640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5800cdb40 con 0x7fc5800cee60 2023-10-16T14:26:18.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.328+0000 7fc586260640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5800cd000 con 0x7fc58006d360 2023-10-16T14:26:18.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.328+0000 7fc586260640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5800cd2a0 con 0x7fc580154d10 2023-10-16T14:26:18.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.328+0000 7fc584a5d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5800cee60 0x7fc5800ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:18.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.328+0000 7fc584a5d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5800cee60 0x7fc5800ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42112/0 (socket says 172.21.15.59:42112) 2023-10-16T14:26:18.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.328+0000 7fc584a5d640 1 -- 172.21.15.59:0/3187903983 learned_addr learned my addr 172.21.15.59:0/3187903983 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:18.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.329+0000 7fc58525e640 1 --2- 172.21.15.59:0/3187903983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc58006d360 0x7fc58015e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:18.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.329+0000 7fc584a5d640 1 -- 172.21.15.59:0/3187903983 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc580154d10 msgr2=0x7fc58014f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:18.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.329+0000 7fc585a5f640 1 --2- 172.21.15.59:0/3187903983 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc580154d10 0x7fc58014f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:18.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.329+0000 7fc584a5d640 1 --2- 172.21.15.59:0/3187903983 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc580154d10 0x7fc58014f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:18.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.329+0000 7fc584a5d640 1 -- 172.21.15.59:0/3187903983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc58006d360 msgr2=0x7fc58015e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:18.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.329+0000 7fc584a5d640 1 --2- 172.21.15.59:0/3187903983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc58006d360 0x7fc58015e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:18.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.329+0000 7fc584a5d640 1 -- 172.21.15.59:0/3187903983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5780094d0 con 0x7fc5800cee60 2023-10-16T14:26:18.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.329+0000 7fc584a5d640 1 --2- 172.21.15.59:0/3187903983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5800cee60 0x7fc5800ccac0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc57400e890 tx=0x7fc57400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:18.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.329+0000 7fc57dffb640 1 -- 172.21.15.59:0/3187903983 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57400c940 con 0x7fc5800cee60 2023-10-16T14:26:18.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.330+0000 7fc57dffb640 1 -- 172.21.15.59:0/3187903983 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57400caa0 con 0x7fc5800cee60 2023-10-16T14:26:18.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.330+0000 7fc57dffb640 1 -- 172.21.15.59:0/3187903983 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57400ce30 con 0x7fc5800cee60 2023-10-16T14:26:18.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.330+0000 7fc586260640 1 -- 172.21.15.59:0/3187903983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5800cd580 con 0x7fc5800cee60 2023-10-16T14:26:18.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.330+0000 7fc586260640 1 -- 172.21.15.59:0/3187903983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5800700e0 con 0x7fc5800cee60 2023-10-16T14:26:18.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.331+0000 7fc586260640 1 -- 172.21.15.59:0/3187903983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58006ff40 con 0x7fc5800cee60 2023-10-16T14:26:18.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.332+0000 7fc57dffb640 1 -- 172.21.15.59:0/3187903983 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc574013470 con 0x7fc5800cee60 2023-10-16T14:26:18.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.333+0000 7fc57dffb640 1 --2- 172.21.15.59:0/3187903983 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc56c06aea0 0x7fc56c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:18.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.334+0000 7fc57dffb640 1 -- 172.21.15.59:0/3187903983 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc574089b30 con 0x7fc5800cee60 2023-10-16T14:26:18.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.334+0000 7fc58525e640 1 --2- 172.21.15.59:0/3187903983 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc56c06aea0 0x7fc56c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:18.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.335+0000 7fc58525e640 1 --2- 172.21.15.59:0/3187903983 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc56c06aea0 0x7fc56c06d360 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc570007380 tx=0x7fc57000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:18.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.338+0000 7fc57dffb640 1 -- 172.21.15.59:0/3187903983 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc58006ff40 con 0x7fc5800cee60 2023-10-16T14:26:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.536+0000 7fc586260640 1 -- 172.21.15.59:0/3187903983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc58006ff40 con 0x7fc5800cee60 2023-10-16T14:26:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.537+0000 7fc57dffb640 1 -- 172.21.15.59:0/3187903983 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc574021020 con 0x7fc5800cee60 2023-10-16T14:26:18.541 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:18.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.539+0000 7fc586260640 1 -- 172.21.15.59:0/3187903983 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc56c06aea0 msgr2=0x7fc56c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.539+0000 7fc586260640 1 --2- 172.21.15.59:0/3187903983 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc56c06aea0 0x7fc56c06d360 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc570007380 tx=0x7fc57000b040 comp rx=0 tx=0).stop 2023-10-16T14:26:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.539+0000 7fc586260640 1 -- 172.21.15.59:0/3187903983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5800cee60 msgr2=0x7fc5800ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.539+0000 7fc586260640 1 --2- 172.21.15.59:0/3187903983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5800cee60 0x7fc5800ccac0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc57400e890 tx=0x7fc57400ed50 comp rx=0 tx=0).stop 2023-10-16T14:26:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.539+0000 7fc586260640 1 -- 172.21.15.59:0/3187903983 shutdown_connections 2023-10-16T14:26:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.539+0000 7fc586260640 1 --2- 172.21.15.59:0/3187903983 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc56c06aea0 0x7fc56c06d360 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.539+0000 7fc586260640 1 --2- 172.21.15.59:0/3187903983 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc580154d10 0x7fc58014f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.539+0000 7fc586260640 1 --2- 172.21.15.59:0/3187903983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5800cee60 0x7fc5800ccac0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.539+0000 7fc586260640 1 --2- 172.21.15.59:0/3187903983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc58006d360 0x7fc58015e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.539+0000 7fc586260640 1 -- 172.21.15.59:0/3187903983 >> 172.21.15.59:0/3187903983 conn(0x7fc58006a200 msgr2=0x7fc5800b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.540+0000 7fc586260640 1 -- 172.21.15.59:0/3187903983 shutdown_connections 2023-10-16T14:26:18.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.540+0000 7fc586260640 1 -- 172.21.15.59:0/3187903983 wait complete. 2023-10-16T14:26:18.563 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T14:26:18.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.777+0000 7f0b3c915640 1 Processor -- start 2023-10-16T14:26:18.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.777+0000 7f0b3c915640 1 -- start start 2023-10-16T14:26:18.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.778+0000 7f0b3c915640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0b3815a8f0 0x7f0b380b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:18.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.778+0000 7f0b3c915640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0b380b1870 0x7f0b38071750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:18.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.778+0000 7f0b3c915640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3806ed50 con 0x7f0b380ae6d0 2023-10-16T14:26:18.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.778+0000 7f0b3c915640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b380aef50 con 0x7f0b380b1870 2023-10-16T14:26:18.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.778+0000 7f0b3c915640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3806f280 con 0x7f0b3815a8f0 2023-10-16T14:26:18.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.779+0000 7f0b3759e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0b380b1870 0x7f0b38071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:18.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.779+0000 7f0b3759e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0b380b1870 0x7f0b38071750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42114/0 (socket says 172.21.15.59:42114) 2023-10-16T14:26:18.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.779+0000 7f0b2e59c640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0b380ae6d0 0x7f0b380b1160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45754/0 (socket says 172.21.15.59:45754) 2023-10-16T14:26:18.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.779+0000 7f0b3759e640 1 -- 172.21.15.59:0/2231881315 learned_addr learned my addr 172.21.15.59:0/2231881315 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:18.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.779+0000 7f0b36d9d640 1 --2- 172.21.15.59:0/2231881315 >> v2:172.21.15.151:3300/0 conn(0x7f0b3815a8f0 0x7f0b380b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:18.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.779+0000 7f0b3759e640 1 -- 172.21.15.59:0/2231881315 >> v2:172.21.15.151:3300/0 conn(0x7f0b3815a8f0 msgr2=0x7f0b380b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:18.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.779+0000 7f0b3759e640 1 --2- 172.21.15.59:0/2231881315 >> v2:172.21.15.151:3300/0 conn(0x7f0b3815a8f0 0x7f0b380b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:18.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.779+0000 7f0b3759e640 1 -- 172.21.15.59:0/2231881315 >> v1:172.21.15.59:6789/0 conn(0x7f0b380ae6d0 legacy=0x7f0b380b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:18.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.780+0000 7f0b3759e640 1 -- 172.21.15.59:0/2231881315 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b380b5430 con 0x7f0b380b1870 2023-10-16T14:26:18.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.779+0000 7f0b3659c640 1 -- 172.21.15.59:0/2231881315 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380370579 0 0) 0x7f0b3806ed50 con 0x7f0b380ae6d0 2023-10-16T14:26:18.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.781+0000 7f0b3759e640 1 --2- 172.21.15.59:0/2231881315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b380b1870 0x7f0b38071750 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0b3806be40 tx=0x7f0b3002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119378de8b7b1f7f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:18.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.781+0000 7f0b3659c640 1 -- 172.21.15.59:0/2231881315 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3002cb20 con 0x7f0b380b1870 2023-10-16T14:26:18.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.781+0000 7f0b3659c640 1 -- 172.21.15.59:0/2231881315 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3002cc80 con 0x7f0b380b1870 2023-10-16T14:26:18.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.781+0000 7f0b3659c640 1 -- 172.21.15.59:0/2231881315 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b300343f0 con 0x7f0b380b1870 2023-10-16T14:26:18.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.782+0000 7f0b3c915640 1 -- 172.21.15.59:0/2231881315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b380b1870 msgr2=0x7f0b38071750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:18.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.782+0000 7f0b3c915640 1 --2- 172.21.15.59:0/2231881315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b380b1870 0x7f0b38071750 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0b3806be40 tx=0x7f0b3002bf80 comp rx=0 tx=0).stop 2023-10-16T14:26:18.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.782+0000 7f0b3c915640 1 -- 172.21.15.59:0/2231881315 shutdown_connections 2023-10-16T14:26:18.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.782+0000 7f0b3c915640 1 --2- 172.21.15.59:0/2231881315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b380b1870 0x7f0b38071750 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:18.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.782+0000 7f0b3c915640 1 --2- 172.21.15.59:0/2231881315 >> v2:172.21.15.151:3300/0 conn(0x7f0b3815a8f0 0x7f0b380b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:18.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.782+0000 7f0b3c915640 1 -- 172.21.15.59:0/2231881315 >> 172.21.15.59:0/2231881315 conn(0x7f0b380cf660 msgr2=0x7f0b380cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:18.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.782+0000 7f0b3c915640 1 -- 172.21.15.59:0/2231881315 shutdown_connections 2023-10-16T14:26:18.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.782+0000 7f0b3c915640 1 -- 172.21.15.59:0/2231881315 wait complete. 2023-10-16T14:26:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.784+0000 7f0b3c915640 1 Processor -- start 2023-10-16T14:26:18.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.784+0000 7f0b3c915640 1 -- start start 2023-10-16T14:26:18.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.785+0000 7f0b3c915640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b380ae6d0 0x7f0b3814ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:18.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.785+0000 7f0b3c915640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b380b1870 0x7f0b3815d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:18.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.785+0000 7f0b3c915640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b3815a8f0 0x7f0b381e4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:18.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.785+0000 7f0b3c915640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3814f450 con 0x7f0b380b1870 2023-10-16T14:26:18.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.785+0000 7f0b3c915640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b38150350 con 0x7f0b3815a8f0 2023-10-16T14:26:18.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.785+0000 7f0b3c915640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b38150630 con 0x7f0b380ae6d0 2023-10-16T14:26:18.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.785+0000 7f0b2e59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b380b1870 0x7f0b3815d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:18.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.785+0000 7f0b2e59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b380b1870 0x7f0b3815d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42118/0 (socket says 172.21.15.59:42118) 2023-10-16T14:26:18.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.785+0000 7f0b2e59c640 1 -- 172.21.15.59:0/3458391001 learned_addr learned my addr 172.21.15.59:0/3458391001 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:18.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.785+0000 7f0b36d9d640 1 --2- 172.21.15.59:0/3458391001 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b380ae6d0 0x7f0b3814ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:18.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.785+0000 7f0b3759e640 1 --2- 172.21.15.59:0/3458391001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b3815a8f0 0x7f0b381e4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:18.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.785+0000 7f0b2e59c640 1 -- 172.21.15.59:0/3458391001 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b380ae6d0 msgr2=0x7f0b3814ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:18.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.785+0000 7f0b2e59c640 1 --2- 172.21.15.59:0/3458391001 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b380ae6d0 0x7f0b3814ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:18.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.785+0000 7f0b2e59c640 1 -- 172.21.15.59:0/3458391001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b3815a8f0 msgr2=0x7f0b381e4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:18.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.785+0000 7f0b2e59c640 1 --2- 172.21.15.59:0/3458391001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b3815a8f0 0x7f0b381e4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:18.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.785+0000 7f0b2e59c640 1 -- 172.21.15.59:0/3458391001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b30009b30 con 0x7f0b380b1870 2023-10-16T14:26:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.786+0000 7f0b2e59c640 1 --2- 172.21.15.59:0/3458391001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b380b1870 0x7f0b3815d650 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0b2000c4d0 tx=0x7f0b2000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.786+0000 7f0b2ffff640 1 -- 172.21.15.59:0/3458391001 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b200074e0 con 0x7f0b380b1870 2023-10-16T14:26:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.786+0000 7f0b2ffff640 1 -- 172.21.15.59:0/3458391001 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b20007660 con 0x7f0b380b1870 2023-10-16T14:26:18.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.786+0000 7f0b3c915640 1 -- 172.21.15.59:0/3458391001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b38150910 con 0x7f0b380b1870 2023-10-16T14:26:18.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.786+0000 7f0b2ffff640 1 -- 172.21.15.59:0/3458391001 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b20004a20 con 0x7f0b380b1870 2023-10-16T14:26:18.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.786+0000 7f0b3c915640 1 -- 172.21.15.59:0/3458391001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b38150ed0 con 0x7f0b380b1870 2023-10-16T14:26:18.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.787+0000 7f0b3c915640 1 -- 172.21.15.59:0/3458391001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b3804e9b0 con 0x7f0b380b1870 2023-10-16T14:26:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.788+0000 7f0b2ffff640 1 -- 172.21.15.59:0/3458391001 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0b20004b80 con 0x7f0b380b1870 2023-10-16T14:26:18.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.789+0000 7f0b2ffff640 1 --2- 172.21.15.59:0/3458391001 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0b1806aea0 0x7f0b1806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:18.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.789+0000 7f0b2ffff640 1 -- 172.21.15.59:0/3458391001 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0b20088df0 con 0x7f0b380b1870 2023-10-16T14:26:18.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.790+0000 7f0b36d9d640 1 --2- 172.21.15.59:0/3458391001 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0b1806aea0 0x7f0b1806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:18.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.791+0000 7f0b36d9d640 1 --2- 172.21.15.59:0/3458391001 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0b1806aea0 0x7f0b1806d360 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0b28006fd0 tx=0x7f0b28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:18.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:18.794+0000 7f0b2ffff640 1 -- 172.21.15.59:0/3458391001 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b20053ba0 con 0x7f0b380b1870 2023-10-16T14:26:19.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.027+0000 7f0b3c915640 1 -- 172.21.15.59:0/3458391001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b380ca410 con 0x7f0b380b1870 2023-10-16T14:26:19.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.027+0000 7f0b2ffff640 1 -- 172.21.15.59:0/3458391001 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f0b20018020 con 0x7f0b380b1870 2023-10-16T14:26:19.031 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:19.031 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3959035293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3959035293},{"type":"v1","addr":"172.21.15.59:6834","nonce":3959035293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1298271347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1298271347},{"type":"v1","addr":"172.21.15.151:6835","nonce":1298271347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/249904108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":249904108},{"type":"v1","addr":"172.21.15.59:6835","nonce":249904108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T14:25:48.130662+0000","modified":"2023-10-16T14:26:09.157993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6837/4004038733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4004038733},{"type":"v1","addr":"172.21.15.151:6837","nonce":4004038733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T14:26:19.032 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 9 2023-10-16T14:26:19.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.030+0000 7f0b3c915640 1 -- 172.21.15.59:0/3458391001 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0b1806aea0 msgr2=0x7f0b1806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:19.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.030+0000 7f0b3c915640 1 --2- 172.21.15.59:0/3458391001 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0b1806aea0 0x7f0b1806d360 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0b28006fd0 tx=0x7f0b28008040 comp rx=0 tx=0).stop 2023-10-16T14:26:19.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.030+0000 7f0b3c915640 1 -- 172.21.15.59:0/3458391001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b380b1870 msgr2=0x7f0b3815d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:19.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.030+0000 7f0b3c915640 1 --2- 172.21.15.59:0/3458391001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b380b1870 0x7f0b3815d650 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0b2000c4d0 tx=0x7f0b2000c990 comp rx=0 tx=0).stop 2023-10-16T14:26:19.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.030+0000 7f0b3c915640 1 -- 172.21.15.59:0/3458391001 shutdown_connections 2023-10-16T14:26:19.034 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.030+0000 7f0b3c915640 1 --2- 172.21.15.59:0/3458391001 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0b1806aea0 0x7f0b1806d360 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.030+0000 7f0b3c915640 1 --2- 172.21.15.59:0/3458391001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b3815a8f0 0x7f0b381e4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.030+0000 7f0b3c915640 1 --2- 172.21.15.59:0/3458391001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b380b1870 0x7f0b3815d650 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.030+0000 7f0b3c915640 1 --2- 172.21.15.59:0/3458391001 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b380ae6d0 0x7f0b3814ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.030+0000 7f0b3c915640 1 -- 172.21.15.59:0/3458391001 >> 172.21.15.59:0/3458391001 conn(0x7f0b380cf660 msgr2=0x7f0b380b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:19.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.031+0000 7f0b3c915640 1 -- 172.21.15.59:0/3458391001 shutdown_connections 2023-10-16T14:26:19.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.031+0000 7f0b3c915640 1 -- 172.21.15.59:0/3458391001 wait complete. 2023-10-16T14:26:19.053 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:26:19.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.268+0000 7f1381f61640 1 Processor -- start 2023-10-16T14:26:19.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.268+0000 7f1381f61640 1 -- start start 2023-10-16T14:26:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.269+0000 7f1381f61640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f137c0c9e70 0x7f137c0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.269+0000 7f1381f61640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137c161250 con 0x7f137c06a4f0 2023-10-16T14:26:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.269+0000 7f1381f61640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137c1614f0 con 0x7f137c15ca80 2023-10-16T14:26:19.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.269+0000 7f1381f61640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f137c071ed0 con 0x7f137c0c9e70 2023-10-16T14:26:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.270+0000 7f137bfff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f137c06a4f0 0x7f137c0cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45768/0 (socket says 172.21.15.59:45768) 2023-10-16T14:26:19.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.270+0000 7f137bfff640 1 -- 172.21.15.59:0/4180022434 learned_addr learned my addr 172.21.15.59:0/4180022434 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:19.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.270+0000 7f137affd640 1 --2- 172.21.15.59:0/4180022434 >> v2:172.21.15.151:3300/0 conn(0x7f137c0c9e70 0x7f137c0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:19.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.270+0000 7f137a7fc640 1 -- 172.21.15.59:0/4180022434 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2201740051 0 0) 0x7f137c161250 con 0x7f137c06a4f0 2023-10-16T14:26:19.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.270+0000 7f137a7fc640 1 -- 172.21.15.59:0/4180022434 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1364003520 con 0x7f137c06a4f0 2023-10-16T14:26:19.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.271+0000 7f137a7fc640 1 -- 172.21.15.59:0/4180022434 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1254497384 0 0) 0x7f1364003520 con 0x7f137c06a4f0 2023-10-16T14:26:19.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.271+0000 7f137a7fc640 1 -- 172.21.15.59:0/4180022434 >> v2:172.21.15.151:3300/0 conn(0x7f137c0c9e70 msgr2=0x7f137c0ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:19.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.271+0000 7f137a7fc640 1 --2- 172.21.15.59:0/4180022434 >> v2:172.21.15.151:3300/0 conn(0x7f137c0c9e70 0x7f137c0ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.271+0000 7f137a7fc640 1 -- 172.21.15.59:0/4180022434 >> v1:172.21.15.151:6789/0 conn(0x7f137c15ca80 legacy=0x7f137c069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:19.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.271+0000 7f137a7fc640 1 -- 172.21.15.59:0/4180022434 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c0721b0 con 0x7f137c06a4f0 2023-10-16T14:26:19.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.271+0000 7f137a7fc640 1 -- 172.21.15.59:0/4180022434 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f1374001670 con 0x7f137c06a4f0 2023-10-16T14:26:19.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.271+0000 7f137a7fc640 1 -- 172.21.15.59:0/4180022434 >> v1:172.21.15.59:6789/0 conn(0x7f137c06a4f0 legacy=0x7f137c0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.271+0000 7f137a7fc640 1 --2- 172.21.15.59:0/4180022434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13640039e0 0x7f1364003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.271+0000 7f137a7fc640 1 --2- 172.21.15.59:0/4180022434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13640047c0 0x7f1364004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.271+0000 7f137a7fc640 1 --2- 172.21.15.59:0/4180022434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13640051f0 0x7f136400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:19.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.271+0000 7f137a7fc640 1 -- 172.21.15.59:0/4180022434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c071ed0 con 0x7f13640047c0 2023-10-16T14:26:19.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.271+0000 7f137a7fc640 1 -- 172.21.15.59:0/4180022434 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136400c150 con 0x7f13640039e0 2023-10-16T14:26:19.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.271+0000 7f137a7fc640 1 -- 172.21.15.59:0/4180022434 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136400c310 con 0x7f13640051f0 2023-10-16T14:26:19.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.271+0000 7f137affd640 1 --2- 172.21.15.59:0/4180022434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13640047c0 0x7f1364004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:19.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.272+0000 7f137b7fe640 1 --2- 172.21.15.59:0/4180022434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13640039e0 0x7f1364003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:19.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.272+0000 7f137bfff640 1 --2- 172.21.15.59:0/4180022434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13640051f0 0x7f136400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.272+0000 7f137affd640 1 -- 172.21.15.59:0/4180022434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13640051f0 msgr2=0x7f136400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.272+0000 7f137affd640 1 --2- 172.21.15.59:0/4180022434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13640051f0 0x7f136400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.272+0000 7f137affd640 1 -- 172.21.15.59:0/4180022434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13640039e0 msgr2=0x7f1364003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.272+0000 7f137affd640 1 --2- 172.21.15.59:0/4180022434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13640039e0 0x7f1364003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.272+0000 7f137affd640 1 -- 172.21.15.59:0/4180022434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1364003520 con 0x7f13640047c0 2023-10-16T14:26:19.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.272+0000 7f137bfff640 1 -- 172.21.15.59:0/4180022434 reap_dead start 2023-10-16T14:26:19.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.272+0000 7f137b7fe640 1 --2- 172.21.15.59:0/4180022434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13640039e0 0x7f1364003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:19.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.273+0000 7f137affd640 1 --2- 172.21.15.59:0/4180022434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13640047c0 0x7f1364004c40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1370009ac0 tx=0x7f13640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5b58a084c53477 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:19.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.273+0000 7f137a7fc640 1 -- 172.21.15.59:0/4180022434 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137002c6b0 con 0x7f13640047c0 2023-10-16T14:26:19.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.273+0000 7f137a7fc640 1 -- 172.21.15.59:0/4180022434 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137002c810 con 0x7f13640047c0 2023-10-16T14:26:19.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.273+0000 7f137a7fc640 1 -- 172.21.15.59:0/4180022434 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137002cba0 con 0x7f13640047c0 2023-10-16T14:26:19.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.274+0000 7f1381f61640 1 -- 172.21.15.59:0/4180022434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13640047c0 msgr2=0x7f1364004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:19.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.274+0000 7f1381f61640 1 --2- 172.21.15.59:0/4180022434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13640047c0 0x7f1364004c40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1370009ac0 tx=0x7f13640057f0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.274+0000 7f1381f61640 1 -- 172.21.15.59:0/4180022434 shutdown_connections 2023-10-16T14:26:19.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.274+0000 7f1381f61640 1 --2- 172.21.15.59:0/4180022434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13640047c0 0x7f1364004c40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.274+0000 7f1381f61640 1 -- 172.21.15.59:0/4180022434 >> 172.21.15.59:0/4180022434 conn(0x7f137c0cc0c0 msgr2=0x7f137c0cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:19.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.274+0000 7f1381f61640 1 -- 172.21.15.59:0/4180022434 shutdown_connections 2023-10-16T14:26:19.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.274+0000 7f1381f61640 1 -- 172.21.15.59:0/4180022434 wait complete. 2023-10-16T14:26:19.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.276+0000 7f1381f61640 1 Processor -- start 2023-10-16T14:26:19.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.276+0000 7f1381f61640 1 -- start start 2023-10-16T14:26:19.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.277+0000 7f1381f61640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13640047c0 0x7f137c1f19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:19.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.277+0000 7f1381f61640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137c15dd60 0x7f137c1f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:19.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.277+0000 7f1381f61640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f137c0c8b20 0x7f137c0c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:19.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.277+0000 7f1381f61640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0c94e0 con 0x7f137c15dd60 2023-10-16T14:26:19.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.277+0000 7f1381f61640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0c4060 con 0x7f13640047c0 2023-10-16T14:26:19.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.277+0000 7f1381f61640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0c6890 con 0x7f137c0c8b20 2023-10-16T14:26:19.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.278+0000 7f137affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137c15dd60 0x7f137c1f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:19.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.278+0000 7f137affd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137c15dd60 0x7f137c1f1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42136/0 (socket says 172.21.15.59:42136) 2023-10-16T14:26:19.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.278+0000 7f137affd640 1 -- 172.21.15.59:0/1531968603 learned_addr learned my addr 172.21.15.59:0/1531968603 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:19.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.278+0000 7f137b7fe640 1 --2- 172.21.15.59:0/1531968603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13640047c0 0x7f137c1f19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:19.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.278+0000 7f137affd640 1 -- 172.21.15.59:0/1531968603 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f137c0c8b20 msgr2=0x7f137c0c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:19.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.278+0000 7f137affd640 1 --2- 172.21.15.59:0/1531968603 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f137c0c8b20 0x7f137c0c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.278+0000 7f137affd640 1 -- 172.21.15.59:0/1531968603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13640047c0 msgr2=0x7f137c1f19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:19.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.278+0000 7f137affd640 1 --2- 172.21.15.59:0/1531968603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13640047c0 0x7f137c1f19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.278+0000 7f137affd640 1 -- 172.21.15.59:0/1531968603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c0c6b70 con 0x7f137c15dd60 2023-10-16T14:26:19.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.278+0000 7f137b7fe640 1 --2- 172.21.15.59:0/1531968603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13640047c0 0x7f137c1f19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:19.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.278+0000 7f137affd640 1 --2- 172.21.15.59:0/1531968603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137c15dd60 0x7f137c1f1f30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f137002c250 tx=0x7f1370004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:19.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.279+0000 7f1363fff640 1 -- 172.21.15.59:0/1531968603 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370003810 con 0x7f137c15dd60 2023-10-16T14:26:19.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.279+0000 7f1363fff640 1 -- 172.21.15.59:0/1531968603 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1370003970 con 0x7f137c15dd60 2023-10-16T14:26:19.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.279+0000 7f1363fff640 1 -- 172.21.15.59:0/1531968603 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370003d00 con 0x7f137c15dd60 2023-10-16T14:26:19.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.279+0000 7f1381f61640 1 -- 172.21.15.59:0/1531968603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f137c0c6e50 con 0x7f137c15dd60 2023-10-16T14:26:19.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.279+0000 7f1381f61640 1 -- 172.21.15.59:0/1531968603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137c0c3510 con 0x7f137c15dd60 2023-10-16T14:26:19.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.280+0000 7f1381f61640 1 -- 172.21.15.59:0/1531968603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137c0c66f0 con 0x7f137c15dd60 2023-10-16T14:26:19.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.281+0000 7f1363fff640 1 -- 172.21.15.59:0/1531968603 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1370034440 con 0x7f137c15dd60 2023-10-16T14:26:19.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.282+0000 7f1363fff640 1 --2- 172.21.15.59:0/1531968603 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f136806aea0 0x7f136806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:19.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.282+0000 7f1363fff640 1 -- 172.21.15.59:0/1531968603 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f13700abbb0 con 0x7f137c15dd60 2023-10-16T14:26:19.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.283+0000 7f137b7fe640 1 --2- 172.21.15.59:0/1531968603 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f136806aea0 0x7f136806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:19.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.284+0000 7f137b7fe640 1 --2- 172.21.15.59:0/1531968603 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f136806aea0 0x7f136806d360 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f136c000f80 tx=0x7f136c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:19.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.286+0000 7f1363fff640 1 -- 172.21.15.59:0/1531968603 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f137c0c66f0 con 0x7f137c15dd60 2023-10-16T14:26:19.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.480+0000 7f1381f61640 1 -- 172.21.15.59:0/1531968603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f137c0c66f0 con 0x7f137c15dd60 2023-10-16T14:26:19.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.482+0000 7f1363fff640 1 -- 172.21.15.59:0/1531968603 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f137c0c66f0 con 0x7f137c15dd60 2023-10-16T14:26:19.486 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:19.486 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:25:53.209862+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:26:19.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.484+0000 7f1381f61640 1 -- 172.21.15.59:0/1531968603 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f136806aea0 msgr2=0x7f136806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:19.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.484+0000 7f1381f61640 1 --2- 172.21.15.59:0/1531968603 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f136806aea0 0x7f136806d360 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f136c000f80 tx=0x7f136c009040 comp rx=0 tx=0).stop 2023-10-16T14:26:19.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.484+0000 7f1381f61640 1 -- 172.21.15.59:0/1531968603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137c15dd60 msgr2=0x7f137c1f1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:19.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.484+0000 7f1381f61640 1 --2- 172.21.15.59:0/1531968603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137c15dd60 0x7f137c1f1f30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f137002c250 tx=0x7f1370004730 comp rx=0 tx=0).stop 2023-10-16T14:26:19.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.484+0000 7f1381f61640 1 -- 172.21.15.59:0/1531968603 shutdown_connections 2023-10-16T14:26:19.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.484+0000 7f1381f61640 1 --2- 172.21.15.59:0/1531968603 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f136806aea0 0x7f136806d360 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.484+0000 7f1381f61640 1 --2- 172.21.15.59:0/1531968603 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f137c0c8b20 0x7f137c0c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.484+0000 7f1381f61640 1 --2- 172.21.15.59:0/1531968603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137c15dd60 0x7f137c1f1f30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.484+0000 7f1381f61640 1 --2- 172.21.15.59:0/1531968603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13640047c0 0x7f137c1f19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.484+0000 7f1381f61640 1 -- 172.21.15.59:0/1531968603 >> 172.21.15.59:0/1531968603 conn(0x7f137c0cc0c0 msgr2=0x7f137c0b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:19.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.484+0000 7f1381f61640 1 -- 172.21.15.59:0/1531968603 shutdown_connections 2023-10-16T14:26:19.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.485+0000 7f1381f61640 1 -- 172.21.15.59:0/1531968603 wait complete. 2023-10-16T14:26:19.507 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T14:25:46.371818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T14:25:47.145341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T14:25:50.758038+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T14:26:19.507 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:26:19.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.735+0000 7f21abef2640 1 Processor -- start 2023-10-16T14:26:19.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.735+0000 7f21abef2640 1 -- start start 2023-10-16T14:26:19.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.737+0000 7f21abef2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21a415a830 0x7f21a40cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:19.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.737+0000 7f21abef2640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f21a40ca550 0x7f21a4070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:19.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.737+0000 7f21abef2640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a40cf040 con 0x7f21a4070860 2023-10-16T14:26:19.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.737+0000 7f21abef2640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a4070cf0 con 0x7f21a40ca550 2023-10-16T14:26:19.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.737+0000 7f21abef2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40ce430 con 0x7f21a415a830 2023-10-16T14:26:19.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.737+0000 7f21a948d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f21a40ca550 0x7f21a4070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:19.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.738+0000 7f21a948d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f21a40ca550 0x7f21a4070320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42142/0 (socket says 172.21.15.59:42142) 2023-10-16T14:26:19.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.738+0000 7f21a948d640 1 -- 172.21.15.59:0/1234111661 learned_addr learned my addr 172.21.15.59:0/1234111661 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:19.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.738+0000 7f21a9c8e640 1 --2- 172.21.15.59:0/1234111661 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21a415a830 0x7f21a40cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:19.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.738+0000 7f21a948d640 1 -- 172.21.15.59:0/1234111661 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21a415a830 msgr2=0x7f21a40cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:19.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.738+0000 7f21a948d640 1 --2- 172.21.15.59:0/1234111661 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21a415a830 0x7f21a40cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.738+0000 7f21a948d640 1 -- 172.21.15.59:0/1234111661 >> v1:172.21.15.151:6789/0 conn(0x7f21a4070860 legacy=0x7f21a415e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:19.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.738+0000 7f21a948d640 1 -- 172.21.15.59:0/1234111661 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a40ce710 con 0x7f21a40ca550 2023-10-16T14:26:19.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.738+0000 7f21a9c8e640 1 --2- 172.21.15.59:0/1234111661 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21a415a830 0x7f21a40cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:19.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.739+0000 7f21a948d640 1 --2- 172.21.15.59:0/1234111661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21a40ca550 0x7f21a4070320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2194009870 tx=0x7f219402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f9c44921a7d208 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:19.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.739+0000 7f21a8c8c640 1 -- 172.21.15.59:0/1234111661 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2194031640 con 0x7f21a40ca550 2023-10-16T14:26:19.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.740+0000 7f21a8c8c640 1 -- 172.21.15.59:0/1234111661 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21940317a0 con 0x7f21a40ca550 2023-10-16T14:26:19.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.740+0000 7f21a8c8c640 1 -- 172.21.15.59:0/1234111661 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2194031b30 con 0x7f21a40ca550 2023-10-16T14:26:19.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.740+0000 7f21abef2640 1 -- 172.21.15.59:0/1234111661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21a40ca550 msgr2=0x7f21a4070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:19.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.740+0000 7f21abef2640 1 --2- 172.21.15.59:0/1234111661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21a40ca550 0x7f21a4070320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2194009870 tx=0x7f219402b8f0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.740+0000 7f21abef2640 1 -- 172.21.15.59:0/1234111661 shutdown_connections 2023-10-16T14:26:19.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.740+0000 7f21abef2640 1 --2- 172.21.15.59:0/1234111661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21a40ca550 0x7f21a4070320 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.740+0000 7f21abef2640 1 --2- 172.21.15.59:0/1234111661 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21a415a830 0x7f21a40cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.740+0000 7f21abef2640 1 -- 172.21.15.59:0/1234111661 >> 172.21.15.59:0/1234111661 conn(0x7f21a40b0030 msgr2=0x7f21a40b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:19.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.740+0000 7f21abef2640 1 -- 172.21.15.59:0/1234111661 shutdown_connections 2023-10-16T14:26:19.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.740+0000 7f21abef2640 1 -- 172.21.15.59:0/1234111661 wait complete. 2023-10-16T14:26:19.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.742+0000 7f21abef2640 1 Processor -- start 2023-10-16T14:26:19.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.742+0000 7f21abef2640 1 -- start start 2023-10-16T14:26:19.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.743+0000 7f21abef2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21a4070860 0x7f21a415ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:19.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.743+0000 7f21abef2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21a40ca550 0x7f21a415cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:19.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.743+0000 7f21abef2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21a415a830 0x7f21a415d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:19.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.743+0000 7f21abef2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a415f360 con 0x7f21a415a830 2023-10-16T14:26:19.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.743+0000 7f21abef2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a41f09e0 con 0x7f21a40ca550 2023-10-16T14:26:19.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.743+0000 7f21abef2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a41f0cc0 con 0x7f21a4070860 2023-10-16T14:26:19.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.743+0000 7f21aa48f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21a415a830 0x7f21a415d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:19.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.744+0000 7f21aa48f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21a415a830 0x7f21a415d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42158/0 (socket says 172.21.15.59:42158) 2023-10-16T14:26:19.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.744+0000 7f21aa48f640 1 -- 172.21.15.59:0/3556400678 learned_addr learned my addr 172.21.15.59:0/3556400678 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:19.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.744+0000 7f21a9c8e640 1 --2- 172.21.15.59:0/3556400678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21a4070860 0x7f21a415ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:19.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.744+0000 7f21a948d640 1 --2- 172.21.15.59:0/3556400678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21a40ca550 0x7f21a415cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:19.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.744+0000 7f21aa48f640 1 -- 172.21.15.59:0/3556400678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21a4070860 msgr2=0x7f21a415ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:19.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.744+0000 7f21aa48f640 1 --2- 172.21.15.59:0/3556400678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21a4070860 0x7f21a415ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.744+0000 7f21aa48f640 1 -- 172.21.15.59:0/3556400678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21a40ca550 msgr2=0x7f21a415cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:19.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.744+0000 7f21aa48f640 1 --2- 172.21.15.59:0/3556400678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21a40ca550 0x7f21a415cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.744+0000 7f21aa48f640 1 -- 172.21.15.59:0/3556400678 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21940094d0 con 0x7f21a415a830 2023-10-16T14:26:19.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.744+0000 7f21a9c8e640 1 --2- 172.21.15.59:0/3556400678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21a4070860 0x7f21a415ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:19.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.744+0000 7f21a948d640 1 --2- 172.21.15.59:0/3556400678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21a40ca550 0x7f21a415cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:19.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.744+0000 7f21aa48f640 1 --2- 172.21.15.59:0/3556400678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21a415a830 0x7f21a415d530 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f219c00c780 tx=0x7f219c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:19.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.744+0000 7f219a7fc640 1 -- 172.21.15.59:0/3556400678 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c004b60 con 0x7f21a415a830 2023-10-16T14:26:19.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.745+0000 7f219a7fc640 1 -- 172.21.15.59:0/3556400678 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c00ce90 con 0x7f21a415a830 2023-10-16T14:26:19.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.745+0000 7f21abef2640 1 -- 172.21.15.59:0/3556400678 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a41f0fa0 con 0x7f21a415a830 2023-10-16T14:26:19.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.745+0000 7f219a7fc640 1 -- 172.21.15.59:0/3556400678 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c00a850 con 0x7f21a415a830 2023-10-16T14:26:19.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.745+0000 7f21abef2640 1 -- 172.21.15.59:0/3556400678 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a415b1d0 con 0x7f21a415a830 2023-10-16T14:26:19.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.746+0000 7f21abef2640 1 -- 172.21.15.59:0/3556400678 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a41f14c0 con 0x7f21a415a830 2023-10-16T14:26:19.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.747+0000 7f219a7fc640 1 -- 172.21.15.59:0/3556400678 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f219c00a9b0 con 0x7f21a415a830 2023-10-16T14:26:19.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.748+0000 7f219a7fc640 1 --2- 172.21.15.59:0/3556400678 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f218806ae70 0x7f218806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:19.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.748+0000 7f219a7fc640 1 -- 172.21.15.59:0/3556400678 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f219c089b60 con 0x7f21a415a830 2023-10-16T14:26:19.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.748+0000 7f21a9c8e640 1 --2- 172.21.15.59:0/3556400678 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f218806ae70 0x7f218806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:19.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.750+0000 7f21a9c8e640 1 --2- 172.21.15.59:0/3556400678 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f218806ae70 0x7f218806d330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f21a0006fd0 tx=0x7f21a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:19.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.752+0000 7f219a7fc640 1 -- 172.21.15.59:0/3556400678 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f21a41f14c0 con 0x7f21a415a830 2023-10-16T14:26:19.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.947+0000 7f21abef2640 1 -- 172.21.15.59:0/3556400678 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21a41f14c0 con 0x7f21a415a830 2023-10-16T14:26:19.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.948+0000 7f219a7fc640 1 -- 172.21.15.59:0/3556400678 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21a41f14c0 con 0x7f21a415a830 2023-10-16T14:26:19.951 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:26:19.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.950+0000 7f21abef2640 1 -- 172.21.15.59:0/3556400678 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f218806ae70 msgr2=0x7f218806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:19.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.950+0000 7f21abef2640 1 --2- 172.21.15.59:0/3556400678 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f218806ae70 0x7f218806d330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f21a0006fd0 tx=0x7f21a0008040 comp rx=0 tx=0).stop 2023-10-16T14:26:19.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.950+0000 7f21abef2640 1 -- 172.21.15.59:0/3556400678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21a415a830 msgr2=0x7f21a415d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:19.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.950+0000 7f21abef2640 1 --2- 172.21.15.59:0/3556400678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21a415a830 0x7f21a415d530 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f219c00c780 tx=0x7f219c00cc40 comp rx=0 tx=0).stop 2023-10-16T14:26:19.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.950+0000 7f21abef2640 1 -- 172.21.15.59:0/3556400678 shutdown_connections 2023-10-16T14:26:19.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.950+0000 7f21abef2640 1 --2- 172.21.15.59:0/3556400678 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f218806ae70 0x7f218806d330 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.950+0000 7f21abef2640 1 --2- 172.21.15.59:0/3556400678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21a415a830 0x7f21a415d530 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.950+0000 7f21abef2640 1 --2- 172.21.15.59:0/3556400678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21a40ca550 0x7f21a415cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.950+0000 7f21abef2640 1 --2- 172.21.15.59:0/3556400678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21a4070860 0x7f21a415ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:19.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.950+0000 7f21abef2640 1 -- 172.21.15.59:0/3556400678 >> 172.21.15.59:0/3556400678 conn(0x7f21a40b0030 msgr2=0x7f21a40adfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:19.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.951+0000 7f21abef2640 1 -- 172.21.15.59:0/3556400678 shutdown_connections 2023-10-16T14:26:19.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:19.951+0000 7f21abef2640 1 -- 172.21.15.59:0/3556400678 wait complete. 2023-10-16T14:26:19.973 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T14:26:20.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.201+0000 7f5fced39640 1 Processor -- start 2023-10-16T14:26:20.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.201+0000 7f5fced39640 1 -- start start 2023-10-16T14:26:20.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.202+0000 7f5fced39640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5fc815a830 0x7f5fc80cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:20.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.202+0000 7f5fced39640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc8070a30 0x7f5fc80c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:20.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.202+0000 7f5fced39640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc80cf040 con 0x7f5fc80ca550 2023-10-16T14:26:20.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.202+0000 7f5fced39640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc80ca9e0 con 0x7f5fc815a830 2023-10-16T14:26:20.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.202+0000 7f5fced39640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc80ce430 con 0x7f5fc8070a30 2023-10-16T14:26:20.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.203+0000 7f5fccad5640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5fc815a830 0x7f5fc80cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:20.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.203+0000 7f5fccad5640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5fc815a830 0x7f5fc80cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42166/0 (socket says 172.21.15.59:42166) 2023-10-16T14:26:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.203+0000 7f5fccad5640 1 -- 172.21.15.59:0/1089878871 learned_addr learned my addr 172.21.15.59:0/1089878871 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:20.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.203+0000 7f5fcd2d6640 1 --2- 172.21.15.59:0/1089878871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc8070a30 0x7f5fc80c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:20.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.203+0000 7f5fccad5640 1 -- 172.21.15.59:0/1089878871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc8070a30 msgr2=0x7f5fc80c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:20.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.203+0000 7f5fccad5640 1 --2- 172.21.15.59:0/1089878871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc8070a30 0x7f5fc80c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.203+0000 7f5fccad5640 1 -- 172.21.15.59:0/1089878871 >> v1:172.21.15.59:6789/0 conn(0x7f5fc80ca550 legacy=0x7f5fc8070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:20.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.203+0000 7f5fccad5640 1 -- 172.21.15.59:0/1089878871 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc80ce710 con 0x7f5fc815a830 2023-10-16T14:26:20.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.203+0000 7f5fc77fe640 1 -- 172.21.15.59:0/1089878871 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1961774062 0 0) 0x7f5fc80cf040 con 0x7f5fc80ca550 2023-10-16T14:26:20.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.205+0000 7f5fccad5640 1 --2- 172.21.15.59:0/1089878871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fc815a830 0x7f5fc80cb640 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8009e50 tx=0x7f5fb802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac8b711d3b6400d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:20.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.205+0000 7f5fc77fe640 1 -- 172.21.15.59:0/1089878871 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb802cb00 con 0x7f5fc815a830 2023-10-16T14:26:20.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.205+0000 7f5fc77fe640 1 -- 172.21.15.59:0/1089878871 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb802cc60 con 0x7f5fc815a830 2023-10-16T14:26:20.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.205+0000 7f5fc77fe640 1 -- 172.21.15.59:0/1089878871 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb80343f0 con 0x7f5fc815a830 2023-10-16T14:26:20.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.206+0000 7f5fced39640 1 -- 172.21.15.59:0/1089878871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fc815a830 msgr2=0x7f5fc80cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:20.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.206+0000 7f5fced39640 1 --2- 172.21.15.59:0/1089878871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fc815a830 0x7f5fc80cb640 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8009e50 tx=0x7f5fb802bf60 comp rx=0 tx=0).stop 2023-10-16T14:26:20.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.206+0000 7f5fced39640 1 -- 172.21.15.59:0/1089878871 shutdown_connections 2023-10-16T14:26:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.206+0000 7f5fced39640 1 --2- 172.21.15.59:0/1089878871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc8070a30 0x7f5fc80c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.206+0000 7f5fced39640 1 --2- 172.21.15.59:0/1089878871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fc815a830 0x7f5fc80cb640 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.206+0000 7f5fced39640 1 -- 172.21.15.59:0/1089878871 >> 172.21.15.59:0/1089878871 conn(0x7f5fc80b0030 msgr2=0x7f5fc80b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.206+0000 7f5fced39640 1 -- 172.21.15.59:0/1089878871 shutdown_connections 2023-10-16T14:26:20.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.206+0000 7f5fced39640 1 -- 172.21.15.59:0/1089878871 wait complete. 2023-10-16T14:26:20.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.207+0000 7f5fced39640 1 Processor -- start 2023-10-16T14:26:20.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.208+0000 7f5fced39640 1 -- start start 2023-10-16T14:26:20.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.209+0000 7f5fced39640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fc8070a30 0x7f5fc81523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:20.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.209+0000 7f5fced39640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc80ca550 0x7f5fc8153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:20.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.209+0000 7f5fced39640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fc815a830 0x7f5fc8153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:20.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.209+0000 7f5fced39640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc80c3a90 con 0x7f5fc8070a30 2023-10-16T14:26:20.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.209+0000 7f5fced39640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc80c3d70 con 0x7f5fc815a830 2023-10-16T14:26:20.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.209+0000 7f5fced39640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc80c4050 con 0x7f5fc80ca550 2023-10-16T14:26:20.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.209+0000 7f5fccad5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fc8070a30 0x7f5fc81523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:20.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.209+0000 7f5fccad5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fc8070a30 0x7f5fc81523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42176/0 (socket says 172.21.15.59:42176) 2023-10-16T14:26:20.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.209+0000 7f5fccad5640 1 -- 172.21.15.59:0/2022676457 learned_addr learned my addr 172.21.15.59:0/2022676457 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:20.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.209+0000 7f5fcd2d6640 1 --2- 172.21.15.59:0/2022676457 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fc815a830 0x7f5fc8153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:20.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.209+0000 7f5fc7fff640 1 --2- 172.21.15.59:0/2022676457 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc80ca550 0x7f5fc8153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:20.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.209+0000 7f5fccad5640 1 -- 172.21.15.59:0/2022676457 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc80ca550 msgr2=0x7f5fc8153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:20.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.209+0000 7f5fccad5640 1 --2- 172.21.15.59:0/2022676457 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc80ca550 0x7f5fc8153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.209+0000 7f5fccad5640 1 -- 172.21.15.59:0/2022676457 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fc815a830 msgr2=0x7f5fc8153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:20.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.209+0000 7f5fccad5640 1 --2- 172.21.15.59:0/2022676457 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fc815a830 0x7f5fc8153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.210+0000 7f5fccad5640 1 -- 172.21.15.59:0/2022676457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb8009b30 con 0x7f5fc8070a30 2023-10-16T14:26:20.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.210+0000 7f5fccad5640 1 --2- 172.21.15.59:0/2022676457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fc8070a30 0x7f5fc81523c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8000f80 tx=0x7f5fb8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:20.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.210+0000 7f5fc57fa640 1 -- 172.21.15.59:0/2022676457 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8009510 con 0x7f5fc8070a30 2023-10-16T14:26:20.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.210+0000 7f5fc57fa640 1 -- 172.21.15.59:0/2022676457 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb803e450 con 0x7f5fc8070a30 2023-10-16T14:26:20.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.210+0000 7f5fc57fa640 1 -- 172.21.15.59:0/2022676457 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb803e800 con 0x7f5fc8070a30 2023-10-16T14:26:20.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.210+0000 7f5fced39640 1 -- 172.21.15.59:0/2022676457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc80c4330 con 0x7f5fc8070a30 2023-10-16T14:26:20.219 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.210+0000 7f5fced39640 1 -- 172.21.15.59:0/2022676457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc80c48f0 con 0x7f5fc8070a30 2023-10-16T14:26:20.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.212+0000 7f5fced39640 1 -- 172.21.15.59:0/2022676457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc8073ef0 con 0x7f5fc8070a30 2023-10-16T14:26:20.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.213+0000 7f5fc57fa640 1 -- 172.21.15.59:0/2022676457 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5fb803e960 con 0x7f5fc8070a30 2023-10-16T14:26:20.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.214+0000 7f5fc57fa640 1 --2- 172.21.15.59:0/2022676457 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f5fb406ae70 0x7f5fb406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:20.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.214+0000 7f5fc57fa640 1 -- 172.21.15.59:0/2022676457 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5fb80ac6c0 con 0x7f5fc8070a30 2023-10-16T14:26:20.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.215+0000 7f5fc7fff640 1 --2- 172.21.15.59:0/2022676457 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f5fb406ae70 0x7f5fb406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:20.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.216+0000 7f5fc7fff640 1 --2- 172.21.15.59:0/2022676457 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f5fb406ae70 0x7f5fb406d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5fc80c8e50 tx=0x7f5fbc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:20.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.219+0000 7f5fc57fa640 1 -- 172.21.15.59:0/2022676457 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5fb8077470 con 0x7f5fc8070a30 2023-10-16T14:26:20.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.414+0000 7f5fced39640 1 -- 172.21.15.59:0/2022676457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5fc80c1c60 con 0x7f5fc8070a30 2023-10-16T14:26:20.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.415+0000 7f5fc57fa640 1 -- 172.21.15.59:0/2022676457 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5fb807aa90 con 0x7f5fc8070a30 2023-10-16T14:26:20.418 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:20.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.417+0000 7f5fced39640 1 -- 172.21.15.59:0/2022676457 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f5fb406ae70 msgr2=0x7f5fb406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:20.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.417+0000 7f5fced39640 1 --2- 172.21.15.59:0/2022676457 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f5fb406ae70 0x7f5fb406d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5fc80c8e50 tx=0x7f5fbc009040 comp rx=0 tx=0).stop 2023-10-16T14:26:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.417+0000 7f5fced39640 1 -- 172.21.15.59:0/2022676457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fc8070a30 msgr2=0x7f5fc81523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.417+0000 7f5fced39640 1 --2- 172.21.15.59:0/2022676457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fc8070a30 0x7f5fc81523c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8000f80 tx=0x7f5fb8004a40 comp rx=0 tx=0).stop 2023-10-16T14:26:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.417+0000 7f5fced39640 1 -- 172.21.15.59:0/2022676457 shutdown_connections 2023-10-16T14:26:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.417+0000 7f5fced39640 1 --2- 172.21.15.59:0/2022676457 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f5fb406ae70 0x7f5fb406d330 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.417+0000 7f5fced39640 1 --2- 172.21.15.59:0/2022676457 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fc815a830 0x7f5fc8153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.417+0000 7f5fced39640 1 --2- 172.21.15.59:0/2022676457 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc80ca550 0x7f5fc8153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.417+0000 7f5fced39640 1 --2- 172.21.15.59:0/2022676457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fc8070a30 0x7f5fc81523c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.417+0000 7f5fced39640 1 -- 172.21.15.59:0/2022676457 >> 172.21.15.59:0/2022676457 conn(0x7f5fc80b0030 msgr2=0x7f5fc80b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.418+0000 7f5fced39640 1 -- 172.21.15.59:0/2022676457 shutdown_connections 2023-10-16T14:26:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.418+0000 7f5fced39640 1 -- 172.21.15.59:0/2022676457 wait complete. 2023-10-16T14:26:20.442 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T14:26:20.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.658+0000 7f97effff640 1 Processor -- start 2023-10-16T14:26:20.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.658+0000 7f97effff640 1 -- start start 2023-10-16T14:26:20.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.660+0000 7f97effff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f97f01609c0 0x7f97f00d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:20.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.660+0000 7f97effff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97f0160da0 0x7f97f00d1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:20.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.660+0000 7f97effff640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f00ce4c0 con 0x7f97f015c530 2023-10-16T14:26:20.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.660+0000 7f97effff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f015d0d0 con 0x7f97f01609c0 2023-10-16T14:26:20.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.660+0000 7f97effff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00cd8b0 con 0x7f97f0160da0 2023-10-16T14:26:20.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.660+0000 7f97ef7fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f97f015c530 0x7f97f015c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45780/0 (socket says 172.21.15.59:45780) 2023-10-16T14:26:20.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.660+0000 7f97ef7fe640 1 -- 172.21.15.59:0/2879709531 learned_addr learned my addr 172.21.15.59:0/2879709531 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.660+0000 7f97eeffd640 1 --2- 172.21.15.59:0/2879709531 >> v2:172.21.15.151:3300/0 conn(0x7f97f01609c0 0x7f97f00d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:20.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.660+0000 7f97ee7fc640 1 --2- 172.21.15.59:0/2879709531 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97f0160da0 0x7f97f00d1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:20.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.661+0000 7f97edffb640 1 -- 172.21.15.59:0/2879709531 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436102807 0 0) 0x7f97f00ce4c0 con 0x7f97f015c530 2023-10-16T14:26:20.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.661+0000 7f97edffb640 1 -- 172.21.15.59:0/2879709531 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97dc003520 con 0x7f97f015c530 2023-10-16T14:26:20.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.661+0000 7f97edffb640 1 -- 172.21.15.59:0/2879709531 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1271893034 0 0) 0x7f97dc003520 con 0x7f97f015c530 2023-10-16T14:26:20.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.661+0000 7f97edffb640 1 -- 172.21.15.59:0/2879709531 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97f0160da0 msgr2=0x7f97f00d1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:20.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.661+0000 7f97edffb640 1 --2- 172.21.15.59:0/2879709531 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97f0160da0 0x7f97f00d1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.661+0000 7f97edffb640 1 -- 172.21.15.59:0/2879709531 >> v2:172.21.15.151:3300/0 conn(0x7f97f01609c0 msgr2=0x7f97f00d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:20.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.661+0000 7f97edffb640 1 --2- 172.21.15.59:0/2879709531 >> v2:172.21.15.151:3300/0 conn(0x7f97f01609c0 0x7f97f00d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.661+0000 7f97edffb640 1 -- 172.21.15.59:0/2879709531 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f00cdb90 con 0x7f97f015c530 2023-10-16T14:26:20.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.661+0000 7f97edffb640 1 -- 172.21.15.59:0/2879709531 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f97e8001670 con 0x7f97f015c530 2023-10-16T14:26:20.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.661+0000 7f97edffb640 1 -- 172.21.15.59:0/2879709531 >> v1:172.21.15.59:6789/0 conn(0x7f97f015c530 legacy=0x7f97f015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:20.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.661+0000 7f97edffb640 1 --2- 172.21.15.59:0/2879709531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97dc0039e0 0x7f97dc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:20.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.661+0000 7f97edffb640 1 --2- 172.21.15.59:0/2879709531 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97f0160da0 0x7f97dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.661+0000 7f97edffb640 1 --2- 172.21.15.59:0/2879709531 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97dc004d00 0x7f97dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.661+0000 7f97edffb640 1 -- 172.21.15.59:0/2879709531 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f015d0d0 con 0x7f97dc0039e0 2023-10-16T14:26:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.661+0000 7f97edffb640 1 -- 172.21.15.59:0/2879709531 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00cd8b0 con 0x7f97dc004d00 2023-10-16T14:26:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.661+0000 7f97edffb640 1 -- 172.21.15.59:0/2879709531 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc00b980 con 0x7f97f0160da0 2023-10-16T14:26:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.662+0000 7f97eeffd640 1 --2- 172.21.15.59:0/2879709531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97dc0039e0 0x7f97dc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.662+0000 7f97ee7fc640 1 --2- 172.21.15.59:0/2879709531 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97f0160da0 0x7f97dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.662+0000 7f97ef7fe640 1 --2- 172.21.15.59:0/2879709531 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97dc004d00 0x7f97dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.662+0000 7f97eeffd640 1 -- 172.21.15.59:0/2879709531 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97f0160da0 msgr2=0x7f97dc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.662+0000 7f97eeffd640 1 --2- 172.21.15.59:0/2879709531 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97f0160da0 0x7f97dc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.662+0000 7f97eeffd640 1 -- 172.21.15.59:0/2879709531 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97dc004d00 msgr2=0x7f97dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.662+0000 7f97eeffd640 1 --2- 172.21.15.59:0/2879709531 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97dc004d00 0x7f97dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.662+0000 7f97eeffd640 1 -- 172.21.15.59:0/2879709531 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc003520 con 0x7f97dc0039e0 2023-10-16T14:26:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.662+0000 7f97ef7fe640 1 --2- 172.21.15.59:0/2879709531 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97dc004d00 0x7f97dc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.663+0000 7f97eeffd640 1 --2- 172.21.15.59:0/2879709531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97dc0039e0 0x7f97dc003e00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f97e000e170 tx=0x7f97dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c744adcb3ecc7a91 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.663+0000 7f97edffb640 1 -- 172.21.15.59:0/2879709531 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e002cca0 con 0x7f97dc0039e0 2023-10-16T14:26:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.663+0000 7f97edffb640 1 -- 172.21.15.59:0/2879709531 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e000f040 con 0x7f97dc0039e0 2023-10-16T14:26:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.663+0000 7f97edffb640 1 -- 172.21.15.59:0/2879709531 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e0034440 con 0x7f97dc0039e0 2023-10-16T14:26:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.664+0000 7f97effff640 1 -- 172.21.15.59:0/2879709531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97dc0039e0 msgr2=0x7f97dc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.664+0000 7f97effff640 1 --2- 172.21.15.59:0/2879709531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97dc0039e0 0x7f97dc003e00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f97e000e170 tx=0x7f97dc0057f0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.664+0000 7f97ef7fe640 1 -- 172.21.15.59:0/2879709531 reap_dead start 2023-10-16T14:26:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.664+0000 7f97effff640 1 -- 172.21.15.59:0/2879709531 shutdown_connections 2023-10-16T14:26:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.664+0000 7f97effff640 1 -- 172.21.15.59:0/2879709531 >> 172.21.15.59:0/2879709531 conn(0x7f97f009bbf0 msgr2=0x7f97f00d28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.664+0000 7f97effff640 1 -- 172.21.15.59:0/2879709531 shutdown_connections 2023-10-16T14:26:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.664+0000 7f97effff640 1 -- 172.21.15.59:0/2879709531 wait complete. 2023-10-16T14:26:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.666+0000 7f97effff640 1 Processor -- start 2023-10-16T14:26:20.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.666+0000 7f97effff640 1 -- start start 2023-10-16T14:26:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.667+0000 7f97effff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97dc0039e0 0x7f97f01f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.667+0000 7f97effff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f01f2040 0x7f97f00c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.667+0000 7f97effff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97f00c9ef0 0x7f97f014d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.667+0000 7f97effff640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00a05e0 con 0x7f97f01f2040 2023-10-16T14:26:20.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.667+0000 7f97effff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f014e3e0 con 0x7f97f00c9ef0 2023-10-16T14:26:20.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.667+0000 7f97effff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f014e6c0 con 0x7f97dc0039e0 2023-10-16T14:26:20.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.667+0000 7f97ee7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f01f2040 0x7f97f00c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:20.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.667+0000 7f97ee7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f01f2040 0x7f97f00c99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42202/0 (socket says 172.21.15.59:42202) 2023-10-16T14:26:20.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.667+0000 7f97ee7fc640 1 -- 172.21.15.59:0/4101002000 learned_addr learned my addr 172.21.15.59:0/4101002000 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:20.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.668+0000 7f97ef7fe640 1 --2- 172.21.15.59:0/4101002000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97f00c9ef0 0x7f97f014d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:20.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.668+0000 7f97ee7fc640 1 -- 172.21.15.59:0/4101002000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97dc0039e0 msgr2=0x7f97f01f1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:20.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.668+0000 7f97eeffd640 1 --2- 172.21.15.59:0/4101002000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97dc0039e0 0x7f97f01f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:20.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.668+0000 7f97ee7fc640 1 --2- 172.21.15.59:0/4101002000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97dc0039e0 0x7f97f01f1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.668+0000 7f97ee7fc640 1 -- 172.21.15.59:0/4101002000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97f00c9ef0 msgr2=0x7f97f014d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.668+0000 7f97ee7fc640 1 --2- 172.21.15.59:0/4101002000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97f00c9ef0 0x7f97f014d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.668+0000 7f97ee7fc640 1 -- 172.21.15.59:0/4101002000 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f014e9a0 con 0x7f97f01f2040 2023-10-16T14:26:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.668+0000 7f97ef7fe640 1 --2- 172.21.15.59:0/4101002000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97f00c9ef0 0x7f97f014d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.668+0000 7f97ee7fc640 1 --2- 172.21.15.59:0/4101002000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f01f2040 0x7f97f00c99b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f97d8011600 tx=0x7f97d8011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.668+0000 7f97e77fe640 1 -- 172.21.15.59:0/4101002000 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d800f920 con 0x7f97f01f2040 2023-10-16T14:26:20.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.668+0000 7f97e77fe640 1 -- 172.21.15.59:0/4101002000 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d800fa80 con 0x7f97f01f2040 2023-10-16T14:26:20.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.668+0000 7f97e77fe640 1 -- 172.21.15.59:0/4101002000 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d800fdf0 con 0x7f97f01f2040 2023-10-16T14:26:20.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.668+0000 7f97effff640 1 -- 172.21.15.59:0/4101002000 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f014ec80 con 0x7f97f01f2040 2023-10-16T14:26:20.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.669+0000 7f97effff640 1 -- 172.21.15.59:0/4101002000 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f01506d0 con 0x7f97f01f2040 2023-10-16T14:26:20.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.670+0000 7f97effff640 1 -- 172.21.15.59:0/4101002000 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f004e9b0 con 0x7f97f01f2040 2023-10-16T14:26:20.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.671+0000 7f97e77fe640 1 -- 172.21.15.59:0/4101002000 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f97d8015460 con 0x7f97f01f2040 2023-10-16T14:26:20.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.672+0000 7f97e77fe640 1 --2- 172.21.15.59:0/4101002000 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f97d006ae70 0x7f97d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:20.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.672+0000 7f97e77fe640 1 -- 172.21.15.59:0/4101002000 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f97d8089de0 con 0x7f97f01f2040 2023-10-16T14:26:20.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.673+0000 7f97eeffd640 1 --2- 172.21.15.59:0/4101002000 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f97d006ae70 0x7f97d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:20.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.674+0000 7f97eeffd640 1 --2- 172.21.15.59:0/4101002000 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f97d006ae70 0x7f97d006d330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f97e0036000 tx=0x7f97e002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:20.688 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.676+0000 7f97e77fe640 1 -- 172.21.15.59:0/4101002000 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f97d8054ba0 con 0x7f97f01f2040 2023-10-16T14:26:20.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.874+0000 7f97effff640 1 -- 172.21.15.59:0/4101002000 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97f00ccc00 con 0x7f97f01f2040 2023-10-16T14:26:20.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.875+0000 7f97e77fe640 1 -- 172.21.15.59:0/4101002000 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f97d80220a0 con 0x7f97f01f2040 2023-10-16T14:26:20.878 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-16T14:26:20.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.877+0000 7f97effff640 1 -- 172.21.15.59:0/4101002000 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f97d006ae70 msgr2=0x7f97d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:20.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.877+0000 7f97effff640 1 --2- 172.21.15.59:0/4101002000 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f97d006ae70 0x7f97d006d330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f97e0036000 tx=0x7f97e002e000 comp rx=0 tx=0).stop 2023-10-16T14:26:20.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.877+0000 7f97effff640 1 -- 172.21.15.59:0/4101002000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f01f2040 msgr2=0x7f97f00c99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:20.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.877+0000 7f97effff640 1 --2- 172.21.15.59:0/4101002000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f01f2040 0x7f97f00c99b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f97d8011600 tx=0x7f97d8011ac0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.878+0000 7f97effff640 1 -- 172.21.15.59:0/4101002000 shutdown_connections 2023-10-16T14:26:20.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.878+0000 7f97effff640 1 --2- 172.21.15.59:0/4101002000 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f97d006ae70 0x7f97d006d330 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.878+0000 7f97effff640 1 --2- 172.21.15.59:0/4101002000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97f00c9ef0 0x7f97f014d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.878+0000 7f97effff640 1 --2- 172.21.15.59:0/4101002000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f01f2040 0x7f97f00c99b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.878+0000 7f97effff640 1 --2- 172.21.15.59:0/4101002000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97dc0039e0 0x7f97f01f1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:20.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.878+0000 7f97effff640 1 -- 172.21.15.59:0/4101002000 >> 172.21.15.59:0/4101002000 conn(0x7f97f009bbf0 msgr2=0x7f97f00b71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:20.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.878+0000 7f97effff640 1 -- 172.21.15.59:0/4101002000 shutdown_connections 2023-10-16T14:26:20.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:20.878+0000 7f97effff640 1 -- 172.21.15.59:0/4101002000 wait complete. 2023-10-16T14:26:20.899 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T14:26:21.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.108+0000 7f3caa96e640 1 Processor -- start 2023-10-16T14:26:21.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.108+0000 7f3caa96e640 1 -- start start 2023-10-16T14:26:21.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.109+0000 7f3caa96e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3ca406c010 0x7f3ca40cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:21.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.110+0000 7f3caa96e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca40ce020 con 0x7f3ca415ccf0 2023-10-16T14:26:21.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.110+0000 7f3caa96e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca40af620 con 0x7f3ca406b100 2023-10-16T14:26:21.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.110+0000 7f3caa96e640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca40cec10 con 0x7f3ca406c010 2023-10-16T14:26:21.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.110+0000 7f3ca996c640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3ca415ccf0 0x7f3ca406b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45784/0 (socket says 172.21.15.59:45784) 2023-10-16T14:26:21.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.110+0000 7f3ca996c640 1 -- 172.21.15.59:0/1633435436 learned_addr learned my addr 172.21.15.59:0/1633435436 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:21.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.110+0000 7f3ca916b640 1 --2- 172.21.15.59:0/1633435436 >> v2:172.21.15.59:3300/0 conn(0x7f3ca406c010 0x7f3ca40cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:21.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.111+0000 7f3ca916b640 1 -- 172.21.15.59:0/1633435436 >> v1:172.21.15.151:6789/0 conn(0x7f3ca406b100 legacy=0x7f3ca40cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:21.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.111+0000 7f3ca916b640 1 -- 172.21.15.59:0/1633435436 >> v1:172.21.15.59:6789/0 conn(0x7f3ca415ccf0 legacy=0x7f3ca406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:21.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.111+0000 7f3ca916b640 1 -- 172.21.15.59:0/1633435436 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca40ceef0 con 0x7f3ca406c010 2023-10-16T14:26:21.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.112+0000 7f3ca916b640 1 --2- 172.21.15.59:0/1633435436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ca406c010 0x7f3ca40cf9d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3c940097a0 tx=0x7f3c9402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a012a365cf02dd39 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:21.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.112+0000 7f3ca896a640 1 -- 172.21.15.59:0/1633435436 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94030610 con 0x7f3ca406c010 2023-10-16T14:26:21.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.112+0000 7f3ca896a640 1 -- 172.21.15.59:0/1633435436 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c94030770 con 0x7f3ca406c010 2023-10-16T14:26:21.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.112+0000 7f3ca896a640 1 -- 172.21.15.59:0/1633435436 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94030b00 con 0x7f3ca406c010 2023-10-16T14:26:21.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.113+0000 7f3caa96e640 1 -- 172.21.15.59:0/1633435436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ca406c010 msgr2=0x7f3ca40cf9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:21.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.113+0000 7f3caa96e640 1 --2- 172.21.15.59:0/1633435436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ca406c010 0x7f3ca40cf9d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3c940097a0 tx=0x7f3c9402b960 comp rx=0 tx=0).stop 2023-10-16T14:26:21.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.113+0000 7f3caa96e640 1 -- 172.21.15.59:0/1633435436 shutdown_connections 2023-10-16T14:26:21.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.113+0000 7f3caa96e640 1 --2- 172.21.15.59:0/1633435436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ca406c010 0x7f3ca40cf9d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:21.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.113+0000 7f3caa96e640 1 -- 172.21.15.59:0/1633435436 >> 172.21.15.59:0/1633435436 conn(0x7f3ca40d0700 msgr2=0x7f3ca40d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:21.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.113+0000 7f3caa96e640 1 -- 172.21.15.59:0/1633435436 shutdown_connections 2023-10-16T14:26:21.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.113+0000 7f3caa96e640 1 -- 172.21.15.59:0/1633435436 wait complete. 2023-10-16T14:26:21.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.115+0000 7f3caa96e640 1 Processor -- start 2023-10-16T14:26:21.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.115+0000 7f3caa96e640 1 -- start start 2023-10-16T14:26:21.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.117+0000 7f3caa96e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ca406b100 0x7f3ca4159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:21.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.117+0000 7f3caa96e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ca406c010 0x7f3ca406f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:21.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.117+0000 7f3caa96e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ca415ccf0 0x7f3ca406faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:21.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.117+0000 7f3caa96e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca415a0e0 con 0x7f3ca415ccf0 2023-10-16T14:26:21.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.117+0000 7f3caa96e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca40c9e80 con 0x7f3ca406b100 2023-10-16T14:26:21.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.117+0000 7f3caa96e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca40c77d0 con 0x7f3ca406c010 2023-10-16T14:26:21.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.117+0000 7f3caa16d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ca415ccf0 0x7f3ca406faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:21.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.117+0000 7f3caa16d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ca415ccf0 0x7f3ca406faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42220/0 (socket says 172.21.15.59:42220) 2023-10-16T14:26:21.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.117+0000 7f3caa16d640 1 -- 172.21.15.59:0/861548480 learned_addr learned my addr 172.21.15.59:0/861548480 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:21.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.118+0000 7f3ca916b640 1 --2- 172.21.15.59:0/861548480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ca406c010 0x7f3ca406f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:21.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.118+0000 7f3ca996c640 1 --2- 172.21.15.59:0/861548480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ca406b100 0x7f3ca4159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:21.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.118+0000 7f3caa16d640 1 -- 172.21.15.59:0/861548480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ca406c010 msgr2=0x7f3ca406f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:21.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.118+0000 7f3caa16d640 1 --2- 172.21.15.59:0/861548480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ca406c010 0x7f3ca406f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:21.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.118+0000 7f3caa16d640 1 -- 172.21.15.59:0/861548480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ca406b100 msgr2=0x7f3ca4159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:21.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.118+0000 7f3caa16d640 1 --2- 172.21.15.59:0/861548480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ca406b100 0x7f3ca4159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:21.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.118+0000 7f3caa16d640 1 -- 172.21.15.59:0/861548480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c94009400 con 0x7f3ca415ccf0 2023-10-16T14:26:21.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.118+0000 7f3caa16d640 1 --2- 172.21.15.59:0/861548480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ca415ccf0 0x7f3ca406faf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00b970 tx=0x7f3c9c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:21.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.118+0000 7f3c9a7fc640 1 -- 172.21.15.59:0/861548480 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c00cb40 con 0x7f3ca415ccf0 2023-10-16T14:26:21.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.118+0000 7f3c9a7fc640 1 -- 172.21.15.59:0/861548480 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c00cca0 con 0x7f3ca415ccf0 2023-10-16T14:26:21.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.118+0000 7f3c9a7fc640 1 -- 172.21.15.59:0/861548480 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c014680 con 0x7f3ca415ccf0 2023-10-16T14:26:21.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.118+0000 7f3caa96e640 1 -- 172.21.15.59:0/861548480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca40c7ab0 con 0x7f3ca415ccf0 2023-10-16T14:26:21.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.119+0000 7f3caa96e640 1 -- 172.21.15.59:0/861548480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca40c8070 con 0x7f3ca415ccf0 2023-10-16T14:26:21.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.120+0000 7f3caa96e640 1 -- 172.21.15.59:0/861548480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca40c8260 con 0x7f3ca415ccf0 2023-10-16T14:26:21.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.121+0000 7f3c9a7fc640 1 -- 172.21.15.59:0/861548480 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3c9c01d3b0 con 0x7f3ca415ccf0 2023-10-16T14:26:21.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.121+0000 7f3c9a7fc640 1 --2- 172.21.15.59:0/861548480 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f3c8806ae70 0x7f3c8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:21.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.122+0000 7f3c9a7fc640 1 -- 172.21.15.59:0/861548480 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3c9c089730 con 0x7f3ca415ccf0 2023-10-16T14:26:21.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.122+0000 7f3ca996c640 1 --2- 172.21.15.59:0/861548480 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f3c8806ae70 0x7f3c8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:21.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.123+0000 7f3ca996c640 1 --2- 172.21.15.59:0/861548480 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f3c8806ae70 0x7f3c8806d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0005880 tx=0x7f3ca0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:21.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.126+0000 7f3c9a7fc640 1 -- 172.21.15.59:0/861548480 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3c9c0544f0 con 0x7f3ca415ccf0 2023-10-16T14:26:21.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.311+0000 7f3caa96e640 1 -- 172.21.15.59:0/861548480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3ca404e9b0 con 0x7f3ca415ccf0 2023-10-16T14:26:21.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.312+0000 7f3c9a7fc640 1 -- 172.21.15.59:0/861548480 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3c9c057b10 con 0x7f3ca415ccf0 2023-10-16T14:26:21.315 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:21.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.314+0000 7f3caa96e640 1 -- 172.21.15.59:0/861548480 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f3c8806ae70 msgr2=0x7f3c8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:21.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.314+0000 7f3caa96e640 1 --2- 172.21.15.59:0/861548480 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f3c8806ae70 0x7f3c8806d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0005880 tx=0x7f3ca0009040 comp rx=0 tx=0).stop 2023-10-16T14:26:21.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.314+0000 7f3caa96e640 1 -- 172.21.15.59:0/861548480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ca415ccf0 msgr2=0x7f3ca406faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:21.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.314+0000 7f3caa96e640 1 --2- 172.21.15.59:0/861548480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ca415ccf0 0x7f3ca406faf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00b970 tx=0x7f3c9c00be30 comp rx=0 tx=0).stop 2023-10-16T14:26:21.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.314+0000 7f3caa96e640 1 -- 172.21.15.59:0/861548480 shutdown_connections 2023-10-16T14:26:21.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.314+0000 7f3caa96e640 1 --2- 172.21.15.59:0/861548480 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f3c8806ae70 0x7f3c8806d330 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:21.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.314+0000 7f3caa96e640 1 --2- 172.21.15.59:0/861548480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ca415ccf0 0x7f3ca406faf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:21.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.314+0000 7f3caa96e640 1 --2- 172.21.15.59:0/861548480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ca406c010 0x7f3ca406f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:21.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.314+0000 7f3caa96e640 1 --2- 172.21.15.59:0/861548480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ca406b100 0x7f3ca4159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:21.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.314+0000 7f3caa96e640 1 -- 172.21.15.59:0/861548480 >> 172.21.15.59:0/861548480 conn(0x7f3ca40d0700 msgr2=0x7f3ca406b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:21.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.315+0000 7f3caa96e640 1 -- 172.21.15.59:0/861548480 shutdown_connections 2023-10-16T14:26:21.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.315+0000 7f3caa96e640 1 -- 172.21.15.59:0/861548480 wait complete. 2023-10-16T14:26:21.336 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T14:26:21.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.555+0000 7fb515afc640 1 Processor -- start 2023-10-16T14:26:21.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.555+0000 7fb515afc640 1 -- start start 2023-10-16T14:26:21.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.556+0000 7fb515afc640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb5100c9e00 0x7fb5100c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:21.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.556+0000 7fb515afc640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb510071c10 con 0x7fb510071800 2023-10-16T14:26:21.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.556+0000 7fb515afc640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb510071e40 con 0x7fb5100ca1e0 2023-10-16T14:26:21.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.556+0000 7fb515afc640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5100cde00 con 0x7fb5100c9e00 2023-10-16T14:26:21.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.557+0000 7fb50ffff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb510071800 0x7fb5100cca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45794/0 (socket says 172.21.15.59:45794) 2023-10-16T14:26:21.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.557+0000 7fb50ffff640 1 -- 172.21.15.59:0/1283891829 learned_addr learned my addr 172.21.15.59:0/1283891829 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:21.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.557+0000 7fb50f7fe640 1 --2- 172.21.15.59:0/1283891829 >> v2:172.21.15.59:3300/0 conn(0x7fb5100c9e00 0x7fb5100c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:21.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.557+0000 7fb50f7fe640 1 -- 172.21.15.59:0/1283891829 >> v1:172.21.15.151:6789/0 conn(0x7fb5100ca1e0 legacy=0x7fb5100710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:21.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.557+0000 7fb50f7fe640 1 -- 172.21.15.59:0/1283891829 >> v1:172.21.15.59:6789/0 conn(0x7fb510071800 legacy=0x7fb5100cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:21.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.557+0000 7fb50e7fc640 1 -- 172.21.15.59:0/1283891829 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085929132 0 0) 0x7fb510071c10 con 0x7fb510071800 2023-10-16T14:26:21.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.557+0000 7fb50f7fe640 1 -- 172.21.15.59:0/1283891829 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb510072120 con 0x7fb5100c9e00 2023-10-16T14:26:21.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.559+0000 7fb50f7fe640 1 --2- 172.21.15.59:0/1283891829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5100c9e00 0x7fb5100c20e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb5000097a0 tx=0x7fb50002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5bdf1663b730956 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:21.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.559+0000 7fb50e7fc640 1 -- 172.21.15.59:0/1283891829 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb500030610 con 0x7fb5100c9e00 2023-10-16T14:26:21.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.559+0000 7fb50e7fc640 1 -- 172.21.15.59:0/1283891829 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb500030770 con 0x7fb5100c9e00 2023-10-16T14:26:21.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.559+0000 7fb50e7fc640 1 -- 172.21.15.59:0/1283891829 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb500030b00 con 0x7fb5100c9e00 2023-10-16T14:26:21.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.559+0000 7fb515afc640 1 -- 172.21.15.59:0/1283891829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5100c9e00 msgr2=0x7fb5100c20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:21.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.559+0000 7fb515afc640 1 --2- 172.21.15.59:0/1283891829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5100c9e00 0x7fb5100c20e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb5000097a0 tx=0x7fb50002b960 comp rx=0 tx=0).stop 2023-10-16T14:26:21.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.560+0000 7fb515afc640 1 -- 172.21.15.59:0/1283891829 shutdown_connections 2023-10-16T14:26:21.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.560+0000 7fb515afc640 1 --2- 172.21.15.59:0/1283891829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5100c9e00 0x7fb5100c20e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:21.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.560+0000 7fb515afc640 1 -- 172.21.15.59:0/1283891829 >> 172.21.15.59:0/1283891829 conn(0x7fb51006c1c0 msgr2=0x7fb51006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:21.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.560+0000 7fb515afc640 1 -- 172.21.15.59:0/1283891829 shutdown_connections 2023-10-16T14:26:21.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.560+0000 7fb515afc640 1 -- 172.21.15.59:0/1283891829 wait complete. 2023-10-16T14:26:21.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.562+0000 7fb515afc640 1 Processor -- start 2023-10-16T14:26:21.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.562+0000 7fb515afc640 1 -- start start 2023-10-16T14:26:21.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.563+0000 7fb515afc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb510071800 0x7fb5101434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:21.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.563+0000 7fb515afc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5100c9e00 0x7fb5100b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:21.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.563+0000 7fb515afc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5100ca1e0 0x7fb5100b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:21.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.563+0000 7fb515afc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5101454d0 con 0x7fb510071800 2023-10-16T14:26:21.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.563+0000 7fb515afc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb510143a10 con 0x7fb5100ca1e0 2023-10-16T14:26:21.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.563+0000 7fb515afc640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5100b40e0 con 0x7fb5100c9e00 2023-10-16T14:26:21.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.563+0000 7fb50f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb510071800 0x7fb5101434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:21.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.563+0000 7fb50f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb510071800 0x7fb5101434d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42232/0 (socket says 172.21.15.59:42232) 2023-10-16T14:26:21.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.563+0000 7fb50f7fe640 1 -- 172.21.15.59:0/2032406626 learned_addr learned my addr 172.21.15.59:0/2032406626 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:21.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.563+0000 7fb50effd640 1 --2- 172.21.15.59:0/2032406626 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5100c9e00 0x7fb5100b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:21.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.563+0000 7fb50ffff640 1 --2- 172.21.15.59:0/2032406626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5100ca1e0 0x7fb5100b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:21.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.564+0000 7fb50f7fe640 1 -- 172.21.15.59:0/2032406626 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5100c9e00 msgr2=0x7fb5100b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:21.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.564+0000 7fb50f7fe640 1 --2- 172.21.15.59:0/2032406626 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5100c9e00 0x7fb5100b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:21.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.564+0000 7fb50f7fe640 1 -- 172.21.15.59:0/2032406626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5100ca1e0 msgr2=0x7fb5100b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:21.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.564+0000 7fb50f7fe640 1 --2- 172.21.15.59:0/2032406626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5100ca1e0 0x7fb5100b0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:21.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.564+0000 7fb50f7fe640 1 -- 172.21.15.59:0/2032406626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb500009400 con 0x7fb510071800 2023-10-16T14:26:21.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.564+0000 7fb50ffff640 1 --2- 172.21.15.59:0/2032406626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5100ca1e0 0x7fb5100b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:21.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.564+0000 7fb50f7fe640 1 --2- 172.21.15.59:0/2032406626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb510071800 0x7fb5101434d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb5000098c0 tx=0x7fb500004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:21.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.564+0000 7fb4f7fff640 1 -- 172.21.15.59:0/2032406626 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50003e040 con 0x7fb510071800 2023-10-16T14:26:21.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.564+0000 7fb4f7fff640 1 -- 172.21.15.59:0/2032406626 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb500039cb0 con 0x7fb510071800 2023-10-16T14:26:21.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.564+0000 7fb4f7fff640 1 -- 172.21.15.59:0/2032406626 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb500044630 con 0x7fb510071800 2023-10-16T14:26:21.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.564+0000 7fb515afc640 1 -- 172.21.15.59:0/2032406626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb510145700 con 0x7fb510071800 2023-10-16T14:26:21.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.565+0000 7fb515afc640 1 -- 172.21.15.59:0/2032406626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5100b2400 con 0x7fb510071800 2023-10-16T14:26:21.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.566+0000 7fb515afc640 1 -- 172.21.15.59:0/2032406626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb510073ef0 con 0x7fb510071800 2023-10-16T14:26:21.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.566+0000 7fb4f7fff640 1 -- 172.21.15.59:0/2032406626 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb500043390 con 0x7fb510071800 2023-10-16T14:26:21.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.567+0000 7fb4f7fff640 1 --2- 172.21.15.59:0/2032406626 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb4fc06ae70 0x7fb4fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:21.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.567+0000 7fb4f7fff640 1 -- 172.21.15.59:0/2032406626 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb5000abda0 con 0x7fb510071800 2023-10-16T14:26:21.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.568+0000 7fb50effd640 1 --2- 172.21.15.59:0/2032406626 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb4fc06ae70 0x7fb4fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:21.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.569+0000 7fb50effd640 1 --2- 172.21.15.59:0/2032406626 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb4fc06ae70 0x7fb4fc06d330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb51006cb60 tx=0x7fb504009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:21.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.572+0000 7fb4f7fff640 1 -- 172.21.15.59:0/2032406626 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb500076ac0 con 0x7fb510071800 2023-10-16T14:26:21.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.809+0000 7fb515afc640 1 -- 172.21.15.59:0/2032406626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5100af820 con 0x7fb510071800 2023-10-16T14:26:21.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.811+0000 7fb4f7fff640 1 -- 172.21.15.59:0/2032406626 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fb500034090 con 0x7fb510071800 2023-10-16T14:26:21.814 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:21.815 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3959035293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3959035293},{"type":"v1","addr":"172.21.15.59:6834","nonce":3959035293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1298271347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1298271347},{"type":"v1","addr":"172.21.15.151:6835","nonce":1298271347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/249904108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":249904108},{"type":"v1","addr":"172.21.15.59:6835","nonce":249904108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T14:25:48.130662+0000","modified":"2023-10-16T14:26:09.157993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6837/4004038733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4004038733},{"type":"v1","addr":"172.21.15.151:6837","nonce":4004038733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T14:26:21.815 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 9 2023-10-16T14:26:21.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.813+0000 7fb515afc640 1 -- 172.21.15.59:0/2032406626 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb4fc06ae70 msgr2=0x7fb4fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:21.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.813+0000 7fb515afc640 1 --2- 172.21.15.59:0/2032406626 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb4fc06ae70 0x7fb4fc06d330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb51006cb60 tx=0x7fb504009040 comp rx=0 tx=0).stop 2023-10-16T14:26:21.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.813+0000 7fb515afc640 1 -- 172.21.15.59:0/2032406626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb510071800 msgr2=0x7fb5101434d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:21.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.813+0000 7fb515afc640 1 --2- 172.21.15.59:0/2032406626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb510071800 0x7fb5101434d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb5000098c0 tx=0x7fb500004730 comp rx=0 tx=0).stop 2023-10-16T14:26:21.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.813+0000 7fb515afc640 1 -- 172.21.15.59:0/2032406626 shutdown_connections 2023-10-16T14:26:21.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.813+0000 7fb515afc640 1 --2- 172.21.15.59:0/2032406626 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb4fc06ae70 0x7fb4fc06d330 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:21.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.813+0000 7fb515afc640 1 --2- 172.21.15.59:0/2032406626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5100ca1e0 0x7fb5100b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:21.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.813+0000 7fb515afc640 1 --2- 172.21.15.59:0/2032406626 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5100c9e00 0x7fb5100b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:21.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.813+0000 7fb515afc640 1 --2- 172.21.15.59:0/2032406626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb510071800 0x7fb5101434d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:21.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.813+0000 7fb515afc640 1 -- 172.21.15.59:0/2032406626 >> 172.21.15.59:0/2032406626 conn(0x7fb51006c1c0 msgr2=0x7fb510072770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:21.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.814+0000 7fb515afc640 1 -- 172.21.15.59:0/2032406626 shutdown_connections 2023-10-16T14:26:21.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:21.814+0000 7fb515afc640 1 -- 172.21.15.59:0/2032406626 wait complete. 2023-10-16T14:26:21.836 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:26:22.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.061+0000 7fd1d3dcc640 1 Processor -- start 2023-10-16T14:26:22.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.061+0000 7fd1d3dcc640 1 -- start start 2023-10-16T14:26:22.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.062+0000 7fd1d3dcc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1cc15ce00 0x7fd1cc0d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:22.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.062+0000 7fd1d3dcc640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd1cc0af960 0x7fd1cc0cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:22.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.062+0000 7fd1d3dcc640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1cc0cd9c0 con 0x7fd1cc0cd560 2023-10-16T14:26:22.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.062+0000 7fd1d3dcc640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1cc0cfee0 con 0x7fd1cc0af960 2023-10-16T14:26:22.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.062+0000 7fd1d3dcc640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0cf680 con 0x7fd1cc15ce00 2023-10-16T14:26:22.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.063+0000 7fd1d1367640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd1cc0af960 0x7fd1cc0cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:22.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.063+0000 7fd1d1367640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd1cc0af960 0x7fd1cc0cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38424/0 (socket says 172.21.15.59:38424) 2023-10-16T14:26:22.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.063+0000 7fd1d1367640 1 -- 172.21.15.59:0/3226174460 learned_addr learned my addr 172.21.15.59:0/3226174460 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:22.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.063+0000 7fd1d1b68640 1 --2- 172.21.15.59:0/3226174460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1cc15ce00 0x7fd1cc0d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:22.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.063+0000 7fd1d0b66640 1 -- 172.21.15.59:0/3226174460 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624243986 0 0) 0x7fd1cc0cd9c0 con 0x7fd1cc0cd560 2023-10-16T14:26:22.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.063+0000 7fd1d0b66640 1 -- 172.21.15.59:0/3226174460 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1b8003520 con 0x7fd1cc0cd560 2023-10-16T14:26:22.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.063+0000 7fd1d1367640 1 -- 172.21.15.59:0/3226174460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1cc15ce00 msgr2=0x7fd1cc0d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:22.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.064+0000 7fd1d1367640 1 --2- 172.21.15.59:0/3226174460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1cc15ce00 0x7fd1cc0d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:22.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.064+0000 7fd1d1367640 1 -- 172.21.15.59:0/3226174460 >> v1:172.21.15.59:6789/0 conn(0x7fd1cc0cd560 legacy=0x7fd1cc06b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:22.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.064+0000 7fd1d1367640 1 -- 172.21.15.59:0/3226174460 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc0cf920 con 0x7fd1cc0af960 2023-10-16T14:26:22.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.065+0000 7fd1d1367640 1 --2- 172.21.15.59:0/3226174460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1cc0af960 0x7fd1cc0cd020 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009870 tx=0x7fd1bc02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106a542fa7d0f6b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:22.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.065+0000 7fd1d0b66640 1 -- 172.21.15.59:0/3226174460 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc031860 con 0x7fd1cc0af960 2023-10-16T14:26:22.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.065+0000 7fd1d0b66640 1 -- 172.21.15.59:0/3226174460 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc0319c0 con 0x7fd1cc0af960 2023-10-16T14:26:22.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.065+0000 7fd1d0b66640 1 -- 172.21.15.59:0/3226174460 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc031d30 con 0x7fd1cc0af960 2023-10-16T14:26:22.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.066+0000 7fd1d3dcc640 1 -- 172.21.15.59:0/3226174460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1cc0af960 msgr2=0x7fd1cc0cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:22.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.066+0000 7fd1d3dcc640 1 --2- 172.21.15.59:0/3226174460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1cc0af960 0x7fd1cc0cd020 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009870 tx=0x7fd1bc02b900 comp rx=0 tx=0).stop 2023-10-16T14:26:22.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.066+0000 7fd1d3dcc640 1 -- 172.21.15.59:0/3226174460 shutdown_connections 2023-10-16T14:26:22.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.066+0000 7fd1d3dcc640 1 --2- 172.21.15.59:0/3226174460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1cc0af960 0x7fd1cc0cd020 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:22.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.066+0000 7fd1d3dcc640 1 --2- 172.21.15.59:0/3226174460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1cc15ce00 0x7fd1cc0d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:22.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.066+0000 7fd1d3dcc640 1 -- 172.21.15.59:0/3226174460 >> 172.21.15.59:0/3226174460 conn(0x7fd1cc0d07a0 msgr2=0x7fd1cc0d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:22.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.066+0000 7fd1d3dcc640 1 -- 172.21.15.59:0/3226174460 shutdown_connections 2023-10-16T14:26:22.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.066+0000 7fd1d3dcc640 1 -- 172.21.15.59:0/3226174460 wait complete. 2023-10-16T14:26:22.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.068+0000 7fd1d3dcc640 1 Processor -- start 2023-10-16T14:26:22.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.068+0000 7fd1d3dcc640 1 -- start start 2023-10-16T14:26:22.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.069+0000 7fd1d3dcc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1cc0af960 0x7fd1cc0c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:22.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.069+0000 7fd1d3dcc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1cc0cd560 0x7fd1cc0c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:22.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.069+0000 7fd1d3dcc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1cc15ce00 0x7fd1cc06f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:22.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.069+0000 7fd1d3dcc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0c7ba0 con 0x7fd1cc0af960 2023-10-16T14:26:22.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.069+0000 7fd1d3dcc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0c7870 con 0x7fd1cc15ce00 2023-10-16T14:26:22.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.069+0000 7fd1d3dcc640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1cc0ca090 con 0x7fd1cc0cd560 2023-10-16T14:26:22.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.069+0000 7fd1d1b68640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1cc0af960 0x7fd1cc0c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:22.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.069+0000 7fd1d1b68640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1cc0af960 0x7fd1cc0c9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38436/0 (socket says 172.21.15.59:38436) 2023-10-16T14:26:22.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.069+0000 7fd1d1b68640 1 -- 172.21.15.59:0/463861154 learned_addr learned my addr 172.21.15.59:0/463861154 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:22.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.070+0000 7fd1d1367640 1 --2- 172.21.15.59:0/463861154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1cc0cd560 0x7fd1cc0c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:22.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.070+0000 7fd1d2369640 1 --2- 172.21.15.59:0/463861154 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1cc15ce00 0x7fd1cc06f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:22.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.070+0000 7fd1d1b68640 1 -- 172.21.15.59:0/463861154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1cc0cd560 msgr2=0x7fd1cc0c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:22.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.070+0000 7fd1d1b68640 1 --2- 172.21.15.59:0/463861154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1cc0cd560 0x7fd1cc0c8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:22.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.070+0000 7fd1d1b68640 1 -- 172.21.15.59:0/463861154 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1cc15ce00 msgr2=0x7fd1cc06f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:22.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.070+0000 7fd1d1b68640 1 --2- 172.21.15.59:0/463861154 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1cc15ce00 0x7fd1cc06f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:22.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.070+0000 7fd1d1b68640 1 -- 172.21.15.59:0/463861154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc0094d0 con 0x7fd1cc0af960 2023-10-16T14:26:22.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.070+0000 7fd1d1b68640 1 --2- 172.21.15.59:0/463861154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1cc0af960 0x7fd1cc0c9a20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd1c800d5f0 tx=0x7fd1c800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:22.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.070+0000 7fd1c27fc640 1 -- 172.21.15.59:0/463861154 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c80125f0 con 0x7fd1cc0af960 2023-10-16T14:26:22.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.070+0000 7fd1c27fc640 1 -- 172.21.15.59:0/463861154 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c8012750 con 0x7fd1cc0af960 2023-10-16T14:26:22.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.070+0000 7fd1c27fc640 1 -- 172.21.15.59:0/463861154 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8012b00 con 0x7fd1cc0af960 2023-10-16T14:26:22.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.070+0000 7fd1d3dcc640 1 -- 172.21.15.59:0/463861154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1cc0ca370 con 0x7fd1cc0af960 2023-10-16T14:26:22.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.070+0000 7fd1d3dcc640 1 -- 172.21.15.59:0/463861154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1cc06fba0 con 0x7fd1cc0af960 2023-10-16T14:26:22.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.072+0000 7fd1d3dcc640 1 -- 172.21.15.59:0/463861154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1cc0c8570 con 0x7fd1cc0af960 2023-10-16T14:26:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.073+0000 7fd1c27fc640 1 -- 172.21.15.59:0/463861154 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd1c8012c60 con 0x7fd1cc0af960 2023-10-16T14:26:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.074+0000 7fd1c27fc640 1 --2- 172.21.15.59:0/463861154 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd1b006aea0 0x7fd1b006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:22.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.074+0000 7fd1c27fc640 1 -- 172.21.15.59:0/463861154 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd1c8089da0 con 0x7fd1cc0af960 2023-10-16T14:26:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.074+0000 7fd1d1367640 1 --2- 172.21.15.59:0/463861154 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd1b006aea0 0x7fd1b006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.075+0000 7fd1d1367640 1 --2- 172.21.15.59:0/463861154 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd1b006aea0 0x7fd1b006d360 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc036000 tx=0x7fd1bc03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:22.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.078+0000 7fd1c27fc640 1 -- 172.21.15.59:0/463861154 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd1c8054b50 con 0x7fd1cc0af960 2023-10-16T14:26:22.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.274+0000 7fd1d3dcc640 1 -- 172.21.15.59:0/463861154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1cc073ef0 con 0x7fd1cc0af960 2023-10-16T14:26:22.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.276+0000 7fd1c27fc640 1 -- 172.21.15.59:0/463861154 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18350 (secure 0 0 0) 0x7fd1c8058170 con 0x7fd1cc0af960 2023-10-16T14:26:22.280 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:22.280 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:25:53.209862+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:26:22.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.278+0000 7fd1d3dcc640 1 -- 172.21.15.59:0/463861154 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd1b006aea0 msgr2=0x7fd1b006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:22.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.278+0000 7fd1d3dcc640 1 --2- 172.21.15.59:0/463861154 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd1b006aea0 0x7fd1b006d360 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc036000 tx=0x7fd1bc03c040 comp rx=0 tx=0).stop 2023-10-16T14:26:22.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.279+0000 7fd1d3dcc640 1 -- 172.21.15.59:0/463861154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1cc0af960 msgr2=0x7fd1cc0c9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:22.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.279+0000 7fd1d3dcc640 1 --2- 172.21.15.59:0/463861154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1cc0af960 0x7fd1cc0c9a20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd1c800d5f0 tx=0x7fd1c800dab0 comp rx=0 tx=0).stop 2023-10-16T14:26:22.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.279+0000 7fd1d3dcc640 1 -- 172.21.15.59:0/463861154 shutdown_connections 2023-10-16T14:26:22.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.279+0000 7fd1d3dcc640 1 --2- 172.21.15.59:0/463861154 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd1b006aea0 0x7fd1b006d360 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:22.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.279+0000 7fd1d3dcc640 1 --2- 172.21.15.59:0/463861154 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1cc15ce00 0x7fd1cc06f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:22.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.279+0000 7fd1d3dcc640 1 --2- 172.21.15.59:0/463861154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1cc0cd560 0x7fd1cc0c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:22.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.279+0000 7fd1d3dcc640 1 --2- 172.21.15.59:0/463861154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1cc0af960 0x7fd1cc0c9a20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:22.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.279+0000 7fd1d3dcc640 1 -- 172.21.15.59:0/463861154 >> 172.21.15.59:0/463861154 conn(0x7fd1cc0d07a0 msgr2=0x7fd1cc15bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:22.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.279+0000 7fd1d3dcc640 1 -- 172.21.15.59:0/463861154 shutdown_connections 2023-10-16T14:26:22.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.279+0000 7fd1d3dcc640 1 -- 172.21.15.59:0/463861154 wait complete. 2023-10-16T14:26:22.302 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T14:26:22.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.519+0000 7ff5065c5640 1 Processor -- start 2023-10-16T14:26:22.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.520+0000 7ff5065c5640 1 -- start start 2023-10-16T14:26:22.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.521+0000 7ff5065c5640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff5000b0010 0x7ff5000701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:22.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.521+0000 7ff5065c5640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5000707f0 con 0x7ff50015ad00 2023-10-16T14:26:22.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.521+0000 7ff5065c5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff500070ad0 con 0x7ff50015f040 2023-10-16T14:26:22.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.521+0000 7ff5065c5640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff50015b1d0 con 0x7ff5000b0010 2023-10-16T14:26:22.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.522+0000 7ff4fffff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff5000b0010 0x7ff5000701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:22.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.522+0000 7ff4f77fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff50015ad00 0x7ff5000b03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58098/0 (socket says 172.21.15.59:58098) 2023-10-16T14:26:22.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.522+0000 7ff4f77fe640 1 -- 172.21.15.59:0/2116400287 learned_addr learned my addr 172.21.15.59:0/2116400287 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:22.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.522+0000 7ff4fffff640 1 -- 172.21.15.59:0/2116400287 >> v1:172.21.15.151:6789/0 conn(0x7ff50015f040 legacy=0x7ff50015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:22.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.522+0000 7ff4fffff640 1 -- 172.21.15.59:0/2116400287 >> v1:172.21.15.59:6789/0 conn(0x7ff50015ad00 legacy=0x7ff5000b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:22.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.522+0000 7ff4fffff640 1 -- 172.21.15.59:0/2116400287 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50015b4b0 con 0x7ff5000b0010 2023-10-16T14:26:22.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.523+0000 7ff4fffff640 1 --2- 172.21.15.59:0/2116400287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5000b0010 0x7ff5000701a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00097a0 tx=0x7ff4f002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8680b0163b507dde server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:22.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.524+0000 7ff4ff7fe640 1 -- 172.21.15.59:0/2116400287 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0030610 con 0x7ff5000b0010 2023-10-16T14:26:22.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.524+0000 7ff4ff7fe640 1 -- 172.21.15.59:0/2116400287 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f0030770 con 0x7ff5000b0010 2023-10-16T14:26:22.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.524+0000 7ff4ff7fe640 1 -- 172.21.15.59:0/2116400287 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0030b00 con 0x7ff5000b0010 2023-10-16T14:26:22.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.524+0000 7ff5065c5640 1 -- 172.21.15.59:0/2116400287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5000b0010 msgr2=0x7ff5000701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:22.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.524+0000 7ff5065c5640 1 --2- 172.21.15.59:0/2116400287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5000b0010 0x7ff5000701a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff4f00097a0 tx=0x7ff4f002b960 comp rx=0 tx=0).stop 2023-10-16T14:26:22.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.525+0000 7ff5065c5640 1 -- 172.21.15.59:0/2116400287 shutdown_connections 2023-10-16T14:26:22.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.525+0000 7ff5065c5640 1 --2- 172.21.15.59:0/2116400287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5000b0010 0x7ff5000701a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:22.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.525+0000 7ff5065c5640 1 -- 172.21.15.59:0/2116400287 >> 172.21.15.59:0/2116400287 conn(0x7ff50006c1c0 msgr2=0x7ff50006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:22.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.525+0000 7ff5065c5640 1 -- 172.21.15.59:0/2116400287 shutdown_connections 2023-10-16T14:26:22.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.525+0000 7ff5065c5640 1 -- 172.21.15.59:0/2116400287 wait complete. 2023-10-16T14:26:22.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.526+0000 7ff5065c5640 1 Processor -- start 2023-10-16T14:26:22.531 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.527+0000 7ff5065c5640 1 -- start start 2023-10-16T14:26:22.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.528+0000 7ff5065c5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5000b0010 0x7ff5000c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:22.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.528+0000 7ff5065c5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff50015ad00 0x7ff500150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:22.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.528+0000 7ff5065c5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff50015f040 0x7ff50015d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:22.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.528+0000 7ff5065c5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5000c68c0 con 0x7ff5000b0010 2023-10-16T14:26:22.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.528+0000 7ff5065c5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5001505b0 con 0x7ff50015ad00 2023-10-16T14:26:22.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.528+0000 7ff5065c5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50015d610 con 0x7ff50015f040 2023-10-16T14:26:22.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.528+0000 7ff4fffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5000b0010 0x7ff5000c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:22.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.528+0000 7ff4fffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5000b0010 0x7ff5000c5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38454/0 (socket says 172.21.15.59:38454) 2023-10-16T14:26:22.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.528+0000 7ff4fffff640 1 -- 172.21.15.59:0/946261291 learned_addr learned my addr 172.21.15.59:0/946261291 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:22.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.528+0000 7ff4f77fe640 1 --2- 172.21.15.59:0/946261291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff50015ad00 0x7ff500150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:22.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.528+0000 7ff504b62640 1 --2- 172.21.15.59:0/946261291 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff50015f040 0x7ff50015d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:22.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.528+0000 7ff4fffff640 1 -- 172.21.15.59:0/946261291 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff50015f040 msgr2=0x7ff50015d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:22.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.528+0000 7ff4fffff640 1 --2- 172.21.15.59:0/946261291 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff50015f040 0x7ff50015d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:22.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.529+0000 7ff4fffff640 1 -- 172.21.15.59:0/946261291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff50015ad00 msgr2=0x7ff500150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:22.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.529+0000 7ff4fffff640 1 --2- 172.21.15.59:0/946261291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff50015ad00 0x7ff500150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:22.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.529+0000 7ff4fffff640 1 -- 172.21.15.59:0/946261291 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0009400 con 0x7ff5000b0010 2023-10-16T14:26:22.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.529+0000 7ff504b62640 1 --2- 172.21.15.59:0/946261291 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff50015f040 0x7ff50015d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:22.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.529+0000 7ff4fffff640 1 --2- 172.21.15.59:0/946261291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5000b0010 0x7ff5000c5660 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff4f002bf70 tx=0x7ff4f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:22.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.529+0000 7ff4fd7fa640 1 -- 172.21.15.59:0/946261291 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f003e040 con 0x7ff5000b0010 2023-10-16T14:26:22.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.529+0000 7ff4fd7fa640 1 -- 172.21.15.59:0/946261291 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f0039cb0 con 0x7ff5000b0010 2023-10-16T14:26:22.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.529+0000 7ff4fd7fa640 1 -- 172.21.15.59:0/946261291 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0044630 con 0x7ff5000b0010 2023-10-16T14:26:22.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.529+0000 7ff5065c5640 1 -- 172.21.15.59:0/946261291 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5000c5cb0 con 0x7ff5000b0010 2023-10-16T14:26:22.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.529+0000 7ff5065c5640 1 -- 172.21.15.59:0/946261291 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5000c6270 con 0x7ff5000b0010 2023-10-16T14:26:22.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.531+0000 7ff5065c5640 1 -- 172.21.15.59:0/946261291 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff500070d90 con 0x7ff5000b0010 2023-10-16T14:26:22.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.532+0000 7ff4fd7fa640 1 -- 172.21.15.59:0/946261291 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff4f0043390 con 0x7ff5000b0010 2023-10-16T14:26:22.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.533+0000 7ff4fd7fa640 1 --2- 172.21.15.59:0/946261291 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff4e006aea0 0x7ff4e006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:22.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.533+0000 7ff4fd7fa640 1 -- 172.21.15.59:0/946261291 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff4f00abbf0 con 0x7ff5000b0010 2023-10-16T14:26:22.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.533+0000 7ff4f77fe640 1 --2- 172.21.15.59:0/946261291 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff4e006aea0 0x7ff4e006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:22.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.534+0000 7ff4f77fe640 1 --2- 172.21.15.59:0/946261291 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff4e006aea0 0x7ff4e006d360 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff5001f3530 tx=0x7ff4e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.537+0000 7ff4fd7fa640 1 -- 172.21.15.59:0/946261291 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff500070d90 con 0x7ff5000b0010 2023-10-16T14:26:22.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.769+0000 7ff5065c5640 1 -- 172.21.15.59:0/946261291 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff500070d90 con 0x7ff5000b0010 2023-10-16T14:26:22.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.770+0000 7ff4fd7fa640 1 -- 172.21.15.59:0/946261291 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7ff500070d90 con 0x7ff5000b0010 2023-10-16T14:26:22.774 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:22.774 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3959035293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3959035293},{"type":"v1","addr":"172.21.15.59:6834","nonce":3959035293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1298271347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1298271347},{"type":"v1","addr":"172.21.15.151:6835","nonce":1298271347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/249904108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":249904108},{"type":"v1","addr":"172.21.15.59:6835","nonce":249904108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T14:25:48.130662+0000","modified":"2023-10-16T14:26:09.157993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6837/4004038733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4004038733},{"type":"v1","addr":"172.21.15.151:6837","nonce":4004038733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T14:26:22.775 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 9 2023-10-16T14:26:22.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.773+0000 7ff5065c5640 1 -- 172.21.15.59:0/946261291 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff4e006aea0 msgr2=0x7ff4e006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:22.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.773+0000 7ff5065c5640 1 --2- 172.21.15.59:0/946261291 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff4e006aea0 0x7ff4e006d360 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff5001f3530 tx=0x7ff4e8009040 comp rx=0 tx=0).stop 2023-10-16T14:26:22.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.773+0000 7ff5065c5640 1 -- 172.21.15.59:0/946261291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5000b0010 msgr2=0x7ff5000c5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:22.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.773+0000 7ff5065c5640 1 --2- 172.21.15.59:0/946261291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5000b0010 0x7ff5000c5660 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff4f002bf70 tx=0x7ff4f0004730 comp rx=0 tx=0).stop 2023-10-16T14:26:22.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.773+0000 7ff5065c5640 1 -- 172.21.15.59:0/946261291 shutdown_connections 2023-10-16T14:26:22.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.773+0000 7ff5065c5640 1 --2- 172.21.15.59:0/946261291 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff4e006aea0 0x7ff4e006d360 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:22.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.773+0000 7ff5065c5640 1 --2- 172.21.15.59:0/946261291 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff50015f040 0x7ff50015d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:22.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.773+0000 7ff5065c5640 1 --2- 172.21.15.59:0/946261291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff50015ad00 0x7ff500150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:22.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.773+0000 7ff5065c5640 1 --2- 172.21.15.59:0/946261291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5000b0010 0x7ff5000c5660 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:22.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.773+0000 7ff5065c5640 1 -- 172.21.15.59:0/946261291 >> 172.21.15.59:0/946261291 conn(0x7ff50006c1c0 msgr2=0x7ff500158c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:22.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.773+0000 7ff5065c5640 1 -- 172.21.15.59:0/946261291 shutdown_connections 2023-10-16T14:26:22.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:22.773+0000 7ff5065c5640 1 -- 172.21.15.59:0/946261291 wait complete. 2023-10-16T14:26:23.197 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T14:25:48.130662+0000', 'modified': '2023-10-16T14:26:09.157993+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.151:6837/4004038733', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6836', 'nonce': 4004038733}, {'type': 'v1', 'addr': '172.21.15.151:6837', 'nonce': 4004038733}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T14:26:23.197 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T14:26:23.198 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-16T14:26:23.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.432+0000 7f8c4dd35640 1 Processor -- start 2023-10-16T14:26:23.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.433+0000 7f8c4dd35640 1 -- start start 2023-10-16T14:26:23.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.434+0000 7f8c4dd35640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8c4815cc90 0x7f8c480d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:23.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.434+0000 7f8c4dd35640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8c480cfe70 0x7f8c480d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:23.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.434+0000 7f8c4dd35640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c480d3760 con 0x7f8c480d05c0 2023-10-16T14:26:23.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.434+0000 7f8c4dd35640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c480cf9e0 con 0x7f8c4815cc90 2023-10-16T14:26:23.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.434+0000 7f8c4dd35640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c4815d070 con 0x7f8c480cfe70 2023-10-16T14:26:23.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.435+0000 7f8c4d534640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8c480d05c0 0x7f8c4806af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58102/0 (socket says 172.21.15.59:58102) 2023-10-16T14:26:23.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.435+0000 7f8c4d534640 1 -- 172.21.15.59:0/239162222 learned_addr learned my addr 172.21.15.59:0/239162222 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:23.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.435+0000 7f8c4cd33640 1 --2- 172.21.15.59:0/239162222 >> v2:172.21.15.59:3300/0 conn(0x7f8c4815cc90 0x7f8c480d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:23.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.435+0000 7f8c3ffff640 1 --2- 172.21.15.59:0/239162222 >> v2:172.21.15.151:3300/0 conn(0x7f8c480cfe70 0x7f8c480d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:23.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.435+0000 7f8c3f7fe640 1 -- 172.21.15.59:0/239162222 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771851877 0 0) 0x7f8c480d3760 con 0x7f8c480d05c0 2023-10-16T14:26:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.435+0000 7f8c4cd33640 1 -- 172.21.15.59:0/239162222 >> v2:172.21.15.151:3300/0 conn(0x7f8c480cfe70 msgr2=0x7f8c480d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.435+0000 7f8c4cd33640 1 --2- 172.21.15.59:0/239162222 >> v2:172.21.15.151:3300/0 conn(0x7f8c480cfe70 0x7f8c480d1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.435+0000 7f8c4cd33640 1 -- 172.21.15.59:0/239162222 >> v1:172.21.15.59:6789/0 conn(0x7f8c480d05c0 legacy=0x7f8c4806af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.435+0000 7f8c4cd33640 1 -- 172.21.15.59:0/239162222 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c480b1870 con 0x7f8c4815cc90 2023-10-16T14:26:23.441 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.436+0000 7f8c4cd33640 1 --2- 172.21.15.59:0/239162222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4815cc90 0x7f8c480d0dc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8c44009d90 tx=0x7f8c4402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb2adf158acb4ba server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:23.442 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.437+0000 7f8c3f7fe640 1 -- 172.21.15.59:0/239162222 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4402cbd0 con 0x7f8c4815cc90 2023-10-16T14:26:23.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.437+0000 7f8c3f7fe640 1 -- 172.21.15.59:0/239162222 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4402cd30 con 0x7f8c4815cc90 2023-10-16T14:26:23.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.437+0000 7f8c3f7fe640 1 -- 172.21.15.59:0/239162222 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4402cea0 con 0x7f8c4815cc90 2023-10-16T14:26:23.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.437+0000 7f8c4dd35640 1 -- 172.21.15.59:0/239162222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4815cc90 msgr2=0x7f8c480d0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:23.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.437+0000 7f8c4dd35640 1 --2- 172.21.15.59:0/239162222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4815cc90 0x7f8c480d0dc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8c44009d90 tx=0x7f8c4402be20 comp rx=0 tx=0).stop 2023-10-16T14:26:23.443 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.437+0000 7f8c4dd35640 1 -- 172.21.15.59:0/239162222 shutdown_connections 2023-10-16T14:26:23.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.437+0000 7f8c4dd35640 1 --2- 172.21.15.59:0/239162222 >> v2:172.21.15.151:3300/0 conn(0x7f8c480cfe70 0x7f8c480d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.437+0000 7f8c4dd35640 1 --2- 172.21.15.59:0/239162222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c4815cc90 0x7f8c480d0dc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.437+0000 7f8c4dd35640 1 -- 172.21.15.59:0/239162222 >> 172.21.15.59:0/239162222 conn(0x7f8c480d27e0 msgr2=0x7f8c480d2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:23.444 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.437+0000 7f8c4dd35640 1 -- 172.21.15.59:0/239162222 shutdown_connections 2023-10-16T14:26:23.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.437+0000 7f8c4dd35640 1 -- 172.21.15.59:0/239162222 wait complete. 2023-10-16T14:26:23.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.439+0000 7f8c4dd35640 1 Processor -- start 2023-10-16T14:26:23.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.439+0000 7f8c4dd35640 1 -- start start 2023-10-16T14:26:23.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.440+0000 7f8c4dd35640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c480cfe70 0x7f8c48152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:23.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.440+0000 7f8c4dd35640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c480d05c0 0x7f8c480cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:23.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.440+0000 7f8c4dd35640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c4815cc90 0x7f8c480b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:23.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.440+0000 7f8c4dd35640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c480ca490 con 0x7f8c480d05c0 2023-10-16T14:26:23.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.440+0000 7f8c4dd35640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c480ca770 con 0x7f8c480cfe70 2023-10-16T14:26:23.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.440+0000 7f8c4dd35640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c480caa50 con 0x7f8c4815cc90 2023-10-16T14:26:23.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.441+0000 7f8c3ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c480d05c0 0x7f8c480cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:23.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.441+0000 7f8c3ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c480d05c0 0x7f8c480cb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38482/0 (socket says 172.21.15.59:38482) 2023-10-16T14:26:23.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.441+0000 7f8c3ffff640 1 -- 172.21.15.59:0/2647236498 learned_addr learned my addr 172.21.15.59:0/2647236498 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:23.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.441+0000 7f8c4d534640 1 --2- 172.21.15.59:0/2647236498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c4815cc90 0x7f8c480b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:23.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.441+0000 7f8c4cd33640 1 --2- 172.21.15.59:0/2647236498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c480cfe70 0x7f8c48152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:23.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.441+0000 7f8c3ffff640 1 -- 172.21.15.59:0/2647236498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c4815cc90 msgr2=0x7f8c480b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:23.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.441+0000 7f8c3ffff640 1 --2- 172.21.15.59:0/2647236498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c4815cc90 0x7f8c480b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.441+0000 7f8c3ffff640 1 -- 172.21.15.59:0/2647236498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c480cfe70 msgr2=0x7f8c48152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:23.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.441+0000 7f8c3ffff640 1 --2- 172.21.15.59:0/2647236498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c480cfe70 0x7f8c48152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.441+0000 7f8c3ffff640 1 -- 172.21.15.59:0/2647236498 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c44009a70 con 0x7f8c480d05c0 2023-10-16T14:26:23.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.441+0000 7f8c4cd33640 1 --2- 172.21.15.59:0/2647236498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c480cfe70 0x7f8c48152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:23.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.441+0000 7f8c3ffff640 1 --2- 172.21.15.59:0/2647236498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c480d05c0 0x7f8c480cb810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800d7d0 tx=0x7f8c3800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:23.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.442+0000 7f8c3d7fa640 1 -- 172.21.15.59:0/2647236498 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38018070 con 0x7f8c480d05c0 2023-10-16T14:26:23.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.442+0000 7f8c3d7fa640 1 -- 172.21.15.59:0/2647236498 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c38004020 con 0x7f8c480d05c0 2023-10-16T14:26:23.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.442+0000 7f8c3d7fa640 1 -- 172.21.15.59:0/2647236498 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c380041b0 con 0x7f8c480d05c0 2023-10-16T14:26:23.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.442+0000 7f8c4dd35640 1 -- 172.21.15.59:0/2647236498 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c480cad30 con 0x7f8c480d05c0 2023-10-16T14:26:23.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.442+0000 7f8c4dd35640 1 -- 172.21.15.59:0/2647236498 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c480cb2f0 con 0x7f8c480d05c0 2023-10-16T14:26:23.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.444+0000 7f8c3d7fa640 1 -- 172.21.15.59:0/2647236498 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8c38004310 con 0x7f8c480d05c0 2023-10-16T14:26:23.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.445+0000 7f8c3d7fa640 1 --2- 172.21.15.59:0/2647236498 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8c3406ae70 0x7f8c3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:23.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.445+0000 7f8c3d7fa640 1 -- 172.21.15.59:0/2647236498 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8c380898b0 con 0x7f8c480d05c0 2023-10-16T14:26:23.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.446+0000 7f8c51c01740 1 Processor -- start 2023-10-16T14:26:23.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.446+0000 7f8c4cd33640 1 --2- 172.21.15.59:0/2647236498 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8c3406ae70 0x7f8c3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:23.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.446+0000 7f8c51c01740 1 -- start start 2023-10-16T14:26:23.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.447+0000 7f8c51c01740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e170 0x562421711070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:23.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.447+0000 7f8c51c01740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56242173e550 0x562421740f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:23.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.447+0000 7f8c51c01740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624217115b0 0x562421741440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:23.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.447+0000 7f8c51c01740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624216317a0 con 0x56242173e170 2023-10-16T14:26:23.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.447+0000 7f8c51c01740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562421683740 con 0x5624217115b0 2023-10-16T14:26:23.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.447+0000 7f8c51c01740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x562421680e30 con 0x56242173e550 2023-10-16T14:26:23.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.447+0000 7f8c4cd33640 1 --2- 172.21.15.59:0/2647236498 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8c3406ae70 0x7f8c3406d330 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8c44036000 tx=0x7f8c44030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:23.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.447+0000 7f8c4cd33640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e170 0x562421711070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:23.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.447+0000 7f8c4cd33640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e170 0x562421711070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38498/0 (socket says 172.21.15.59:38498) 2023-10-16T14:26:23.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.447+0000 7f8c4cd33640 1 -- 172.21.15.59:0/78857407 learned_addr learned my addr 172.21.15.59:0/78857407 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:23.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.447+0000 7f8c3ffff640 1 --2- 172.21.15.59:0/78857407 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56242173e550 0x562421740f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:23.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.447+0000 7f8c4d534640 1 --2- 172.21.15.59:0/78857407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624217115b0 0x562421741440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:23.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.448+0000 7f8c4cd33640 1 -- 172.21.15.59:0/78857407 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56242173e550 msgr2=0x562421740f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:23.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.448+0000 7f8c4cd33640 1 --2- 172.21.15.59:0/78857407 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56242173e550 0x562421740f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.448+0000 7f8c4cd33640 1 -- 172.21.15.59:0/78857407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624217115b0 msgr2=0x562421741440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:23.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.448+0000 7f8c4cd33640 1 --2- 172.21.15.59:0/78857407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624217115b0 0x562421741440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.448+0000 7f8c4cd33640 1 -- 172.21.15.59:0/78857407 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562421640910 con 0x56242173e170 2023-10-16T14:26:23.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.448+0000 7f8c4cd33640 1 --2- 172.21.15.59:0/78857407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e170 0x562421711070 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8c4402c430 tx=0x7f8c4402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b830670c02c7002 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:23.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.448+0000 7f8c2effd640 1 -- 172.21.15.59:0/78857407 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4402cea0 con 0x56242173e170 2023-10-16T14:26:23.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.448+0000 7f8c2effd640 1 -- 172.21.15.59:0/78857407 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c44045040 con 0x56242173e170 2023-10-16T14:26:23.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.448+0000 7f8c2effd640 1 -- 172.21.15.59:0/78857407 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4403e810 con 0x56242173e170 2023-10-16T14:26:23.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.449+0000 7f8c51c01740 1 -- 172.21.15.59:0/78857407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e170 msgr2=0x562421711070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:23.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.449+0000 7f8c51c01740 1 --2- 172.21.15.59:0/78857407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e170 0x562421711070 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8c4402c430 tx=0x7f8c4402e000 comp rx=0 tx=0).stop 2023-10-16T14:26:23.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.449+0000 7f8c51c01740 1 -- 172.21.15.59:0/78857407 shutdown_connections 2023-10-16T14:26:23.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.449+0000 7f8c51c01740 1 --2- 172.21.15.59:0/78857407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624217115b0 0x562421741440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.449+0000 7f8c51c01740 1 --2- 172.21.15.59:0/78857407 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56242173e550 0x562421740f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.449+0000 7f8c51c01740 1 --2- 172.21.15.59:0/78857407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e170 0x562421711070 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.449+0000 7f8c51c01740 1 -- 172.21.15.59:0/78857407 >> 172.21.15.59:0/78857407 conn(0x562421713380 msgr2=0x56242175bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:23.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.449+0000 7f8c51c01740 1 -- 172.21.15.59:0/78857407 shutdown_connections 2023-10-16T14:26:23.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.449+0000 7f8c51c01740 1 -- 172.21.15.59:0/78857407 wait complete. 2023-10-16T14:26:23.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.450+0000 7f8c51c01740 1 -- start start 2023-10-16T14:26:23.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.450+0000 7f8c51c01740 1 Processor -- start 2023-10-16T14:26:23.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.451+0000 7f8c51c01740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56242173e170 0x562421745830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:23.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.451+0000 7f8c51c01740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56242173e550 0x562421745d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:23.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.451+0000 7f8c51c01740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562421729b00 0x562421729f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:23.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.451+0000 7f8c51c01740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56242167c720 con 0x562421729b00 2023-10-16T14:26:23.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.451+0000 7f8c51c01740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56242161a970 con 0x56242173e550 2023-10-16T14:26:23.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.451+0000 7f8c51c01740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56242161a610 con 0x56242173e170 2023-10-16T14:26:23.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.451+0000 7f8c51c01740 10 client.0 _ll_register_callbacks cb 0x56242163c9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T14:26:23.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.452+0000 7f8c4d534640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562421729b00 0x562421729f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:23.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.452+0000 7f8c4d534640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562421729b00 0x562421729f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38510/0 (socket says 172.21.15.59:38510) 2023-10-16T14:26:23.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.452+0000 7f8c4d534640 1 -- 172.21.15.59:0/4010740639 learned_addr learned my addr 172.21.15.59:0/4010740639 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:23.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.452+0000 7f8c4cd33640 1 --2- 172.21.15.59:0/4010740639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56242173e170 0x562421745830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:23.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.452+0000 7f8c4d534640 1 -- 172.21.15.59:0/4010740639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56242173e170 msgr2=0x562421745830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:23.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.452+0000 7f8c4d534640 1 --2- 172.21.15.59:0/4010740639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56242173e170 0x562421745830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.452+0000 7f8c3ffff640 1 --2- 172.21.15.59:0/4010740639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56242173e550 0x562421745d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:23.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.452+0000 7f8c4d534640 1 -- 172.21.15.59:0/4010740639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56242173e550 msgr2=0x562421745d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:23.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.452+0000 7f8c4d534640 1 --2- 172.21.15.59:0/4010740639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56242173e550 0x562421745d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.452+0000 7f8c4d534640 1 -- 172.21.15.59:0/4010740639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c480b1870 con 0x562421729b00 2023-10-16T14:26:23.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.452+0000 7f8c4d534640 1 --2- 172.21.15.59:0/4010740639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562421729b00 0x562421729f80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c40005aa0 tx=0x7f8c40005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be7461c89bb8a12 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:23.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.452+0000 7f8c277fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-16T14:26:23.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.453+0000 7f8c277fe640 1 -- 172.21.15.59:0/4010740639 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c40001d10 con 0x562421729b00 2023-10-16T14:26:23.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.453+0000 7f8c277fe640 1 -- 172.21.15.59:0/4010740639 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8c40016e00 con 0x562421729b00 2023-10-16T14:26:23.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.453+0000 7f8c51c01740 1 -- 172.21.15.59:0/4010740639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624216a3160 con 0x562421729b00 2023-10-16T14:26:23.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.453+0000 7f8c277fe640 1 -- 172.21.15.59:0/4010740639 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c400203b0 con 0x562421729b00 2023-10-16T14:26:23.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.453+0000 7f8c51c01740 10 client.4764 fetch_fsmap learned FSMap version 9 2023-10-16T14:26:23.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.453+0000 7f8c51c01740 1 -- 172.21.15.59:0/4010740639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x56242167ada0 con 0x562421729b00 2023-10-16T14:26:23.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.453+0000 7f8c277fe640 1 -- 172.21.15.59:0/4010740639 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5624216a3160 con 0x562421729b00 2023-10-16T14:26:23.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.453+0000 7f8c277fe640 1 -- 172.21.15.59:0/4010740639 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f8c40020510 con 0x562421729b00 2023-10-16T14:26:23.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.453+0000 7f8c51c01740 10 client.4764 fetch_fsmap finished waiting for FSMap version 9 2023-10-16T14:26:23.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.453+0000 7f8c51c01740 10 client.4764 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-16T14:26:23.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.453+0000 7f8c51c01740 20 client.4764 populate_metadata read hostname 'smithi059' 2023-10-16T14:26:23.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.453+0000 7f8c51c01740 1 --2- 172.21.15.59:0/4010740639 >> [v2:172.21.15.151:6836/4004038733,v1:172.21.15.151:6837/4004038733] conn(0x56242172b5e0 0x562421743890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:23.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.453+0000 7f8c51c01740 4 client.4764 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T14:26:23.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.453+0000 7f8c51c01740 1 -- 172.21.15.59:0/4010740639 --> [v2:172.21.15.151:6836/4004038733,v1:172.21.15.151:6837/4004038733] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56242164ecc0 con 0x56242172b5e0 2023-10-16T14:26:23.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.454+0000 7f8c4cd33640 1 --2- 172.21.15.59:0/4010740639 >> [v2:172.21.15.151:6836/4004038733,v1:172.21.15.151:6837/4004038733] conn(0x56242172b5e0 0x562421743890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:23.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.455+0000 7f8c4cd33640 1 --2- 172.21.15.59:0/4010740639 >> [v2:172.21.15.151:6836/4004038733,v1:172.21.15.151:6837/4004038733] conn(0x56242172b5e0 0x562421743890 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dab927bff9007f server_cookie=dc650da56b3514e6 in_seq=0 out_seq=0 2023-10-16T14:26:23.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.455+0000 7f8c277fe640 10 client.4764 ms_handle_connect on v2:172.21.15.151:6836/4004038733 2023-10-16T14:26:23.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.457+0000 7f8c277fe640 1 -- 172.21.15.59:0/4010740639 <== mds.0 v2:172.21.15.151:6836/4004038733 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56242164ecc0 con 0x56242172b5e0 2023-10-16T14:26:23.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.457+0000 7f8c277fe640 10 client.4764 handle_command_reply: tid=0 2023-10-16T14:26:23.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.457+0000 7f8c51c01740 1 client.4764 shutdown 2023-10-16T14:26:23.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.457+0000 7f8c51c01740 1 -- 172.21.15.59:0/4010740639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562421729b00 msgr2=0x562421729f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:23.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.457+0000 7f8c51c01740 1 --2- 172.21.15.59:0/4010740639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562421729b00 0x562421729f80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c40005aa0 tx=0x7f8c40005f60 comp rx=0 tx=0).stop 2023-10-16T14:26:23.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.457+0000 7f8c51c01740 1 -- 172.21.15.59:0/4010740639 shutdown_connections 2023-10-16T14:26:23.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.457+0000 7f8c51c01740 1 --2- 172.21.15.59:0/4010740639 >> [v2:172.21.15.151:6836/4004038733,v1:172.21.15.151:6837/4004038733] conn(0x56242172b5e0 0x562421743890 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.457+0000 7f8c51c01740 1 --2- 172.21.15.59:0/4010740639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562421729b00 0x562421729f80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.457+0000 7f8c51c01740 1 --2- 172.21.15.59:0/4010740639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56242173e550 0x562421745d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.457+0000 7f8c51c01740 1 --2- 172.21.15.59:0/4010740639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56242173e170 0x562421745830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.457+0000 7f8c277fe640 0 client.4764 ms_handle_reset on v2:172.21.15.151:6836/4004038733 2023-10-16T14:26:23.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.457+0000 7f8c51c01740 1 -- 172.21.15.59:0/4010740639 >> 172.21.15.59:0/4010740639 conn(0x5624217115b0 msgr2=0x56242175f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:23.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.457+0000 7f8c51c01740 1 -- 172.21.15.59:0/4010740639 shutdown_connections 2023-10-16T14:26:23.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.458+0000 7f8c51c01740 1 -- 172.21.15.59:0/4010740639 wait complete. 2023-10-16T14:26:23.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.458+0000 7f8c51c01740 20 client.4764 trim_cache size 0 max 16384 2023-10-16T14:26:23.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.475+0000 7f8c51c01740 1 Processor -- start 2023-10-16T14:26:23.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.475+0000 7f8c51c01740 1 -- start start 2023-10-16T14:26:23.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.476+0000 7f8c51c01740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562421729b00 0x56242170c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:23.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.476+0000 7f8c51c01740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e170 0x562421718130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:23.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.476+0000 7f8c51c01740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56242173e550 0x56242173a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:23.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.476+0000 7f8c51c01740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624213e0f20 con 0x56242173e170 2023-10-16T14:26:23.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.476+0000 7f8c51c01740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56242176bc80 con 0x562421729b00 2023-10-16T14:26:23.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.476+0000 7f8c51c01740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624216498a0 con 0x56242173e550 2023-10-16T14:26:23.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.476+0000 7f8c3ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e170 0x562421718130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:23.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.476+0000 7f8c3ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e170 0x562421718130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38520/0 (socket says 172.21.15.59:38520) 2023-10-16T14:26:23.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.476+0000 7f8c3ffff640 1 -- 172.21.15.59:0/1037387500 learned_addr learned my addr 172.21.15.59:0/1037387500 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:23.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.476+0000 7f8c3ffff640 1 -- 172.21.15.59:0/1037387500 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56242173e550 msgr2=0x56242173a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:23.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.476+0000 7f8c3ffff640 1 --2- 172.21.15.59:0/1037387500 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56242173e550 0x56242173a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.476+0000 7f8c3ffff640 1 -- 172.21.15.59:0/1037387500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562421729b00 msgr2=0x56242170c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:23.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.476+0000 7f8c3ffff640 1 --2- 172.21.15.59:0/1037387500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562421729b00 0x56242170c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.476+0000 7f8c3ffff640 1 -- 172.21.15.59:0/1037387500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562421619b80 con 0x56242173e170 2023-10-16T14:26:23.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.477+0000 7f8c3ffff640 1 --2- 172.21.15.59:0/1037387500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e170 0x562421718130 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8c38006fd0 tx=0x7f8c3801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a6011c8a8f9739 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:23.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.477+0000 7f8c2f7fe640 1 -- 172.21.15.59:0/1037387500 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3805c3e0 con 0x56242173e170 2023-10-16T14:26:23.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.477+0000 7f8c2f7fe640 1 -- 172.21.15.59:0/1037387500 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c38060590 con 0x56242173e170 2023-10-16T14:26:23.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.477+0000 7f8c2f7fe640 1 -- 172.21.15.59:0/1037387500 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38056630 con 0x56242173e170 2023-10-16T14:26:23.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.478+0000 7f8c51c01740 1 -- 172.21.15.59:0/1037387500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e170 msgr2=0x562421718130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:23.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.478+0000 7f8c51c01740 1 --2- 172.21.15.59:0/1037387500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e170 0x562421718130 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8c38006fd0 tx=0x7f8c3801d000 comp rx=0 tx=0).stop 2023-10-16T14:26:23.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.478+0000 7f8c51c01740 1 -- 172.21.15.59:0/1037387500 shutdown_connections 2023-10-16T14:26:23.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.478+0000 7f8c51c01740 1 --2- 172.21.15.59:0/1037387500 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56242173e550 0x56242173a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.478+0000 7f8c51c01740 1 --2- 172.21.15.59:0/1037387500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e170 0x562421718130 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.478+0000 7f8c51c01740 1 --2- 172.21.15.59:0/1037387500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562421729b00 0x56242170c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.478+0000 7f8c51c01740 1 -- 172.21.15.59:0/1037387500 >> 172.21.15.59:0/1037387500 conn(0x5624217115b0 msgr2=0x562421738ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:23.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.478+0000 7f8c51c01740 1 -- 172.21.15.59:0/1037387500 shutdown_connections 2023-10-16T14:26:23.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.478+0000 7f8c51c01740 1 -- 172.21.15.59:0/1037387500 wait complete. 2023-10-16T14:26:23.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.478+0000 7f8c51c01740 1 -- start start 2023-10-16T14:26:23.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.479+0000 7f8c51c01740 1 Processor -- start 2023-10-16T14:26:23.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.480+0000 7f8c51c01740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562421729b00 0x5624217c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:23.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.480+0000 7f8c51c01740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56242173e170 0x5624217383f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:23.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.480+0000 7f8c51c01740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e550 0x5624217436a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:23.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.480+0000 7f8c51c01740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624217c43d0 con 0x56242173e550 2023-10-16T14:26:23.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.480+0000 7f8c51c01740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562421738930 con 0x562421729b00 2023-10-16T14:26:23.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.480+0000 7f8c51c01740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56242173a730 con 0x56242173e170 2023-10-16T14:26:23.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.480+0000 7f8c51c01740 10 client.0 _ll_register_callbacks cb 0x7f8c40007d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T14:26:23.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.480+0000 7f8c4d534640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e550 0x5624217436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:23.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.480+0000 7f8c4d534640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e550 0x5624217436a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38528/0 (socket says 172.21.15.59:38528) 2023-10-16T14:26:23.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.480+0000 7f8c4d534640 1 -- 172.21.15.59:0/763926171 learned_addr learned my addr 172.21.15.59:0/763926171 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:23.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.480+0000 7f8c4cd33640 1 --2- 172.21.15.59:0/763926171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562421729b00 0x5624217c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:23.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.480+0000 7f8c3ffff640 1 --2- 172.21.15.59:0/763926171 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56242173e170 0x5624217383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:23.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.480+0000 7f8c4d534640 1 -- 172.21.15.59:0/763926171 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56242173e170 msgr2=0x5624217383f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:23.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.480+0000 7f8c4d534640 1 --2- 172.21.15.59:0/763926171 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56242173e170 0x5624217383f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.480+0000 7f8c4d534640 1 -- 172.21.15.59:0/763926171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562421729b00 msgr2=0x5624217c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:23.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.480+0000 7f8c4d534640 1 --2- 172.21.15.59:0/763926171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562421729b00 0x5624217c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.480+0000 7f8c4d534640 1 -- 172.21.15.59:0/763926171 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c480cb2f0 con 0x56242173e550 2023-10-16T14:26:23.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.481+0000 7f8c3ffff640 1 --2- 172.21.15.59:0/763926171 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56242173e170 0x5624217383f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:23.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.481+0000 7f8c4d534640 1 --2- 172.21.15.59:0/763926171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e550 0x5624217436a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8c40000ea0 tx=0x7f8c40000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0200d0c4ff3ecf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:23.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.481+0000 7f8c277fe640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-16T14:26:23.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.481+0000 7f8c277fe640 1 -- 172.21.15.59:0/763926171 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c40001d10 con 0x56242173e550 2023-10-16T14:26:23.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.481+0000 7f8c277fe640 1 -- 172.21.15.59:0/763926171 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8c4002bdc0 con 0x56242173e550 2023-10-16T14:26:23.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.481+0000 7f8c51c01740 1 -- 172.21.15.59:0/763926171 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562421739930 con 0x56242173e550 2023-10-16T14:26:23.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.481+0000 7f8c277fe640 1 -- 172.21.15.59:0/763926171 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c40020980 con 0x56242173e550 2023-10-16T14:26:23.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.481+0000 7f8c51c01740 10 client.4770 fetch_fsmap learned FSMap version 9 2023-10-16T14:26:23.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.481+0000 7f8c51c01740 1 -- 172.21.15.59:0/763926171 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x56242163f170 con 0x56242173e550 2023-10-16T14:26:23.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.482+0000 7f8c277fe640 1 -- 172.21.15.59:0/763926171 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562421739930 con 0x56242173e550 2023-10-16T14:26:23.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.482+0000 7f8c277fe640 1 -- 172.21.15.59:0/763926171 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f8c40020d00 con 0x56242173e550 2023-10-16T14:26:23.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.482+0000 7f8c51c01740 10 client.4770 fetch_fsmap finished waiting for FSMap version 9 2023-10-16T14:26:23.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.482+0000 7f8c51c01740 10 client.4770 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-16T14:26:23.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.482+0000 7f8c51c01740 20 client.4770 populate_metadata read hostname 'smithi059' 2023-10-16T14:26:23.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.482+0000 7f8c51c01740 1 --2- 172.21.15.59:0/763926171 >> [v2:172.21.15.151:6836/4004038733,v1:172.21.15.151:6837/4004038733] conn(0x5624217c5230 0x56242175b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:23.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.482+0000 7f8c51c01740 4 client.4770 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T14:26:23.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.482+0000 7f8c51c01740 1 -- 172.21.15.59:0/763926171 --> [v2:172.21.15.151:6836/4004038733,v1:172.21.15.151:6837/4004038733] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f8c44045040 con 0x5624217c5230 2023-10-16T14:26:23.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.482+0000 7f8c4cd33640 1 --2- 172.21.15.59:0/763926171 >> [v2:172.21.15.151:6836/4004038733,v1:172.21.15.151:6837/4004038733] conn(0x5624217c5230 0x56242175b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:23.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.483+0000 7f8c4cd33640 1 --2- 172.21.15.59:0/763926171 >> [v2:172.21.15.151:6836/4004038733,v1:172.21.15.151:6837/4004038733] conn(0x5624217c5230 0x56242175b810 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d8df653f016f2b8 server_cookie=5240afdbe0b1c490 in_seq=0 out_seq=0 2023-10-16T14:26:23.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.484+0000 7f8c277fe640 10 client.4770 ms_handle_connect on v2:172.21.15.151:6836/4004038733 2023-10-16T14:26:23.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.484+0000 7f8c277fe640 1 -- 172.21.15.59:0/763926171 <== mds.0 v2:172.21.15.151:6836/4004038733 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x7f8c44045040 con 0x5624217c5230 2023-10-16T14:26:23.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.484+0000 7f8c277fe640 10 client.4770 handle_command_reply: tid=0 2023-10-16T14:26:23.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.484+0000 7f8c51c01740 1 client.4770 shutdown 2023-10-16T14:26:23.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.485+0000 7f8c51c01740 1 -- 172.21.15.59:0/763926171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e550 msgr2=0x5624217436a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:23.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.485+0000 7f8c51c01740 1 --2- 172.21.15.59:0/763926171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e550 0x5624217436a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8c40000ea0 tx=0x7f8c40000ed0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.485+0000 7f8c51c01740 1 -- 172.21.15.59:0/763926171 shutdown_connections 2023-10-16T14:26:23.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.485+0000 7f8c51c01740 1 --2- 172.21.15.59:0/763926171 >> [v2:172.21.15.151:6836/4004038733,v1:172.21.15.151:6837/4004038733] conn(0x5624217c5230 0x56242175b810 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.485+0000 7f8c51c01740 1 --2- 172.21.15.59:0/763926171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56242173e550 0x5624217436a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.485+0000 7f8c51c01740 1 --2- 172.21.15.59:0/763926171 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56242173e170 0x5624217383f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.485+0000 7f8c277fe640 0 client.4770 ms_handle_reset on v2:172.21.15.151:6836/4004038733 2023-10-16T14:26:23.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.485+0000 7f8c51c01740 1 --2- 172.21.15.59:0/763926171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562421729b00 0x5624217c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.485+0000 7f8c51c01740 1 -- 172.21.15.59:0/763926171 >> 172.21.15.59:0/763926171 conn(0x5624217115b0 msgr2=0x562421742950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:23.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.485+0000 7f8c51c01740 1 -- 172.21.15.59:0/763926171 shutdown_connections 2023-10-16T14:26:23.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.485+0000 7f8c51c01740 1 -- 172.21.15.59:0/763926171 wait complete. 2023-10-16T14:26:23.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.485+0000 7f8c51c01740 20 client.4770 trim_cache size 0 max 16384 2023-10-16T14:26:23.500 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-16T14:26:23.500 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "c3201022-15a8-4479-95cd-5e66eaaa456b", 2023-10-16T14:26:23.500 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2023-10-16T14:26:23.501 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4282, 2023-10-16T14:26:23.501 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2023-10-16T14:26:23.501 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2023-10-16T14:26:23.501 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2023-10-16T14:26:23.501 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 34.798180223999999, 2023-10-16T14:26:23.501 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 9, 2023-10-16T14:26:23.502 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 26, 2023-10-16T14:26:23.502 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 26, 2023-10-16T14:26:23.502 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 40.205252352000002 2023-10-16T14:26:23.502 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-16T14:26:23.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.486+0000 7f8c4dd35640 1 -- 172.21.15.59:0/2647236498 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8c3406ae70 msgr2=0x7f8c3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:23.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.486+0000 7f8c4dd35640 1 --2- 172.21.15.59:0/2647236498 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8c3406ae70 0x7f8c3406d330 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8c44036000 tx=0x7f8c44030000 comp rx=0 tx=0).stop 2023-10-16T14:26:23.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.486+0000 7f8c4dd35640 1 -- 172.21.15.59:0/2647236498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c480d05c0 msgr2=0x7f8c480cb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:23.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.486+0000 7f8c4dd35640 1 --2- 172.21.15.59:0/2647236498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c480d05c0 0x7f8c480cb810 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800d7d0 tx=0x7f8c3800dc90 comp rx=0 tx=0).stop 2023-10-16T14:26:23.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.486+0000 7f8c4dd35640 1 -- 172.21.15.59:0/2647236498 shutdown_connections 2023-10-16T14:26:23.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.486+0000 7f8c4dd35640 1 --2- 172.21.15.59:0/2647236498 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8c3406ae70 0x7f8c3406d330 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.486+0000 7f8c4dd35640 1 --2- 172.21.15.59:0/2647236498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c4815cc90 0x7f8c480b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.486+0000 7f8c4dd35640 1 --2- 172.21.15.59:0/2647236498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c480d05c0 0x7f8c480cb810 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.486+0000 7f8c4dd35640 1 --2- 172.21.15.59:0/2647236498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c480cfe70 0x7f8c48152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:23.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.486+0000 7f8c4dd35640 1 -- 172.21.15.59:0/2647236498 >> 172.21.15.59:0/2647236498 conn(0x7f8c480d27e0 msgr2=0x7f8c4815aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:23.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.486+0000 7f8c4dd35640 1 -- 172.21.15.59:0/2647236498 shutdown_connections 2023-10-16T14:26:23.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:23.486+0000 7f8c4dd35640 1 -- 172.21.15.59:0/2647236498 wait complete. 2023-10-16T14:26:23.507 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-16T14:26:23.524 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-16T14:26:23.524 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-16T14:26:23.525 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-16T14:26:23.525 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T14:26:23.525 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T14:26:23.525 INFO:tasks.ceph_fuse:client.2 config is {} 2023-10-16T14:26:23.526 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T14:26:23.526 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-16T14:26:23.526 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-16T14:26:23.527 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T14:26:23.527 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T14:26:23.527 INFO:tasks.ceph_fuse:client.3 config is {} 2023-10-16T14:26:23.527 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-16T14:26:23.527 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-16T14:26:23.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:23.528 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-10-16T14:26:23.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:23.591 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2023-10-16T14:26:23.693 INFO:teuthology.orchestra.run.smithi151.stderr:Cannot find device "ceph-brx" 2023-10-16T14:26:23.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T14:26:23.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:23.697 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-16T14:26:23.761 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-16T14:26:23.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:23.763 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-16T14:26:23.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:23.861 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2023-10-16T14:26:24.003 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-16T14:26:24.003 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T14:26:24.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.205+0000 7f316baf7640 1 Processor -- start 2023-10-16T14:26:24.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.205+0000 7f316baf7640 1 -- start start 2023-10-16T14:26:24.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.207+0000 7f316baf7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31640701a0 0x7f316415f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:24.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.207+0000 7f316baf7640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316415f580 con 0x7f31640b0010 2023-10-16T14:26:24.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.207+0000 7f316baf7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31640707f0 con 0x7f316415ad00 2023-10-16T14:26:24.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.207+0000 7f316baf7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3164070610 con 0x7f31640701a0 2023-10-16T14:26:24.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.207+0000 7f3169893640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f31640b0010 0x7f31640b03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58118/0 (socket says 172.21.15.59:58118) 2023-10-16T14:26:24.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.207+0000 7f3169893640 1 -- 172.21.15.59:0/1795264594 learned_addr learned my addr 172.21.15.59:0/1795264594 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.207+0000 7f316a094640 1 --2- 172.21.15.59:0/1795264594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31640701a0 0x7f316415f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.208+0000 7f3168891640 1 -- 172.21.15.59:0/1795264594 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565872170 0 0) 0x7f3160001110 con 0x7f31640b0010 2023-10-16T14:26:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.208+0000 7f3168891640 1 -- 172.21.15.59:0/1795264594 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3150003520 con 0x7f31640b0010 2023-10-16T14:26:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.208+0000 7f3168891640 1 -- 172.21.15.59:0/1795264594 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1507631927 0 0) 0x7f3150003520 con 0x7f31640b0010 2023-10-16T14:26:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.208+0000 7f3168891640 1 -- 172.21.15.59:0/1795264594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31640701a0 msgr2=0x7f316415f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.208+0000 7f3168891640 1 --2- 172.21.15.59:0/1795264594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31640701a0 0x7f316415f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.208+0000 7f3168891640 1 -- 172.21.15.59:0/1795264594 >> v1:172.21.15.151:6789/0 conn(0x7f316415ad00 legacy=0x7f316415b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.208+0000 7f3168891640 1 -- 172.21.15.59:0/1795264594 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3164070ad0 con 0x7f31640b0010 2023-10-16T14:26:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.208+0000 7f3168891640 1 -- 172.21.15.59:0/1795264594 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f3160001800 con 0x7f31640b0010 2023-10-16T14:26:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.208+0000 7f3168891640 1 -- 172.21.15.59:0/1795264594 >> v1:172.21.15.59:6789/0 conn(0x7f31640b0010 legacy=0x7f31640b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.208+0000 7f3168891640 1 --2- 172.21.15.59:0/1795264594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3150003a10 0x7f3150003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.208+0000 7f3168891640 1 --2- 172.21.15.59:0/1795264594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31640701a0 0x7f31500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.208+0000 7f3168891640 1 --2- 172.21.15.59:0/1795264594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3150004d00 0x7f3150005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.208+0000 7f3168891640 1 -- 172.21.15.59:0/1795264594 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3164070610 con 0x7f3150004d00 2023-10-16T14:26:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.208+0000 7f3168891640 1 -- 172.21.15.59:0/1795264594 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315000ba90 con 0x7f3150003a10 2023-10-16T14:26:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.208+0000 7f3168891640 1 -- 172.21.15.59:0/1795264594 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315000bc50 con 0x7f31640701a0 2023-10-16T14:26:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.209+0000 7f316a094640 1 --2- 172.21.15.59:0/1795264594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3150004d00 0x7f3150005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:24.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.209+0000 7f3169092640 1 --2- 172.21.15.59:0/1795264594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31640701a0 0x7f31500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:24.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.209+0000 7f3169893640 1 --2- 172.21.15.59:0/1795264594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3150003a10 0x7f3150003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:24.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.209+0000 7f316a094640 1 -- 172.21.15.59:0/1795264594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31640701a0 msgr2=0x7f31500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:24.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.209+0000 7f316a094640 1 --2- 172.21.15.59:0/1795264594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31640701a0 0x7f31500047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:24.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.209+0000 7f316a094640 1 -- 172.21.15.59:0/1795264594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3150003a10 msgr2=0x7f3150003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:24.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.209+0000 7f316a094640 1 --2- 172.21.15.59:0/1795264594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3150003a10 0x7f3150003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:24.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.209+0000 7f316a094640 1 -- 172.21.15.59:0/1795264594 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3150003520 con 0x7f3150004d00 2023-10-16T14:26:24.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.210+0000 7f316a094640 1 --2- 172.21.15.59:0/1795264594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3150004d00 0x7f3150005180 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f315c009f90 tx=0x7f31500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9cd5a610abbeb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:24.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.211+0000 7f3168891640 1 -- 172.21.15.59:0/1795264594 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c02cbd0 con 0x7f3150004d00 2023-10-16T14:26:24.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.211+0000 7f3168891640 1 -- 172.21.15.59:0/1795264594 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c00f040 con 0x7f3150004d00 2023-10-16T14:26:24.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.211+0000 7f3168891640 1 -- 172.21.15.59:0/1795264594 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c034440 con 0x7f3150004d00 2023-10-16T14:26:24.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.211+0000 7f316baf7640 1 -- 172.21.15.59:0/1795264594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3150004d00 msgr2=0x7f3150005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:24.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.211+0000 7f316baf7640 1 --2- 172.21.15.59:0/1795264594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3150004d00 0x7f3150005180 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f315c009f90 tx=0x7f31500057f0 comp rx=0 tx=0).stop 2023-10-16T14:26:24.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.211+0000 7f316a094640 1 -- 172.21.15.59:0/1795264594 reap_dead start 2023-10-16T14:26:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.211+0000 7f316baf7640 1 -- 172.21.15.59:0/1795264594 shutdown_connections 2023-10-16T14:26:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.211+0000 7f316baf7640 1 -- 172.21.15.59:0/1795264594 >> 172.21.15.59:0/1795264594 conn(0x7f316406c1c0 msgr2=0x7f316406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.211+0000 7f316baf7640 1 -- 172.21.15.59:0/1795264594 shutdown_connections 2023-10-16T14:26:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.212+0000 7f316baf7640 1 -- 172.21.15.59:0/1795264594 wait complete. 2023-10-16T14:26:24.223 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.213+0000 7f316baf7640 1 Processor -- start 2023-10-16T14:26:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.214+0000 7f316baf7640 1 -- start start 2023-10-16T14:26:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.214+0000 7f316baf7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3150004d00 0x7f3164155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.214+0000 7f316baf7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3164155ff0 0x7f316415e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:24.224 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.214+0000 7f316baf7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3164155a30 0x7f31640c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:24.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.215+0000 7f316baf7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316415df20 con 0x7f3164155ff0 2023-10-16T14:26:24.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.215+0000 7f316baf7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316415d2a0 con 0x7f3150004d00 2023-10-16T14:26:24.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.215+0000 7f316baf7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316415d580 con 0x7f3164155a30 2023-10-16T14:26:24.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.215+0000 7f3169092640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3164155ff0 0x7f316415e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:24.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.215+0000 7f3169092640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3164155ff0 0x7f316415e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38552/0 (socket says 172.21.15.59:38552) 2023-10-16T14:26:24.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.215+0000 7f3169092640 1 -- 172.21.15.59:0/1520181245 learned_addr learned my addr 172.21.15.59:0/1520181245 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:24.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.215+0000 7f3169893640 1 --2- 172.21.15.59:0/1520181245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3150004d00 0x7f3164155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:24.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.215+0000 7f316a094640 1 --2- 172.21.15.59:0/1520181245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3164155a30 0x7f31640c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:24.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.215+0000 7f3169092640 1 -- 172.21.15.59:0/1520181245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3164155a30 msgr2=0x7f31640c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:24.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.215+0000 7f3169092640 1 --2- 172.21.15.59:0/1520181245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3164155a30 0x7f31640c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:24.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.215+0000 7f3169092640 1 -- 172.21.15.59:0/1520181245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3150004d00 msgr2=0x7f3164155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:24.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.215+0000 7f3169092640 1 --2- 172.21.15.59:0/1520181245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3150004d00 0x7f3164155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:24.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.215+0000 7f3169092640 1 -- 172.21.15.59:0/1520181245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316415d860 con 0x7f3164155ff0 2023-10-16T14:26:24.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.216+0000 7f3169092640 1 --2- 172.21.15.59:0/1520181245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3164155ff0 0x7f316415e340 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f315400f7f0 tx=0x7f315400fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:24.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.216+0000 7f315a7fc640 1 -- 172.21.15.59:0/1520181245 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31540050d0 con 0x7f3164155ff0 2023-10-16T14:26:24.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.216+0000 7f315a7fc640 1 -- 172.21.15.59:0/1520181245 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3154005230 con 0x7f3164155ff0 2023-10-16T14:26:24.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.216+0000 7f316baf7640 1 -- 172.21.15.59:0/1520181245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f316415db40 con 0x7f3164155ff0 2023-10-16T14:26:24.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.216+0000 7f315a7fc640 1 -- 172.21.15.59:0/1520181245 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315400d730 con 0x7f3164155ff0 2023-10-16T14:26:24.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.216+0000 7f316baf7640 1 -- 172.21.15.59:0/1520181245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316415cec0 con 0x7f3164155ff0 2023-10-16T14:26:24.228 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.217+0000 7f316baf7640 1 -- 172.21.15.59:0/1520181245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316415e060 con 0x7f3164155ff0 2023-10-16T14:26:24.229 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.218+0000 7f315a7fc640 1 -- 172.21.15.59:0/1520181245 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f315400d890 con 0x7f3164155ff0 2023-10-16T14:26:24.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.219+0000 7f315a7fc640 1 --2- 172.21.15.59:0/1520181245 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f314806ae70 0x7f314806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:24.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.219+0000 7f315a7fc640 1 -- 172.21.15.59:0/1520181245 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f31540898f0 con 0x7f3164155ff0 2023-10-16T14:26:24.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.220+0000 7f3169893640 1 --2- 172.21.15.59:0/1520181245 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f314806ae70 0x7f314806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:24.230 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.221+0000 7f3169893640 1 --2- 172.21.15.59:0/1520181245 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f314806ae70 0x7f314806d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3160005a70 tx=0x7f3160009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:24.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.224+0000 7f315a7fc640 1 -- 172.21.15.59:0/1520181245 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f316415e060 con 0x7f3164155ff0 2023-10-16T14:26:24.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.456+0000 7f316baf7640 1 -- 172.21.15.59:0/1520181245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f316415e060 con 0x7f3164155ff0 2023-10-16T14:26:24.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.457+0000 7f315a7fc640 1 -- 172.21.15.59:0/1520181245 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f316415e060 con 0x7f3164155ff0 2023-10-16T14:26:24.461 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T14:26:24.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.461+0000 7f316baf7640 1 -- 172.21.15.59:0/1520181245 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f314806ae70 msgr2=0x7f314806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:24.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.461+0000 7f316baf7640 1 --2- 172.21.15.59:0/1520181245 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f314806ae70 0x7f314806d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3160005a70 tx=0x7f3160009040 comp rx=0 tx=0).stop 2023-10-16T14:26:24.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.461+0000 7f316baf7640 1 -- 172.21.15.59:0/1520181245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3164155ff0 msgr2=0x7f316415e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:24.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.461+0000 7f316baf7640 1 --2- 172.21.15.59:0/1520181245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3164155ff0 0x7f316415e340 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f315400f7f0 tx=0x7f315400fcb0 comp rx=0 tx=0).stop 2023-10-16T14:26:24.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.461+0000 7f316baf7640 1 -- 172.21.15.59:0/1520181245 shutdown_connections 2023-10-16T14:26:24.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.461+0000 7f316baf7640 1 --2- 172.21.15.59:0/1520181245 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f314806ae70 0x7f314806d330 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:24.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.461+0000 7f316baf7640 1 --2- 172.21.15.59:0/1520181245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3164155a30 0x7f31640c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:24.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.461+0000 7f316baf7640 1 --2- 172.21.15.59:0/1520181245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3164155ff0 0x7f316415e340 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:24.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.461+0000 7f316baf7640 1 --2- 172.21.15.59:0/1520181245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3150004d00 0x7f3164155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:24.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.461+0000 7f316baf7640 1 -- 172.21.15.59:0/1520181245 >> 172.21.15.59:0/1520181245 conn(0x7f316406c1c0 msgr2=0x7f31640b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:24.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.461+0000 7f316baf7640 1 -- 172.21.15.59:0/1520181245 shutdown_connections 2023-10-16T14:26:24.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:24.461+0000 7f316baf7640 1 -- 172.21.15.59:0/1520181245 wait complete. 2023-10-16T14:26:24.482 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T14:26:24.483 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T14:26:24.483 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-10-16T14:26:24.483 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T14:26:24.483 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T14:26:24.484 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T14:26:24.484 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T14:26:24.484 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T14:26:24.484 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T14:26:24.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:24.485 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-10-16T14:26:24.539 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T14:26:24.539 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T14:26:24.539 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T14:26:24.540 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:24.540 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-16T14:26:24.540 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:24.540 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T14:26:24.540 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-10-16T14:26:24.541 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2023-10-16T14:26:24.541 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T14:26:24.541 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-10-16T14:26:24.541 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2023-10-16T14:26:24.541 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T14:26:24.542 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-10-16T14:26:24.542 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2023-10-16T14:26:24.542 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-16T14:26:24.542 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42306sec preferred_lft 42306sec 2023-10-16T14:26:24.542 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link noprefixroute 2023-10-16T14:26:24.543 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:24.543 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T14:26:24.543 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-10-16T14:26:24.543 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2023-10-16T14:26:24.544 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T14:26:24.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:24.544 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-16T14:26:24.545 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-16T14:26:24.545 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add name ceph-brx type bridge 2023-10-16T14:26:24.545 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr flush dev ceph-brx 2023-10-16T14:26:24.546 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set ceph-brx up 2023-10-16T14:26:24.546 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T14:26:24.546 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-16T14:26:24.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:24.795 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T14:26:24.879 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-16T14:26:24.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:24.882 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-10-16T14:26:24.932 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-10-16T14:26:24.932 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T14:26:24.933 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-16T14:26:24.933 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-16T14:26:24.933 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T14:26:24.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:24.934 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-16T14:26:24.934 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-16T14:26:24.934 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-16T14:26:24.935 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-16T14:26:24.935 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-16T14:26:24.935 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-16T14:26:25.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:25.130 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-16T14:26:25.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:25.187 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list-id 2023-10-16T14:26:25.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:25.244 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-16T14:26:25.244 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-16T14:26:25.244 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T14:26:25.245 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-16T14:26:25.245 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-16T14:26:25.395 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-16T14:26:25.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:25.396 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-16T14:26:25.396 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-16T14:26:25.396 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-16T14:26:25.396 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T14:26:25.397 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-16T14:26:25.397 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-16T14:26:25.397 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-16T14:26:25.397 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-16T14:26:25.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:25.659 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-16T14:26:25.659 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-16T14:26:25.660 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2023-10-16T14:26:25.660 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T14:26:25.660 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-16T14:26:25.827 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-16T14:26:25.828 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T14:26:25.828 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T14:26:25.879 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T14:26:25.879 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T14:26:25.880 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T14:26:25.932 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2023-10-16T14:26:26.027 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T14:26:26.085 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2023-10-16T14:26:26.086 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2023-10-16T14:26:26.086 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2023-10-16T14:26:26.086 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2023-10-16T14:26:26.086 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2023-10-16T14:26:26.089 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2023-10-16T14:26:26.089 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2023-10-16T14:26:26.090 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2023-10-16T14:26:26.090 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2023-10-16T14:26:26.090 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2023-10-16T14:26:26.090 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/selinux 2023-10-16T14:26:26.090 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T14:26:26.091 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2023-10-16T14:26:26.091 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2023-10-16T14:26:26.091 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2023-10-16T14:26:26.091 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2023-10-16T14:26:26.091 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2023-10-16T14:26:26.092 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T14:26:26.092 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T14:26:26.092 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2023-10-16T14:26:26.092 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T14:26:26.092 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T14:26:26.093 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2023-10-16T14:26:26.093 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2023-10-16T14:26:26.093 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T14:26:26.093 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T14:26:26.093 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T14:26:26.093 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T14:26:26.094 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2023-10-16T14:26:26.094 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T14:26:26.094 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T14:26:26.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:26.096 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2023-10-16T14:26:26.156 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-16T14:26:26.156 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-16T14:26:26.162 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2023-10-16T14:26:26.241 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T14:26:26.283 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2023-10-16T14:26:26.284 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2023-10-16T14:26:26.284 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2023-10-16T14:26:26.284 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2023-10-16T14:26:26.284 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2023-10-16T14:26:26.284 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2023-10-16T14:26:26.285 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2023-10-16T14:26:26.285 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2023-10-16T14:26:26.285 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2023-10-16T14:26:26.285 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2023-10-16T14:26:26.285 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/selinux 2023-10-16T14:26:26.285 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T14:26:26.286 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2023-10-16T14:26:26.286 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2023-10-16T14:26:26.286 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2023-10-16T14:26:26.286 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2023-10-16T14:26:26.286 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2023-10-16T14:26:26.287 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T14:26:26.289 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T14:26:26.289 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2023-10-16T14:26:26.289 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T14:26:26.290 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T14:26:26.290 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2023-10-16T14:26:26.290 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2023-10-16T14:26:26.290 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T14:26:26.290 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T14:26:26.290 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T14:26:26.291 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T14:26:26.291 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2023-10-16T14:26:26.291 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T14:26:26.291 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T14:26:26.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:26.293 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2023-10-16T14:26:26.352 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:2023-10-16T14:26:26.349+0000 7fefa2252480 -1 init, newargv = 0x565221bc3b90 newargc=15 2023-10-16T14:26:26.353 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[96926]: starting ceph client 2023-10-16T14:26:26.364 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[96926]: starting fuse 2023-10-16T14:26:26.381 INFO:teuthology.orchestra.run.smithi059.stdout:41 2023-10-16T14:26:26.381 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-10-16T14:26:26.381 DEBUG:teuthology.orchestra.run.smithi059:> sudo stdin-killer -- python3 -c ' 2023-10-16T14:26:26.382 DEBUG:teuthology.orchestra.run.smithi059:> import glob 2023-10-16T14:26:26.382 DEBUG:teuthology.orchestra.run.smithi059:> import re 2023-10-16T14:26:26.382 DEBUG:teuthology.orchestra.run.smithi059:> import os 2023-10-16T14:26:26.383 DEBUG:teuthology.orchestra.run.smithi059:> import subprocess 2023-10-16T14:26:26.383 DEBUG:teuthology.orchestra.run.smithi059:> 2023-10-16T14:26:26.383 DEBUG:teuthology.orchestra.run.smithi059:> def _find_admin_socket(client_name): 2023-10-16T14:26:26.383 DEBUG:teuthology.orchestra.run.smithi059:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-16T14:26:26.384 DEBUG:teuthology.orchestra.run.smithi059:> files = glob.glob(asok_path) 2023-10-16T14:26:26.384 DEBUG:teuthology.orchestra.run.smithi059:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-16T14:26:26.384 DEBUG:teuthology.orchestra.run.smithi059:> 2023-10-16T14:26:26.385 DEBUG:teuthology.orchestra.run.smithi059:> # Given a non-glob path, it better be there 2023-10-16T14:26:26.385 DEBUG:teuthology.orchestra.run.smithi059:> if "*" not in asok_path: 2023-10-16T14:26:26.385 DEBUG:teuthology.orchestra.run.smithi059:> assert(len(files) == 1) 2023-10-16T14:26:26.386 DEBUG:teuthology.orchestra.run.smithi059:> return files[0] 2023-10-16T14:26:26.386 DEBUG:teuthology.orchestra.run.smithi059:> 2023-10-16T14:26:26.386 DEBUG:teuthology.orchestra.run.smithi059:> for f in files: 2023-10-16T14:26:26.386 DEBUG:teuthology.orchestra.run.smithi059:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-16T14:26:26.387 DEBUG:teuthology.orchestra.run.smithi059:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-16T14:26:26.387 DEBUG:teuthology.orchestra.run.smithi059:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-16T14:26:26.387 DEBUG:teuthology.orchestra.run.smithi059:> contents = proc_f.read() 2023-10-16T14:26:26.388 DEBUG:teuthology.orchestra.run.smithi059:> if mountpoint in contents: 2023-10-16T14:26:26.388 DEBUG:teuthology.orchestra.run.smithi059:> return f 2023-10-16T14:26:26.388 DEBUG:teuthology.orchestra.run.smithi059:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-16T14:26:26.389 DEBUG:teuthology.orchestra.run.smithi059:> 2023-10-16T14:26:26.389 DEBUG:teuthology.orchestra.run.smithi059:> print(_find_admin_socket("client.0")) 2023-10-16T14:26:26.389 DEBUG:teuthology.orchestra.run.smithi059:> ' 2023-10-16T14:26:26.598 INFO:teuthology.orchestra.run.smithi059.stdout:/var/run/ceph/ceph-client.0.96926.asok 2023-10-16T14:26:26.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-16T14:26:26.617 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.96926.asok 2023-10-16T14:26:26.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:26.617 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.96926.asok status 2023-10-16T14:26:26.867 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-16T14:26:26.868 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": { 2023-10-16T14:26:26.868 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-16T14:26:26.868 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-16T14:26:26.869 INFO:teuthology.orchestra.run.smithi059.stdout: "entity_id": "0", 2023-10-16T14:26:26.869 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": "smithi059", 2023-10-16T14:26:26.869 INFO:teuthology.orchestra.run.smithi059.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-16T14:26:26.869 INFO:teuthology.orchestra.run.smithi059.stdout: "pid": "96926", 2023-10-16T14:26:26.869 INFO:teuthology.orchestra.run.smithi059.stdout: "root": "/" 2023-10-16T14:26:26.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:26:26.870 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_count": 0, 2023-10-16T14:26:26.870 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_pinned_count": 0, 2023-10-16T14:26:26.870 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4782, 2023-10-16T14:26:26.870 INFO:teuthology.orchestra.run.smithi059.stdout: "inst": { 2023-10-16T14:26:26.871 INFO:teuthology.orchestra.run.smithi059.stdout: "name": { 2023-10-16T14:26:26.871 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "client", 2023-10-16T14:26:26.871 INFO:teuthology.orchestra.run.smithi059.stdout: "num": 4782 2023-10-16T14:26:26.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:26:26.871 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2023-10-16T14:26:26.871 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-16T14:26:26.872 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2023-10-16T14:26:26.872 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2572153495 2023-10-16T14:26:26.872 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:26:26.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:26:26.872 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2023-10-16T14:26:26.873 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-16T14:26:26.873 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2023-10-16T14:26:26.873 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 2572153495 2023-10-16T14:26:26.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:26:26.873 INFO:teuthology.orchestra.run.smithi059.stdout: "inst_str": "client.4782 192.168.0.1:0/2572153495", 2023-10-16T14:26:26.874 INFO:teuthology.orchestra.run.smithi059.stdout: "addr_str": "192.168.0.1:0/2572153495", 2023-10-16T14:26:26.874 INFO:teuthology.orchestra.run.smithi059.stdout: "inode_count": 1, 2023-10-16T14:26:26.874 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_epoch": 9, 2023-10-16T14:26:26.874 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch": 26, 2023-10-16T14:26:26.874 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch_barrier": 0, 2023-10-16T14:26:26.875 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklisted": false, 2023-10-16T14:26:26.875 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs" 2023-10-16T14:26:26.875 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-16T14:26:26.882 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T14:26:27.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.103+0000 7fe37ef1d640 1 Processor -- start 2023-10-16T14:26:27.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.103+0000 7fe37ef1d640 1 -- start start 2023-10-16T14:26:27.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.104+0000 7fe37ef1d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe3780c9e00 0x7fe3780c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:27.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.104+0000 7fe37ef1d640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe378071c10 con 0x7fe3780ca1e0 2023-10-16T14:26:27.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.104+0000 7fe37ef1d640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe378071e40 con 0x7fe378071800 2023-10-16T14:26:27.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.104+0000 7fe37ef1d640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3780cde00 con 0x7fe3780c9e00 2023-10-16T14:26:27.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.105+0000 7fe377fff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe3780ca1e0 0x7fe3780710f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58128/0 (socket says 172.21.15.59:58128) 2023-10-16T14:26:27.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.105+0000 7fe377fff640 1 -- 172.21.15.59:0/1815567252 learned_addr learned my addr 172.21.15.59:0/1815567252 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:27.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.105+0000 7fe37ccb9640 1 --2- 172.21.15.59:0/1815567252 >> v2:172.21.15.151:3300/0 conn(0x7fe3780c9e00 0x7fe3780c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:27.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.105+0000 7fe3777fe640 1 -- 172.21.15.59:0/1815567252 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177242150 0 0) 0x7fe378071c10 con 0x7fe3780ca1e0 2023-10-16T14:26:27.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.105+0000 7fe3777fe640 1 -- 172.21.15.59:0/1815567252 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe360003520 con 0x7fe3780ca1e0 2023-10-16T14:26:27.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.106+0000 7fe3777fe640 1 -- 172.21.15.59:0/1815567252 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3555750575 0 0) 0x7fe360003520 con 0x7fe3780ca1e0 2023-10-16T14:26:27.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.106+0000 7fe3777fe640 1 -- 172.21.15.59:0/1815567252 >> v2:172.21.15.151:3300/0 conn(0x7fe3780c9e00 msgr2=0x7fe3780c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:27.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.106+0000 7fe3777fe640 1 --2- 172.21.15.59:0/1815567252 >> v2:172.21.15.151:3300/0 conn(0x7fe3780c9e00 0x7fe3780c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:27.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.106+0000 7fe3777fe640 1 -- 172.21.15.59:0/1815567252 >> v1:172.21.15.151:6789/0 conn(0x7fe378071800 legacy=0x7fe3780cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:27.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.106+0000 7fe3777fe640 1 -- 172.21.15.59:0/1815567252 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe378072120 con 0x7fe3780ca1e0 2023-10-16T14:26:27.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.106+0000 7fe3777fe640 1 -- 172.21.15.59:0/1815567252 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7fe36c0019f0 con 0x7fe3780ca1e0 2023-10-16T14:26:27.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.106+0000 7fe3777fe640 1 -- 172.21.15.59:0/1815567252 >> v1:172.21.15.59:6789/0 conn(0x7fe3780ca1e0 legacy=0x7fe3780710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:27.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.106+0000 7fe3777fe640 1 --2- 172.21.15.59:0/1815567252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3600039e0 0x7fe360003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:27.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.106+0000 7fe3777fe640 1 --2- 172.21.15.59:0/1815567252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3600047c0 0x7fe360004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:27.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.106+0000 7fe3777fe640 1 --2- 172.21.15.59:0/1815567252 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe360005180 0x7fe36000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:27.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.106+0000 7fe3777fe640 1 -- 172.21.15.59:0/1815567252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3780cde00 con 0x7fe3600039e0 2023-10-16T14:26:27.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.106+0000 7fe3777fe640 1 -- 172.21.15.59:0/1815567252 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36000e2c0 con 0x7fe3600047c0 2023-10-16T14:26:27.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.106+0000 7fe3777fe640 1 -- 172.21.15.59:0/1815567252 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36000e480 con 0x7fe360005180 2023-10-16T14:26:27.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.106+0000 7fe37ccb9640 1 --2- 172.21.15.59:0/1815567252 >> v2:172.21.15.151:3300/0 conn(0x7fe3780c9e00 0x7fe3780c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:26:27.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.106+0000 7fe37ccb9640 1 --2- 172.21.15.59:0/1815567252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3600039e0 0x7fe360003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:27.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.107+0000 7fe377fff640 1 --2- 172.21.15.59:0/1815567252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3600047c0 0x7fe360004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:27.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.107+0000 7fe37d4ba640 1 --2- 172.21.15.59:0/1815567252 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe360005180 0x7fe36000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:27.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.107+0000 7fe37ccb9640 1 -- 172.21.15.59:0/1815567252 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe360005180 msgr2=0x7fe36000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:27.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.107+0000 7fe37ccb9640 1 --2- 172.21.15.59:0/1815567252 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe360005180 0x7fe36000db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:27.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.107+0000 7fe37ccb9640 1 -- 172.21.15.59:0/1815567252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3600047c0 msgr2=0x7fe360004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:27.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.107+0000 7fe37ccb9640 1 --2- 172.21.15.59:0/1815567252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3600047c0 0x7fe360004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:27.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.107+0000 7fe37ccb9640 1 -- 172.21.15.59:0/1815567252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe360003520 con 0x7fe3600039e0 2023-10-16T14:26:27.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.107+0000 7fe377fff640 1 --2- 172.21.15.59:0/1815567252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3600047c0 0x7fe360004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:26:27.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.107+0000 7fe37d4ba640 1 -- 172.21.15.59:0/1815567252 reap_dead start 2023-10-16T14:26:27.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.108+0000 7fe37ccb9640 1 --2- 172.21.15.59:0/1815567252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3600039e0 0x7fe360003e00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe368009c70 tx=0x7fe3600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a73b80c5ca40316 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:27.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.108+0000 7fe3777fe640 1 -- 172.21.15.59:0/1815567252 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe368004020 con 0x7fe3600039e0 2023-10-16T14:26:27.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.108+0000 7fe3777fe640 1 -- 172.21.15.59:0/1815567252 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe368004180 con 0x7fe3600039e0 2023-10-16T14:26:27.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.108+0000 7fe3777fe640 1 -- 172.21.15.59:0/1815567252 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36802c8f0 con 0x7fe3600039e0 2023-10-16T14:26:27.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.109+0000 7fe37ef1d640 1 -- 172.21.15.59:0/1815567252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3600039e0 msgr2=0x7fe360003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:27.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.109+0000 7fe37ef1d640 1 --2- 172.21.15.59:0/1815567252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3600039e0 0x7fe360003e00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe368009c70 tx=0x7fe3600057f0 comp rx=0 tx=0).stop 2023-10-16T14:26:27.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.109+0000 7fe37ef1d640 1 -- 172.21.15.59:0/1815567252 shutdown_connections 2023-10-16T14:26:27.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.109+0000 7fe37ef1d640 1 --2- 172.21.15.59:0/1815567252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3600039e0 0x7fe360003e00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:27.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.109+0000 7fe37ef1d640 1 -- 172.21.15.59:0/1815567252 >> 172.21.15.59:0/1815567252 conn(0x7fe37806c1c0 msgr2=0x7fe37806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:27.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.109+0000 7fe37ef1d640 1 -- 172.21.15.59:0/1815567252 shutdown_connections 2023-10-16T14:26:27.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.109+0000 7fe37ef1d640 1 -- 172.21.15.59:0/1815567252 wait complete. 2023-10-16T14:26:27.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.111+0000 7fe37ef1d640 1 Processor -- start 2023-10-16T14:26:27.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.111+0000 7fe37ef1d640 1 -- start start 2023-10-16T14:26:27.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.112+0000 7fe37ef1d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3600039e0 0x7fe3780b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:27.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.112+0000 7fe37ef1d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe378155c50 0x7fe3780b1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:27.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.112+0000 7fe37ef1d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3780b28d0 0x7fe378148740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:27.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.112+0000 7fe37ef1d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3780b08b0 con 0x7fe378155c50 2023-10-16T14:26:27.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.112+0000 7fe37ef1d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3780b0b90 con 0x7fe3780b28d0 2023-10-16T14:26:27.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.112+0000 7fe37ef1d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3780b0e70 con 0x7fe3600039e0 2023-10-16T14:26:27.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.113+0000 7fe377fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe378155c50 0x7fe3780b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:27.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.113+0000 7fe377fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe378155c50 0x7fe3780b1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38568/0 (socket says 172.21.15.59:38568) 2023-10-16T14:26:27.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.113+0000 7fe377fff640 1 -- 172.21.15.59:0/2415862912 learned_addr learned my addr 172.21.15.59:0/2415862912 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:27.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.113+0000 7fe37d4ba640 1 --2- 172.21.15.59:0/2415862912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3780b28d0 0x7fe378148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:27.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.113+0000 7fe37ccb9640 1 --2- 172.21.15.59:0/2415862912 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3600039e0 0x7fe3780b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:27.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.113+0000 7fe377fff640 1 -- 172.21.15.59:0/2415862912 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3600039e0 msgr2=0x7fe3780b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:27.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.113+0000 7fe377fff640 1 --2- 172.21.15.59:0/2415862912 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3600039e0 0x7fe3780b0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:27.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.113+0000 7fe377fff640 1 -- 172.21.15.59:0/2415862912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3780b28d0 msgr2=0x7fe378148740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:27.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.113+0000 7fe377fff640 1 --2- 172.21.15.59:0/2415862912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3780b28d0 0x7fe378148740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:27.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.113+0000 7fe377fff640 1 -- 172.21.15.59:0/2415862912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3780b1150 con 0x7fe378155c50 2023-10-16T14:26:27.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.113+0000 7fe377fff640 1 --2- 172.21.15.59:0/2415862912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe378155c50 0x7fe3780b1950 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe36c005fd0 tx=0x7fe36c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:27.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.114+0000 7fe3757fa640 1 -- 172.21.15.59:0/2415862912 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c00ee50 con 0x7fe378155c50 2023-10-16T14:26:27.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.114+0000 7fe3757fa640 1 -- 172.21.15.59:0/2415862912 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c013420 con 0x7fe378155c50 2023-10-16T14:26:27.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.114+0000 7fe3757fa640 1 -- 172.21.15.59:0/2415862912 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c0137b0 con 0x7fe378155c50 2023-10-16T14:26:27.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.114+0000 7fe37ef1d640 1 -- 172.21.15.59:0/2415862912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3780b1430 con 0x7fe378155c50 2023-10-16T14:26:27.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.114+0000 7fe37ef1d640 1 -- 172.21.15.59:0/2415862912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3780b1e90 con 0x7fe378155c50 2023-10-16T14:26:27.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.115+0000 7fe37ef1d640 1 -- 172.21.15.59:0/2415862912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3780b1650 con 0x7fe378155c50 2023-10-16T14:26:27.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.116+0000 7fe3757fa640 1 -- 172.21.15.59:0/2415862912 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe36c013910 con 0x7fe378155c50 2023-10-16T14:26:27.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.117+0000 7fe3757fa640 1 --2- 172.21.15.59:0/2415862912 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe36406ae70 0x7fe36406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:27.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.117+0000 7fe3757fa640 1 -- 172.21.15.59:0/2415862912 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe36c08a140 con 0x7fe378155c50 2023-10-16T14:26:27.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.117+0000 7fe37ccb9640 1 --2- 172.21.15.59:0/2415862912 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe36406ae70 0x7fe36406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:27.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.119+0000 7fe37ccb9640 1 --2- 172.21.15.59:0/2415862912 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe36406ae70 0x7fe36406d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe368035000 tx=0x7fe368030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:27.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.121+0000 7fe3757fa640 1 -- 172.21.15.59:0/2415862912 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe36c054ef0 con 0x7fe378155c50 2023-10-16T14:26:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.356+0000 7fe37ef1d640 1 -- 172.21.15.59:0/2415862912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe378073ef0 con 0x7fe378155c50 2023-10-16T14:26:27.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.357+0000 7fe3757fa640 1 -- 172.21.15.59:0/2415862912 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe36c0018f0 con 0x7fe378155c50 2023-10-16T14:26:27.360 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T14:26:27.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.359+0000 7fe37ef1d640 1 -- 172.21.15.59:0/2415862912 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe36406ae70 msgr2=0x7fe36406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:27.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.359+0000 7fe37ef1d640 1 --2- 172.21.15.59:0/2415862912 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe36406ae70 0x7fe36406d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe368035000 tx=0x7fe368030000 comp rx=0 tx=0).stop 2023-10-16T14:26:27.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.359+0000 7fe37ef1d640 1 -- 172.21.15.59:0/2415862912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe378155c50 msgr2=0x7fe3780b1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:27.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.359+0000 7fe37ef1d640 1 --2- 172.21.15.59:0/2415862912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe378155c50 0x7fe3780b1950 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe36c005fd0 tx=0x7fe36c00e530 comp rx=0 tx=0).stop 2023-10-16T14:26:27.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.359+0000 7fe37ef1d640 1 -- 172.21.15.59:0/2415862912 shutdown_connections 2023-10-16T14:26:27.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.359+0000 7fe37ef1d640 1 --2- 172.21.15.59:0/2415862912 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe36406ae70 0x7fe36406d330 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:27.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.359+0000 7fe37ef1d640 1 --2- 172.21.15.59:0/2415862912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3780b28d0 0x7fe378148740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:27.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.359+0000 7fe37ef1d640 1 --2- 172.21.15.59:0/2415862912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe378155c50 0x7fe3780b1950 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:27.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.359+0000 7fe37ef1d640 1 --2- 172.21.15.59:0/2415862912 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3600039e0 0x7fe3780b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:27.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.359+0000 7fe37ef1d640 1 -- 172.21.15.59:0/2415862912 >> 172.21.15.59:0/2415862912 conn(0x7fe37806c1c0 msgr2=0x7fe3780c2360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.359+0000 7fe37ef1d640 1 -- 172.21.15.59:0/2415862912 shutdown_connections 2023-10-16T14:26:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:27.359+0000 7fe37ef1d640 1 -- 172.21.15.59:0/2415862912 wait complete. 2023-10-16T14:26:27.382 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T14:26:27.383 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T14:26:27.383 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-10-16T14:26:27.383 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-16T14:26:27.384 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-16T14:26:27.384 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T14:26:27.384 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T14:26:27.384 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T14:26:27.384 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-16T14:26:27.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:27.385 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-10-16T14:26:27.442 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T14:26:27.442 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T14:26:27.442 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T14:26:27.443 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:27.443 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-16T14:26:27.443 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:27.443 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T14:26:27.443 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-10-16T14:26:27.443 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2023-10-16T14:26:27.444 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T14:26:27.444 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-10-16T14:26:27.444 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2023-10-16T14:26:27.444 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T14:26:27.444 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-10-16T14:26:27.445 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2023-10-16T14:26:27.445 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-16T14:26:27.445 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42303sec preferred_lft 42303sec 2023-10-16T14:26:27.445 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link noprefixroute 2023-10-16T14:26:27.445 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:27.446 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T14:26:27.446 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-10-16T14:26:27.446 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2023-10-16T14:26:27.446 INFO:teuthology.orchestra.run.smithi059.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T14:26:27.446 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 42:e4:88:d9:5f:1f brd ff:ff:ff:ff:ff:ff 2023-10-16T14:26:27.447 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T14:26:27.447 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:27.447 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::503c:deff:fe31:98c7/64 scope link 2023-10-16T14:26:27.447 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:27.447 INFO:teuthology.orchestra.run.smithi059.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T14:26:27.447 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 42:e4:88:d9:5f:1f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T14:26:27.448 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::40e4:88ff:fed9:5f1f/64 scope link 2023-10-16T14:26:27.448 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:27.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:27.449 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T14:26:27.544 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-16T14:26:27.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:27.548 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-10-16T14:26:27.610 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-10-16T14:26:27.610 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T14:26:27.611 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-16T14:26:27.611 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-16T14:26:27.611 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T14:26:27.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:27.612 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-16T14:26:27.613 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-16T14:26:27.613 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-16T14:26:27.613 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-16T14:26:27.614 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-16T14:26:27.614 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-16T14:26:27.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:27.817 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-16T14:26:27.872 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T14:26:27.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:27.874 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list-id 2023-10-16T14:26:27.931 INFO:teuthology.orchestra.run.smithi059.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-16T14:26:27.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:27.932 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-16T14:26:27.933 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-16T14:26:27.933 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T14:26:27.933 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-16T14:26:27.934 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-16T14:26:28.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:28.091 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-16T14:26:28.190 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T14:26:28.191 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T14:26:28.191 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T14:26:28.191 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:28.191 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-16T14:26:28.192 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:28.192 INFO:teuthology.orchestra.run.smithi059.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T14:26:28.192 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether ea:1c:ff:09:2a:ec brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T14:26:28.192 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T14:26:28.192 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:28.192 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::e81c:ffff:fe09:2aec/64 scope link 2023-10-16T14:26:28.193 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:28.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:28.195 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-16T14:26:28.300 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T14:26:28.300 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T14:26:28.301 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T14:26:28.301 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:28.301 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-16T14:26:28.301 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:28.301 INFO:teuthology.orchestra.run.smithi059.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T14:26:28.302 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether ea:1c:ff:09:2a:ec brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T14:26:28.302 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T14:26:28.302 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:28.302 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::e81c:ffff:fe09:2aec/64 scope link 2023-10-16T14:26:28.302 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:28.304 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-16T14:26:28.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:28.305 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-16T14:26:28.305 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-16T14:26:28.306 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-16T14:26:28.306 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-16T14:26:28.306 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-16T14:26:28.307 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-16T14:26:28.307 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-16T14:26:28.307 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-16T14:26:28.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:28.600 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-16T14:26:28.601 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-16T14:26:28.601 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.1 up 2023-10-16T14:26:28.601 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set dev brx.1 master ceph-brx 2023-10-16T14:26:28.602 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-16T14:26:28.776 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-10-16T14:26:28.776 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T14:26:28.776 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-16T14:26:28.826 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-16T14:26:28.827 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T14:26:28.827 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-16T14:26:28.876 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2023-10-16T14:26:28.964 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T14:26:29.017 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2023-10-16T14:26:29.018 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2023-10-16T14:26:29.018 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2023-10-16T14:26:29.018 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2023-10-16T14:26:29.018 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2023-10-16T14:26:29.019 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2023-10-16T14:26:29.019 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2023-10-16T14:26:29.019 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2023-10-16T14:26:29.019 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2023-10-16T14:26:29.019 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2023-10-16T14:26:29.020 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/selinux 2023-10-16T14:26:29.020 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T14:26:29.020 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2023-10-16T14:26:29.020 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2023-10-16T14:26:29.020 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2023-10-16T14:26:29.021 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2023-10-16T14:26:29.021 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2023-10-16T14:26:29.021 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T14:26:29.021 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T14:26:29.021 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2023-10-16T14:26:29.022 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T14:26:29.022 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T14:26:29.022 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2023-10-16T14:26:29.022 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2023-10-16T14:26:29.022 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T14:26:29.022 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T14:26:29.023 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T14:26:29.023 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T14:26:29.023 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2023-10-16T14:26:29.023 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T14:26:29.023 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T14:26:29.024 INFO:teuthology.orchestra.run.smithi059.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-16T14:26:29.024 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T14:26:29.024 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T14:26:29.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:29.025 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2023-10-16T14:26:29.078 INFO:teuthology.orchestra.run.smithi059.stdout:41 2023-10-16T14:26:29.078 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2023-10-16T14:26:29.078 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-10-16T14:26:29.085 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2023-10-16T14:26:29.166 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T14:26:29.213 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2023-10-16T14:26:29.214 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2023-10-16T14:26:29.214 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2023-10-16T14:26:29.214 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2023-10-16T14:26:29.214 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2023-10-16T14:26:29.215 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2023-10-16T14:26:29.215 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2023-10-16T14:26:29.215 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2023-10-16T14:26:29.215 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2023-10-16T14:26:29.215 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2023-10-16T14:26:29.215 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/selinux 2023-10-16T14:26:29.216 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T14:26:29.216 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2023-10-16T14:26:29.216 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2023-10-16T14:26:29.216 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2023-10-16T14:26:29.216 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2023-10-16T14:26:29.217 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2023-10-16T14:26:29.217 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T14:26:29.217 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T14:26:29.217 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2023-10-16T14:26:29.218 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T14:26:29.218 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T14:26:29.218 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2023-10-16T14:26:29.218 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2023-10-16T14:26:29.218 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T14:26:29.219 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T14:26:29.219 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T14:26:29.219 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T14:26:29.219 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2023-10-16T14:26:29.219 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T14:26:29.220 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T14:26:29.220 INFO:teuthology.orchestra.run.smithi059.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-16T14:26:29.220 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T14:26:29.220 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T14:26:29.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:29.222 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2023-10-16T14:26:29.271 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi059.stderr:2023-10-16T14:26:29.268+0000 7f9f0cf3d480 -1 init, newargv = 0x5597cab93ff0 newargc=15 2023-10-16T14:26:29.272 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi059.stderr:ceph-fuse[97421]: starting ceph client 2023-10-16T14:26:29.283 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi059.stderr:ceph-fuse[97421]: starting fuse 2023-10-16T14:26:29.308 INFO:teuthology.orchestra.run.smithi059.stdout:41 2023-10-16T14:26:29.309 INFO:teuthology.orchestra.run.smithi059.stdout:42 2023-10-16T14:26:29.309 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 42] 2023-10-16T14:26:29.309 DEBUG:teuthology.orchestra.run.smithi059:> sudo stdin-killer -- python3 -c ' 2023-10-16T14:26:29.310 DEBUG:teuthology.orchestra.run.smithi059:> import glob 2023-10-16T14:26:29.310 DEBUG:teuthology.orchestra.run.smithi059:> import re 2023-10-16T14:26:29.310 DEBUG:teuthology.orchestra.run.smithi059:> import os 2023-10-16T14:26:29.311 DEBUG:teuthology.orchestra.run.smithi059:> import subprocess 2023-10-16T14:26:29.311 DEBUG:teuthology.orchestra.run.smithi059:> 2023-10-16T14:26:29.312 DEBUG:teuthology.orchestra.run.smithi059:> def _find_admin_socket(client_name): 2023-10-16T14:26:29.312 DEBUG:teuthology.orchestra.run.smithi059:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-10-16T14:26:29.312 DEBUG:teuthology.orchestra.run.smithi059:> files = glob.glob(asok_path) 2023-10-16T14:26:29.312 DEBUG:teuthology.orchestra.run.smithi059:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-10-16T14:26:29.313 DEBUG:teuthology.orchestra.run.smithi059:> 2023-10-16T14:26:29.313 DEBUG:teuthology.orchestra.run.smithi059:> # Given a non-glob path, it better be there 2023-10-16T14:26:29.313 DEBUG:teuthology.orchestra.run.smithi059:> if "*" not in asok_path: 2023-10-16T14:26:29.314 DEBUG:teuthology.orchestra.run.smithi059:> assert(len(files) == 1) 2023-10-16T14:26:29.314 DEBUG:teuthology.orchestra.run.smithi059:> return files[0] 2023-10-16T14:26:29.314 DEBUG:teuthology.orchestra.run.smithi059:> 2023-10-16T14:26:29.315 DEBUG:teuthology.orchestra.run.smithi059:> for f in files: 2023-10-16T14:26:29.315 DEBUG:teuthology.orchestra.run.smithi059:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-16T14:26:29.315 DEBUG:teuthology.orchestra.run.smithi059:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-16T14:26:29.315 DEBUG:teuthology.orchestra.run.smithi059:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-16T14:26:29.316 DEBUG:teuthology.orchestra.run.smithi059:> contents = proc_f.read() 2023-10-16T14:26:29.316 DEBUG:teuthology.orchestra.run.smithi059:> if mountpoint in contents: 2023-10-16T14:26:29.316 DEBUG:teuthology.orchestra.run.smithi059:> return f 2023-10-16T14:26:29.317 DEBUG:teuthology.orchestra.run.smithi059:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-16T14:26:29.317 DEBUG:teuthology.orchestra.run.smithi059:> 2023-10-16T14:26:29.317 DEBUG:teuthology.orchestra.run.smithi059:> print(_find_admin_socket("client.2")) 2023-10-16T14:26:29.318 DEBUG:teuthology.orchestra.run.smithi059:> ' 2023-10-16T14:26:29.509 INFO:teuthology.orchestra.run.smithi059.stdout:/var/run/ceph/ceph-client.2.97421.asok 2023-10-16T14:26:29.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-16T14:26:29.526 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.97421.asok 2023-10-16T14:26:29.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:29.527 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.97421.asok status 2023-10-16T14:26:29.761 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-16T14:26:29.761 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": { 2023-10-16T14:26:29.762 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-16T14:26:29.762 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-16T14:26:29.762 INFO:teuthology.orchestra.run.smithi059.stdout: "entity_id": "2", 2023-10-16T14:26:29.762 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": "smithi059", 2023-10-16T14:26:29.762 INFO:teuthology.orchestra.run.smithi059.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-10-16T14:26:29.763 INFO:teuthology.orchestra.run.smithi059.stdout: "pid": "97421", 2023-10-16T14:26:29.763 INFO:teuthology.orchestra.run.smithi059.stdout: "root": "/" 2023-10-16T14:26:29.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:26:29.763 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_count": 0, 2023-10-16T14:26:29.763 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_pinned_count": 0, 2023-10-16T14:26:29.764 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4794, 2023-10-16T14:26:29.764 INFO:teuthology.orchestra.run.smithi059.stdout: "inst": { 2023-10-16T14:26:29.764 INFO:teuthology.orchestra.run.smithi059.stdout: "name": { 2023-10-16T14:26:29.764 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "client", 2023-10-16T14:26:29.764 INFO:teuthology.orchestra.run.smithi059.stdout: "num": 4794 2023-10-16T14:26:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:26:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2023-10-16T14:26:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-16T14:26:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.2:0", 2023-10-16T14:26:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3632811606 2023-10-16T14:26:29.766 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:26:29.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:26:29.766 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2023-10-16T14:26:29.767 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-16T14:26:29.767 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.2:0", 2023-10-16T14:26:29.767 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3632811606 2023-10-16T14:26:29.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:26:29.767 INFO:teuthology.orchestra.run.smithi059.stdout: "inst_str": "client.4794 192.168.0.2:0/3632811606", 2023-10-16T14:26:29.768 INFO:teuthology.orchestra.run.smithi059.stdout: "addr_str": "192.168.0.2:0/3632811606", 2023-10-16T14:26:29.768 INFO:teuthology.orchestra.run.smithi059.stdout: "inode_count": 1, 2023-10-16T14:26:29.768 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_epoch": 9, 2023-10-16T14:26:29.768 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch": 27, 2023-10-16T14:26:29.768 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch_barrier": 0, 2023-10-16T14:26:29.769 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklisted": false, 2023-10-16T14:26:29.769 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs" 2023-10-16T14:26:29.769 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-16T14:26:29.776 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T14:26:29.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.991+0000 7f9e1f009640 1 Processor -- start 2023-10-16T14:26:29.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.991+0000 7f9e1f009640 1 -- start start 2023-10-16T14:26:29.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.993+0000 7f9e1f009640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9e180b8600 0x7f9e180cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:29.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.993+0000 7f9e1f009640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e180d1440 0x7f9e180b66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:29.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.993+0000 7f9e1f009640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e180b6240 con 0x7f9e180cf6a0 2023-10-16T14:26:29.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.993+0000 7f9e1f009640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e180cd740 con 0x7f9e180b8600 2023-10-16T14:26:29.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.993+0000 7f9e1f009640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e180cfb50 con 0x7f9e180d1440 2023-10-16T14:26:29.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.993+0000 7f9e1cda5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9e180b8600 0x7f9e180cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:29.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.993+0000 7f9e1d5a6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e180d1440 0x7f9e180b66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:30.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.993+0000 7f9e1cda5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9e180b8600 0x7f9e180cf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.59:56940/0 (socket says 172.21.15.59:56940) 2023-10-16T14:26:30.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.993+0000 7f9e1cda5640 1 -- 172.21.15.59:0/2297378239 learned_addr learned my addr 172.21.15.59:0/2297378239 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:30.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.994+0000 7f9e1cda5640 1 -- 172.21.15.59:0/2297378239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e180d1440 msgr2=0x7f9e180b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:30.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.994+0000 7f9e1cda5640 1 --2- 172.21.15.59:0/2297378239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e180d1440 0x7f9e180b66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:30.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.994+0000 7f9e1cda5640 1 -- 172.21.15.59:0/2297378239 >> v1:172.21.15.151:6789/0 conn(0x7f9e180cf6a0 legacy=0x7f9e180d0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.994+0000 7f9e1cda5640 1 -- 172.21.15.59:0/2297378239 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e180d19b0 con 0x7f9e180b8600 2023-10-16T14:26:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.995+0000 7f9e1cda5640 1 --2- 172.21.15.59:0/2297378239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e180b8600 0x7f9e180cf160 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c009850 tx=0x7f9e0c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ac06dc733ce35db server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.996+0000 7f9e177fe640 1 -- 172.21.15.59:0/2297378239 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c004230 con 0x7f9e180b8600 2023-10-16T14:26:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.996+0000 7f9e177fe640 1 -- 172.21.15.59:0/2297378239 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0c004390 con 0x7f9e180b8600 2023-10-16T14:26:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.996+0000 7f9e177fe640 1 -- 172.21.15.59:0/2297378239 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c003810 con 0x7f9e180b8600 2023-10-16T14:26:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.996+0000 7f9e1f009640 1 -- 172.21.15.59:0/2297378239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e180b8600 msgr2=0x7f9e180cf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.997+0000 7f9e1f009640 1 --2- 172.21.15.59:0/2297378239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e180b8600 0x7f9e180cf160 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c009850 tx=0x7f9e0c02b960 comp rx=0 tx=0).stop 2023-10-16T14:26:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.997+0000 7f9e1f009640 1 -- 172.21.15.59:0/2297378239 shutdown_connections 2023-10-16T14:26:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.997+0000 7f9e1f009640 1 --2- 172.21.15.59:0/2297378239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e180d1440 0x7f9e180b66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.997+0000 7f9e1f009640 1 --2- 172.21.15.59:0/2297378239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e180b8600 0x7f9e180cf160 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.997+0000 7f9e1f009640 1 -- 172.21.15.59:0/2297378239 >> 172.21.15.59:0/2297378239 conn(0x7f9e180b44a0 msgr2=0x7f9e180b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.997+0000 7f9e1f009640 1 -- 172.21.15.59:0/2297378239 shutdown_connections 2023-10-16T14:26:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.997+0000 7f9e1f009640 1 -- 172.21.15.59:0/2297378239 wait complete. 2023-10-16T14:26:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.999+0000 7f9e1f009640 1 Processor -- start 2023-10-16T14:26:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:29.999+0000 7f9e1f009640 1 -- start start 2023-10-16T14:26:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.000+0000 7f9e1f009640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e180b8600 0x7f9e1814e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.000+0000 7f9e1f009640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e180cf6a0 0x7f9e180ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.000+0000 7f9e1f009640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e180d1440 0x7f9e180acad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.000+0000 7f9e1f009640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1814f0f0 con 0x7f9e180d1440 2023-10-16T14:26:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.000+0000 7f9e1f009640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e180c8550 con 0x7f9e180cf6a0 2023-10-16T14:26:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.000+0000 7f9e1f009640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e180c8830 con 0x7f9e180b8600 2023-10-16T14:26:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.001+0000 7f9e1d5a6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e180d1440 0x7f9e180acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.001+0000 7f9e1d5a6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e180d1440 0x7f9e180acad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38576/0 (socket says 172.21.15.59:38576) 2023-10-16T14:26:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.001+0000 7f9e1d5a6640 1 -- 172.21.15.59:0/4139059627 learned_addr learned my addr 172.21.15.59:0/4139059627 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.001+0000 7f9e17fff640 1 --2- 172.21.15.59:0/4139059627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e180cf6a0 0x7f9e180ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.001+0000 7f9e1cda5640 1 --2- 172.21.15.59:0/4139059627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e180b8600 0x7f9e1814e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:30.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.001+0000 7f9e1d5a6640 1 -- 172.21.15.59:0/4139059627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e180b8600 msgr2=0x7f9e1814e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:30.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.001+0000 7f9e1d5a6640 1 --2- 172.21.15.59:0/4139059627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e180b8600 0x7f9e1814e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:30.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.001+0000 7f9e1d5a6640 1 -- 172.21.15.59:0/4139059627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e180cf6a0 msgr2=0x7f9e180ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:30.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.001+0000 7f9e1d5a6640 1 --2- 172.21.15.59:0/4139059627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e180cf6a0 0x7f9e180ac590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:30.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.001+0000 7f9e1d5a6640 1 -- 172.21.15.59:0/4139059627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c009460 con 0x7f9e180d1440 2023-10-16T14:26:30.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.002+0000 7f9e1d5a6640 1 --2- 172.21.15.59:0/4139059627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e180d1440 0x7f9e180acad0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000efc0 tx=0x7f9e1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:30.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.002+0000 7f9e157fa640 1 -- 172.21.15.59:0/4139059627 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e10009ba0 con 0x7f9e180d1440 2023-10-16T14:26:30.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.002+0000 7f9e157fa640 1 -- 172.21.15.59:0/4139059627 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1000f040 con 0x7f9e180d1440 2023-10-16T14:26:30.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.002+0000 7f9e1f009640 1 -- 172.21.15.59:0/4139059627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e180c8b10 con 0x7f9e180d1440 2023-10-16T14:26:30.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.002+0000 7f9e157fa640 1 -- 172.21.15.59:0/4139059627 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e100146c0 con 0x7f9e180d1440 2023-10-16T14:26:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.002+0000 7f9e1f009640 1 -- 172.21.15.59:0/4139059627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e1814ea40 con 0x7f9e180d1440 2023-10-16T14:26:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.003+0000 7f9e1f009640 1 -- 172.21.15.59:0/4139059627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e1814f2f0 con 0x7f9e180d1440 2023-10-16T14:26:30.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.004+0000 7f9e157fa640 1 -- 172.21.15.59:0/4139059627 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9e10014820 con 0x7f9e180d1440 2023-10-16T14:26:30.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.006+0000 7f9e157fa640 1 --2- 172.21.15.59:0/4139059627 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9dfc06ae70 0x7f9dfc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:30.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.006+0000 7f9e157fa640 1 -- 172.21.15.59:0/4139059627 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f9e1008a430 con 0x7f9e180d1440 2023-10-16T14:26:30.024 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.007+0000 7f9e1cda5640 1 --2- 172.21.15.59:0/4139059627 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9dfc06ae70 0x7f9dfc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:30.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.008+0000 7f9e1cda5640 1 --2- 172.21.15.59:0/4139059627 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9dfc06ae70 0x7f9dfc06d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c035000 tx=0x7f9e0c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:30.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.011+0000 7f9e157fa640 1 -- 172.21.15.59:0/4139059627 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9e1814f2f0 con 0x7f9e180d1440 2023-10-16T14:26:30.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.248+0000 7f9e1f009640 1 -- 172.21.15.59:0/4139059627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9e18073ef0 con 0x7f9e180d1440 2023-10-16T14:26:30.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.249+0000 7f9e157fa640 1 -- 172.21.15.59:0/4139059627 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9e10055110 con 0x7f9e180d1440 2023-10-16T14:26:30.252 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T14:26:30.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.251+0000 7f9e1f009640 1 -- 172.21.15.59:0/4139059627 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9dfc06ae70 msgr2=0x7f9dfc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:30.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.251+0000 7f9e1f009640 1 --2- 172.21.15.59:0/4139059627 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9dfc06ae70 0x7f9dfc06d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c035000 tx=0x7f9e0c008030 comp rx=0 tx=0).stop 2023-10-16T14:26:30.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.251+0000 7f9e1f009640 1 -- 172.21.15.59:0/4139059627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e180d1440 msgr2=0x7f9e180acad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:30.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.251+0000 7f9e1f009640 1 --2- 172.21.15.59:0/4139059627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e180d1440 0x7f9e180acad0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000efc0 tx=0x7f9e1000c490 comp rx=0 tx=0).stop 2023-10-16T14:26:30.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.251+0000 7f9e1f009640 1 -- 172.21.15.59:0/4139059627 shutdown_connections 2023-10-16T14:26:30.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.251+0000 7f9e1f009640 1 --2- 172.21.15.59:0/4139059627 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9dfc06ae70 0x7f9dfc06d330 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:30.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.251+0000 7f9e1f009640 1 --2- 172.21.15.59:0/4139059627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e180d1440 0x7f9e180acad0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:30.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.251+0000 7f9e1f009640 1 --2- 172.21.15.59:0/4139059627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e180cf6a0 0x7f9e180ac590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:30.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.251+0000 7f9e1f009640 1 --2- 172.21.15.59:0/4139059627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e180b8600 0x7f9e1814e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:30.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.251+0000 7f9e1f009640 1 -- 172.21.15.59:0/4139059627 >> 172.21.15.59:0/4139059627 conn(0x7f9e180b44a0 msgr2=0x7f9e180cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:30.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.251+0000 7f9e1f009640 1 -- 172.21.15.59:0/4139059627 shutdown_connections 2023-10-16T14:26:30.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:30.251+0000 7f9e1f009640 1 -- 172.21.15.59:0/4139059627 wait complete. 2023-10-16T14:26:30.272 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T14:26:30.273 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T14:26:30.273 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-10-16T14:26:30.273 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-16T14:26:30.273 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-16T14:26:30.274 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T14:26:30.274 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T14:26:30.274 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T14:26:30.274 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-16T14:26:30.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:30.275 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-10-16T14:26:30.337 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T14:26:30.337 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T14:26:30.337 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T14:26:30.338 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:30.338 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-10-16T14:26:30.338 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:30.338 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T14:26:30.338 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-10-16T14:26:30.339 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-10-16T14:26:30.339 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T14:26:30.339 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-10-16T14:26:30.339 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-10-16T14:26:30.340 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T14:26:30.340 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-10-16T14:26:30.340 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T14:26:30.340 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-10-16T14:26:30.340 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T14:26:30.341 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42332sec preferred_lft 42332sec 2023-10-16T14:26:30.341 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-10-16T14:26:30.341 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:30.341 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-16T14:26:30.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:30.342 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-16T14:26:30.342 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-16T14:26:30.343 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add name ceph-brx type bridge 2023-10-16T14:26:30.343 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr flush dev ceph-brx 2023-10-16T14:26:30.343 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set ceph-brx up 2023-10-16T14:26:30.343 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-16T14:26:30.344 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-16T14:26:30.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:30.823 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T14:26:30.907 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-10-16T14:26:30.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:30.911 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-10-16T14:26:30.965 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-10-16T14:26:30.966 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T14:26:30.966 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T14:26:30.966 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T14:26:30.966 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T14:26:30.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:30.967 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-16T14:26:30.967 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-16T14:26:30.968 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T14:26:30.968 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T14:26:30.968 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T14:26:30.969 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-16T14:26:31.388 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:26:31.398 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:26:31.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:31.765 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-10-16T14:26:31.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:31.817 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list-id 2023-10-16T14:26:31.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:31.904 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-16T14:26:31.905 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-16T14:26:31.905 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T14:26:31.905 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-16T14:26:31.905 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-16T14:26:32.073 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-16T14:26:32.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:32.074 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-16T14:26:32.074 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-16T14:26:32.074 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-16T14:26:32.074 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-16T14:26:32.075 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-16T14:26:32.075 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-16T14:26:32.075 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-16T14:26:32.076 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-16T14:26:32.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:32.383 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-16T14:26:32.383 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-16T14:26:32.384 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-10-16T14:26:32.384 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set dev brx.0 master ceph-brx 2023-10-16T14:26:32.384 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-16T14:26:32.526 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-16T14:26:32.526 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T14:26:32.526 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-16T14:26:32.567 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-16T14:26:32.568 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T14:26:32.568 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-16T14:26:32.657 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2023-10-16T14:26:32.742 DEBUG:teuthology.orchestra.run.smithi151:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T14:26:32.791 INFO:teuthology.orchestra.run.smithi151.stdout:/proc 2023-10-16T14:26:32.791 INFO:teuthology.orchestra.run.smithi151.stdout:/sys 2023-10-16T14:26:32.791 INFO:teuthology.orchestra.run.smithi151.stdout:/dev 2023-10-16T14:26:32.792 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/security 2023-10-16T14:26:32.792 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/shm 2023-10-16T14:26:32.792 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/pts 2023-10-16T14:26:32.792 INFO:teuthology.orchestra.run.smithi151.stdout:/run 2023-10-16T14:26:32.792 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/cgroup 2023-10-16T14:26:32.793 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/pstore 2023-10-16T14:26:32.793 INFO:teuthology.orchestra.run.smithi151.stdout:/ 2023-10-16T14:26:32.793 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/selinux 2023-10-16T14:26:32.793 INFO:teuthology.orchestra.run.smithi151.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T14:26:32.793 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/hugepages 2023-10-16T14:26:32.794 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/mqueue 2023-10-16T14:26:32.794 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/debug 2023-10-16T14:26:32.794 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/tracing 2023-10-16T14:26:32.794 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/fuse/connections 2023-10-16T14:26:32.794 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/config 2023-10-16T14:26:32.795 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T14:26:32.795 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T14:26:32.795 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T14:26:32.795 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T14:26:32.795 INFO:teuthology.orchestra.run.smithi151.stdout:/run/user/1000 2023-10-16T14:26:32.796 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph 2023-10-16T14:26:32.796 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-4 2023-10-16T14:26:32.796 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-5 2023-10-16T14:26:32.796 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-6 2023-10-16T14:26:32.796 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-7 2023-10-16T14:26:32.796 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns 2023-10-16T14:26:32.797 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T14:26:32.797 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T14:26:32.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:32.798 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2023-10-16T14:26:32.839 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-16T14:26:32.839 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-16T14:26:32.888 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2023-10-16T14:26:32.962 DEBUG:teuthology.orchestra.run.smithi151:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T14:26:33.004 INFO:teuthology.orchestra.run.smithi151.stdout:/proc 2023-10-16T14:26:33.004 INFO:teuthology.orchestra.run.smithi151.stdout:/sys 2023-10-16T14:26:33.004 INFO:teuthology.orchestra.run.smithi151.stdout:/dev 2023-10-16T14:26:33.004 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/security 2023-10-16T14:26:33.005 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/shm 2023-10-16T14:26:33.005 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/pts 2023-10-16T14:26:33.005 INFO:teuthology.orchestra.run.smithi151.stdout:/run 2023-10-16T14:26:33.005 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/cgroup 2023-10-16T14:26:33.005 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/pstore 2023-10-16T14:26:33.005 INFO:teuthology.orchestra.run.smithi151.stdout:/ 2023-10-16T14:26:33.006 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/selinux 2023-10-16T14:26:33.006 INFO:teuthology.orchestra.run.smithi151.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T14:26:33.006 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/hugepages 2023-10-16T14:26:33.006 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/mqueue 2023-10-16T14:26:33.006 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/debug 2023-10-16T14:26:33.007 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/tracing 2023-10-16T14:26:33.007 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/fuse/connections 2023-10-16T14:26:33.007 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/config 2023-10-16T14:26:33.007 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T14:26:33.007 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T14:26:33.008 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T14:26:33.008 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T14:26:33.008 INFO:teuthology.orchestra.run.smithi151.stdout:/run/user/1000 2023-10-16T14:26:33.008 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph 2023-10-16T14:26:33.008 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-4 2023-10-16T14:26:33.009 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-5 2023-10-16T14:26:33.009 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-6 2023-10-16T14:26:33.009 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-7 2023-10-16T14:26:33.009 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns 2023-10-16T14:26:33.009 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T14:26:33.009 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T14:26:33.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:33.011 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2023-10-16T14:26:33.074 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi151.stderr:2023-10-16T14:26:33.070+0000 7fef0ba3a480 -1 init, newargv = 0x56496f222c40 newargc=15 2023-10-16T14:26:33.074 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi151.stderr:ceph-fuse[92833]: starting ceph client 2023-10-16T14:26:33.085 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi151.stderr:ceph-fuse[92833]: starting fuse 2023-10-16T14:26:33.095 INFO:teuthology.orchestra.run.smithi151.stdout:39 2023-10-16T14:26:33.096 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-10-16T14:26:33.096 DEBUG:teuthology.orchestra.run.smithi151:> sudo stdin-killer -- python3 -c ' 2023-10-16T14:26:33.096 DEBUG:teuthology.orchestra.run.smithi151:> import glob 2023-10-16T14:26:33.097 DEBUG:teuthology.orchestra.run.smithi151:> import re 2023-10-16T14:26:33.097 DEBUG:teuthology.orchestra.run.smithi151:> import os 2023-10-16T14:26:33.097 DEBUG:teuthology.orchestra.run.smithi151:> import subprocess 2023-10-16T14:26:33.098 DEBUG:teuthology.orchestra.run.smithi151:> 2023-10-16T14:26:33.098 DEBUG:teuthology.orchestra.run.smithi151:> def _find_admin_socket(client_name): 2023-10-16T14:26:33.098 DEBUG:teuthology.orchestra.run.smithi151:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-16T14:26:33.099 DEBUG:teuthology.orchestra.run.smithi151:> files = glob.glob(asok_path) 2023-10-16T14:26:33.099 DEBUG:teuthology.orchestra.run.smithi151:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-16T14:26:33.099 DEBUG:teuthology.orchestra.run.smithi151:> 2023-10-16T14:26:33.099 DEBUG:teuthology.orchestra.run.smithi151:> # Given a non-glob path, it better be there 2023-10-16T14:26:33.100 DEBUG:teuthology.orchestra.run.smithi151:> if "*" not in asok_path: 2023-10-16T14:26:33.100 DEBUG:teuthology.orchestra.run.smithi151:> assert(len(files) == 1) 2023-10-16T14:26:33.100 DEBUG:teuthology.orchestra.run.smithi151:> return files[0] 2023-10-16T14:26:33.101 DEBUG:teuthology.orchestra.run.smithi151:> 2023-10-16T14:26:33.101 DEBUG:teuthology.orchestra.run.smithi151:> for f in files: 2023-10-16T14:26:33.101 DEBUG:teuthology.orchestra.run.smithi151:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-16T14:26:33.102 DEBUG:teuthology.orchestra.run.smithi151:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-16T14:26:33.102 DEBUG:teuthology.orchestra.run.smithi151:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-16T14:26:33.102 DEBUG:teuthology.orchestra.run.smithi151:> contents = proc_f.read() 2023-10-16T14:26:33.102 DEBUG:teuthology.orchestra.run.smithi151:> if mountpoint in contents: 2023-10-16T14:26:33.103 DEBUG:teuthology.orchestra.run.smithi151:> return f 2023-10-16T14:26:33.103 DEBUG:teuthology.orchestra.run.smithi151:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-16T14:26:33.103 DEBUG:teuthology.orchestra.run.smithi151:> 2023-10-16T14:26:33.104 DEBUG:teuthology.orchestra.run.smithi151:> print(_find_admin_socket("client.1")) 2023-10-16T14:26:33.104 DEBUG:teuthology.orchestra.run.smithi151:> ' 2023-10-16T14:26:33.305 INFO:teuthology.orchestra.run.smithi151.stdout:/var/run/ceph/ceph-client.1.92833.asok 2023-10-16T14:26:33.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:26:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-16T14:26:33.322 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.92833.asok 2023-10-16T14:26:33.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:33.323 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.92833.asok status 2023-10-16T14:26:33.563 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-10-16T14:26:33.564 INFO:teuthology.orchestra.run.smithi151.stdout: "metadata": { 2023-10-16T14:26:33.564 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-16T14:26:33.564 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-16T14:26:33.564 INFO:teuthology.orchestra.run.smithi151.stdout: "entity_id": "1", 2023-10-16T14:26:33.565 INFO:teuthology.orchestra.run.smithi151.stdout: "hostname": "smithi151", 2023-10-16T14:26:33.565 INFO:teuthology.orchestra.run.smithi151.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-16T14:26:33.565 INFO:teuthology.orchestra.run.smithi151.stdout: "pid": "92833", 2023-10-16T14:26:33.565 INFO:teuthology.orchestra.run.smithi151.stdout: "root": "/" 2023-10-16T14:26:33.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-10-16T14:26:33.565 INFO:teuthology.orchestra.run.smithi151.stdout: "dentry_count": 0, 2023-10-16T14:26:33.566 INFO:teuthology.orchestra.run.smithi151.stdout: "dentry_pinned_count": 0, 2023-10-16T14:26:33.566 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 4693, 2023-10-16T14:26:33.566 INFO:teuthology.orchestra.run.smithi151.stdout: "inst": { 2023-10-16T14:26:33.566 INFO:teuthology.orchestra.run.smithi151.stdout: "name": { 2023-10-16T14:26:33.567 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "client", 2023-10-16T14:26:33.567 INFO:teuthology.orchestra.run.smithi151.stdout: "num": 4693 2023-10-16T14:26:33.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-10-16T14:26:33.567 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": { 2023-10-16T14:26:33.567 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v1", 2023-10-16T14:26:33.567 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "192.168.0.1:0", 2023-10-16T14:26:33.568 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 3665413384 2023-10-16T14:26:33.568 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-10-16T14:26:33.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-10-16T14:26:33.568 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": { 2023-10-16T14:26:33.568 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v1", 2023-10-16T14:26:33.569 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "192.168.0.1:0", 2023-10-16T14:26:33.569 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 3665413384 2023-10-16T14:26:33.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-10-16T14:26:33.569 INFO:teuthology.orchestra.run.smithi151.stdout: "inst_str": "client.4693 192.168.0.1:0/3665413384", 2023-10-16T14:26:33.569 INFO:teuthology.orchestra.run.smithi151.stdout: "addr_str": "192.168.0.1:0/3665413384", 2023-10-16T14:26:33.570 INFO:teuthology.orchestra.run.smithi151.stdout: "inode_count": 1, 2023-10-16T14:26:33.570 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_epoch": 9, 2023-10-16T14:26:33.570 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_epoch": 28, 2023-10-16T14:26:33.570 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_epoch_barrier": 0, 2023-10-16T14:26:33.570 INFO:teuthology.orchestra.run.smithi151.stdout: "blocklisted": false, 2023-10-16T14:26:33.571 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs" 2023-10-16T14:26:33.571 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-10-16T14:26:33.579 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T14:26:33.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.812+0000 7fdab359e640 1 Processor -- start 2023-10-16T14:26:33.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.813+0000 7fdab359e640 1 -- start start 2023-10-16T14:26:33.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.814+0000 7fdab359e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab40cacf0 0x7fdab40cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:33.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.814+0000 7fdab359e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdab415cb80 0x7fdab40cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:33.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.814+0000 7fdab359e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab40cc1e0 con 0x7fdab40cb0d0 2023-10-16T14:26:33.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.814+0000 7fdab359e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab4070170 con 0x7fdab415cb80 2023-10-16T14:26:33.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.814+0000 7fdab359e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40cd360 con 0x7fdab40cacf0 2023-10-16T14:26:33.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.815+0000 7fdab259c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab40cacf0 0x7fdab40cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:33.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.815+0000 7fdab259c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab40cacf0 0x7fdab40cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.59:40962/0 (socket says 172.21.15.59:40962) 2023-10-16T14:26:33.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.815+0000 7fdab259c640 1 -- 172.21.15.59:0/324221773 learned_addr learned my addr 172.21.15.59:0/324221773 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:33.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.815+0000 7fdaabfff640 1 --2- 172.21.15.59:0/324221773 >> v2:172.21.15.151:3300/0 conn(0x7fdab415cb80 0x7fdab40cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:33.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.816+0000 7fdab259c640 1 -- 172.21.15.59:0/324221773 >> v2:172.21.15.151:3300/0 conn(0x7fdab415cb80 msgr2=0x7fdab40cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:33.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.816+0000 7fdab259c640 1 --2- 172.21.15.59:0/324221773 >> v2:172.21.15.151:3300/0 conn(0x7fdab415cb80 0x7fdab40cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:33.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.816+0000 7fdab259c640 1 -- 172.21.15.59:0/324221773 >> v1:172.21.15.151:6789/0 conn(0x7fdab40cb0d0 legacy=0x7fdab406bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:33.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.816+0000 7fdab259c640 1 -- 172.21.15.59:0/324221773 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab40ccac0 con 0x7fdab40cacf0 2023-10-16T14:26:33.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.817+0000 7fdab259c640 1 --2- 172.21.15.59:0/324221773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab40cacf0 0x7fdab40cdc20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009870 tx=0x7fdaa402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67f0e78b5220c20a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:33.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.818+0000 7fdab1d9b640 1 -- 172.21.15.59:0/324221773 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4030840 con 0x7fdab40cacf0 2023-10-16T14:26:33.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.818+0000 7fdab1d9b640 1 -- 172.21.15.59:0/324221773 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa40309a0 con 0x7fdab40cacf0 2023-10-16T14:26:33.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.818+0000 7fdab1d9b640 1 -- 172.21.15.59:0/324221773 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4030d30 con 0x7fdab40cacf0 2023-10-16T14:26:33.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.819+0000 7fdab359e640 1 -- 172.21.15.59:0/324221773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab40cacf0 msgr2=0x7fdab40cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:33.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.819+0000 7fdab359e640 1 --2- 172.21.15.59:0/324221773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab40cacf0 0x7fdab40cdc20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009870 tx=0x7fdaa402b980 comp rx=0 tx=0).stop 2023-10-16T14:26:33.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.819+0000 7fdab359e640 1 -- 172.21.15.59:0/324221773 shutdown_connections 2023-10-16T14:26:33.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.819+0000 7fdab359e640 1 --2- 172.21.15.59:0/324221773 >> v2:172.21.15.151:3300/0 conn(0x7fdab415cb80 0x7fdab40cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:33.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.819+0000 7fdab359e640 1 --2- 172.21.15.59:0/324221773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab40cacf0 0x7fdab40cdc20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:33.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.819+0000 7fdab359e640 1 -- 172.21.15.59:0/324221773 >> 172.21.15.59:0/324221773 conn(0x7fdab406a470 msgr2=0x7fdab40afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:33.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.819+0000 7fdab359e640 1 -- 172.21.15.59:0/324221773 shutdown_connections 2023-10-16T14:26:33.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.819+0000 7fdab359e640 1 -- 172.21.15.59:0/324221773 wait complete. 2023-10-16T14:26:33.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.821+0000 7fdab359e640 1 Processor -- start 2023-10-16T14:26:33.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.821+0000 7fdab359e640 1 -- start start 2023-10-16T14:26:33.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.822+0000 7fdab359e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab40cacf0 0x7fdab41578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:33.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.822+0000 7fdab359e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdab40cb0d0 0x7fdab41580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:33.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.822+0000 7fdab359e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab415cb80 0x7fdab40c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:33.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.822+0000 7fdab359e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40c74e0 con 0x7fdab40cacf0 2023-10-16T14:26:33.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.822+0000 7fdab359e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40c76d0 con 0x7fdab40cb0d0 2023-10-16T14:26:33.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.822+0000 7fdab359e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40c5e60 con 0x7fdab415cb80 2023-10-16T14:26:33.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.822+0000 7fdab259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab40cacf0 0x7fdab41578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:33.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.822+0000 7fdab259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab40cacf0 0x7fdab41578a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35768/0 (socket says 172.21.15.59:35768) 2023-10-16T14:26:33.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.822+0000 7fdab259c640 1 -- 172.21.15.59:0/3638388574 learned_addr learned my addr 172.21.15.59:0/3638388574 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:33.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.823+0000 7fdaabfff640 1 --2- 172.21.15.59:0/3638388574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdab40cb0d0 0x7fdab41580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:33.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.823+0000 7fdab2d9d640 1 --2- 172.21.15.59:0/3638388574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab415cb80 0x7fdab40c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:33.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.823+0000 7fdab259c640 1 -- 172.21.15.59:0/3638388574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab415cb80 msgr2=0x7fdab40c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:33.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.823+0000 7fdab259c640 1 --2- 172.21.15.59:0/3638388574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab415cb80 0x7fdab40c6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:33.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.823+0000 7fdab259c640 1 -- 172.21.15.59:0/3638388574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdab40cb0d0 msgr2=0x7fdab41580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:33.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.823+0000 7fdab259c640 1 --2- 172.21.15.59:0/3638388574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdab40cb0d0 0x7fdab41580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:33.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.823+0000 7fdab259c640 1 -- 172.21.15.59:0/3638388574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa40094d0 con 0x7fdab40cacf0 2023-10-16T14:26:33.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.823+0000 7fdab2d9d640 1 --2- 172.21.15.59:0/3638388574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab415cb80 0x7fdab40c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:33.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.823+0000 7fdab259c640 1 --2- 172.21.15.59:0/3638388574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab40cacf0 0x7fdab41578a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009870 tx=0x7fdaa4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:33.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.824+0000 7fdaaaffd640 1 -- 172.21.15.59:0/3638388574 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4039a90 con 0x7fdab40cacf0 2023-10-16T14:26:33.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.824+0000 7fdaaaffd640 1 -- 172.21.15.59:0/3638388574 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa4039c10 con 0x7fdab40cacf0 2023-10-16T14:26:33.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.824+0000 7fdaaaffd640 1 -- 172.21.15.59:0/3638388574 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa40433f0 con 0x7fdab40cacf0 2023-10-16T14:26:33.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.824+0000 7fdab359e640 1 -- 172.21.15.59:0/3638388574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab40c6140 con 0x7fdab40cacf0 2023-10-16T14:26:33.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.824+0000 7fdab359e640 1 -- 172.21.15.59:0/3638388574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab40c6700 con 0x7fdab40cacf0 2023-10-16T14:26:33.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.825+0000 7fdab359e640 1 -- 172.21.15.59:0/3638388574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab404e9b0 con 0x7fdab40cacf0 2023-10-16T14:26:33.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.826+0000 7fdaaaffd640 1 -- 172.21.15.59:0/3638388574 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdaa4042390 con 0x7fdab40cacf0 2023-10-16T14:26:33.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.827+0000 7fdaaaffd640 1 --2- 172.21.15.59:0/3638388574 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fda9406aea0 0x7fda9406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:33.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.827+0000 7fdaaaffd640 1 -- 172.21.15.59:0/3638388574 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fdaa40abb50 con 0x7fdab40cacf0 2023-10-16T14:26:33.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.828+0000 7fdaabfff640 1 --2- 172.21.15.59:0/3638388574 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fda9406aea0 0x7fda9406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:33.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.829+0000 7fdaabfff640 1 --2- 172.21.15.59:0/3638388574 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fda9406aea0 0x7fda9406d360 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdab40ceac0 tx=0x7fda9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:33.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:33.832+0000 7fdaaaffd640 1 -- 172.21.15.59:0/3638388574 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdaa4076830 con 0x7fdab40cacf0 2023-10-16T14:26:34.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:34.064+0000 7fdab359e640 1 -- 172.21.15.59:0/3638388574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdab40cc6c0 con 0x7fdab40cacf0 2023-10-16T14:26:34.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:34.064+0000 7fdaaaffd640 1 -- 172.21.15.59:0/3638388574 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fdaa4034070 con 0x7fdab40cacf0 2023-10-16T14:26:34.068 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-16T14:26:34.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:34.067+0000 7fdab359e640 1 -- 172.21.15.59:0/3638388574 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fda9406aea0 msgr2=0x7fda9406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:34.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:34.067+0000 7fdab359e640 1 --2- 172.21.15.59:0/3638388574 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fda9406aea0 0x7fda9406d360 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdab40ceac0 tx=0x7fda9c008040 comp rx=0 tx=0).stop 2023-10-16T14:26:34.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:34.067+0000 7fdab359e640 1 -- 172.21.15.59:0/3638388574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab40cacf0 msgr2=0x7fdab41578a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:34.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:34.067+0000 7fdab359e640 1 --2- 172.21.15.59:0/3638388574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab40cacf0 0x7fdab41578a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009870 tx=0x7fdaa4004730 comp rx=0 tx=0).stop 2023-10-16T14:26:34.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:34.067+0000 7fdab359e640 1 -- 172.21.15.59:0/3638388574 shutdown_connections 2023-10-16T14:26:34.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:34.067+0000 7fdab359e640 1 --2- 172.21.15.59:0/3638388574 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fda9406aea0 0x7fda9406d360 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:34.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:34.067+0000 7fdab359e640 1 --2- 172.21.15.59:0/3638388574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdab415cb80 0x7fdab40c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:34.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:34.067+0000 7fdab359e640 1 --2- 172.21.15.59:0/3638388574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdab40cb0d0 0x7fdab41580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:34.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:34.067+0000 7fdab359e640 1 --2- 172.21.15.59:0/3638388574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdab40cacf0 0x7fdab41578a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:34.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:34.067+0000 7fdab359e640 1 -- 172.21.15.59:0/3638388574 >> 172.21.15.59:0/3638388574 conn(0x7fdab406a470 msgr2=0x7fdab40ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:34.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:34.068+0000 7fdab359e640 1 -- 172.21.15.59:0/3638388574 shutdown_connections 2023-10-16T14:26:34.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:34.068+0000 7fdab359e640 1 -- 172.21.15.59:0/3638388574 wait complete. 2023-10-16T14:26:34.090 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T14:26:34.090 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T14:26:34.090 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-10-16T14:26:34.091 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-16T14:26:34.091 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-16T14:26:34.091 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T14:26:34.091 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T14:26:34.092 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T14:26:34.092 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-16T14:26:34.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:34.093 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-10-16T14:26:34.154 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T14:26:34.155 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T14:26:34.155 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T14:26:34.155 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:34.155 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-10-16T14:26:34.156 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:34.156 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T14:26:34.156 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-10-16T14:26:34.156 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-10-16T14:26:34.156 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T14:26:34.157 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-10-16T14:26:34.157 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-10-16T14:26:34.157 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T14:26:34.157 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-10-16T14:26:34.157 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T14:26:34.158 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-10-16T14:26:34.158 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-16T14:26:34.158 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42328sec preferred_lft 42328sec 2023-10-16T14:26:34.158 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-10-16T14:26:34.158 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:34.158 INFO:teuthology.orchestra.run.smithi151.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T14:26:34.159 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 7e:b8:94:0f:c4:c1 brd ff:ff:ff:ff:ff:ff 2023-10-16T14:26:34.159 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T14:26:34.159 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:34.159 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::d8b5:daff:feda:2e9a/64 scope link 2023-10-16T14:26:34.159 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:34.160 INFO:teuthology.orchestra.run.smithi151.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T14:26:34.160 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 7e:b8:94:0f:c4:c1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T14:26:34.160 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::7cb8:94ff:fe0f:c4c1/64 scope link tentative 2023-10-16T14:26:34.160 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:34.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:34.162 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T14:26:34.257 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-10-16T14:26:34.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:34.262 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-10-16T14:26:34.316 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-10-16T14:26:34.317 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T14:26:34.317 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-16T14:26:34.317 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-16T14:26:34.317 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T14:26:34.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:34.318 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-16T14:26:34.318 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-16T14:26:34.319 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-16T14:26:34.319 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-16T14:26:34.319 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-16T14:26:34.320 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-16T14:26:34.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:34.503 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-10-16T14:26:34.555 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-16T14:26:34.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:34.557 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list-id 2023-10-16T14:26:34.614 INFO:teuthology.orchestra.run.smithi151.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-16T14:26:34.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:34.615 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-16T14:26:34.616 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-16T14:26:34.616 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T14:26:34.617 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-16T14:26:34.617 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-16T14:26:34.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:34.765 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-16T14:26:34.856 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T14:26:34.856 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T14:26:34.857 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T14:26:34.857 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:34.857 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-10-16T14:26:34.857 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:34.858 INFO:teuthology.orchestra.run.smithi151.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T14:26:34.858 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9a:a9:a4:76:52:0d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T14:26:34.858 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T14:26:34.859 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:34.859 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::98a9:a4ff:fe76:520d/64 scope link 2023-10-16T14:26:34.859 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:34.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:34.860 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-16T14:26:34.954 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T14:26:34.954 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T14:26:34.955 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T14:26:34.955 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:34.955 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-10-16T14:26:34.955 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:34.955 INFO:teuthology.orchestra.run.smithi151.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T14:26:34.956 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9a:a9:a4:76:52:0d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-16T14:26:34.956 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-16T14:26:34.956 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:34.956 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::98a9:a4ff:fe76:520d/64 scope link 2023-10-16T14:26:34.956 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:26:34.958 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-16T14:26:34.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:34.959 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-16T14:26:34.959 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-16T14:26:34.959 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-16T14:26:34.959 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-16T14:26:34.960 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-16T14:26:34.960 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-16T14:26:34.960 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-16T14:26:34.961 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-16T14:26:35.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:35.220 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-16T14:26:35.220 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-16T14:26:35.221 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.1 up 2023-10-16T14:26:35.221 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set dev brx.1 master ceph-brx 2023-10-16T14:26:35.221 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-16T14:26:35.388 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-10-16T14:26:35.389 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T14:26:35.389 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-16T14:26:35.440 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-16T14:26:35.440 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T14:26:35.441 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-16T14:26:35.493 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2023-10-16T14:26:35.590 DEBUG:teuthology.orchestra.run.smithi151:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T14:26:35.650 INFO:teuthology.orchestra.run.smithi151.stdout:/proc 2023-10-16T14:26:35.651 INFO:teuthology.orchestra.run.smithi151.stdout:/sys 2023-10-16T14:26:35.651 INFO:teuthology.orchestra.run.smithi151.stdout:/dev 2023-10-16T14:26:35.651 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/security 2023-10-16T14:26:35.651 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/shm 2023-10-16T14:26:35.652 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/pts 2023-10-16T14:26:35.652 INFO:teuthology.orchestra.run.smithi151.stdout:/run 2023-10-16T14:26:35.652 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/cgroup 2023-10-16T14:26:35.652 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/pstore 2023-10-16T14:26:35.652 INFO:teuthology.orchestra.run.smithi151.stdout:/ 2023-10-16T14:26:35.653 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/selinux 2023-10-16T14:26:35.653 INFO:teuthology.orchestra.run.smithi151.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T14:26:35.653 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/hugepages 2023-10-16T14:26:35.653 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/mqueue 2023-10-16T14:26:35.654 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/debug 2023-10-16T14:26:35.654 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/tracing 2023-10-16T14:26:35.654 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/fuse/connections 2023-10-16T14:26:35.654 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/config 2023-10-16T14:26:35.655 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T14:26:35.655 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T14:26:35.655 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T14:26:35.655 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T14:26:35.656 INFO:teuthology.orchestra.run.smithi151.stdout:/run/user/1000 2023-10-16T14:26:35.656 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph 2023-10-16T14:26:35.656 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-4 2023-10-16T14:26:35.656 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-5 2023-10-16T14:26:35.656 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-6 2023-10-16T14:26:35.657 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-7 2023-10-16T14:26:35.657 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns 2023-10-16T14:26:35.657 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T14:26:35.657 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T14:26:35.658 INFO:teuthology.orchestra.run.smithi151.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-16T14:26:35.658 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T14:26:35.658 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T14:26:35.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:35.660 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2023-10-16T14:26:35.715 INFO:teuthology.orchestra.run.smithi151.stdout:39 2023-10-16T14:26:35.715 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [39] 2023-10-16T14:26:35.716 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-10-16T14:26:35.721 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2023-10-16T14:26:35.798 DEBUG:teuthology.orchestra.run.smithi151:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T14:26:35.844 INFO:teuthology.orchestra.run.smithi151.stdout:/proc 2023-10-16T14:26:35.844 INFO:teuthology.orchestra.run.smithi151.stdout:/sys 2023-10-16T14:26:35.844 INFO:teuthology.orchestra.run.smithi151.stdout:/dev 2023-10-16T14:26:35.844 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/security 2023-10-16T14:26:35.845 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/shm 2023-10-16T14:26:35.845 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/pts 2023-10-16T14:26:35.845 INFO:teuthology.orchestra.run.smithi151.stdout:/run 2023-10-16T14:26:35.845 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/cgroup 2023-10-16T14:26:35.846 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/pstore 2023-10-16T14:26:35.846 INFO:teuthology.orchestra.run.smithi151.stdout:/ 2023-10-16T14:26:35.846 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/selinux 2023-10-16T14:26:35.846 INFO:teuthology.orchestra.run.smithi151.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T14:26:35.846 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/hugepages 2023-10-16T14:26:35.847 INFO:teuthology.orchestra.run.smithi151.stdout:/dev/mqueue 2023-10-16T14:26:35.847 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/debug 2023-10-16T14:26:35.847 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/tracing 2023-10-16T14:26:35.847 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/fs/fuse/connections 2023-10-16T14:26:35.847 INFO:teuthology.orchestra.run.smithi151.stdout:/sys/kernel/config 2023-10-16T14:26:35.848 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T14:26:35.848 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T14:26:35.848 INFO:teuthology.orchestra.run.smithi151.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T14:26:35.848 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T14:26:35.848 INFO:teuthology.orchestra.run.smithi151.stdout:/run/user/1000 2023-10-16T14:26:35.848 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph 2023-10-16T14:26:35.849 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-4 2023-10-16T14:26:35.849 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-5 2023-10-16T14:26:35.849 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-6 2023-10-16T14:26:35.849 INFO:teuthology.orchestra.run.smithi151.stdout:/var/lib/ceph/osd/ceph-7 2023-10-16T14:26:35.849 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns 2023-10-16T14:26:35.850 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T14:26:35.850 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-16T14:26:35.850 INFO:teuthology.orchestra.run.smithi151.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-16T14:26:35.850 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T14:26:35.850 INFO:teuthology.orchestra.run.smithi151.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-16T14:26:35.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:35.852 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2023-10-16T14:26:35.914 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi151.stderr:2023-10-16T14:26:35.910+0000 7f4527a3a480 -1 init, newargv = 0x55b0b7066b00 newargc=15 2023-10-16T14:26:35.914 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi151.stderr:ceph-fuse[93285]: starting ceph client 2023-10-16T14:26:35.923 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi151.stderr:ceph-fuse[93285]: starting fuse 2023-10-16T14:26:35.939 INFO:teuthology.orchestra.run.smithi151.stdout:39 2023-10-16T14:26:35.939 INFO:teuthology.orchestra.run.smithi151.stdout:42 2023-10-16T14:26:35.940 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39, 42] 2023-10-16T14:26:35.940 DEBUG:teuthology.orchestra.run.smithi151:> sudo stdin-killer -- python3 -c ' 2023-10-16T14:26:35.941 DEBUG:teuthology.orchestra.run.smithi151:> import glob 2023-10-16T14:26:35.941 DEBUG:teuthology.orchestra.run.smithi151:> import re 2023-10-16T14:26:35.941 DEBUG:teuthology.orchestra.run.smithi151:> import os 2023-10-16T14:26:35.942 DEBUG:teuthology.orchestra.run.smithi151:> import subprocess 2023-10-16T14:26:35.942 DEBUG:teuthology.orchestra.run.smithi151:> 2023-10-16T14:26:35.942 DEBUG:teuthology.orchestra.run.smithi151:> def _find_admin_socket(client_name): 2023-10-16T14:26:35.943 DEBUG:teuthology.orchestra.run.smithi151:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-10-16T14:26:35.943 DEBUG:teuthology.orchestra.run.smithi151:> files = glob.glob(asok_path) 2023-10-16T14:26:35.943 DEBUG:teuthology.orchestra.run.smithi151:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-10-16T14:26:35.944 DEBUG:teuthology.orchestra.run.smithi151:> 2023-10-16T14:26:35.944 DEBUG:teuthology.orchestra.run.smithi151:> # Given a non-glob path, it better be there 2023-10-16T14:26:35.945 DEBUG:teuthology.orchestra.run.smithi151:> if "*" not in asok_path: 2023-10-16T14:26:35.945 DEBUG:teuthology.orchestra.run.smithi151:> assert(len(files) == 1) 2023-10-16T14:26:35.945 DEBUG:teuthology.orchestra.run.smithi151:> return files[0] 2023-10-16T14:26:35.946 DEBUG:teuthology.orchestra.run.smithi151:> 2023-10-16T14:26:35.946 DEBUG:teuthology.orchestra.run.smithi151:> for f in files: 2023-10-16T14:26:35.946 DEBUG:teuthology.orchestra.run.smithi151:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-16T14:26:35.947 DEBUG:teuthology.orchestra.run.smithi151:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-16T14:26:35.947 DEBUG:teuthology.orchestra.run.smithi151:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-16T14:26:35.947 DEBUG:teuthology.orchestra.run.smithi151:> contents = proc_f.read() 2023-10-16T14:26:35.948 DEBUG:teuthology.orchestra.run.smithi151:> if mountpoint in contents: 2023-10-16T14:26:35.948 DEBUG:teuthology.orchestra.run.smithi151:> return f 2023-10-16T14:26:35.948 DEBUG:teuthology.orchestra.run.smithi151:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-16T14:26:35.948 DEBUG:teuthology.orchestra.run.smithi151:> 2023-10-16T14:26:35.949 DEBUG:teuthology.orchestra.run.smithi151:> print(_find_admin_socket("client.3")) 2023-10-16T14:26:35.949 DEBUG:teuthology.orchestra.run.smithi151:> ' 2023-10-16T14:26:36.138 INFO:teuthology.orchestra.run.smithi151.stdout:/var/run/ceph/ceph-client.3.93285.asok 2023-10-16T14:26:36.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-16T14:26:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-16T14:26:36.155 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.93285.asok 2023-10-16T14:26:36.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:36.156 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.93285.asok status 2023-10-16T14:26:36.397 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-10-16T14:26:36.397 INFO:teuthology.orchestra.run.smithi151.stdout: "metadata": { 2023-10-16T14:26:36.397 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-16T14:26:36.398 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-16T14:26:36.398 INFO:teuthology.orchestra.run.smithi151.stdout: "entity_id": "3", 2023-10-16T14:26:36.398 INFO:teuthology.orchestra.run.smithi151.stdout: "hostname": "smithi151", 2023-10-16T14:26:36.398 INFO:teuthology.orchestra.run.smithi151.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-10-16T14:26:36.398 INFO:teuthology.orchestra.run.smithi151.stdout: "pid": "93285", 2023-10-16T14:26:36.399 INFO:teuthology.orchestra.run.smithi151.stdout: "root": "/" 2023-10-16T14:26:36.399 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-10-16T14:26:36.399 INFO:teuthology.orchestra.run.smithi151.stdout: "dentry_count": 0, 2023-10-16T14:26:36.399 INFO:teuthology.orchestra.run.smithi151.stdout: "dentry_pinned_count": 0, 2023-10-16T14:26:36.399 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 4711, 2023-10-16T14:26:36.400 INFO:teuthology.orchestra.run.smithi151.stdout: "inst": { 2023-10-16T14:26:36.400 INFO:teuthology.orchestra.run.smithi151.stdout: "name": { 2023-10-16T14:26:36.400 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "client", 2023-10-16T14:26:36.400 INFO:teuthology.orchestra.run.smithi151.stdout: "num": 4711 2023-10-16T14:26:36.400 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-10-16T14:26:36.400 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": { 2023-10-16T14:26:36.401 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v1", 2023-10-16T14:26:36.401 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "192.168.0.2:0", 2023-10-16T14:26:36.401 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 3585013445 2023-10-16T14:26:36.401 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-10-16T14:26:36.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-10-16T14:26:36.402 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": { 2023-10-16T14:26:36.402 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v1", 2023-10-16T14:26:36.402 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "192.168.0.2:0", 2023-10-16T14:26:36.402 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 3585013445 2023-10-16T14:26:36.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-10-16T14:26:36.403 INFO:teuthology.orchestra.run.smithi151.stdout: "inst_str": "client.4711 192.168.0.2:0/3585013445", 2023-10-16T14:26:36.403 INFO:teuthology.orchestra.run.smithi151.stdout: "addr_str": "192.168.0.2:0/3585013445", 2023-10-16T14:26:36.403 INFO:teuthology.orchestra.run.smithi151.stdout: "inode_count": 1, 2023-10-16T14:26:36.403 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_epoch": 9, 2023-10-16T14:26:36.403 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_epoch": 28, 2023-10-16T14:26:36.404 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_epoch_barrier": 0, 2023-10-16T14:26:36.404 INFO:teuthology.orchestra.run.smithi151.stdout: "blocklisted": false, 2023-10-16T14:26:36.404 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs" 2023-10-16T14:26:36.404 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-10-16T14:26:36.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:36.413 DEBUG:teuthology.orchestra.run.smithi059:> stat --file-system '--printf=%T 2023-10-16T14:26:36.413 DEBUG:teuthology.orchestra.run.smithi059:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-16T14:26:36.478 INFO:teuthology.orchestra.run.smithi059.stdout:fuseblk 2023-10-16T14:26:36.479 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-16T14:26:36.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:36.479 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T14:26:36.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:36.586 DEBUG:teuthology.orchestra.run.smithi059:> stat --file-system '--printf=%T 2023-10-16T14:26:36.586 DEBUG:teuthology.orchestra.run.smithi059:> ' -- /home/ubuntu/cephtest/mnt.2 2023-10-16T14:26:36.647 INFO:teuthology.orchestra.run.smithi059.stdout:fuseblk 2023-10-16T14:26:36.647 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-10-16T14:26:36.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:36.648 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-16T14:26:36.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:36.755 DEBUG:teuthology.orchestra.run.smithi151:> stat --file-system '--printf=%T 2023-10-16T14:26:36.755 DEBUG:teuthology.orchestra.run.smithi151:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-16T14:26:36.816 INFO:teuthology.orchestra.run.smithi151.stdout:fuseblk 2023-10-16T14:26:36.816 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-16T14:26:36.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:36.817 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-16T14:26:36.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:36.915 DEBUG:teuthology.orchestra.run.smithi151:> stat --file-system '--printf=%T 2023-10-16T14:26:36.915 DEBUG:teuthology.orchestra.run.smithi151:> ' -- /home/ubuntu/cephtest/mnt.3 2023-10-16T14:26:36.971 INFO:teuthology.orchestra.run.smithi151.stdout:fuseblk 2023-10-16T14:26:36.972 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-10-16T14:26:36.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:36.972 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-16T14:26:37.057 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-16T14:26:37.073 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:26:37.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.307+0000 7f47bdf21640 1 Processor -- start 2023-10-16T14:26:37.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.307+0000 7f47bdf21640 1 -- start start 2023-10-16T14:26:37.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.308+0000 7f47bdf21640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f47b80cad30 0x7f47b80cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:37.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.308+0000 7f47bdf21640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47b80c8d40 0x7f47b80cb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:37.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.309+0000 7f47bdf21640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47b81651e0 0x7f47b8070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:37.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.309+0000 7f47bdf21640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b8164a20 con 0x7f47b81651e0 2023-10-16T14:26:37.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.309+0000 7f47bdf21640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b80721e0 con 0x7f47b80cad30 2023-10-16T14:26:37.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.309+0000 7f47bdf21640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b80c9270 con 0x7f47b80c8d40 2023-10-16T14:26:37.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.309+0000 7f47bd720640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47b81651e0 0x7f47b8070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:37.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.309+0000 7f47bd720640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47b81651e0 0x7f47b8070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35780/0 (socket says 172.21.15.59:35780) 2023-10-16T14:26:37.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.309+0000 7f47bd720640 1 -- 172.21.15.59:0/645571418 learned_addr learned my addr 172.21.15.59:0/645571418 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:37.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.309+0000 7f47affff640 1 --2- 172.21.15.59:0/645571418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47b80c8d40 0x7f47b80cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:37.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.309+0000 7f47bcf1f640 1 --2- 172.21.15.59:0/645571418 >> v2:172.21.15.151:3300/0 conn(0x7f47b80cad30 0x7f47b80cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:37.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.310+0000 7f47bd720640 1 -- 172.21.15.59:0/645571418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47b80c8d40 msgr2=0x7f47b80cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:37.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.310+0000 7f47bd720640 1 --2- 172.21.15.59:0/645571418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47b80c8d40 0x7f47b80cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.310+0000 7f47bd720640 1 -- 172.21.15.59:0/645571418 >> v2:172.21.15.151:3300/0 conn(0x7f47b80cad30 msgr2=0x7f47b80cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:37.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.310+0000 7f47bd720640 1 --2- 172.21.15.59:0/645571418 >> v2:172.21.15.151:3300/0 conn(0x7f47b80cad30 0x7f47b80cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.310+0000 7f47bd720640 1 -- 172.21.15.59:0/645571418 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b80c9550 con 0x7f47b81651e0 2023-10-16T14:26:37.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.311+0000 7f47bd720640 1 --2- 172.21.15.59:0/645571418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47b81651e0 0x7f47b8070080 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f47b80b0c40 tx=0x7f47b002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7d81658b81b90f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:37.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.311+0000 7f47af7fe640 1 -- 172.21.15.59:0/645571418 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0031860 con 0x7f47b81651e0 2023-10-16T14:26:37.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.311+0000 7f47af7fe640 1 -- 172.21.15.59:0/645571418 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b00319c0 con 0x7f47b81651e0 2023-10-16T14:26:37.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.311+0000 7f47af7fe640 1 -- 172.21.15.59:0/645571418 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0031d50 con 0x7f47b81651e0 2023-10-16T14:26:37.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.312+0000 7f47bdf21640 1 -- 172.21.15.59:0/645571418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47b81651e0 msgr2=0x7f47b8070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:37.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.312+0000 7f47bdf21640 1 --2- 172.21.15.59:0/645571418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47b81651e0 0x7f47b8070080 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f47b80b0c40 tx=0x7f47b002b900 comp rx=0 tx=0).stop 2023-10-16T14:26:37.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.312+0000 7f47bdf21640 1 -- 172.21.15.59:0/645571418 shutdown_connections 2023-10-16T14:26:37.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.312+0000 7f47bdf21640 1 --2- 172.21.15.59:0/645571418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47b81651e0 0x7f47b8070080 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.312+0000 7f47bdf21640 1 --2- 172.21.15.59:0/645571418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47b80c8d40 0x7f47b80cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.312+0000 7f47bdf21640 1 --2- 172.21.15.59:0/645571418 >> v2:172.21.15.151:3300/0 conn(0x7f47b80cad30 0x7f47b80cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.312+0000 7f47bdf21640 1 -- 172.21.15.59:0/645571418 >> 172.21.15.59:0/645571418 conn(0x7f47b806a470 msgr2=0x7f47b80afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:37.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.312+0000 7f47bdf21640 1 -- 172.21.15.59:0/645571418 shutdown_connections 2023-10-16T14:26:37.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.312+0000 7f47bdf21640 1 -- 172.21.15.59:0/645571418 wait complete. 2023-10-16T14:26:37.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.314+0000 7f47bdf21640 1 Processor -- start 2023-10-16T14:26:37.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.314+0000 7f47bdf21640 1 -- start start 2023-10-16T14:26:37.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.315+0000 7f47bdf21640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47b80c8d40 0x7f47b815db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.315+0000 7f47bdf21640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47b80cad30 0x7f47b80c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.315+0000 7f47bdf21640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47b81651e0 0x7f47b80b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.315+0000 7f47bdf21640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b8162610 con 0x7f47b80c8d40 2023-10-16T14:26:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.315+0000 7f47bdf21640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b8161c70 con 0x7f47b80cad30 2023-10-16T14:26:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.315+0000 7f47bdf21640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b8161f50 con 0x7f47b81651e0 2023-10-16T14:26:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.315+0000 7f47bcf1f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47b80c8d40 0x7f47b815db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.315+0000 7f47bcf1f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47b80c8d40 0x7f47b815db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35788/0 (socket says 172.21.15.59:35788) 2023-10-16T14:26:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.315+0000 7f47bcf1f640 1 -- 172.21.15.59:0/1641026564 learned_addr learned my addr 172.21.15.59:0/1641026564 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.315+0000 7f47bd720640 1 --2- 172.21.15.59:0/1641026564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47b81651e0 0x7f47b80b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.316+0000 7f47affff640 1 --2- 172.21.15.59:0/1641026564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47b80cad30 0x7f47b80c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.316+0000 7f47bcf1f640 1 -- 172.21.15.59:0/1641026564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47b81651e0 msgr2=0x7f47b80b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.316+0000 7f47bcf1f640 1 --2- 172.21.15.59:0/1641026564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47b81651e0 0x7f47b80b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.316+0000 7f47bcf1f640 1 -- 172.21.15.59:0/1641026564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47b80cad30 msgr2=0x7f47b80c1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.316+0000 7f47bcf1f640 1 --2- 172.21.15.59:0/1641026564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47b80cad30 0x7f47b80c1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.316+0000 7f47bcf1f640 1 -- 172.21.15.59:0/1641026564 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b00094d0 con 0x7f47b80c8d40 2023-10-16T14:26:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.316+0000 7f47bcf1f640 1 --2- 172.21.15.59:0/1641026564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47b80c8d40 0x7f47b815db20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009fc0 tx=0x7f47b400e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:37.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.316+0000 7f47ad7fa640 1 -- 172.21.15.59:0/1641026564 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b4014620 con 0x7f47b80c8d40 2023-10-16T14:26:37.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.316+0000 7f47ad7fa640 1 -- 172.21.15.59:0/1641026564 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b4014780 con 0x7f47b80c8d40 2023-10-16T14:26:37.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.316+0000 7f47ad7fa640 1 -- 172.21.15.59:0/1641026564 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b4014b30 con 0x7f47b80c8d40 2023-10-16T14:26:37.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.316+0000 7f47bdf21640 1 -- 172.21.15.59:0/1641026564 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b8162230 con 0x7f47b80c8d40 2023-10-16T14:26:37.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.317+0000 7f47bdf21640 1 -- 172.21.15.59:0/1641026564 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b80c20c0 con 0x7f47b80c8d40 2023-10-16T14:26:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.318+0000 7f47bdf21640 1 -- 172.21.15.59:0/1641026564 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b804e9b0 con 0x7f47b80c8d40 2023-10-16T14:26:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.319+0000 7f47ad7fa640 1 -- 172.21.15.59:0/1641026564 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f47b4014c90 con 0x7f47b80c8d40 2023-10-16T14:26:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.320+0000 7f47ad7fa640 1 --2- 172.21.15.59:0/1641026564 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f47a406ae70 0x7f47a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.320+0000 7f47ad7fa640 1 -- 172.21.15.59:0/1641026564 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f47b408a3a0 con 0x7f47b80c8d40 2023-10-16T14:26:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.320+0000 7f47affff640 1 --2- 172.21.15.59:0/1641026564 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f47a406ae70 0x7f47a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.321+0000 7f47affff640 1 --2- 172.21.15.59:0/1641026564 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f47a406ae70 0x7f47a406d330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f47a8006fd0 tx=0x7f47a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.324+0000 7f47ad7fa640 1 -- 172.21.15.59:0/1641026564 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47b4055110 con 0x7f47b80c8d40 2023-10-16T14:26:37.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.517+0000 7f47bdf21640 1 -- 172.21.15.59:0/1641026564 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47b815e090 con 0x7f47b80c8d40 2023-10-16T14:26:37.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.519+0000 7f47ad7fa640 1 -- 172.21.15.59:0/1641026564 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18445 (secure 0 0 0) 0x7f47b4058730 con 0x7f47b80c8d40 2023-10-16T14:26:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:37.523 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:26:29.634854+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:26:37.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.522+0000 7f47bdf21640 1 -- 172.21.15.59:0/1641026564 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f47a406ae70 msgr2=0x7f47a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:37.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.522+0000 7f47bdf21640 1 --2- 172.21.15.59:0/1641026564 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f47a406ae70 0x7f47a406d330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f47a8006fd0 tx=0x7f47a8008040 comp rx=0 tx=0).stop 2023-10-16T14:26:37.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.522+0000 7f47bdf21640 1 -- 172.21.15.59:0/1641026564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47b80c8d40 msgr2=0x7f47b815db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:37.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.522+0000 7f47bdf21640 1 --2- 172.21.15.59:0/1641026564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47b80c8d40 0x7f47b815db20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009fc0 tx=0x7f47b400e570 comp rx=0 tx=0).stop 2023-10-16T14:26:37.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.522+0000 7f47bdf21640 1 -- 172.21.15.59:0/1641026564 shutdown_connections 2023-10-16T14:26:37.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.522+0000 7f47bdf21640 1 --2- 172.21.15.59:0/1641026564 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f47a406ae70 0x7f47a406d330 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.522+0000 7f47bdf21640 1 --2- 172.21.15.59:0/1641026564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47b81651e0 0x7f47b80b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.522+0000 7f47bdf21640 1 --2- 172.21.15.59:0/1641026564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47b80cad30 0x7f47b80c1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.522+0000 7f47bdf21640 1 --2- 172.21.15.59:0/1641026564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47b80c8d40 0x7f47b815db20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.523+0000 7f47bdf21640 1 -- 172.21.15.59:0/1641026564 >> 172.21.15.59:0/1641026564 conn(0x7f47b806a470 msgr2=0x7f47b80713c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:37.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.523+0000 7f47bdf21640 1 -- 172.21.15.59:0/1641026564 shutdown_connections 2023-10-16T14:26:37.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.523+0000 7f47bdf21640 1 -- 172.21.15.59:0/1641026564 wait complete. 2023-10-16T14:26:37.544 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T14:25:46.371818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T14:25:47.145341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T14:25:50.758038+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T14:26:37.545 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:26:37.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.773+0000 7fe0cb59e640 1 Processor -- start 2023-10-16T14:26:37.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.773+0000 7fe0cb59e640 1 -- start start 2023-10-16T14:26:37.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.774+0000 7fe0cb59e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe0cc0cb400 0x7fe0cc15e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:37.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.774+0000 7fe0cb59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0cc0c8930 0x7fe0cc0707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:37.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.774+0000 7fe0cb59e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0cc0c8e40 con 0x7fe0cc070400 2023-10-16T14:26:37.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.774+0000 7fe0cb59e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0cc0c9090 con 0x7fe0cc0cb400 2023-10-16T14:26:37.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.774+0000 7fe0cb59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0c9370 con 0x7fe0cc0c8930 2023-10-16T14:26:37.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.775+0000 7fe0ca59c640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe0cc070400 0x7fe0cc0cacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53086/0 (socket says 172.21.15.59:53086) 2023-10-16T14:26:37.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.775+0000 7fe0ca59c640 1 -- 172.21.15.59:0/794880754 learned_addr learned my addr 172.21.15.59:0/794880754 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:37.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.775+0000 7fe0cad9d640 1 --2- 172.21.15.59:0/794880754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0cc0c8930 0x7fe0cc0707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:37.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.775+0000 7fe0c9d9b640 1 --2- 172.21.15.59:0/794880754 >> v2:172.21.15.151:3300/0 conn(0x7fe0cc0cb400 0x7fe0cc15e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:37.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.775+0000 7fe0c959a640 1 -- 172.21.15.59:0/794880754 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304208062 0 0) 0x7fe0cc0c8e40 con 0x7fe0cc070400 2023-10-16T14:26:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.775+0000 7fe0c959a640 1 -- 172.21.15.59:0/794880754 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0b8003520 con 0x7fe0cc070400 2023-10-16T14:26:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.775+0000 7fe0c959a640 1 -- 172.21.15.59:0/794880754 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3713408299 0 0) 0x7fe0b8003520 con 0x7fe0cc070400 2023-10-16T14:26:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.775+0000 7fe0c959a640 1 -- 172.21.15.59:0/794880754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0cc0c8930 msgr2=0x7fe0cc0707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.775+0000 7fe0c959a640 1 --2- 172.21.15.59:0/794880754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0cc0c8930 0x7fe0cc0707e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.775+0000 7fe0c959a640 1 -- 172.21.15.59:0/794880754 >> v2:172.21.15.151:3300/0 conn(0x7fe0cc0cb400 msgr2=0x7fe0cc15e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.775+0000 7fe0c959a640 1 --2- 172.21.15.59:0/794880754 >> v2:172.21.15.151:3300/0 conn(0x7fe0cc0cb400 0x7fe0cc15e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.775+0000 7fe0c959a640 1 -- 172.21.15.59:0/794880754 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc0c9650 con 0x7fe0cc070400 2023-10-16T14:26:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.776+0000 7fe0c959a640 1 -- 172.21.15.59:0/794880754 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7fe0bc001670 con 0x7fe0cc070400 2023-10-16T14:26:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.776+0000 7fe0c959a640 1 -- 172.21.15.59:0/794880754 >> v1:172.21.15.59:6789/0 conn(0x7fe0cc070400 legacy=0x7fe0cc0cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.776+0000 7fe0c959a640 1 --2- 172.21.15.59:0/794880754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0cc0c8930 0x7fe0b8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:37.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.776+0000 7fe0c959a640 1 --2- 172.21.15.59:0/794880754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0b8003f40 0x7fe0b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.776+0000 7fe0c959a640 1 --2- 172.21.15.59:0/794880754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b8004d00 0x7fe0b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.776+0000 7fe0c959a640 1 -- 172.21.15.59:0/794880754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0c9090 con 0x7fe0b8004d00 2023-10-16T14:26:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.776+0000 7fe0c959a640 1 -- 172.21.15.59:0/794880754 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0c9370 con 0x7fe0b8003f40 2023-10-16T14:26:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.776+0000 7fe0c959a640 1 -- 172.21.15.59:0/794880754 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b800b980 con 0x7fe0cc0c8930 2023-10-16T14:26:37.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.776+0000 7fe0cad9d640 1 --2- 172.21.15.59:0/794880754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b8004d00 0x7fe0b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.776+0000 7fe0c9d9b640 1 --2- 172.21.15.59:0/794880754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0b8003f40 0x7fe0b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.776+0000 7fe0ca59c640 1 --2- 172.21.15.59:0/794880754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0cc0c8930 0x7fe0b8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.776+0000 7fe0cad9d640 1 -- 172.21.15.59:0/794880754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0cc0c8930 msgr2=0x7fe0b8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.776+0000 7fe0cad9d640 1 --2- 172.21.15.59:0/794880754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0cc0c8930 0x7fe0b8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.776+0000 7fe0cad9d640 1 -- 172.21.15.59:0/794880754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0b8003f40 msgr2=0x7fe0b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:37.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.776+0000 7fe0cad9d640 1 --2- 172.21.15.59:0/794880754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0b8003f40 0x7fe0b80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.777+0000 7fe0cad9d640 1 -- 172.21.15.59:0/794880754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b8003520 con 0x7fe0b8004d00 2023-10-16T14:26:37.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.777+0000 7fe0c9d9b640 1 --2- 172.21.15.59:0/794880754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0b8003f40 0x7fe0b80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:37.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.777+0000 7fe0ca59c640 1 --2- 172.21.15.59:0/794880754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0cc0c8930 0x7fe0b8003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.778+0000 7fe0cad9d640 1 --2- 172.21.15.59:0/794880754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b8004d00 0x7fe0b8005180 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009ac0 tx=0x7fe0b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eda392c9656ef4f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.778+0000 7fe0c959a640 1 -- 172.21.15.59:0/794880754 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c402c660 con 0x7fe0b8004d00 2023-10-16T14:26:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.778+0000 7fe0c959a640 1 -- 172.21.15.59:0/794880754 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c402c7c0 con 0x7fe0b8004d00 2023-10-16T14:26:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.778+0000 7fe0c959a640 1 -- 172.21.15.59:0/794880754 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c402cb70 con 0x7fe0b8004d00 2023-10-16T14:26:37.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.778+0000 7fe0cb59e640 1 -- 172.21.15.59:0/794880754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b8004d00 msgr2=0x7fe0b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:37.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.778+0000 7fe0cb59e640 1 --2- 172.21.15.59:0/794880754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b8004d00 0x7fe0b8005180 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009ac0 tx=0x7fe0b80057f0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.778+0000 7fe0cad9d640 1 -- 172.21.15.59:0/794880754 reap_dead start 2023-10-16T14:26:37.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.779+0000 7fe0cb59e640 1 -- 172.21.15.59:0/794880754 shutdown_connections 2023-10-16T14:26:37.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.779+0000 7fe0cb59e640 1 -- 172.21.15.59:0/794880754 >> 172.21.15.59:0/794880754 conn(0x7fe0cc06a470 msgr2=0x7fe0cc0afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:37.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.779+0000 7fe0cb59e640 1 -- 172.21.15.59:0/794880754 shutdown_connections 2023-10-16T14:26:37.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.779+0000 7fe0cb59e640 1 -- 172.21.15.59:0/794880754 wait complete. 2023-10-16T14:26:37.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.781+0000 7fe0cb59e640 1 Processor -- start 2023-10-16T14:26:37.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.781+0000 7fe0cb59e640 1 -- start start 2023-10-16T14:26:37.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.782+0000 7fe0cb59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0cc1ef6a0 0x7fe0cc0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:37.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.782+0000 7fe0cb59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0cc149940 0x7fe0cc0b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:37.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.782+0000 7fe0cb59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0cc149380 0x7fe0cc0b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:37.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.782+0000 7fe0cb59e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0b1d80 con 0x7fe0cc149940 2023-10-16T14:26:37.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.782+0000 7fe0cb59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0b1170 con 0x7fe0cc149380 2023-10-16T14:26:37.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.782+0000 7fe0cb59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0b1450 con 0x7fe0cc1ef6a0 2023-10-16T14:26:37.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.782+0000 7fe0c9d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0cc149940 0x7fe0cc0b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:37.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.782+0000 7fe0c9d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0cc149940 0x7fe0cc0b3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35802/0 (socket says 172.21.15.59:35802) 2023-10-16T14:26:37.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.782+0000 7fe0c9d9b640 1 -- 172.21.15.59:0/1257946409 learned_addr learned my addr 172.21.15.59:0/1257946409 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:37.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.782+0000 7fe0ca59c640 1 --2- 172.21.15.59:0/1257946409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0cc1ef6a0 0x7fe0cc0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:37.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.782+0000 7fe0cad9d640 1 --2- 172.21.15.59:0/1257946409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0cc149380 0x7fe0cc0b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:37.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.782+0000 7fe0c9d9b640 1 -- 172.21.15.59:0/1257946409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0cc1ef6a0 msgr2=0x7fe0cc0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:37.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.782+0000 7fe0c9d9b640 1 --2- 172.21.15.59:0/1257946409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0cc1ef6a0 0x7fe0cc0b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.782+0000 7fe0c9d9b640 1 -- 172.21.15.59:0/1257946409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0cc149380 msgr2=0x7fe0cc0b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:37.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.782+0000 7fe0c9d9b640 1 --2- 172.21.15.59:0/1257946409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0cc149380 0x7fe0cc0b3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.782+0000 7fe0c9d9b640 1 -- 172.21.15.59:0/1257946409 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc0b1730 con 0x7fe0cc149940 2023-10-16T14:26:37.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.783+0000 7fe0c9d9b640 1 --2- 172.21.15.59:0/1257946409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0cc149940 0x7fe0cc0b3110 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400f3d0 tx=0x7fe0b400f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:37.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.783+0000 7fe0c2ffd640 1 -- 172.21.15.59:0/1257946409 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b401a070 con 0x7fe0cc149940 2023-10-16T14:26:37.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.783+0000 7fe0c2ffd640 1 -- 172.21.15.59:0/1257946409 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b4003990 con 0x7fe0cc149940 2023-10-16T14:26:37.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.783+0000 7fe0c2ffd640 1 -- 172.21.15.59:0/1257946409 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4003d00 con 0x7fe0cc149940 2023-10-16T14:26:37.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.783+0000 7fe0cb59e640 1 -- 172.21.15.59:0/1257946409 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0cc0b1a10 con 0x7fe0cc149940 2023-10-16T14:26:37.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.783+0000 7fe0cb59e640 1 -- 172.21.15.59:0/1257946409 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0cc0b0d90 con 0x7fe0cc149940 2023-10-16T14:26:37.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.785+0000 7fe0cb59e640 1 -- 172.21.15.59:0/1257946409 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0cc04e9b0 con 0x7fe0cc149940 2023-10-16T14:26:37.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.785+0000 7fe0c2ffd640 1 -- 172.21.15.59:0/1257946409 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe0b4004020 con 0x7fe0cc149940 2023-10-16T14:26:37.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.786+0000 7fe0c2ffd640 1 --2- 172.21.15.59:0/1257946409 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe0ac06ae70 0x7fe0ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:37.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.787+0000 7fe0c2ffd640 1 -- 172.21.15.59:0/1257946409 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fe0b408a5c0 con 0x7fe0cc149940 2023-10-16T14:26:37.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.787+0000 7fe0ca59c640 1 --2- 172.21.15.59:0/1257946409 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe0ac06ae70 0x7fe0ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:37.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.788+0000 7fe0ca59c640 1 --2- 172.21.15.59:0/1257946409 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe0ac06ae70 0x7fe0ac06d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc000ff0 tx=0x7fe0bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:37.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.791+0000 7fe0c2ffd640 1 -- 172.21.15.59:0/1257946409 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe0b4055330 con 0x7fe0cc149940 2023-10-16T14:26:37.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.990+0000 7fe0cb59e640 1 -- 172.21.15.59:0/1257946409 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe0cc0b0b70 con 0x7fe0cc149940 2023-10-16T14:26:37.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.991+0000 7fe0c2ffd640 1 -- 172.21.15.59:0/1257946409 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe0b4003e60 con 0x7fe0cc149940 2023-10-16T14:26:37.995 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:26:37.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.994+0000 7fe0cb59e640 1 -- 172.21.15.59:0/1257946409 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe0ac06ae70 msgr2=0x7fe0ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:37.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.994+0000 7fe0cb59e640 1 --2- 172.21.15.59:0/1257946409 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe0ac06ae70 0x7fe0ac06d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc000ff0 tx=0x7fe0bc009040 comp rx=0 tx=0).stop 2023-10-16T14:26:37.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.994+0000 7fe0cb59e640 1 -- 172.21.15.59:0/1257946409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0cc149940 msgr2=0x7fe0cc0b3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:37.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.994+0000 7fe0cb59e640 1 --2- 172.21.15.59:0/1257946409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0cc149940 0x7fe0cc0b3110 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400f3d0 tx=0x7fe0b400f890 comp rx=0 tx=0).stop 2023-10-16T14:26:37.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.994+0000 7fe0cb59e640 1 -- 172.21.15.59:0/1257946409 shutdown_connections 2023-10-16T14:26:37.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.994+0000 7fe0cb59e640 1 --2- 172.21.15.59:0/1257946409 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe0ac06ae70 0x7fe0ac06d330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.994+0000 7fe0cb59e640 1 --2- 172.21.15.59:0/1257946409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0cc149380 0x7fe0cc0b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.994+0000 7fe0cb59e640 1 --2- 172.21.15.59:0/1257946409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0cc149940 0x7fe0cc0b3110 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.994+0000 7fe0cb59e640 1 --2- 172.21.15.59:0/1257946409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0cc1ef6a0 0x7fe0cc0b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:37.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.994+0000 7fe0cb59e640 1 -- 172.21.15.59:0/1257946409 >> 172.21.15.59:0/1257946409 conn(0x7fe0cc06a470 msgr2=0x7fe0cc0afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:37.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.994+0000 7fe0cb59e640 1 -- 172.21.15.59:0/1257946409 shutdown_connections 2023-10-16T14:26:38.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:37.994+0000 7fe0cb59e640 1 -- 172.21.15.59:0/1257946409 wait complete. 2023-10-16T14:26:38.015 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T14:26:38.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.231+0000 7f85691c5640 1 Processor -- start 2023-10-16T14:26:38.235 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.231+0000 7f85691c5640 1 -- start start 2023-10-16T14:26:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.233+0000 7f85691c5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8564071f40 0x7f85640c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:38.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.233+0000 7f85691c5640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85640cd0c0 con 0x7f85640ca820 2023-10-16T14:26:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.233+0000 7f85691c5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85640cc540 con 0x7f8564159890 2023-10-16T14:26:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.233+0000 7f85691c5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85640cc820 con 0x7f8564071f40 2023-10-16T14:26:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.233+0000 7f856259c640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f85640ca820 0x7f85640c8ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53092/0 (socket says 172.21.15.59:53092) 2023-10-16T14:26:38.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.233+0000 7f856259c640 1 -- 172.21.15.59:0/4285299005 learned_addr learned my addr 172.21.15.59:0/4285299005 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:38.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.233+0000 7f856359e640 1 --2- 172.21.15.59:0/4285299005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8564071f40 0x7f85640c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:38.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.234+0000 7f8561d9b640 1 -- 172.21.15.59:0/4285299005 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52265176 0 0) 0x7f85640cd0c0 con 0x7f85640ca820 2023-10-16T14:26:38.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.234+0000 7f8561d9b640 1 -- 172.21.15.59:0/4285299005 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8550005730 con 0x7f85640ca820 2023-10-16T14:26:38.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.234+0000 7f8561d9b640 1 -- 172.21.15.59:0/4285299005 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 601912161 0 0) 0x7f8550005730 con 0x7f85640ca820 2023-10-16T14:26:38.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.234+0000 7f8561d9b640 1 -- 172.21.15.59:0/4285299005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8564071f40 msgr2=0x7f85640c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:38.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.234+0000 7f8561d9b640 1 --2- 172.21.15.59:0/4285299005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8564071f40 0x7f85640c95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.234+0000 7f8561d9b640 1 -- 172.21.15.59:0/4285299005 >> v1:172.21.15.151:6789/0 conn(0x7f8564159890 legacy=0x7f85640ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:38.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.234+0000 7f8561d9b640 1 -- 172.21.15.59:0/4285299005 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85640ccb00 con 0x7f85640ca820 2023-10-16T14:26:38.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.234+0000 7f8561d9b640 1 -- 172.21.15.59:0/4285299005 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f854c001690 con 0x7f85640ca820 2023-10-16T14:26:38.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.234+0000 7f8561d9b640 1 -- 172.21.15.59:0/4285299005 >> v1:172.21.15.59:6789/0 conn(0x7f85640ca820 legacy=0x7f85640c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:38.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.234+0000 7f8561d9b640 1 --2- 172.21.15.59:0/4285299005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8550005bb0 0x7f8550005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:38.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.234+0000 7f8561d9b640 1 --2- 172.21.15.59:0/4285299005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85500069d0 0x7f8550006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:38.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.234+0000 7f8561d9b640 1 --2- 172.21.15.59:0/4285299005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8564071f40 0x7f8550007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:38.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.234+0000 7f8561d9b640 1 -- 172.21.15.59:0/4285299005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85640cc820 con 0x7f85500069d0 2023-10-16T14:26:38.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.234+0000 7f8561d9b640 1 -- 172.21.15.59:0/4285299005 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855000dc70 con 0x7f8550005bb0 2023-10-16T14:26:38.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.234+0000 7f8561d9b640 1 -- 172.21.15.59:0/4285299005 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855000de30 con 0x7f8564071f40 2023-10-16T14:26:38.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.235+0000 7f856259c640 1 --2- 172.21.15.59:0/4285299005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85500069d0 0x7f8550006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:38.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.235+0000 7f8562d9d640 1 --2- 172.21.15.59:0/4285299005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8550005bb0 0x7f8550005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:38.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.235+0000 7f856259c640 1 -- 172.21.15.59:0/4285299005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8564071f40 msgr2=0x7f8550007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:38.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.235+0000 7f856259c640 1 --2- 172.21.15.59:0/4285299005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8564071f40 0x7f8550007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.235+0000 7f856259c640 1 -- 172.21.15.59:0/4285299005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8550005bb0 msgr2=0x7f8550005fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:38.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.235+0000 7f856259c640 1 --2- 172.21.15.59:0/4285299005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8550005bb0 0x7f8550005fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.235+0000 7f856259c640 1 -- 172.21.15.59:0/4285299005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8550005730 con 0x7f85500069d0 2023-10-16T14:26:38.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.236+0000 7f856259c640 1 --2- 172.21.15.59:0/4285299005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85500069d0 0x7f8550006e50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f85640cd9d0 tx=0x7f8550007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156ee4ee71349014 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:38.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.237+0000 7f8561d9b640 1 -- 172.21.15.59:0/4285299005 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c005ad0 con 0x7f85500069d0 2023-10-16T14:26:38.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.237+0000 7f8561d9b640 1 -- 172.21.15.59:0/4285299005 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854c005c30 con 0x7f85500069d0 2023-10-16T14:26:38.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.237+0000 7f8561d9b640 1 -- 172.21.15.59:0/4285299005 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854c02c790 con 0x7f85500069d0 2023-10-16T14:26:38.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.237+0000 7f85691c5640 1 -- 172.21.15.59:0/4285299005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85500069d0 msgr2=0x7f8550006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:38.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.237+0000 7f85691c5640 1 --2- 172.21.15.59:0/4285299005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85500069d0 0x7f8550006e50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f85640cd9d0 tx=0x7f8550007a00 comp rx=0 tx=0).stop 2023-10-16T14:26:38.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.237+0000 7f856359e640 1 -- 172.21.15.59:0/4285299005 reap_dead start 2023-10-16T14:26:38.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.237+0000 7f85691c5640 1 -- 172.21.15.59:0/4285299005 shutdown_connections 2023-10-16T14:26:38.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.237+0000 7f85691c5640 1 -- 172.21.15.59:0/4285299005 >> 172.21.15.59:0/4285299005 conn(0x7f85640b0030 msgr2=0x7f85640b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:38.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.237+0000 7f85691c5640 1 -- 172.21.15.59:0/4285299005 shutdown_connections 2023-10-16T14:26:38.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.237+0000 7f85691c5640 1 -- 172.21.15.59:0/4285299005 wait complete. 2023-10-16T14:26:38.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.239+0000 7f85691c5640 1 Processor -- start 2023-10-16T14:26:38.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.239+0000 7f85691c5640 1 -- start start 2023-10-16T14:26:38.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.240+0000 7f85691c5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85500069d0 0x7f8564151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:38.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.240+0000 7f85691c5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85640713f0 0x7f8564071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:38.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.240+0000 7f85691c5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85641f5ae0 0x7f85641f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:38.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.240+0000 7f85691c5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85641f6850 con 0x7f85641f5ae0 2023-10-16T14:26:38.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.240+0000 7f85691c5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8564071d90 con 0x7f85500069d0 2023-10-16T14:26:38.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.240+0000 7f85691c5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8564151f80 con 0x7f85640713f0 2023-10-16T14:26:38.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.241+0000 7f856359e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85641f5ae0 0x7f85641f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:38.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.241+0000 7f856359e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85641f5ae0 0x7f85641f5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35812/0 (socket says 172.21.15.59:35812) 2023-10-16T14:26:38.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.241+0000 7f856359e640 1 -- 172.21.15.59:0/612881419 learned_addr learned my addr 172.21.15.59:0/612881419 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:38.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.241+0000 7f8562d9d640 1 --2- 172.21.15.59:0/612881419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85500069d0 0x7f8564151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:38.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.241+0000 7f856259c640 1 --2- 172.21.15.59:0/612881419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85640713f0 0x7f8564071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:38.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.241+0000 7f856359e640 1 -- 172.21.15.59:0/612881419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85640713f0 msgr2=0x7f8564071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:38.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.241+0000 7f856359e640 1 --2- 172.21.15.59:0/612881419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85640713f0 0x7f8564071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.241+0000 7f856359e640 1 -- 172.21.15.59:0/612881419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85500069d0 msgr2=0x7f8564151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:38.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.241+0000 7f856359e640 1 --2- 172.21.15.59:0/612881419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85500069d0 0x7f8564151a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.241+0000 7f856359e640 1 -- 172.21.15.59:0/612881419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85640b1aa0 con 0x7f85641f5ae0 2023-10-16T14:26:38.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.241+0000 7f856259c640 1 --2- 172.21.15.59:0/612881419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85640713f0 0x7f8564071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:38.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.241+0000 7f856359e640 1 --2- 172.21.15.59:0/612881419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85641f5ae0 0x7f85641f5f60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f85640700a0 tx=0x7f855c00e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:38.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.242+0000 7f855b7fe640 1 -- 172.21.15.59:0/612881419 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c013680 con 0x7f85641f5ae0 2023-10-16T14:26:38.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.242+0000 7f855b7fe640 1 -- 172.21.15.59:0/612881419 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855c0137e0 con 0x7f85641f5ae0 2023-10-16T14:26:38.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.242+0000 7f855b7fe640 1 -- 172.21.15.59:0/612881419 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c013b90 con 0x7f85641f5ae0 2023-10-16T14:26:38.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.242+0000 7f85691c5640 1 -- 172.21.15.59:0/612881419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85640b1170 con 0x7f85641f5ae0 2023-10-16T14:26:38.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.242+0000 7f85691c5640 1 -- 172.21.15.59:0/612881419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85640b1730 con 0x7f85641f5ae0 2023-10-16T14:26:38.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.243+0000 7f85691c5640 1 -- 172.21.15.59:0/612881419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85640b18f0 con 0x7f85641f5ae0 2023-10-16T14:26:38.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.244+0000 7f855b7fe640 1 -- 172.21.15.59:0/612881419 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f855c013cf0 con 0x7f85641f5ae0 2023-10-16T14:26:38.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.246+0000 7f855b7fe640 1 --2- 172.21.15.59:0/612881419 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f854406aea0 0x7f854406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:38.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.246+0000 7f855b7fe640 1 -- 172.21.15.59:0/612881419 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f855c089590 con 0x7f85641f5ae0 2023-10-16T14:26:38.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.247+0000 7f8562d9d640 1 --2- 172.21.15.59:0/612881419 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f854406aea0 0x7f854406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:38.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.248+0000 7f8562d9d640 1 --2- 172.21.15.59:0/612881419 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f854406aea0 0x7f854406d360 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8554007fd0 tx=0x7f8554009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:38.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.250+0000 7f855b7fe640 1 -- 172.21.15.59:0/612881419 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f855c054270 con 0x7f85641f5ae0 2023-10-16T14:26:38.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.441+0000 7f85691c5640 1 -- 172.21.15.59:0/612881419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f85640b1c30 con 0x7f85641f5ae0 2023-10-16T14:26:38.445 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.442+0000 7f855b7fe640 1 -- 172.21.15.59:0/612881419 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f855c057890 con 0x7f85641f5ae0 2023-10-16T14:26:38.446 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:38.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.444+0000 7f85691c5640 1 -- 172.21.15.59:0/612881419 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f854406aea0 msgr2=0x7f854406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:38.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.444+0000 7f85691c5640 1 --2- 172.21.15.59:0/612881419 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f854406aea0 0x7f854406d360 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8554007fd0 tx=0x7f8554009040 comp rx=0 tx=0).stop 2023-10-16T14:26:38.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.444+0000 7f85691c5640 1 -- 172.21.15.59:0/612881419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85641f5ae0 msgr2=0x7f85641f5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:38.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.444+0000 7f85691c5640 1 --2- 172.21.15.59:0/612881419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85641f5ae0 0x7f85641f5f60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f85640700a0 tx=0x7f855c00e9f0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.445+0000 7f85691c5640 1 -- 172.21.15.59:0/612881419 shutdown_connections 2023-10-16T14:26:38.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.445+0000 7f85691c5640 1 --2- 172.21.15.59:0/612881419 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f854406aea0 0x7f854406d360 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.445+0000 7f85691c5640 1 --2- 172.21.15.59:0/612881419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85641f5ae0 0x7f85641f5f60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.445+0000 7f85691c5640 1 --2- 172.21.15.59:0/612881419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85640713f0 0x7f8564071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.445+0000 7f85691c5640 1 --2- 172.21.15.59:0/612881419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85500069d0 0x7f8564151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.445+0000 7f85691c5640 1 -- 172.21.15.59:0/612881419 >> 172.21.15.59:0/612881419 conn(0x7f85640b0030 msgr2=0x7f85640ac220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:38.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.445+0000 7f85691c5640 1 -- 172.21.15.59:0/612881419 shutdown_connections 2023-10-16T14:26:38.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.445+0000 7f85691c5640 1 -- 172.21.15.59:0/612881419 wait complete. 2023-10-16T14:26:38.468 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T14:26:38.692 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.689+0000 7f14d0755640 1 Processor -- start 2023-10-16T14:26:38.693 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.689+0000 7f14d0755640 1 -- start start 2023-10-16T14:26:38.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.690+0000 7f14d0755640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c81611f0 0x7f14c815cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:38.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.691+0000 7f14d0755640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c8160730 con 0x7f14c815cbf0 2023-10-16T14:26:38.694 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.691+0000 7f14d0755640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c815dd60 con 0x7f14c80cb3b0 2023-10-16T14:26:38.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.691+0000 7f14d0755640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c81609f0 con 0x7f14c81611f0 2023-10-16T14:26:38.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.691+0000 7f14ce4f1640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f14c815cbf0 0x7f14c80caca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53102/0 (socket says 172.21.15.59:53102) 2023-10-16T14:26:38.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.691+0000 7f14ce4f1640 1 -- 172.21.15.59:0/4026792375 learned_addr learned my addr 172.21.15.59:0/4026792375 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:38.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.691+0000 7f14cdcf0640 1 --2- 172.21.15.59:0/4026792375 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c81611f0 0x7f14c815cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:38.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.691+0000 7f14cd4ef640 1 -- 172.21.15.59:0/4026792375 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65491829 0 0) 0x7f14c8160730 con 0x7f14c815cbf0 2023-10-16T14:26:38.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.691+0000 7f14cd4ef640 1 -- 172.21.15.59:0/4026792375 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14b4003520 con 0x7f14c815cbf0 2023-10-16T14:26:38.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.692+0000 7f14cd4ef640 1 -- 172.21.15.59:0/4026792375 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2451016139 0 0) 0x7f14b4003520 con 0x7f14c815cbf0 2023-10-16T14:26:38.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.692+0000 7f14cd4ef640 1 -- 172.21.15.59:0/4026792375 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c81611f0 msgr2=0x7f14c815cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:38.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.692+0000 7f14cd4ef640 1 --2- 172.21.15.59:0/4026792375 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c81611f0 0x7f14c815cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.692+0000 7f14cd4ef640 1 -- 172.21.15.59:0/4026792375 >> v1:172.21.15.151:6789/0 conn(0x7f14c80cb3b0 legacy=0x7f14c815d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:38.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.692+0000 7f14cd4ef640 1 -- 172.21.15.59:0/4026792375 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c8160cd0 con 0x7f14c815cbf0 2023-10-16T14:26:38.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.692+0000 7f14cd4ef640 1 -- 172.21.15.59:0/4026792375 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f14c4001670 con 0x7f14c815cbf0 2023-10-16T14:26:38.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.692+0000 7f14cd4ef640 1 -- 172.21.15.59:0/4026792375 >> v1:172.21.15.59:6789/0 conn(0x7f14c815cbf0 legacy=0x7f14c80caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:38.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.692+0000 7f14cd4ef640 1 --2- 172.21.15.59:0/4026792375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14b40039a0 0x7f14b4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:38.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.692+0000 7f14cd4ef640 1 --2- 172.21.15.59:0/4026792375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40047c0 0x7f14b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:38.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.692+0000 7f14cd4ef640 1 --2- 172.21.15.59:0/4026792375 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c81611f0 0x7f14b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:38.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.692+0000 7f14cd4ef640 1 -- 172.21.15.59:0/4026792375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c81609f0 con 0x7f14b40047c0 2023-10-16T14:26:38.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.692+0000 7f14cd4ef640 1 -- 172.21.15.59:0/4026792375 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b400ba60 con 0x7f14b40039a0 2023-10-16T14:26:38.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.692+0000 7f14cd4ef640 1 -- 172.21.15.59:0/4026792375 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b400bc20 con 0x7f14c81611f0 2023-10-16T14:26:38.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.692+0000 7f14cdcf0640 1 --2- 172.21.15.59:0/4026792375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40047c0 0x7f14b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:38.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.693+0000 7f14ce4f1640 1 --2- 172.21.15.59:0/4026792375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14b40039a0 0x7f14b4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:38.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.693+0000 7f14cecf2640 1 --2- 172.21.15.59:0/4026792375 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c81611f0 0x7f14b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:38.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.693+0000 7f14cdcf0640 1 -- 172.21.15.59:0/4026792375 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c81611f0 msgr2=0x7f14b4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:38.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.693+0000 7f14cdcf0640 1 --2- 172.21.15.59:0/4026792375 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c81611f0 0x7f14b4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.693+0000 7f14cdcf0640 1 -- 172.21.15.59:0/4026792375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14b40039a0 msgr2=0x7f14b4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:38.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.693+0000 7f14cdcf0640 1 --2- 172.21.15.59:0/4026792375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14b40039a0 0x7f14b4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.693+0000 7f14cdcf0640 1 -- 172.21.15.59:0/4026792375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b4003520 con 0x7f14b40047c0 2023-10-16T14:26:38.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.694+0000 7f14cdcf0640 1 --2- 172.21.15.59:0/4026792375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40047c0 0x7f14b4004c40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f14c8161650 tx=0x7f14b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65eef8f6407b89e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:38.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.694+0000 7f14cd4ef640 1 -- 172.21.15.59:0/4026792375 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b802c630 con 0x7f14b40047c0 2023-10-16T14:26:38.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.694+0000 7f14cd4ef640 1 -- 172.21.15.59:0/4026792375 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b802c790 con 0x7f14b40047c0 2023-10-16T14:26:38.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.694+0000 7f14cd4ef640 1 -- 172.21.15.59:0/4026792375 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b802cb20 con 0x7f14b40047c0 2023-10-16T14:26:38.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.695+0000 7f14d0755640 1 -- 172.21.15.59:0/4026792375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40047c0 msgr2=0x7f14b4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:38.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.695+0000 7f14d0755640 1 --2- 172.21.15.59:0/4026792375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40047c0 0x7f14b4004c40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f14c8161650 tx=0x7f14b40057f0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.695+0000 7f14cecf2640 1 -- 172.21.15.59:0/4026792375 reap_dead start 2023-10-16T14:26:38.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.695+0000 7f14d0755640 1 -- 172.21.15.59:0/4026792375 shutdown_connections 2023-10-16T14:26:38.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.695+0000 7f14d0755640 1 -- 172.21.15.59:0/4026792375 >> 172.21.15.59:0/4026792375 conn(0x7f14c80b0030 msgr2=0x7f14c80b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:38.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.695+0000 7f14d0755640 1 -- 172.21.15.59:0/4026792375 shutdown_connections 2023-10-16T14:26:38.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.695+0000 7f14d0755640 1 -- 172.21.15.59:0/4026792375 wait complete. 2023-10-16T14:26:38.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.697+0000 7f14d0755640 1 Processor -- start 2023-10-16T14:26:38.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.697+0000 7f14d0755640 1 -- start start 2023-10-16T14:26:38.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.698+0000 7f14d0755640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40047c0 0x7f14c80af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:38.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.698+0000 7f14d0755640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c80afc10 0x7f14c81f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:38.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.698+0000 7f14d0755640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14c81f2480 0x7f14c80ac020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:38.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.698+0000 7f14d0755640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80c50b0 con 0x7f14b40047c0 2023-10-16T14:26:38.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.698+0000 7f14d0755640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c81f2930 con 0x7f14c81f2480 2023-10-16T14:26:38.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.698+0000 7f14d0755640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c81502f0 con 0x7f14c80afc10 2023-10-16T14:26:38.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.698+0000 7f14ce4f1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40047c0 0x7f14c80af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:38.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.698+0000 7f14ce4f1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40047c0 0x7f14c80af6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35834/0 (socket says 172.21.15.59:35834) 2023-10-16T14:26:38.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.698+0000 7f14ce4f1640 1 -- 172.21.15.59:0/4084421071 learned_addr learned my addr 172.21.15.59:0/4084421071 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:38.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.699+0000 7f14cdcf0640 1 --2- 172.21.15.59:0/4084421071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c80afc10 0x7f14c81f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:38.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.699+0000 7f14cecf2640 1 --2- 172.21.15.59:0/4084421071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14c81f2480 0x7f14c80ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:38.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.699+0000 7f14ce4f1640 1 -- 172.21.15.59:0/4084421071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c80afc10 msgr2=0x7f14c81f1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:38.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.699+0000 7f14ce4f1640 1 --2- 172.21.15.59:0/4084421071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c80afc10 0x7f14c81f1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.699+0000 7f14ce4f1640 1 -- 172.21.15.59:0/4084421071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14c81f2480 msgr2=0x7f14c80ac020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:38.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.699+0000 7f14ce4f1640 1 --2- 172.21.15.59:0/4084421071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14c81f2480 0x7f14c80ac020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.699+0000 7f14ce4f1640 1 -- 172.21.15.59:0/4084421071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c80c4af0 con 0x7f14b40047c0 2023-10-16T14:26:38.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.699+0000 7f14cdcf0640 1 --2- 172.21.15.59:0/4084421071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c80afc10 0x7f14c81f1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:38.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.699+0000 7f14ce4f1640 1 --2- 172.21.15.59:0/4084421071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40047c0 0x7f14c80af6d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f14c400e830 tx=0x7f14c400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:38.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.699+0000 7f14beffd640 1 -- 172.21.15.59:0/4084421071 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c400c870 con 0x7f14b40047c0 2023-10-16T14:26:38.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.700+0000 7f14beffd640 1 -- 172.21.15.59:0/4084421071 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c400c9d0 con 0x7f14b40047c0 2023-10-16T14:26:38.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.700+0000 7f14beffd640 1 -- 172.21.15.59:0/4084421071 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c400cd80 con 0x7f14b40047c0 2023-10-16T14:26:38.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.700+0000 7f14d0755640 1 -- 172.21.15.59:0/4084421071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c80c4dd0 con 0x7f14b40047c0 2023-10-16T14:26:38.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.700+0000 7f14d0755640 1 -- 172.21.15.59:0/4084421071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c8150930 con 0x7f14b40047c0 2023-10-16T14:26:38.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.701+0000 7f14d0755640 1 -- 172.21.15.59:0/4084421071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c81504b0 con 0x7f14b40047c0 2023-10-16T14:26:38.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.702+0000 7f14beffd640 1 -- 172.21.15.59:0/4084421071 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f14c401d460 con 0x7f14b40047c0 2023-10-16T14:26:38.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.703+0000 7f14beffd640 1 --2- 172.21.15.59:0/4084421071 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f14ac06ae70 0x7f14ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:38.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.703+0000 7f14beffd640 1 -- 172.21.15.59:0/4084421071 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f14c4089950 con 0x7f14b40047c0 2023-10-16T14:26:38.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.704+0000 7f14cdcf0640 1 --2- 172.21.15.59:0/4084421071 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f14ac06ae70 0x7f14ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:38.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.705+0000 7f14cdcf0640 1 --2- 172.21.15.59:0/4084421071 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f14ac06ae70 0x7f14ac06d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f14b8036000 tx=0x7f14b8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:38.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.708+0000 7f14beffd640 1 -- 172.21.15.59:0/4084421071 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f14c81504b0 con 0x7f14b40047c0 2023-10-16T14:26:38.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.903+0000 7f14d0755640 1 -- 172.21.15.59:0/4084421071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f14c81504b0 con 0x7f14b40047c0 2023-10-16T14:26:38.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.904+0000 7f14beffd640 1 -- 172.21.15.59:0/4084421071 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f14c81504b0 con 0x7f14b40047c0 2023-10-16T14:26:38.908 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-16T14:26:38.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.907+0000 7f14d0755640 1 -- 172.21.15.59:0/4084421071 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f14ac06ae70 msgr2=0x7f14ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:38.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.907+0000 7f14d0755640 1 --2- 172.21.15.59:0/4084421071 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f14ac06ae70 0x7f14ac06d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f14b8036000 tx=0x7f14b8030000 comp rx=0 tx=0).stop 2023-10-16T14:26:38.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.907+0000 7f14d0755640 1 -- 172.21.15.59:0/4084421071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40047c0 msgr2=0x7f14c80af6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:38.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.907+0000 7f14d0755640 1 --2- 172.21.15.59:0/4084421071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40047c0 0x7f14c80af6d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f14c400e830 tx=0x7f14c400ecf0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.907+0000 7f14d0755640 1 -- 172.21.15.59:0/4084421071 shutdown_connections 2023-10-16T14:26:38.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.907+0000 7f14d0755640 1 --2- 172.21.15.59:0/4084421071 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f14ac06ae70 0x7f14ac06d330 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.907+0000 7f14d0755640 1 --2- 172.21.15.59:0/4084421071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14c81f2480 0x7f14c80ac020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.907+0000 7f14d0755640 1 --2- 172.21.15.59:0/4084421071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14c80afc10 0x7f14c81f1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.907+0000 7f14d0755640 1 --2- 172.21.15.59:0/4084421071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40047c0 0x7f14c80af6d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:38.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.907+0000 7f14d0755640 1 -- 172.21.15.59:0/4084421071 >> 172.21.15.59:0/4084421071 conn(0x7f14c80b0030 msgr2=0x7f14c815f150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:38.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.908+0000 7f14d0755640 1 -- 172.21.15.59:0/4084421071 shutdown_connections 2023-10-16T14:26:38.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:38.908+0000 7f14d0755640 1 -- 172.21.15.59:0/4084421071 wait complete. 2023-10-16T14:26:38.931 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T14:26:39.164 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.161+0000 7f4910e09640 1 Processor -- start 2023-10-16T14:26:39.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.161+0000 7f4910e09640 1 -- start start 2023-10-16T14:26:39.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.162+0000 7f4910e09640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f490c15a830 0x7f490c0cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:39.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.162+0000 7f4910e09640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f490c0ca550 0x7f490c070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:39.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.162+0000 7f4910e09640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f490c0cf040 con 0x7f490c070860 2023-10-16T14:26:39.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.162+0000 7f4910e09640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f490c070cf0 con 0x7f490c15a830 2023-10-16T14:26:39.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.162+0000 7f4910e09640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f490c0ca9e0 con 0x7f490c0ca550 2023-10-16T14:26:39.167 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.163+0000 7f490a59c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f490c15a830 0x7f490c0cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:39.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.163+0000 7f490a59c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f490c15a830 0x7f490c0cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35838/0 (socket says 172.21.15.59:35838) 2023-10-16T14:26:39.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.163+0000 7f490a59c640 1 -- 172.21.15.59:0/3308733968 learned_addr learned my addr 172.21.15.59:0/3308733968 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:39.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.163+0000 7f4903fff640 1 --2- 172.21.15.59:0/3308733968 >> v2:172.21.15.151:3300/0 conn(0x7f490c0ca550 0x7f490c070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:39.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.164+0000 7f490a59c640 1 -- 172.21.15.59:0/3308733968 >> v2:172.21.15.151:3300/0 conn(0x7f490c0ca550 msgr2=0x7f490c070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:39.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.164+0000 7f490a59c640 1 --2- 172.21.15.59:0/3308733968 >> v2:172.21.15.151:3300/0 conn(0x7f490c0ca550 0x7f490c070320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:39.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.164+0000 7f490a59c640 1 -- 172.21.15.59:0/3308733968 >> v1:172.21.15.151:6789/0 conn(0x7f490c070860 legacy=0x7f490c15e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:39.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.164+0000 7f490a59c640 1 -- 172.21.15.59:0/3308733968 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490c0ce430 con 0x7f490c15a830 2023-10-16T14:26:39.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.165+0000 7f490a59c640 1 --2- 172.21.15.59:0/3308733968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f490c15a830 0x7f490c0cb640 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f490c0b0b40 tx=0x7f48fc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f5d1db6d74e5b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:39.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.166+0000 7f4909d9b640 1 -- 172.21.15.59:0/3308733968 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc030860 con 0x7f490c15a830 2023-10-16T14:26:39.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.166+0000 7f4909d9b640 1 -- 172.21.15.59:0/3308733968 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc0309c0 con 0x7f490c15a830 2023-10-16T14:26:39.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.166+0000 7f4909d9b640 1 -- 172.21.15.59:0/3308733968 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc030d50 con 0x7f490c15a830 2023-10-16T14:26:39.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.166+0000 7f4910e09640 1 -- 172.21.15.59:0/3308733968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f490c15a830 msgr2=0x7f490c0cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:39.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.166+0000 7f4910e09640 1 --2- 172.21.15.59:0/3308733968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f490c15a830 0x7f490c0cb640 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f490c0b0b40 tx=0x7f48fc02b9a0 comp rx=0 tx=0).stop 2023-10-16T14:26:39.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.167+0000 7f4910e09640 1 -- 172.21.15.59:0/3308733968 shutdown_connections 2023-10-16T14:26:39.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.167+0000 7f4910e09640 1 --2- 172.21.15.59:0/3308733968 >> v2:172.21.15.151:3300/0 conn(0x7f490c0ca550 0x7f490c070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:39.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.167+0000 7f4910e09640 1 --2- 172.21.15.59:0/3308733968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f490c15a830 0x7f490c0cb640 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:39.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.167+0000 7f4910e09640 1 -- 172.21.15.59:0/3308733968 >> 172.21.15.59:0/3308733968 conn(0x7f490c0b0030 msgr2=0x7f490c0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:39.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.167+0000 7f4910e09640 1 -- 172.21.15.59:0/3308733968 shutdown_connections 2023-10-16T14:26:39.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.167+0000 7f4910e09640 1 -- 172.21.15.59:0/3308733968 wait complete. 2023-10-16T14:26:39.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.169+0000 7f4910e09640 1 Processor -- start 2023-10-16T14:26:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.169+0000 7f4910e09640 1 -- start start 2023-10-16T14:26:39.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.171+0000 7f4910e09640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f490c070860 0x7f490c1ef840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:39.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.171+0000 7f4910e09640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f490c0ca550 0x7f490c0c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:39.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.171+0000 7f4910e09640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f490c15a830 0x7f490c15ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:39.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.171+0000 7f4910e09640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c0c4a10 con 0x7f490c15a830 2023-10-16T14:26:39.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.171+0000 7f4910e09640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c0c3e00 con 0x7f490c070860 2023-10-16T14:26:39.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.171+0000 7f4910e09640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490c0c40e0 con 0x7f490c0ca550 2023-10-16T14:26:39.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.171+0000 7f490ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f490c15a830 0x7f490c15ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:39.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.171+0000 7f490ad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f490c15a830 0x7f490c15ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35848/0 (socket says 172.21.15.59:35848) 2023-10-16T14:26:39.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.171+0000 7f490ad9d640 1 -- 172.21.15.59:0/4039474501 learned_addr learned my addr 172.21.15.59:0/4039474501 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:39.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.171+0000 7f490a59c640 1 --2- 172.21.15.59:0/4039474501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f490c070860 0x7f490c1ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:39.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.171+0000 7f4903fff640 1 --2- 172.21.15.59:0/4039474501 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f490c0ca550 0x7f490c0c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:39.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.172+0000 7f490ad9d640 1 -- 172.21.15.59:0/4039474501 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f490c0ca550 msgr2=0x7f490c0c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:39.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.172+0000 7f490ad9d640 1 --2- 172.21.15.59:0/4039474501 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f490c0ca550 0x7f490c0c3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:39.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.172+0000 7f490ad9d640 1 -- 172.21.15.59:0/4039474501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f490c070860 msgr2=0x7f490c1ef840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:39.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.172+0000 7f490ad9d640 1 --2- 172.21.15.59:0/4039474501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f490c070860 0x7f490c1ef840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:39.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.172+0000 7f490ad9d640 1 -- 172.21.15.59:0/4039474501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc0094d0 con 0x7f490c15a830 2023-10-16T14:26:39.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.172+0000 7f490a59c640 1 --2- 172.21.15.59:0/4039474501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f490c070860 0x7f490c1ef840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:26:39.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.172+0000 7f490ad9d640 1 --2- 172.21.15.59:0/4039474501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f490c15a830 0x7f490c15ac10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f490400c7a0 tx=0x7f490400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:39.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.172+0000 7f4902ffd640 1 -- 172.21.15.59:0/4039474501 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4904003b70 con 0x7f490c15a830 2023-10-16T14:26:39.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.172+0000 7f4902ffd640 1 -- 172.21.15.59:0/4039474501 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4904003cf0 con 0x7f490c15a830 2023-10-16T14:26:39.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.172+0000 7f4902ffd640 1 -- 172.21.15.59:0/4039474501 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4904003ea0 con 0x7f490c15a830 2023-10-16T14:26:39.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.172+0000 7f4910e09640 1 -- 172.21.15.59:0/4039474501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490c0c43c0 con 0x7f490c15a830 2023-10-16T14:26:39.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.173+0000 7f4910e09640 1 -- 172.21.15.59:0/4039474501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490c1efd80 con 0x7f490c15a830 2023-10-16T14:26:39.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.174+0000 7f4910e09640 1 -- 172.21.15.59:0/4039474501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f490c0c4b80 con 0x7f490c15a830 2023-10-16T14:26:39.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.175+0000 7f4902ffd640 1 -- 172.21.15.59:0/4039474501 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f490400aa90 con 0x7f490c15a830 2023-10-16T14:26:39.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.176+0000 7f4902ffd640 1 --2- 172.21.15.59:0/4039474501 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f48ec06aec0 0x7f48ec06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:39.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.176+0000 7f4902ffd640 1 -- 172.21.15.59:0/4039474501 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f4904089710 con 0x7f490c15a830 2023-10-16T14:26:39.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.177+0000 7f490a59c640 1 --2- 172.21.15.59:0/4039474501 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f48ec06aec0 0x7f48ec06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:39.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.178+0000 7f490a59c640 1 --2- 172.21.15.59:0/4039474501 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f48ec06aec0 0x7f48ec06d380 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f48fc036000 tx=0x7f48fc03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:39.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.181+0000 7f4902ffd640 1 -- 172.21.15.59:0/4039474501 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4904054500 con 0x7f490c15a830 2023-10-16T14:26:39.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.374+0000 7f4910e09640 1 -- 172.21.15.59:0/4039474501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f490c073ef0 con 0x7f490c15a830 2023-10-16T14:26:39.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.375+0000 7f4902ffd640 1 -- 172.21.15.59:0/4039474501 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4904057b20 con 0x7f490c15a830 2023-10-16T14:26:39.379 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:39.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.378+0000 7f4910e09640 1 -- 172.21.15.59:0/4039474501 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f48ec06aec0 msgr2=0x7f48ec06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:39.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.378+0000 7f4910e09640 1 --2- 172.21.15.59:0/4039474501 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f48ec06aec0 0x7f48ec06d380 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f48fc036000 tx=0x7f48fc03b040 comp rx=0 tx=0).stop 2023-10-16T14:26:39.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.378+0000 7f4910e09640 1 -- 172.21.15.59:0/4039474501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f490c15a830 msgr2=0x7f490c15ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:39.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.378+0000 7f4910e09640 1 --2- 172.21.15.59:0/4039474501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f490c15a830 0x7f490c15ac10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f490400c7a0 tx=0x7f490400cc60 comp rx=0 tx=0).stop 2023-10-16T14:26:39.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.378+0000 7f4910e09640 1 -- 172.21.15.59:0/4039474501 shutdown_connections 2023-10-16T14:26:39.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.378+0000 7f4910e09640 1 --2- 172.21.15.59:0/4039474501 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f48ec06aec0 0x7f48ec06d380 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:39.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.378+0000 7f4910e09640 1 --2- 172.21.15.59:0/4039474501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f490c15a830 0x7f490c15ac10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:39.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.378+0000 7f4910e09640 1 --2- 172.21.15.59:0/4039474501 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f490c0ca550 0x7f490c0c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:39.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.378+0000 7f4910e09640 1 --2- 172.21.15.59:0/4039474501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f490c070860 0x7f490c1ef840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:39.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.378+0000 7f4910e09640 1 -- 172.21.15.59:0/4039474501 >> 172.21.15.59:0/4039474501 conn(0x7f490c0b0030 msgr2=0x7f490c0adfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:39.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.378+0000 7f4910e09640 1 -- 172.21.15.59:0/4039474501 shutdown_connections 2023-10-16T14:26:39.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.379+0000 7f4910e09640 1 -- 172.21.15.59:0/4039474501 wait complete. 2023-10-16T14:26:39.402 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:26:39.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.626+0000 7f7a04105640 1 Processor -- start 2023-10-16T14:26:39.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.627+0000 7f7a04105640 1 -- start start 2023-10-16T14:26:39.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.628+0000 7f7a04105640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f79fc0b0720 0x7f79fc0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:39.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.628+0000 7f7a04105640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79fc15ce60 0x7f79fc0cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:39.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.628+0000 7f7a04105640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79fc161620 con 0x7f79fc15ca80 2023-10-16T14:26:39.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.628+0000 7f7a04105640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79fc0cafa0 con 0x7f79fc0b0720 2023-10-16T14:26:39.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.628+0000 7f7a04105640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc0cb280 con 0x7f79fc15ce60 2023-10-16T14:26:39.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.629+0000 7f7a026a2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79fc15ce60 0x7f79fc0cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:39.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.629+0000 7f7a01ea1640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f79fc15ca80 0x7f79fc0b0010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.59:42644/0 (socket says 172.21.15.59:42644) 2023-10-16T14:26:39.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.629+0000 7f7a01ea1640 1 -- 172.21.15.59:0/901712362 learned_addr learned my addr 172.21.15.59:0/901712362 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:39.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.629+0000 7f7a016a0640 1 --2- 172.21.15.59:0/901712362 >> v2:172.21.15.151:3300/0 conn(0x7f79fc0b0720 0x7f79fc0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:39.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.630+0000 7f7a026a2640 1 -- 172.21.15.59:0/901712362 >> v2:172.21.15.151:3300/0 conn(0x7f79fc0b0720 msgr2=0x7f79fc0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:39.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.630+0000 7f7a026a2640 1 --2- 172.21.15.59:0/901712362 >> v2:172.21.15.151:3300/0 conn(0x7f79fc0b0720 0x7f79fc0cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:39.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.630+0000 7f7a026a2640 1 -- 172.21.15.59:0/901712362 >> v1:172.21.15.151:6789/0 conn(0x7f79fc15ca80 legacy=0x7f79fc0b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:39.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.630+0000 7f7a026a2640 1 -- 172.21.15.59:0/901712362 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc0cb560 con 0x7f79fc15ce60 2023-10-16T14:26:39.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.631+0000 7f7a026a2640 1 --2- 172.21.15.59:0/901712362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79fc15ce60 0x7f79fc0cc4f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f79f40097a0 tx=0x7f79f402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e42f2a70185d5092 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.632+0000 7f7a00e9f640 1 -- 172.21.15.59:0/901712362 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f4031830 con 0x7f79fc15ce60 2023-10-16T14:26:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.632+0000 7f7a00e9f640 1 -- 172.21.15.59:0/901712362 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f4031990 con 0x7f79fc15ce60 2023-10-16T14:26:39.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.632+0000 7f7a00e9f640 1 -- 172.21.15.59:0/901712362 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f4031d20 con 0x7f79fc15ce60 2023-10-16T14:26:39.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.633+0000 7f7a04105640 1 -- 172.21.15.59:0/901712362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79fc15ce60 msgr2=0x7f79fc0cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:39.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.633+0000 7f7a04105640 1 --2- 172.21.15.59:0/901712362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79fc15ce60 0x7f79fc0cc4f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f79f40097a0 tx=0x7f79f402b8d0 comp rx=0 tx=0).stop 2023-10-16T14:26:39.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.633+0000 7f7a04105640 1 -- 172.21.15.59:0/901712362 shutdown_connections 2023-10-16T14:26:39.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.633+0000 7f7a04105640 1 --2- 172.21.15.59:0/901712362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79fc15ce60 0x7f79fc0cc4f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:39.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.633+0000 7f7a04105640 1 --2- 172.21.15.59:0/901712362 >> v2:172.21.15.151:3300/0 conn(0x7f79fc0b0720 0x7f79fc0cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:39.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.633+0000 7f7a04105640 1 -- 172.21.15.59:0/901712362 >> 172.21.15.59:0/901712362 conn(0x7f79fc06c1c0 msgr2=0x7f79fc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:39.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.633+0000 7f7a04105640 1 -- 172.21.15.59:0/901712362 shutdown_connections 2023-10-16T14:26:39.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.633+0000 7f7a04105640 1 -- 172.21.15.59:0/901712362 wait complete. 2023-10-16T14:26:39.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.635+0000 7f7a04105640 1 Processor -- start 2023-10-16T14:26:39.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.635+0000 7f7a04105640 1 -- start start 2023-10-16T14:26:39.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.636+0000 7f7a04105640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79fc0b0720 0x7f79fc0b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:39.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.636+0000 7f7a04105640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79fc15ca80 0x7f79fc1484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:39.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.636+0000 7f7a04105640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79fc15ce60 0x7f79fc14b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:39.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.636+0000 7f7a04105640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc0c3180 con 0x7f79fc0b0720 2023-10-16T14:26:39.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.636+0000 7f7a04105640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc0c3460 con 0x7f79fc15ca80 2023-10-16T14:26:39.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.636+0000 7f7a04105640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79fc0c3740 con 0x7f79fc15ce60 2023-10-16T14:26:39.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.636+0000 7f7a01ea1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79fc0b0720 0x7f79fc0b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:39.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.636+0000 7f7a01ea1640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79fc0b0720 0x7f79fc0b3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35864/0 (socket says 172.21.15.59:35864) 2023-10-16T14:26:39.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.636+0000 7f7a01ea1640 1 -- 172.21.15.59:0/2658112151 learned_addr learned my addr 172.21.15.59:0/2658112151 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:39.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.636+0000 7f7a026a2640 1 --2- 172.21.15.59:0/2658112151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79fc15ce60 0x7f79fc14b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:39.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.636+0000 7f7a016a0640 1 --2- 172.21.15.59:0/2658112151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79fc15ca80 0x7f79fc1484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:39.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.637+0000 7f7a01ea1640 1 -- 172.21.15.59:0/2658112151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79fc15ce60 msgr2=0x7f79fc14b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:39.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.637+0000 7f7a01ea1640 1 --2- 172.21.15.59:0/2658112151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79fc15ce60 0x7f79fc14b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:39.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.637+0000 7f7a01ea1640 1 -- 172.21.15.59:0/2658112151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79fc15ca80 msgr2=0x7f79fc1484d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:39.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.637+0000 7f7a01ea1640 1 --2- 172.21.15.59:0/2658112151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79fc15ca80 0x7f79fc1484d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:39.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.637+0000 7f7a01ea1640 1 -- 172.21.15.59:0/2658112151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f4009400 con 0x7f79fc0b0720 2023-10-16T14:26:39.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.637+0000 7f7a01ea1640 1 --2- 172.21.15.59:0/2658112151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79fc0b0720 0x7f79fc0b3d60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f79f800cbc0 tx=0x7f79f800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:39.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.637+0000 7f79f27fc640 1 -- 172.21.15.59:0/2658112151 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f800aca0 con 0x7f79fc0b0720 2023-10-16T14:26:39.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.638+0000 7f79f27fc640 1 -- 172.21.15.59:0/2658112151 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f800ae00 con 0x7f79fc0b0720 2023-10-16T14:26:39.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.638+0000 7f79f27fc640 1 -- 172.21.15.59:0/2658112151 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f8012600 con 0x7f79fc0b0720 2023-10-16T14:26:39.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.638+0000 7f7a04105640 1 -- 172.21.15.59:0/2658112151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79fc0c3a20 con 0x7f79fc0b0720 2023-10-16T14:26:39.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.638+0000 7f7a04105640 1 -- 172.21.15.59:0/2658112151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79fc14ba80 con 0x7f79fc0b0720 2023-10-16T14:26:39.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.639+0000 7f7a04105640 1 -- 172.21.15.59:0/2658112151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79fc0c3f40 con 0x7f79fc0b0720 2023-10-16T14:26:39.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.640+0000 7f79f27fc640 1 -- 172.21.15.59:0/2658112151 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f79f8007070 con 0x7f79fc0b0720 2023-10-16T14:26:39.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.641+0000 7f79f27fc640 1 --2- 172.21.15.59:0/2658112151 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f79e006ae70 0x7f79e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:39.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.641+0000 7f79f27fc640 1 -- 172.21.15.59:0/2658112151 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f79f8089790 con 0x7f79fc0b0720 2023-10-16T14:26:39.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.642+0000 7f7a016a0640 1 --2- 172.21.15.59:0/2658112151 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f79e006ae70 0x7f79e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:39.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.643+0000 7f7a016a0640 1 --2- 172.21.15.59:0/2658112151 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f79e006ae70 0x7f79e006d330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0c4c90 tx=0x7f79ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:39.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.648+0000 7f79f27fc640 1 -- 172.21.15.59:0/2658112151 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f79fc0c3f40 con 0x7f79fc0b0720 2023-10-16T14:26:39.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.843+0000 7f7a04105640 1 -- 172.21.15.59:0/2658112151 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79fc0c3f40 con 0x7f79fc0b0720 2023-10-16T14:26:39.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.846+0000 7f79f27fc640 1 -- 172.21.15.59:0/2658112151 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18445 (secure 0 0 0) 0x7f79fc0c3f40 con 0x7f79fc0b0720 2023-10-16T14:26:39.850 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:39.851 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:26:29.634854+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:26:39.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.848+0000 7f7a04105640 1 -- 172.21.15.59:0/2658112151 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f79e006ae70 msgr2=0x7f79e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:39.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.848+0000 7f7a04105640 1 --2- 172.21.15.59:0/2658112151 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f79e006ae70 0x7f79e006d330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0c4c90 tx=0x7f79ec008040 comp rx=0 tx=0).stop 2023-10-16T14:26:39.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.848+0000 7f7a04105640 1 -- 172.21.15.59:0/2658112151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79fc0b0720 msgr2=0x7f79fc0b3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:39.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.848+0000 7f7a04105640 1 --2- 172.21.15.59:0/2658112151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79fc0b0720 0x7f79fc0b3d60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f79f800cbc0 tx=0x7f79f800a060 comp rx=0 tx=0).stop 2023-10-16T14:26:39.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.848+0000 7f7a04105640 1 -- 172.21.15.59:0/2658112151 shutdown_connections 2023-10-16T14:26:39.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.848+0000 7f7a04105640 1 --2- 172.21.15.59:0/2658112151 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f79e006ae70 0x7f79e006d330 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:39.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.848+0000 7f7a04105640 1 --2- 172.21.15.59:0/2658112151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79fc15ce60 0x7f79fc14b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:39.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.848+0000 7f7a04105640 1 --2- 172.21.15.59:0/2658112151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79fc15ca80 0x7f79fc1484d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:39.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.848+0000 7f7a04105640 1 --2- 172.21.15.59:0/2658112151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79fc0b0720 0x7f79fc0b3d60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:39.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.848+0000 7f7a04105640 1 -- 172.21.15.59:0/2658112151 >> 172.21.15.59:0/2658112151 conn(0x7f79fc06c1c0 msgr2=0x7f79fc070940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:39.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.848+0000 7f7a04105640 1 -- 172.21.15.59:0/2658112151 shutdown_connections 2023-10-16T14:26:39.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:39.848+0000 7f7a04105640 1 -- 172.21.15.59:0/2658112151 wait complete. 2023-10-16T14:26:39.873 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T14:25:46.371818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T14:25:47.145341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T14:25:50.758038+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T14:26:39.873 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:26:40.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.096+0000 7fd8d946d640 1 Processor -- start 2023-10-16T14:26:40.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.096+0000 7fd8d946d640 1 -- start start 2023-10-16T14:26:40.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.097+0000 7fd8d946d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8d40b1a30 0x7fd8d40cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:40.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.097+0000 7fd8d946d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8d40d0cd0 0x7fd8d40d10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:40.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.097+0000 7fd8d946d640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d40cfc20 con 0x7fd8d406b570 2023-10-16T14:26:40.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.097+0000 7fd8d946d640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d40d15f0 con 0x7fd8d40d0cd0 2023-10-16T14:26:40.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.097+0000 7fd8d946d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d40cd4a0 con 0x7fd8d40b1a30 2023-10-16T14:26:40.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.097+0000 7fd8cbfff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8d40d0cd0 0x7fd8d40d10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:40.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.097+0000 7fd8cbfff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8d40d0cd0 0x7fd8d40d10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35866/0 (socket says 172.21.15.59:35866) 2023-10-16T14:26:40.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.097+0000 7fd8cbfff640 1 -- 172.21.15.59:0/3830575827 learned_addr learned my addr 172.21.15.59:0/3830575827 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:40.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.097+0000 7fd8d3fff640 1 --2- 172.21.15.59:0/3830575827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8d40b1a30 0x7fd8d40cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:40.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.098+0000 7fd8cbfff640 1 -- 172.21.15.59:0/3830575827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8d40b1a30 msgr2=0x7fd8d40cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:40.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.098+0000 7fd8cbfff640 1 --2- 172.21.15.59:0/3830575827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8d40b1a30 0x7fd8d40cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:40.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.098+0000 7fd8cbfff640 1 -- 172.21.15.59:0/3830575827 >> v1:172.21.15.151:6789/0 conn(0x7fd8d406b570 legacy=0x7fd8d406ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:40.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.098+0000 7fd8cbfff640 1 -- 172.21.15.59:0/3830575827 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d40cd780 con 0x7fd8d40d0cd0 2023-10-16T14:26:40.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.098+0000 7fd8d3fff640 1 --2- 172.21.15.59:0/3830575827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8d40b1a30 0x7fd8d40cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:40.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.099+0000 7fd8cbfff640 1 --2- 172.21.15.59:0/3830575827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d40d0cd0 0x7fd8d40d10b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc009870 tx=0x7fd8bc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216731a9f63ebd0e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:40.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.099+0000 7fd8d37fe640 1 -- 172.21.15.59:0/3830575827 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc031640 con 0x7fd8d40d0cd0 2023-10-16T14:26:40.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.099+0000 7fd8d37fe640 1 -- 172.21.15.59:0/3830575827 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc0317a0 con 0x7fd8d40d0cd0 2023-10-16T14:26:40.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.099+0000 7fd8d37fe640 1 -- 172.21.15.59:0/3830575827 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc031b30 con 0x7fd8d40d0cd0 2023-10-16T14:26:40.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.100+0000 7fd8d946d640 1 -- 172.21.15.59:0/3830575827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d40d0cd0 msgr2=0x7fd8d40d10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:40.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.100+0000 7fd8d946d640 1 --2- 172.21.15.59:0/3830575827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d40d0cd0 0x7fd8d40d10b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc009870 tx=0x7fd8bc02b8f0 comp rx=0 tx=0).stop 2023-10-16T14:26:40.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.100+0000 7fd8d946d640 1 -- 172.21.15.59:0/3830575827 shutdown_connections 2023-10-16T14:26:40.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.100+0000 7fd8d946d640 1 --2- 172.21.15.59:0/3830575827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d40d0cd0 0x7fd8d40d10b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:40.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.100+0000 7fd8d946d640 1 --2- 172.21.15.59:0/3830575827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8d40b1a30 0x7fd8d40cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:40.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.100+0000 7fd8d946d640 1 -- 172.21.15.59:0/3830575827 >> 172.21.15.59:0/3830575827 conn(0x7fd8d408c140 msgr2=0x7fd8d409ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:40.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.100+0000 7fd8d946d640 1 -- 172.21.15.59:0/3830575827 shutdown_connections 2023-10-16T14:26:40.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.100+0000 7fd8d946d640 1 -- 172.21.15.59:0/3830575827 wait complete. 2023-10-16T14:26:40.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.102+0000 7fd8d946d640 1 Processor -- start 2023-10-16T14:26:40.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.102+0000 7fd8d946d640 1 -- start start 2023-10-16T14:26:40.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.103+0000 7fd8d946d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8d406b570 0x7fd8d4150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:40.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.103+0000 7fd8d946d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d40b1a30 0x7fd8d41f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:40.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.103+0000 7fd8d946d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8d40d0cd0 0x7fd8d40af880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:40.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.103+0000 7fd8d946d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d40cb2a0 con 0x7fd8d40b1a30 2023-10-16T14:26:40.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.103+0000 7fd8d946d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d41f6130 con 0x7fd8d406b570 2023-10-16T14:26:40.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.103+0000 7fd8d946d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d41f6410 con 0x7fd8d40d0cd0 2023-10-16T14:26:40.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.103+0000 7fd8cbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d40b1a30 0x7fd8d41f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:40.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.104+0000 7fd8cbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d40b1a30 0x7fd8d41f5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35874/0 (socket says 172.21.15.59:35874) 2023-10-16T14:26:40.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.104+0000 7fd8cbfff640 1 -- 172.21.15.59:0/4049245774 learned_addr learned my addr 172.21.15.59:0/4049245774 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:40.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.104+0000 7fd8cbfff640 1 -- 172.21.15.59:0/4049245774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8d40d0cd0 msgr2=0x7fd8d40af880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:40.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.104+0000 7fd8cbfff640 1 --2- 172.21.15.59:0/4049245774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8d40d0cd0 0x7fd8d40af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:40.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.104+0000 7fd8cbfff640 1 -- 172.21.15.59:0/4049245774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8d406b570 msgr2=0x7fd8d4150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:40.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.104+0000 7fd8cbfff640 1 --2- 172.21.15.59:0/4049245774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8d406b570 0x7fd8d4150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:40.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.104+0000 7fd8cbfff640 1 -- 172.21.15.59:0/4049245774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc0094d0 con 0x7fd8d40b1a30 2023-10-16T14:26:40.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.104+0000 7fd8cbfff640 1 --2- 172.21.15.59:0/4049245774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d40b1a30 0x7fd8d41f5850 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc009870 tx=0x7fd8bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:40.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.105+0000 7fd8d17fa640 1 -- 172.21.15.59:0/4049245774 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc03ac60 con 0x7fd8d40b1a30 2023-10-16T14:26:40.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.105+0000 7fd8d17fa640 1 -- 172.21.15.59:0/4049245774 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc03ade0 con 0x7fd8d40b1a30 2023-10-16T14:26:40.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.105+0000 7fd8d17fa640 1 -- 172.21.15.59:0/4049245774 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc044630 con 0x7fd8d40b1a30 2023-10-16T14:26:40.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.105+0000 7fd8d946d640 1 -- 172.21.15.59:0/4049245774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d41f66f0 con 0x7fd8d40b1a30 2023-10-16T14:26:40.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.105+0000 7fd8d946d640 1 -- 172.21.15.59:0/4049245774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d4150780 con 0x7fd8d40b1a30 2023-10-16T14:26:40.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.106+0000 7fd8d946d640 1 -- 172.21.15.59:0/4049245774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d404e9b0 con 0x7fd8d40b1a30 2023-10-16T14:26:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.107+0000 7fd8d17fa640 1 -- 172.21.15.59:0/4049245774 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd8bc02f050 con 0x7fd8d40b1a30 2023-10-16T14:26:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.108+0000 7fd8d17fa640 1 --2- 172.21.15.59:0/4049245774 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd8b406ae70 0x7fd8b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.108+0000 7fd8d17fa640 1 -- 172.21.15.59:0/4049245774 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fd8bc0aba70 con 0x7fd8d40b1a30 2023-10-16T14:26:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.109+0000 7fd8d3fff640 1 --2- 172.21.15.59:0/4049245774 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd8b406ae70 0x7fd8b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:40.114 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.110+0000 7fd8d3fff640 1 --2- 172.21.15.59:0/4049245774 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd8b406ae70 0x7fd8b406d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4006fd0 tx=0x7fd8c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:40.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.112+0000 7fd8d17fa640 1 -- 172.21.15.59:0/4049245774 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd8bc0767e0 con 0x7fd8d40b1a30 2023-10-16T14:26:40.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.309+0000 7fd8d946d640 1 -- 172.21.15.59:0/4049245774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8d40cb3e0 con 0x7fd8d40b1a30 2023-10-16T14:26:40.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.310+0000 7fd8d17fa640 1 -- 172.21.15.59:0/4049245774 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd8bc0350a0 con 0x7fd8d40b1a30 2023-10-16T14:26:40.314 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:26:40.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.313+0000 7fd8d946d640 1 -- 172.21.15.59:0/4049245774 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd8b406ae70 msgr2=0x7fd8b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:40.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.313+0000 7fd8d946d640 1 --2- 172.21.15.59:0/4049245774 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd8b406ae70 0x7fd8b406d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4006fd0 tx=0x7fd8c4008040 comp rx=0 tx=0).stop 2023-10-16T14:26:40.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.313+0000 7fd8d946d640 1 -- 172.21.15.59:0/4049245774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d40b1a30 msgr2=0x7fd8d41f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:40.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.313+0000 7fd8d946d640 1 --2- 172.21.15.59:0/4049245774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d40b1a30 0x7fd8d41f5850 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc009870 tx=0x7fd8bc0046c0 comp rx=0 tx=0).stop 2023-10-16T14:26:40.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.313+0000 7fd8d946d640 1 -- 172.21.15.59:0/4049245774 shutdown_connections 2023-10-16T14:26:40.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.313+0000 7fd8d946d640 1 --2- 172.21.15.59:0/4049245774 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd8b406ae70 0x7fd8b406d330 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:40.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.313+0000 7fd8d946d640 1 --2- 172.21.15.59:0/4049245774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8d40d0cd0 0x7fd8d40af880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:40.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.313+0000 7fd8d946d640 1 --2- 172.21.15.59:0/4049245774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d40b1a30 0x7fd8d41f5850 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:40.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.313+0000 7fd8d946d640 1 --2- 172.21.15.59:0/4049245774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8d406b570 0x7fd8d4150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:40.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.313+0000 7fd8d946d640 1 -- 172.21.15.59:0/4049245774 >> 172.21.15.59:0/4049245774 conn(0x7fd8d408c140 msgr2=0x7fd8d40d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:40.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.313+0000 7fd8d946d640 1 -- 172.21.15.59:0/4049245774 shutdown_connections 2023-10-16T14:26:40.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.313+0000 7fd8d946d640 1 -- 172.21.15.59:0/4049245774 wait complete. 2023-10-16T14:26:40.337 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T14:26:40.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.544+0000 7f557c94b640 1 Processor -- start 2023-10-16T14:26:40.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.544+0000 7f557c94b640 1 -- start start 2023-10-16T14:26:40.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.545+0000 7f557c94b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f55780d0d80 0x7f55780d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:40.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.545+0000 7f557c94b640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f55780b5fd0 0x7f55780b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:40.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.545+0000 7f557c94b640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55780ce810 con 0x7f557815c940 2023-10-16T14:26:40.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.545+0000 7f557c94b640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55780d1740 con 0x7f55780b5fd0 2023-10-16T14:26:40.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.545+0000 7f557c94b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55780b5b40 con 0x7f55780d0d80 2023-10-16T14:26:40.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.546+0000 7f5576d9d640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f557815c940 0x7f55780d0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:53108/0 (socket says 172.21.15.59:53108) 2023-10-16T14:26:40.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.546+0000 7f5576d9d640 1 -- 172.21.15.59:0/1542572172 learned_addr learned my addr 172.21.15.59:0/1542572172 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:40.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.546+0000 7f557759e640 1 --2- 172.21.15.59:0/1542572172 >> v2:172.21.15.59:3300/0 conn(0x7f55780b5fd0 0x7f55780b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:40.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.546+0000 7f557659c640 1 --2- 172.21.15.59:0/1542572172 >> v2:172.21.15.151:3300/0 conn(0x7f55780d0d80 0x7f55780d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:40.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.546+0000 7f5575d9b640 1 -- 172.21.15.59:0/1542572172 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444104029 0 0) 0x7f55780ce810 con 0x7f557815c940 2023-10-16T14:26:40.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.546+0000 7f5575d9b640 1 -- 172.21.15.59:0/1542572172 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5560003520 con 0x7f557815c940 2023-10-16T14:26:40.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.546+0000 7f557759e640 1 -- 172.21.15.59:0/1542572172 >> v2:172.21.15.151:3300/0 conn(0x7f55780d0d80 msgr2=0x7f55780d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:40.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.546+0000 7f557759e640 1 --2- 172.21.15.59:0/1542572172 >> v2:172.21.15.151:3300/0 conn(0x7f55780d0d80 0x7f55780d1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:40.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.546+0000 7f557759e640 1 -- 172.21.15.59:0/1542572172 >> v1:172.21.15.59:6789/0 conn(0x7f557815c940 legacy=0x7f55780d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:40.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.546+0000 7f557759e640 1 -- 172.21.15.59:0/1542572172 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55780d0b10 con 0x7f55780b5fd0 2023-10-16T14:26:40.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.548+0000 7f557759e640 1 --2- 172.21.15.59:0/1542572172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55780b5fd0 0x7f55780b6420 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f55780b88e0 tx=0x7f557002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448967909fb82e2b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:40.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.548+0000 7f5575d9b640 1 -- 172.21.15.59:0/1542572172 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557002e070 con 0x7f55780b5fd0 2023-10-16T14:26:40.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.548+0000 7f5575d9b640 1 -- 172.21.15.59:0/1542572172 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55700315a0 con 0x7f55780b5fd0 2023-10-16T14:26:40.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.548+0000 7f5575d9b640 1 -- 172.21.15.59:0/1542572172 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570031930 con 0x7f55780b5fd0 2023-10-16T14:26:40.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.550+0000 7f557c94b640 1 -- 172.21.15.59:0/1542572172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55780b5fd0 msgr2=0x7f55780b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:40.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.550+0000 7f557c94b640 1 --2- 172.21.15.59:0/1542572172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55780b5fd0 0x7f55780b6420 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f55780b88e0 tx=0x7f557002b840 comp rx=0 tx=0).stop 2023-10-16T14:26:40.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.550+0000 7f557c94b640 1 -- 172.21.15.59:0/1542572172 shutdown_connections 2023-10-16T14:26:40.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.550+0000 7f557c94b640 1 --2- 172.21.15.59:0/1542572172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55780b5fd0 0x7f55780b6420 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:40.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.550+0000 7f557c94b640 1 --2- 172.21.15.59:0/1542572172 >> v2:172.21.15.151:3300/0 conn(0x7f55780d0d80 0x7f55780d1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:40.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.550+0000 7f557c94b640 1 -- 172.21.15.59:0/1542572172 >> 172.21.15.59:0/1542572172 conn(0x7f557809bb30 msgr2=0x7f55780d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:40.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.550+0000 7f557c94b640 1 -- 172.21.15.59:0/1542572172 shutdown_connections 2023-10-16T14:26:40.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.550+0000 7f557c94b640 1 -- 172.21.15.59:0/1542572172 wait complete. 2023-10-16T14:26:40.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.551+0000 7f557c94b640 1 Processor -- start 2023-10-16T14:26:40.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.551+0000 7f557c94b640 1 -- start start 2023-10-16T14:26:40.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.552+0000 7f557c94b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55780b5fd0 0x7f55780c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:40.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.552+0000 7f557c94b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55780d0d80 0x7f5578155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:40.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.552+0000 7f557c94b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f557815c940 0x7f55781f1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:40.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.552+0000 7f557c94b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5578155590 con 0x7f55780d0d80 2023-10-16T14:26:40.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.552+0000 7f557c94b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55780c9890 con 0x7f55780b5fd0 2023-10-16T14:26:40.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.552+0000 7f557c94b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55780c9ae0 con 0x7f557815c940 2023-10-16T14:26:40.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.552+0000 7f557659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55780d0d80 0x7f5578155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:40.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.552+0000 7f557659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55780d0d80 0x7f5578155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35904/0 (socket says 172.21.15.59:35904) 2023-10-16T14:26:40.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.552+0000 7f557659c640 1 -- 172.21.15.59:0/3648730165 learned_addr learned my addr 172.21.15.59:0/3648730165 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:40.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.552+0000 7f5576d9d640 1 --2- 172.21.15.59:0/3648730165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55780b5fd0 0x7f55780c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:40.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.552+0000 7f557759e640 1 --2- 172.21.15.59:0/3648730165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f557815c940 0x7f55781f1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:40.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.553+0000 7f557659c640 1 -- 172.21.15.59:0/3648730165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f557815c940 msgr2=0x7f55781f1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:40.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.553+0000 7f557659c640 1 --2- 172.21.15.59:0/3648730165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f557815c940 0x7f55781f1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:40.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.553+0000 7f557659c640 1 -- 172.21.15.59:0/3648730165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55780b5fd0 msgr2=0x7f55780c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:40.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.553+0000 7f557659c640 1 --2- 172.21.15.59:0/3648730165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55780b5fd0 0x7f55780c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:40.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.553+0000 7f557659c640 1 -- 172.21.15.59:0/3648730165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5570009400 con 0x7f55780d0d80 2023-10-16T14:26:40.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.553+0000 7f5576d9d640 1 --2- 172.21.15.59:0/3648730165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55780b5fd0 0x7f55780c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:26:40.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.553+0000 7f557659c640 1 --2- 172.21.15.59:0/3648730165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55780d0d80 0x7f5578155ed0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f556c00e870 tx=0x7f556c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:40.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.553+0000 7f555f7fe640 1 -- 172.21.15.59:0/3648730165 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c0094f0 con 0x7f55780d0d80 2023-10-16T14:26:40.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.553+0000 7f555f7fe640 1 -- 172.21.15.59:0/3648730165 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556c00c940 con 0x7f55780d0d80 2023-10-16T14:26:40.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.553+0000 7f555f7fe640 1 -- 172.21.15.59:0/3648730165 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c00ccf0 con 0x7f55780d0d80 2023-10-16T14:26:40.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.553+0000 7f557c94b640 1 -- 172.21.15.59:0/3648730165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55780c9dc0 con 0x7f55780d0d80 2023-10-16T14:26:40.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.553+0000 7f557c94b640 1 -- 172.21.15.59:0/3648730165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55780ca380 con 0x7f55780d0d80 2023-10-16T14:26:40.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.555+0000 7f557c94b640 1 -- 172.21.15.59:0/3648730165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557804e9b0 con 0x7f55780d0d80 2023-10-16T14:26:40.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.556+0000 7f555f7fe640 1 -- 172.21.15.59:0/3648730165 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f556c013470 con 0x7f55780d0d80 2023-10-16T14:26:40.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.556+0000 7f555f7fe640 1 --2- 172.21.15.59:0/3648730165 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f556406ae70 0x7f556406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:40.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.557+0000 7f555f7fe640 1 -- 172.21.15.59:0/3648730165 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f556c089a60 con 0x7f55780d0d80 2023-10-16T14:26:40.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.557+0000 7f5576d9d640 1 --2- 172.21.15.59:0/3648730165 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f556406ae70 0x7f556406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:40.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.558+0000 7f5576d9d640 1 --2- 172.21.15.59:0/3648730165 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f556406ae70 0x7f556406d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5568001560 tx=0x7f5568009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:40.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.561+0000 7f555f7fe640 1 -- 172.21.15.59:0/3648730165 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f556c0547e0 con 0x7f55780d0d80 2023-10-16T14:26:40.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.803+0000 7f557c94b640 1 -- 172.21.15.59:0/3648730165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f55780a04e0 con 0x7f55780d0d80 2023-10-16T14:26:40.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.804+0000 7f555f7fe640 1 -- 172.21.15.59:0/3648730165 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f556c017020 con 0x7f55780d0d80 2023-10-16T14:26:40.808 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:40.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.808+0000 7f557c94b640 1 -- 172.21.15.59:0/3648730165 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f556406ae70 msgr2=0x7f556406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:40.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.808+0000 7f557c94b640 1 --2- 172.21.15.59:0/3648730165 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f556406ae70 0x7f556406d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5568001560 tx=0x7f5568009040 comp rx=0 tx=0).stop 2023-10-16T14:26:40.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.808+0000 7f557c94b640 1 -- 172.21.15.59:0/3648730165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55780d0d80 msgr2=0x7f5578155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:40.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.808+0000 7f557c94b640 1 --2- 172.21.15.59:0/3648730165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55780d0d80 0x7f5578155ed0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f556c00e870 tx=0x7f556c00ed30 comp rx=0 tx=0).stop 2023-10-16T14:26:40.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.808+0000 7f557c94b640 1 -- 172.21.15.59:0/3648730165 shutdown_connections 2023-10-16T14:26:40.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.808+0000 7f557c94b640 1 --2- 172.21.15.59:0/3648730165 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f556406ae70 0x7f556406d330 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:40.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.808+0000 7f557c94b640 1 --2- 172.21.15.59:0/3648730165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f557815c940 0x7f55781f1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:40.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.808+0000 7f557c94b640 1 --2- 172.21.15.59:0/3648730165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55780d0d80 0x7f5578155ed0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:40.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.808+0000 7f557c94b640 1 --2- 172.21.15.59:0/3648730165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55780b5fd0 0x7f55780c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:40.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.808+0000 7f557c94b640 1 -- 172.21.15.59:0/3648730165 >> 172.21.15.59:0/3648730165 conn(0x7f557809bb30 msgr2=0x7f557806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:40.813 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.808+0000 7f557c94b640 1 -- 172.21.15.59:0/3648730165 shutdown_connections 2023-10-16T14:26:40.814 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:40.808+0000 7f557c94b640 1 -- 172.21.15.59:0/3648730165 wait complete. 2023-10-16T14:26:40.830 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T14:26:41.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.050+0000 7f4ed1947640 1 Processor -- start 2023-10-16T14:26:41.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.050+0000 7f4ed1947640 1 -- start start 2023-10-16T14:26:41.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.051+0000 7f4ed1947640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ecc15c940 0x7f4ecc0d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:41.054 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.051+0000 7f4ed1947640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ecc0d0d80 0x7f4ecc0d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:41.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.051+0000 7f4ed1947640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ecc0ce810 con 0x7f4ecc160520 2023-10-16T14:26:41.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.051+0000 7f4ed1947640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ecc0d1740 con 0x7f4ecc0d0d80 2023-10-16T14:26:41.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.051+0000 7f4ed1947640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc0b5b40 con 0x7f4ecc15c940 2023-10-16T14:26:41.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.051+0000 7f4ecbfff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ecc0d0d80 0x7f4ecc0d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:41.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.051+0000 7f4ecbfff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ecc0d0d80 0x7f4ecc0d1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35920/0 (socket says 172.21.15.59:35920) 2023-10-16T14:26:41.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.051+0000 7f4ecbfff640 1 -- 172.21.15.59:0/135905674 learned_addr learned my addr 172.21.15.59:0/135905674 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:41.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.051+0000 7f4ed0945640 1 --2- 172.21.15.59:0/135905674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ecc15c940 0x7f4ecc0d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:41.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.051+0000 7f4ecbfff640 1 -- 172.21.15.59:0/135905674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ecc15c940 msgr2=0x7f4ecc0d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:41.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.051+0000 7f4ecbfff640 1 --2- 172.21.15.59:0/135905674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ecc15c940 0x7f4ecc0d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.051+0000 7f4ecbfff640 1 -- 172.21.15.59:0/135905674 >> v1:172.21.15.151:6789/0 conn(0x7f4ecc160520 legacy=0x7f4ecc1609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:41.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.051+0000 7f4ecbfff640 1 -- 172.21.15.59:0/135905674 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc0ce250 con 0x7f4ecc0d0d80 2023-10-16T14:26:41.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.052+0000 7f4ecbfff640 1 --2- 172.21.15.59:0/135905674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ecc0d0d80 0x7f4ecc0d1200 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8009870 tx=0x7f4eb802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea8264a8834eac9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:41.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.053+0000 7f4ecb7fe640 1 -- 172.21.15.59:0/135905674 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb80317c0 con 0x7f4ecc0d0d80 2023-10-16T14:26:41.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.053+0000 7f4ecb7fe640 1 -- 172.21.15.59:0/135905674 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb8031920 con 0x7f4ecc0d0d80 2023-10-16T14:26:41.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.053+0000 7f4ecb7fe640 1 -- 172.21.15.59:0/135905674 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8031cb0 con 0x7f4ecc0d0d80 2023-10-16T14:26:41.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.053+0000 7f4ed1947640 1 -- 172.21.15.59:0/135905674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ecc0d0d80 msgr2=0x7f4ecc0d1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:41.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.053+0000 7f4ed1947640 1 --2- 172.21.15.59:0/135905674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ecc0d0d80 0x7f4ecc0d1200 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8009870 tx=0x7f4eb802b860 comp rx=0 tx=0).stop 2023-10-16T14:26:41.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.054+0000 7f4ed1947640 1 -- 172.21.15.59:0/135905674 shutdown_connections 2023-10-16T14:26:41.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.054+0000 7f4ed1947640 1 --2- 172.21.15.59:0/135905674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ecc0d0d80 0x7f4ecc0d1200 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.054+0000 7f4ed1947640 1 --2- 172.21.15.59:0/135905674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ecc15c940 0x7f4ecc0d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.054+0000 7f4ed1947640 1 -- 172.21.15.59:0/135905674 >> 172.21.15.59:0/135905674 conn(0x7f4ecc09bb30 msgr2=0x7f4ecc0d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:41.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.054+0000 7f4ed1947640 1 -- 172.21.15.59:0/135905674 shutdown_connections 2023-10-16T14:26:41.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.054+0000 7f4ed1947640 1 -- 172.21.15.59:0/135905674 wait complete. 2023-10-16T14:26:41.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.057+0000 7f4ed1947640 1 Processor -- start 2023-10-16T14:26:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.057+0000 7f4ed1947640 1 -- start start 2023-10-16T14:26:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ed1947640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ecc0d0d80 0x7f4ecc158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ed1947640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ecc15c940 0x7f4ecc0cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ed1947640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ecc160520 0x7f4ecc0c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:41.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ed1947640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc09c4a0 con 0x7f4ecc15c940 2023-10-16T14:26:41.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ed1947640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc0c6ae0 con 0x7f4ecc0d0d80 2023-10-16T14:26:41.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ed1947640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc0c6dc0 con 0x7f4ecc160520 2023-10-16T14:26:41.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ecbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ecc15c940 0x7f4ecc0cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:41.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ecbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ecc15c940 0x7f4ecc0cb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35930/0 (socket says 172.21.15.59:35930) 2023-10-16T14:26:41.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ecbfff640 1 -- 172.21.15.59:0/1828151803 learned_addr learned my addr 172.21.15.59:0/1828151803 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:41.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ed0945640 1 --2- 172.21.15.59:0/1828151803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ecc0d0d80 0x7f4ecc158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:41.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ed1146640 1 --2- 172.21.15.59:0/1828151803 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ecc160520 0x7f4ecc0c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:41.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ecbfff640 1 -- 172.21.15.59:0/1828151803 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ecc160520 msgr2=0x7f4ecc0c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:41.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ecbfff640 1 --2- 172.21.15.59:0/1828151803 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ecc160520 0x7f4ecc0c7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ecbfff640 1 -- 172.21.15.59:0/1828151803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ecc0d0d80 msgr2=0x7f4ecc158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:41.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ecbfff640 1 --2- 172.21.15.59:0/1828151803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ecc0d0d80 0x7f4ecc158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ecbfff640 1 -- 172.21.15.59:0/1828151803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb80094d0 con 0x7f4ecc15c940 2023-10-16T14:26:41.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ed0945640 1 --2- 172.21.15.59:0/1828151803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ecc0d0d80 0x7f4ecc158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:41.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ecbfff640 1 --2- 172.21.15.59:0/1828151803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ecc15c940 0x7f4ecc0cb6b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8000c00 tx=0x7f4eb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:41.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ec97fa640 1 -- 172.21.15.59:0/1828151803 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8032860 con 0x7f4ecc15c940 2023-10-16T14:26:41.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ec97fa640 1 -- 172.21.15.59:0/1828151803 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb80329c0 con 0x7f4ecc15c940 2023-10-16T14:26:41.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ed1947640 1 -- 172.21.15.59:0/1828151803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ecc0c70a0 con 0x7f4ecc15c940 2023-10-16T14:26:41.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.058+0000 7f4ec97fa640 1 -- 172.21.15.59:0/1828151803 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8032d70 con 0x7f4ecc15c940 2023-10-16T14:26:41.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.059+0000 7f4ed1947640 1 -- 172.21.15.59:0/1828151803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ecc0c7660 con 0x7f4ecc15c940 2023-10-16T14:26:41.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.060+0000 7f4ed1947640 1 -- 172.21.15.59:0/1828151803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ecc0b5cb0 con 0x7f4ecc15c940 2023-10-16T14:26:41.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.062+0000 7f4ec97fa640 1 -- 172.21.15.59:0/1828151803 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4eb804e450 con 0x7f4ecc15c940 2023-10-16T14:26:41.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.063+0000 7f4ec97fa640 1 --2- 172.21.15.59:0/1828151803 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4eb006ae70 0x7f4eb006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:41.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.063+0000 7f4ec97fa640 1 -- 172.21.15.59:0/1828151803 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f4eb80abb40 con 0x7f4ecc15c940 2023-10-16T14:26:41.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.063+0000 7f4ed0945640 1 --2- 172.21.15.59:0/1828151803 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4eb006ae70 0x7f4eb006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:41.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.064+0000 7f4ed0945640 1 --2- 172.21.15.59:0/1828151803 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4eb006ae70 0x7f4eb006d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0006fd0 tx=0x7f4ec0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:41.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.067+0000 7f4ec97fa640 1 -- 172.21.15.59:0/1828151803 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4eb80768c0 con 0x7f4ecc15c940 2023-10-16T14:26:41.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.263+0000 7f4ed1947640 1 -- 172.21.15.59:0/1828151803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ecc0c7850 con 0x7f4ecc15c940 2023-10-16T14:26:41.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.264+0000 7f4ec97fa640 1 -- 172.21.15.59:0/1828151803 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4eb8079ee0 con 0x7f4ecc15c940 2023-10-16T14:26:41.268 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-16T14:26:41.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.267+0000 7f4ed1947640 1 -- 172.21.15.59:0/1828151803 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4eb006ae70 msgr2=0x7f4eb006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:41.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.267+0000 7f4ed1947640 1 --2- 172.21.15.59:0/1828151803 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4eb006ae70 0x7f4eb006d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0006fd0 tx=0x7f4ec0008040 comp rx=0 tx=0).stop 2023-10-16T14:26:41.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.267+0000 7f4ed1947640 1 -- 172.21.15.59:0/1828151803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ecc15c940 msgr2=0x7f4ecc0cb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:41.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.267+0000 7f4ed1947640 1 --2- 172.21.15.59:0/1828151803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ecc15c940 0x7f4ecc0cb6b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8000c00 tx=0x7f4eb80046c0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.267+0000 7f4ed1947640 1 -- 172.21.15.59:0/1828151803 shutdown_connections 2023-10-16T14:26:41.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.267+0000 7f4ed1947640 1 --2- 172.21.15.59:0/1828151803 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4eb006ae70 0x7f4eb006d330 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.267+0000 7f4ed1947640 1 --2- 172.21.15.59:0/1828151803 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ecc160520 0x7f4ecc0c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.267+0000 7f4ed1947640 1 --2- 172.21.15.59:0/1828151803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ecc15c940 0x7f4ecc0cb6b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.267+0000 7f4ed1947640 1 --2- 172.21.15.59:0/1828151803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ecc0d0d80 0x7f4ecc158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.267+0000 7f4ed1947640 1 -- 172.21.15.59:0/1828151803 >> 172.21.15.59:0/1828151803 conn(0x7f4ecc09bb30 msgr2=0x7f4ecc0b81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:41.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.267+0000 7f4ed1947640 1 -- 172.21.15.59:0/1828151803 shutdown_connections 2023-10-16T14:26:41.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.267+0000 7f4ed1947640 1 -- 172.21.15.59:0/1828151803 wait complete. 2023-10-16T14:26:41.291 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T14:26:41.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.520+0000 7f49ae2c2640 1 Processor -- start 2023-10-16T14:26:41.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.520+0000 7f49ae2c2640 1 -- start start 2023-10-16T14:26:41.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.521+0000 7f49ae2c2640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49a80ca820 0x7f49a8071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:41.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.521+0000 7f49ae2c2640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f49a80c8ea0 0x7f49a80c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:41.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.521+0000 7f49ae2c2640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a8072480 con 0x7f49a8159890 2023-10-16T14:26:41.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.521+0000 7f49ae2c2640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a80cd0c0 con 0x7f49a80ca820 2023-10-16T14:26:41.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.521+0000 7f49ae2c2640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a80cc540 con 0x7f49a80c8ea0 2023-10-16T14:26:41.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.522+0000 7f49a77fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49a80ca820 0x7f49a8071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:41.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.522+0000 7f49a77fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49a80ca820 0x7f49a8071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35942/0 (socket says 172.21.15.59:35942) 2023-10-16T14:26:41.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.522+0000 7f49a77fe640 1 -- 172.21.15.59:0/2354648898 learned_addr learned my addr 172.21.15.59:0/2354648898 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:41.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.522+0000 7f49ac85f640 1 --2- 172.21.15.59:0/2354648898 >> v2:172.21.15.151:3300/0 conn(0x7f49a80c8ea0 0x7f49a80c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:41.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.522+0000 7f49a77fe640 1 -- 172.21.15.59:0/2354648898 >> v2:172.21.15.151:3300/0 conn(0x7f49a80c8ea0 msgr2=0x7f49a80c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:41.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.522+0000 7f49a77fe640 1 --2- 172.21.15.59:0/2354648898 >> v2:172.21.15.151:3300/0 conn(0x7f49a80c8ea0 0x7f49a80c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.522+0000 7f49a77fe640 1 -- 172.21.15.59:0/2354648898 >> v1:172.21.15.151:6789/0 conn(0x7f49a8159890 legacy=0x7f49a80ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:41.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.523+0000 7f49a77fe640 1 -- 172.21.15.59:0/2354648898 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a80cc820 con 0x7f49a80ca820 2023-10-16T14:26:41.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.523+0000 7f49ac85f640 1 --2- 172.21.15.59:0/2354648898 >> v2:172.21.15.151:3300/0 conn(0x7f49a80c8ea0 0x7f49a80c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:41.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.524+0000 7f49a77fe640 1 --2- 172.21.15.59:0/2354648898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49a80ca820 0x7f49a8071f40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f49a80cd9a0 tx=0x7f499c02bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b881b4bfb77d50 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:41.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.524+0000 7f49a6ffd640 1 -- 172.21.15.59:0/2354648898 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c02cb10 con 0x7f49a80ca820 2023-10-16T14:26:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.524+0000 7f49a6ffd640 1 -- 172.21.15.59:0/2354648898 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c02cc70 con 0x7f49a80ca820 2023-10-16T14:26:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.524+0000 7f49a6ffd640 1 -- 172.21.15.59:0/2354648898 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c0343f0 con 0x7f49a80ca820 2023-10-16T14:26:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.525+0000 7f49ae2c2640 1 -- 172.21.15.59:0/2354648898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49a80ca820 msgr2=0x7f49a8071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.525+0000 7f49ae2c2640 1 --2- 172.21.15.59:0/2354648898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49a80ca820 0x7f49a8071f40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f49a80cd9a0 tx=0x7f499c02bf70 comp rx=0 tx=0).stop 2023-10-16T14:26:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.525+0000 7f49ae2c2640 1 -- 172.21.15.59:0/2354648898 shutdown_connections 2023-10-16T14:26:41.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.525+0000 7f49ae2c2640 1 --2- 172.21.15.59:0/2354648898 >> v2:172.21.15.151:3300/0 conn(0x7f49a80c8ea0 0x7f49a80c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.525+0000 7f49ae2c2640 1 --2- 172.21.15.59:0/2354648898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49a80ca820 0x7f49a8071f40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.525+0000 7f49ae2c2640 1 -- 172.21.15.59:0/2354648898 >> 172.21.15.59:0/2354648898 conn(0x7f49a80b0030 msgr2=0x7f49a80b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:41.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.525+0000 7f49ae2c2640 1 -- 172.21.15.59:0/2354648898 shutdown_connections 2023-10-16T14:26:41.530 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.525+0000 7f49ae2c2640 1 -- 172.21.15.59:0/2354648898 wait complete. 2023-10-16T14:26:41.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.527+0000 7f49ae2c2640 1 Processor -- start 2023-10-16T14:26:41.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.527+0000 7f49ae2c2640 1 -- start start 2023-10-16T14:26:41.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.528+0000 7f49ae2c2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49a80c8ea0 0x7f49a80c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:41.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.528+0000 7f49ae2c2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49a80ca820 0x7f49a80cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:41.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.528+0000 7f49ae2c2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49a8159890 0x7f49a814e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:41.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.528+0000 7f49ae2c2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a80c7bf0 con 0x7f49a8159890 2023-10-16T14:26:41.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.528+0000 7f49ae2c2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a80c75e0 con 0x7f49a80ca820 2023-10-16T14:26:41.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.528+0000 7f49ae2c2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a814dac0 con 0x7f49a80c8ea0 2023-10-16T14:26:41.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.528+0000 7f49ac85f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49a8159890 0x7f49a814e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:41.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.528+0000 7f49ac85f640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49a8159890 0x7f49a814e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35958/0 (socket says 172.21.15.59:35958) 2023-10-16T14:26:41.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.528+0000 7f49ac85f640 1 -- 172.21.15.59:0/4214767297 learned_addr learned my addr 172.21.15.59:0/4214767297 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:41.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.529+0000 7f49a77fe640 1 --2- 172.21.15.59:0/4214767297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49a80ca820 0x7f49a80cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:41.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.529+0000 7f49ac85f640 1 -- 172.21.15.59:0/4214767297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49a80c8ea0 msgr2=0x7f49a80c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:41.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.529+0000 7f49a7fff640 1 --2- 172.21.15.59:0/4214767297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49a80c8ea0 0x7f49a80c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:41.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.529+0000 7f49ac85f640 1 --2- 172.21.15.59:0/4214767297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49a80c8ea0 0x7f49a80c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.529+0000 7f49ac85f640 1 -- 172.21.15.59:0/4214767297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49a80ca820 msgr2=0x7f49a80cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:41.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.529+0000 7f49ac85f640 1 --2- 172.21.15.59:0/4214767297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49a80ca820 0x7f49a80cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.529+0000 7f49ac85f640 1 -- 172.21.15.59:0/4214767297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c009b30 con 0x7f49a8159890 2023-10-16T14:26:41.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.529+0000 7f49a77fe640 1 --2- 172.21.15.59:0/4214767297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49a80ca820 0x7f49a80cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:41.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.529+0000 7f49a7fff640 1 --2- 172.21.15.59:0/4214767297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49a80c8ea0 0x7f49a80c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:41.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.529+0000 7f49ac85f640 1 --2- 172.21.15.59:0/4214767297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49a8159890 0x7f49a814e020 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f49a000c7c0 tx=0x7f49a000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:41.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.529+0000 7f49a4ff9640 1 -- 172.21.15.59:0/4214767297 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a0004230 con 0x7f49a8159890 2023-10-16T14:26:41.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.529+0000 7f49a4ff9640 1 -- 172.21.15.59:0/4214767297 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a0004390 con 0x7f49a8159890 2023-10-16T14:26:41.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.529+0000 7f49a4ff9640 1 -- 172.21.15.59:0/4214767297 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a0007860 con 0x7f49a8159890 2023-10-16T14:26:41.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.529+0000 7f49ae2c2640 1 -- 172.21.15.59:0/4214767297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a80c7880 con 0x7f49a8159890 2023-10-16T14:26:41.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.530+0000 7f49ae2c2640 1 -- 172.21.15.59:0/4214767297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a80cb6c0 con 0x7f49a8159890 2023-10-16T14:26:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.531+0000 7f49ae2c2640 1 -- 172.21.15.59:0/4214767297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a80cb8b0 con 0x7f49a8159890 2023-10-16T14:26:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.532+0000 7f49a4ff9640 1 -- 172.21.15.59:0/4214767297 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f49a00079c0 con 0x7f49a8159890 2023-10-16T14:26:41.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.533+0000 7f49a4ff9640 1 --2- 172.21.15.59:0/4214767297 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f499406ae70 0x7f499406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:41.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.533+0000 7f49a4ff9640 1 -- 172.21.15.59:0/4214767297 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f49a0089c90 con 0x7f49a8159890 2023-10-16T14:26:41.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.533+0000 7f49a7fff640 1 --2- 172.21.15.59:0/4214767297 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f499406ae70 0x7f499406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:41.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.535+0000 7f49a7fff640 1 --2- 172.21.15.59:0/4214767297 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f499406ae70 0x7f499406d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4998000f60 tx=0x7f4998009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:41.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.537+0000 7f49a4ff9640 1 -- 172.21.15.59:0/4214767297 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f49a0054a30 con 0x7f49a8159890 2023-10-16T14:26:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.731+0000 7f49ae2c2640 1 -- 172.21.15.59:0/4214767297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f49a80c7440 con 0x7f49a8159890 2023-10-16T14:26:41.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.732+0000 7f49a4ff9640 1 -- 172.21.15.59:0/4214767297 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f49a80c7440 con 0x7f49a8159890 2023-10-16T14:26:41.735 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:41.737 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.735+0000 7f49ae2c2640 1 -- 172.21.15.59:0/4214767297 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f499406ae70 msgr2=0x7f499406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:41.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.735+0000 7f49ae2c2640 1 --2- 172.21.15.59:0/4214767297 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f499406ae70 0x7f499406d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4998000f60 tx=0x7f4998009040 comp rx=0 tx=0).stop 2023-10-16T14:26:41.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.735+0000 7f49ae2c2640 1 -- 172.21.15.59:0/4214767297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49a8159890 msgr2=0x7f49a814e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:41.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.735+0000 7f49ae2c2640 1 --2- 172.21.15.59:0/4214767297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49a8159890 0x7f49a814e020 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f49a000c7c0 tx=0x7f49a000cc80 comp rx=0 tx=0).stop 2023-10-16T14:26:41.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.735+0000 7f49ae2c2640 1 -- 172.21.15.59:0/4214767297 shutdown_connections 2023-10-16T14:26:41.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.735+0000 7f49ae2c2640 1 --2- 172.21.15.59:0/4214767297 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f499406ae70 0x7f499406d330 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.735+0000 7f49ae2c2640 1 --2- 172.21.15.59:0/4214767297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49a8159890 0x7f49a814e020 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.735+0000 7f49ae2c2640 1 --2- 172.21.15.59:0/4214767297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49a80ca820 0x7f49a80cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.735+0000 7f49ae2c2640 1 --2- 172.21.15.59:0/4214767297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49a80c8ea0 0x7f49a80c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.735+0000 7f49ae2c2640 1 -- 172.21.15.59:0/4214767297 >> 172.21.15.59:0/4214767297 conn(0x7f49a80b0030 msgr2=0x7f49a80ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:41.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.735+0000 7f49ae2c2640 1 -- 172.21.15.59:0/4214767297 shutdown_connections 2023-10-16T14:26:41.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.735+0000 7f49ae2c2640 1 -- 172.21.15.59:0/4214767297 wait complete. 2023-10-16T14:26:41.756 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:26:41.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.975+0000 7ff769c56640 1 Processor -- start 2023-10-16T14:26:41.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.975+0000 7ff769c56640 1 -- start start 2023-10-16T14:26:41.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.976+0000 7ff769c56640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7640cdde0 0x7ff7640b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:41.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.976+0000 7ff769c56640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7640b88e0 con 0x7ff7640b1c30 2023-10-16T14:26:41.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.976+0000 7ff769c56640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7640b8600 con 0x7ff76415ffe0 2023-10-16T14:26:41.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.976+0000 7ff769c56640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640b5f70 con 0x7ff7640cdde0 2023-10-16T14:26:41.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.976+0000 7ff763fff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff7640b1c30 0x7ff7640d1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51788/0 (socket says 172.21.15.59:51788) 2023-10-16T14:26:41.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.976+0000 7ff763fff640 1 -- 172.21.15.59:0/2061075731 learned_addr learned my addr 172.21.15.59:0/2061075731 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:41.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.977+0000 7ff762ffd640 1 --2- 172.21.15.59:0/2061075731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7640cdde0 0x7ff7640b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:41.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.977+0000 7ff7627fc640 1 -- 172.21.15.59:0/2061075731 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604870737 0 0) 0x7ff7640b88e0 con 0x7ff7640b1c30 2023-10-16T14:26:41.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.977+0000 7ff7627fc640 1 -- 172.21.15.59:0/2061075731 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff750003520 con 0x7ff7640b1c30 2023-10-16T14:26:41.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.977+0000 7ff7627fc640 1 -- 172.21.15.59:0/2061075731 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1091105019 0 0) 0x7ff750003520 con 0x7ff7640b1c30 2023-10-16T14:26:41.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.977+0000 7ff7627fc640 1 -- 172.21.15.59:0/2061075731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7640cdde0 msgr2=0x7ff7640b5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:41.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.977+0000 7ff7627fc640 1 --2- 172.21.15.59:0/2061075731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7640cdde0 0x7ff7640b5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.977+0000 7ff7627fc640 1 -- 172.21.15.59:0/2061075731 >> v1:172.21.15.151:6789/0 conn(0x7ff76415ffe0 legacy=0x7ff7640cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:41.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.977+0000 7ff7627fc640 1 -- 172.21.15.59:0/2061075731 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7640d0d90 con 0x7ff7640b1c30 2023-10-16T14:26:41.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.977+0000 7ff7627fc640 1 -- 172.21.15.59:0/2061075731 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7ff75c001690 con 0x7ff7640b1c30 2023-10-16T14:26:41.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.977+0000 7ff7627fc640 1 -- 172.21.15.59:0/2061075731 >> v1:172.21.15.59:6789/0 conn(0x7ff7640b1c30 legacy=0x7ff7640d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:41.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.977+0000 7ff7627fc640 1 --2- 172.21.15.59:0/2061075731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff750003a10 0x7ff750003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:41.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.977+0000 7ff7627fc640 1 --2- 172.21.15.59:0/2061075731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7640cdde0 0x7ff7500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:41.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.977+0000 7ff7627fc640 1 --2- 172.21.15.59:0/2061075731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff750004d00 0x7ff750005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:41.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.977+0000 7ff7627fc640 1 -- 172.21.15.59:0/2061075731 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640b5f70 con 0x7ff750003a10 2023-10-16T14:26:41.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.977+0000 7ff7627fc640 1 -- 172.21.15.59:0/2061075731 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75000bb10 con 0x7ff750004d00 2023-10-16T14:26:41.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.977+0000 7ff7627fc640 1 -- 172.21.15.59:0/2061075731 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff75000bcd0 con 0x7ff7640cdde0 2023-10-16T14:26:41.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.978+0000 7ff7637fe640 1 --2- 172.21.15.59:0/2061075731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff750003a10 0x7ff750003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:41.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.978+0000 7ff762ffd640 1 --2- 172.21.15.59:0/2061075731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7640cdde0 0x7ff7500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:41.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.978+0000 7ff763fff640 1 --2- 172.21.15.59:0/2061075731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff750004d00 0x7ff750005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:41.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.978+0000 7ff7637fe640 1 -- 172.21.15.59:0/2061075731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7640cdde0 msgr2=0x7ff7500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:41.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.978+0000 7ff7637fe640 1 --2- 172.21.15.59:0/2061075731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7640cdde0 0x7ff7500047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.978+0000 7ff7637fe640 1 -- 172.21.15.59:0/2061075731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff750004d00 msgr2=0x7ff750005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:41.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.978+0000 7ff7637fe640 1 --2- 172.21.15.59:0/2061075731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff750004d00 0x7ff750005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.978+0000 7ff7637fe640 1 -- 172.21.15.59:0/2061075731 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff750003520 con 0x7ff750003a10 2023-10-16T14:26:41.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.979+0000 7ff7637fe640 1 --2- 172.21.15.59:0/2061075731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff750003a10 0x7ff750003e30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff754001e20 tx=0x7ff7500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96488a2e8fb022a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:41.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.980+0000 7ff7627fc640 1 -- 172.21.15.59:0/2061075731 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff754003b70 con 0x7ff750003a10 2023-10-16T14:26:41.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.980+0000 7ff7627fc640 1 -- 172.21.15.59:0/2061075731 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff754003cd0 con 0x7ff750003a10 2023-10-16T14:26:41.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.980+0000 7ff7627fc640 1 -- 172.21.15.59:0/2061075731 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff754005310 con 0x7ff750003a10 2023-10-16T14:26:41.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.980+0000 7ff769c56640 1 -- 172.21.15.59:0/2061075731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff750003a10 msgr2=0x7ff750003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:41.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.980+0000 7ff769c56640 1 --2- 172.21.15.59:0/2061075731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff750003a10 0x7ff750003e30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff754001e20 tx=0x7ff7500057f0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.980+0000 7ff763fff640 1 -- 172.21.15.59:0/2061075731 reap_dead start 2023-10-16T14:26:41.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.980+0000 7ff769c56640 1 -- 172.21.15.59:0/2061075731 shutdown_connections 2023-10-16T14:26:41.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.980+0000 7ff769c56640 1 -- 172.21.15.59:0/2061075731 >> 172.21.15.59:0/2061075731 conn(0x7ff76406afe0 msgr2=0x7ff76406b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:41.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.980+0000 7ff769c56640 1 -- 172.21.15.59:0/2061075731 shutdown_connections 2023-10-16T14:26:41.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.980+0000 7ff769c56640 1 -- 172.21.15.59:0/2061075731 wait complete. 2023-10-16T14:26:41.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.982+0000 7ff769c56640 1 Processor -- start 2023-10-16T14:26:41.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.982+0000 7ff769c56640 1 -- start start 2023-10-16T14:26:41.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.983+0000 7ff769c56640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff750003a10 0x7ff7641f3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:41.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.983+0000 7ff769c56640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7641f4f20 0x7ff7641f5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:41.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.983+0000 7ff769c56640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7641f5cb0 0x7ff7641576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:41.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.983+0000 7ff769c56640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640c91d0 con 0x7ff7641f5cb0 2023-10-16T14:26:41.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.983+0000 7ff769c56640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7641f6110 con 0x7ff750003a10 2023-10-16T14:26:41.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.983+0000 7ff769c56640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff764158490 con 0x7ff7641f4f20 2023-10-16T14:26:41.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.983+0000 7ff763fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7641f5cb0 0x7ff7641576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:41.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.984+0000 7ff763fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7641f5cb0 0x7ff7641576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54770/0 (socket says 172.21.15.59:54770) 2023-10-16T14:26:41.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.984+0000 7ff763fff640 1 -- 172.21.15.59:0/1028558973 learned_addr learned my addr 172.21.15.59:0/1028558973 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:41.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.984+0000 7ff7637fe640 1 --2- 172.21.15.59:0/1028558973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff750003a10 0x7ff7641f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:41.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.984+0000 7ff762ffd640 1 --2- 172.21.15.59:0/1028558973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7641f4f20 0x7ff7641f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:41.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.984+0000 7ff763fff640 1 -- 172.21.15.59:0/1028558973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7641f4f20 msgr2=0x7ff7641f5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:41.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.984+0000 7ff763fff640 1 --2- 172.21.15.59:0/1028558973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7641f4f20 0x7ff7641f5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.984+0000 7ff763fff640 1 -- 172.21.15.59:0/1028558973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff750003a10 msgr2=0x7ff7641f3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:41.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.984+0000 7ff763fff640 1 --2- 172.21.15.59:0/1028558973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff750003a10 0x7ff7641f3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:41.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.984+0000 7ff763fff640 1 -- 172.21.15.59:0/1028558973 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76415ab70 con 0x7ff7641f5cb0 2023-10-16T14:26:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.984+0000 7ff7637fe640 1 --2- 172.21.15.59:0/1028558973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff750003a10 0x7ff7641f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.984+0000 7ff763fff640 1 --2- 172.21.15.59:0/1028558973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7641f5cb0 0x7ff7641576d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff7640b5980 tx=0x7ff75c00d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.985+0000 7ff75bfff640 1 -- 172.21.15.59:0/1028558973 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c007440 con 0x7ff7641f5cb0 2023-10-16T14:26:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.985+0000 7ff75bfff640 1 -- 172.21.15.59:0/1028558973 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75c0075a0 con 0x7ff7641f5cb0 2023-10-16T14:26:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.985+0000 7ff75bfff640 1 -- 172.21.15.59:0/1028558973 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75c004a00 con 0x7ff7641f5cb0 2023-10-16T14:26:41.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.985+0000 7ff769c56640 1 -- 172.21.15.59:0/1028558973 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76415ae50 con 0x7ff7641f5cb0 2023-10-16T14:26:41.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.985+0000 7ff769c56640 1 -- 172.21.15.59:0/1028558973 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76415a820 con 0x7ff7641f5cb0 2023-10-16T14:26:41.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.986+0000 7ff769c56640 1 -- 172.21.15.59:0/1028558973 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76415a9e0 con 0x7ff7641f5cb0 2023-10-16T14:26:41.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.987+0000 7ff75bfff640 1 -- 172.21.15.59:0/1028558973 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff75c004b60 con 0x7ff7641f5cb0 2023-10-16T14:26:41.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.988+0000 7ff75bfff640 1 --2- 172.21.15.59:0/1028558973 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff74406ae70 0x7ff74406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:41.996 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.988+0000 7ff75bfff640 1 -- 172.21.15.59:0/1028558973 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff75c089670 con 0x7ff7641f5cb0 2023-10-16T14:26:41.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.989+0000 7ff7637fe640 1 --2- 172.21.15.59:0/1028558973 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff74406ae70 0x7ff74406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:41.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.990+0000 7ff7637fe640 1 --2- 172.21.15.59:0/1028558973 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff74406ae70 0x7ff74406d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff754001e20 tx=0x7ff754009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:41.997 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:41.992+0000 7ff75bfff640 1 -- 172.21.15.59:0/1028558973 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff75c054410 con 0x7ff7641f5cb0 2023-10-16T14:26:42.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.190+0000 7ff769c56640 1 -- 172.21.15.59:0/1028558973 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff76415b370 con 0x7ff7641f5cb0 2023-10-16T14:26:42.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.192+0000 7ff75bfff640 1 -- 172.21.15.59:0/1028558973 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18445 (secure 0 0 0) 0x7ff76415b370 con 0x7ff7641f5cb0 2023-10-16T14:26:42.195 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:42.195 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:26:29.634854+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:26:42.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.194+0000 7ff769c56640 1 -- 172.21.15.59:0/1028558973 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff74406ae70 msgr2=0x7ff74406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:42.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.194+0000 7ff769c56640 1 --2- 172.21.15.59:0/1028558973 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff74406ae70 0x7ff74406d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff754001e20 tx=0x7ff754009030 comp rx=0 tx=0).stop 2023-10-16T14:26:42.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.194+0000 7ff769c56640 1 -- 172.21.15.59:0/1028558973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7641f5cb0 msgr2=0x7ff7641576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:42.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.194+0000 7ff769c56640 1 --2- 172.21.15.59:0/1028558973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7641f5cb0 0x7ff7641576d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff7640b5980 tx=0x7ff75c00d9d0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.194+0000 7ff769c56640 1 -- 172.21.15.59:0/1028558973 shutdown_connections 2023-10-16T14:26:42.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.194+0000 7ff769c56640 1 --2- 172.21.15.59:0/1028558973 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff74406ae70 0x7ff74406d330 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.194+0000 7ff769c56640 1 --2- 172.21.15.59:0/1028558973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7641f5cb0 0x7ff7641576d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.194+0000 7ff769c56640 1 --2- 172.21.15.59:0/1028558973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7641f4f20 0x7ff7641f5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.194+0000 7ff769c56640 1 --2- 172.21.15.59:0/1028558973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff750003a10 0x7ff7641f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.194+0000 7ff769c56640 1 -- 172.21.15.59:0/1028558973 >> 172.21.15.59:0/1028558973 conn(0x7ff76406afe0 msgr2=0x7ff7640c9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:42.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.195+0000 7ff769c56640 1 -- 172.21.15.59:0/1028558973 shutdown_connections 2023-10-16T14:26:42.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.195+0000 7ff769c56640 1 -- 172.21.15.59:0/1028558973 wait complete. 2023-10-16T14:26:42.217 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T14:25:46.371818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T14:25:47.145341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T14:25:50.758038+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T14:26:42.218 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:26:42.447 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.445+0000 7f24e4802640 1 Processor -- start 2023-10-16T14:26:42.448 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.445+0000 7f24e4802640 1 -- start start 2023-10-16T14:26:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.447+0000 7f24e4802640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f24e015a830 0x7f24e00cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.447+0000 7f24e4802640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f24e00ca550 0x7f24e0070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:42.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.447+0000 7f24e4802640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e00cf040 con 0x7f24e0070860 2023-10-16T14:26:42.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.447+0000 7f24e4802640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e0070cf0 con 0x7f24e00ca550 2023-10-16T14:26:42.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.447+0000 7f24e4802640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e00ca9e0 con 0x7f24e015a830 2023-10-16T14:26:42.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.447+0000 7f24d7fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f24e00ca550 0x7f24e0070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:42.450 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.447+0000 7f24ded9d640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f24e0070860 0x7f24e015e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51792/0 (socket says 172.21.15.59:51792) 2023-10-16T14:26:42.451 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.447+0000 7f24ded9d640 1 -- 172.21.15.59:0/2333585900 learned_addr learned my addr 172.21.15.59:0/2333585900 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:42.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.447+0000 7f24d7fff640 1 -- 172.21.15.59:0/2333585900 >> v2:172.21.15.151:3300/0 conn(0x7f24e015a830 msgr2=0x7f24e00cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:42.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.448+0000 7f24de59c640 1 --2- 172.21.15.59:0/2333585900 >> v2:172.21.15.151:3300/0 conn(0x7f24e015a830 0x7f24e00cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:42.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.448+0000 7f24ddd9b640 1 -- 172.21.15.59:0/2333585900 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008584515 0 0) 0x7f24e00cf040 con 0x7f24e0070860 2023-10-16T14:26:42.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.448+0000 7f24d7fff640 1 --2- 172.21.15.59:0/2333585900 >> v2:172.21.15.151:3300/0 conn(0x7f24e015a830 0x7f24e00cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.448+0000 7f24d7fff640 1 -- 172.21.15.59:0/2333585900 >> v1:172.21.15.59:6789/0 conn(0x7f24e0070860 legacy=0x7f24e015e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.448+0000 7f24d7fff640 1 -- 172.21.15.59:0/2333585900 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e00ce430 con 0x7f24e00ca550 2023-10-16T14:26:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.448+0000 7f24de59c640 1 --2- 172.21.15.59:0/2333585900 >> v2:172.21.15.151:3300/0 conn(0x7f24e015a830 0x7f24e00cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.449+0000 7f24d7fff640 1 --2- 172.21.15.59:0/2333585900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24e00ca550 0x7f24e0070320 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f24e00cf570 tx=0x7f24c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f3cd88b2a6f97e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.449+0000 7f24ddd9b640 1 -- 172.21.15.59:0/2333585900 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c8031830 con 0x7f24e00ca550 2023-10-16T14:26:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.449+0000 7f24ddd9b640 1 -- 172.21.15.59:0/2333585900 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c8031990 con 0x7f24e00ca550 2023-10-16T14:26:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.449+0000 7f24ddd9b640 1 -- 172.21.15.59:0/2333585900 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c8031d20 con 0x7f24e00ca550 2023-10-16T14:26:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.450+0000 7f24e4802640 1 -- 172.21.15.59:0/2333585900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24e00ca550 msgr2=0x7f24e0070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.450+0000 7f24e4802640 1 --2- 172.21.15.59:0/2333585900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24e00ca550 0x7f24e0070320 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f24e00cf570 tx=0x7f24c802b8d0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.450+0000 7f24e4802640 1 -- 172.21.15.59:0/2333585900 shutdown_connections 2023-10-16T14:26:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.450+0000 7f24e4802640 1 --2- 172.21.15.59:0/2333585900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24e00ca550 0x7f24e0070320 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.450+0000 7f24e4802640 1 --2- 172.21.15.59:0/2333585900 >> v2:172.21.15.151:3300/0 conn(0x7f24e015a830 0x7f24e00cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.450+0000 7f24e4802640 1 -- 172.21.15.59:0/2333585900 >> 172.21.15.59:0/2333585900 conn(0x7f24e00b0030 msgr2=0x7f24e00b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:42.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.450+0000 7f24e4802640 1 -- 172.21.15.59:0/2333585900 shutdown_connections 2023-10-16T14:26:42.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.451+0000 7f24e4802640 1 -- 172.21.15.59:0/2333585900 wait complete. 2023-10-16T14:26:42.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.452+0000 7f24e4802640 1 Processor -- start 2023-10-16T14:26:42.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.453+0000 7f24e4802640 1 -- start start 2023-10-16T14:26:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.453+0000 7f24e4802640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24e0070860 0x7f24e0149f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:42.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.454+0000 7f24e4802640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24e015a830 0x7f24e00a7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.454+0000 7f24e4802640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24e00a7990 0x7f24e014b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.454+0000 7f24e4802640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e014c560 con 0x7f24e015a830 2023-10-16T14:26:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.454+0000 7f24e4802640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e00a7e40 con 0x7f24e0070860 2023-10-16T14:26:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.454+0000 7f24e4802640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e00c80c0 con 0x7f24e00a7990 2023-10-16T14:26:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.454+0000 7f24d7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24e015a830 0x7f24e00a7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:42.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.454+0000 7f24d7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24e015a830 0x7f24e00a7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54786/0 (socket says 172.21.15.59:54786) 2023-10-16T14:26:42.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.454+0000 7f24d7fff640 1 -- 172.21.15.59:0/3280556248 learned_addr learned my addr 172.21.15.59:0/3280556248 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:42.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.454+0000 7f24de59c640 1 --2- 172.21.15.59:0/3280556248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24e0070860 0x7f24e0149f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:42.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.454+0000 7f24ded9d640 1 --2- 172.21.15.59:0/3280556248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24e00a7990 0x7f24e014b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:42.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.454+0000 7f24d7fff640 1 -- 172.21.15.59:0/3280556248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24e00a7990 msgr2=0x7f24e014b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:42.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.454+0000 7f24d7fff640 1 --2- 172.21.15.59:0/3280556248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24e00a7990 0x7f24e014b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.454+0000 7f24d7fff640 1 -- 172.21.15.59:0/3280556248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24e0070860 msgr2=0x7f24e0149f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:42.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.454+0000 7f24d7fff640 1 --2- 172.21.15.59:0/3280556248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24e0070860 0x7f24e0149f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.454+0000 7f24d7fff640 1 -- 172.21.15.59:0/3280556248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c8009400 con 0x7f24e015a830 2023-10-16T14:26:42.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.454+0000 7f24ded9d640 1 --2- 172.21.15.59:0/3280556248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24e00a7990 0x7f24e014b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:42.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.455+0000 7f24d7fff640 1 --2- 172.21.15.59:0/3280556248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24e015a830 0x7f24e00a7450 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f24c802be60 tx=0x7f24c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:42.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.455+0000 7f24d6ffd640 1 -- 172.21.15.59:0/3280556248 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c80317f0 con 0x7f24e015a830 2023-10-16T14:26:42.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.455+0000 7f24d6ffd640 1 -- 172.21.15.59:0/3280556248 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c8004030 con 0x7f24e015a830 2023-10-16T14:26:42.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.455+0000 7f24d6ffd640 1 -- 172.21.15.59:0/3280556248 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c80043a0 con 0x7f24e015a830 2023-10-16T14:26:42.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.455+0000 7f24e4802640 1 -- 172.21.15.59:0/3280556248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e014a450 con 0x7f24e015a830 2023-10-16T14:26:42.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.455+0000 7f24e4802640 1 -- 172.21.15.59:0/3280556248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e00c7a00 con 0x7f24e015a830 2023-10-16T14:26:42.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.457+0000 7f24e4802640 1 -- 172.21.15.59:0/3280556248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e00c7860 con 0x7f24e015a830 2023-10-16T14:26:42.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.457+0000 7f24d6ffd640 1 -- 172.21.15.59:0/3280556248 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f24c8043070 con 0x7f24e015a830 2023-10-16T14:26:42.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.459+0000 7f24d6ffd640 1 --2- 172.21.15.59:0/3280556248 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f24c006aea0 0x7f24c006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:42.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.459+0000 7f24d6ffd640 1 -- 172.21.15.59:0/3280556248 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f24c80ab670 con 0x7f24e015a830 2023-10-16T14:26:42.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.460+0000 7f24de59c640 1 --2- 172.21.15.59:0/3280556248 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f24c006aea0 0x7f24c006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:42.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.461+0000 7f24de59c640 1 --2- 172.21.15.59:0/3280556248 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f24c006aea0 0x7f24c006d360 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f24d000a950 tx=0x7f24d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:42.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.463+0000 7f24d6ffd640 1 -- 172.21.15.59:0/3280556248 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f24e00c7860 con 0x7f24e015a830 2023-10-16T14:26:42.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.656+0000 7f24e4802640 1 -- 172.21.15.59:0/3280556248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f24e00c8200 con 0x7f24e015a830 2023-10-16T14:26:42.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.658+0000 7f24d6ffd640 1 -- 172.21.15.59:0/3280556248 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f24e00c8200 con 0x7f24e015a830 2023-10-16T14:26:42.661 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:26:42.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.661+0000 7f24e4802640 1 -- 172.21.15.59:0/3280556248 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f24c006aea0 msgr2=0x7f24c006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:42.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.661+0000 7f24e4802640 1 --2- 172.21.15.59:0/3280556248 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f24c006aea0 0x7f24c006d360 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f24d000a950 tx=0x7f24d0008040 comp rx=0 tx=0).stop 2023-10-16T14:26:42.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.661+0000 7f24e4802640 1 -- 172.21.15.59:0/3280556248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24e015a830 msgr2=0x7f24e00a7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:42.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.661+0000 7f24e4802640 1 --2- 172.21.15.59:0/3280556248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24e015a830 0x7f24e00a7450 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f24c802be60 tx=0x7f24c80046c0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.661+0000 7f24e4802640 1 -- 172.21.15.59:0/3280556248 shutdown_connections 2023-10-16T14:26:42.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.661+0000 7f24e4802640 1 --2- 172.21.15.59:0/3280556248 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f24c006aea0 0x7f24c006d360 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.661+0000 7f24e4802640 1 --2- 172.21.15.59:0/3280556248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24e00a7990 0x7f24e014b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.661+0000 7f24e4802640 1 --2- 172.21.15.59:0/3280556248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24e015a830 0x7f24e00a7450 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.661+0000 7f24e4802640 1 --2- 172.21.15.59:0/3280556248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24e0070860 0x7f24e0149f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.661+0000 7f24e4802640 1 -- 172.21.15.59:0/3280556248 >> 172.21.15.59:0/3280556248 conn(0x7f24e00b0030 msgr2=0x7f24e00c4040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:42.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.661+0000 7f24e4802640 1 -- 172.21.15.59:0/3280556248 shutdown_connections 2023-10-16T14:26:42.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.661+0000 7f24e4802640 1 -- 172.21.15.59:0/3280556248 wait complete. 2023-10-16T14:26:42.684 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T14:26:42.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.893+0000 7fa85a0d7640 1 Processor -- start 2023-10-16T14:26:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.893+0000 7fa85a0d7640 1 -- start start 2023-10-16T14:26:42.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.894+0000 7fa85a0d7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa85415df20 0x7fa8540cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:42.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.895+0000 7fa85a0d7640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa85406cdf0 con 0x7fa85406a4f0 2023-10-16T14:26:42.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.895+0000 7fa85a0d7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8540cc580 con 0x7fa8540c2be0 2023-10-16T14:26:42.897 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.895+0000 7fa85a0d7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540cce20 con 0x7fa85415df20 2023-10-16T14:26:42.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.895+0000 7fa8598d6640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa85406a4f0 0x7fa85406d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51798/0 (socket says 172.21.15.59:51798) 2023-10-16T14:26:42.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.895+0000 7fa8598d6640 1 -- 172.21.15.59:0/2236744444 learned_addr learned my addr 172.21.15.59:0/2236744444 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:42.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.895+0000 7fa8590d5640 1 --2- 172.21.15.59:0/2236744444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa85415df20 0x7fa8540cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:42.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.895+0000 7fa84bfff640 1 -- 172.21.15.59:0/2236744444 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44793809 0 0) 0x7fa85406cdf0 con 0x7fa85406a4f0 2023-10-16T14:26:42.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.896+0000 7fa84bfff640 1 -- 172.21.15.59:0/2236744444 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa840003520 con 0x7fa85406a4f0 2023-10-16T14:26:42.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.896+0000 7fa84bfff640 1 -- 172.21.15.59:0/2236744444 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4161418815 0 0) 0x7fa840003520 con 0x7fa85406a4f0 2023-10-16T14:26:42.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.896+0000 7fa84bfff640 1 -- 172.21.15.59:0/2236744444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa85415df20 msgr2=0x7fa8540cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:42.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.896+0000 7fa84bfff640 1 --2- 172.21.15.59:0/2236744444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa85415df20 0x7fa8540cb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.896+0000 7fa84bfff640 1 -- 172.21.15.59:0/2236744444 >> v1:172.21.15.151:6789/0 conn(0x7fa8540c2be0 legacy=0x7fa854069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:42.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.896+0000 7fa84bfff640 1 -- 172.21.15.59:0/2236744444 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8540cc860 con 0x7fa85406a4f0 2023-10-16T14:26:42.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.896+0000 7fa84bfff640 1 -- 172.21.15.59:0/2236744444 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7fa84c0019f0 con 0x7fa85406a4f0 2023-10-16T14:26:42.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.896+0000 7fa84bfff640 1 -- 172.21.15.59:0/2236744444 >> v1:172.21.15.59:6789/0 conn(0x7fa85406a4f0 legacy=0x7fa85406d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:42.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.896+0000 7fa84bfff640 1 --2- 172.21.15.59:0/2236744444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa840003a10 0x7fa840003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:42.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.896+0000 7fa84bfff640 1 --2- 172.21.15.59:0/2236744444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa85415df20 0x7fa8400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:42.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.896+0000 7fa84bfff640 1 --2- 172.21.15.59:0/2236744444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa840004d00 0x7fa840005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:42.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.896+0000 7fa84bfff640 1 -- 172.21.15.59:0/2236744444 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84000bb10 con 0x7fa840003a10 2023-10-16T14:26:42.902 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.896+0000 7fa84bfff640 1 -- 172.21.15.59:0/2236744444 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84000bc50 con 0x7fa840004d00 2023-10-16T14:26:42.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.896+0000 7fa84bfff640 1 -- 172.21.15.59:0/2236744444 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84000bde0 con 0x7fa85415df20 2023-10-16T14:26:42.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.896+0000 7fa8590d5640 1 --2- 172.21.15.59:0/2236744444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa840003a10 0x7fa840003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:42.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.897+0000 7fa8588d4640 1 --2- 172.21.15.59:0/2236744444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa85415df20 0x7fa8400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:42.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.897+0000 7fa8598d6640 1 --2- 172.21.15.59:0/2236744444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa840004d00 0x7fa840005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:42.903 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.897+0000 7fa8590d5640 1 -- 172.21.15.59:0/2236744444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa85415df20 msgr2=0x7fa8400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:42.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.897+0000 7fa8590d5640 1 --2- 172.21.15.59:0/2236744444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa85415df20 0x7fa8400047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.897+0000 7fa8590d5640 1 -- 172.21.15.59:0/2236744444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa840004d00 msgr2=0x7fa840005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:42.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.897+0000 7fa8590d5640 1 --2- 172.21.15.59:0/2236744444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa840004d00 0x7fa840005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.897+0000 7fa8590d5640 1 -- 172.21.15.59:0/2236744444 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa840003520 con 0x7fa840003a10 2023-10-16T14:26:42.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.897+0000 7fa8588d4640 1 --2- 172.21.15.59:0/2236744444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa85415df20 0x7fa8400047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:42.904 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.897+0000 7fa8598d6640 1 --2- 172.21.15.59:0/2236744444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa840004d00 0x7fa840005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:42.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.898+0000 7fa8590d5640 1 --2- 172.21.15.59:0/2236744444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa840003a10 0x7fa840003e30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa850009ab0 tx=0x7fa8400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7761994673a72494 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:42.907 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.898+0000 7fa84bfff640 1 -- 172.21.15.59:0/2236744444 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850005990 con 0x7fa840003a10 2023-10-16T14:26:42.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.898+0000 7fa84bfff640 1 -- 172.21.15.59:0/2236744444 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa850005af0 con 0x7fa840003a10 2023-10-16T14:26:42.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.898+0000 7fa84bfff640 1 -- 172.21.15.59:0/2236744444 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850005ea0 con 0x7fa840003a10 2023-10-16T14:26:42.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.899+0000 7fa85a0d7640 1 -- 172.21.15.59:0/2236744444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa840003a10 msgr2=0x7fa840003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:42.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.899+0000 7fa85a0d7640 1 --2- 172.21.15.59:0/2236744444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa840003a10 0x7fa840003e30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa850009ab0 tx=0x7fa8400057f0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.908 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.899+0000 7fa8598d6640 1 -- 172.21.15.59:0/2236744444 reap_dead start 2023-10-16T14:26:42.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.899+0000 7fa85a0d7640 1 -- 172.21.15.59:0/2236744444 shutdown_connections 2023-10-16T14:26:42.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.899+0000 7fa85a0d7640 1 -- 172.21.15.59:0/2236744444 >> 172.21.15.59:0/2236744444 conn(0x7fa8540cf4e0 msgr2=0x7fa8540cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:42.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.899+0000 7fa85a0d7640 1 -- 172.21.15.59:0/2236744444 shutdown_connections 2023-10-16T14:26:42.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.899+0000 7fa85a0d7640 1 -- 172.21.15.59:0/2236744444 wait complete. 2023-10-16T14:26:42.909 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.901+0000 7fa85a0d7640 1 Processor -- start 2023-10-16T14:26:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.901+0000 7fa85a0d7640 1 -- start start 2023-10-16T14:26:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.902+0000 7fa85a0d7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa840003a10 0x7fa854155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.902+0000 7fa85a0d7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8540b3640 0x7fa8540b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.902+0000 7fa85a0d7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8540c6f70 0x7fa8540b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:42.910 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.902+0000 7fa85a0d7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa854153140 con 0x7fa8540b3640 2023-10-16T14:26:42.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.902+0000 7fa85a0d7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540c74c0 con 0x7fa8540c6f70 2023-10-16T14:26:42.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.902+0000 7fa85a0d7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8540c77a0 con 0x7fa840003a10 2023-10-16T14:26:42.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.902+0000 7fa8588d4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8540b3640 0x7fa8540b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:42.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.902+0000 7fa8588d4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8540b3640 0x7fa8540b3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54808/0 (socket says 172.21.15.59:54808) 2023-10-16T14:26:42.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.902+0000 7fa8588d4640 1 -- 172.21.15.59:0/3694782639 learned_addr learned my addr 172.21.15.59:0/3694782639 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:42.911 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.903+0000 7fa8590d5640 1 --2- 172.21.15.59:0/3694782639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa840003a10 0x7fa854155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:42.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.903+0000 7fa8588d4640 1 -- 172.21.15.59:0/3694782639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa840003a10 msgr2=0x7fa854155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:42.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.903+0000 7fa8588d4640 1 --2- 172.21.15.59:0/3694782639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa840003a10 0x7fa854155470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.903+0000 7fa8598d6640 1 --2- 172.21.15.59:0/3694782639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8540c6f70 0x7fa8540b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:42.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.903+0000 7fa8588d4640 1 -- 172.21.15.59:0/3694782639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8540c6f70 msgr2=0x7fa8540b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:42.912 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.903+0000 7fa8588d4640 1 --2- 172.21.15.59:0/3694782639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8540c6f70 0x7fa8540b3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:42.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.903+0000 7fa8588d4640 1 -- 172.21.15.59:0/3694782639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8540c7a80 con 0x7fa8540b3640 2023-10-16T14:26:42.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.903+0000 7fa8598d6640 1 --2- 172.21.15.59:0/3694782639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8540c6f70 0x7fa8540b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:42.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.903+0000 7fa8588d4640 1 --2- 172.21.15.59:0/3694782639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8540b3640 0x7fa8540b3a50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa84400d770 tx=0x7fa84400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:42.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.903+0000 7fa849ffb640 1 -- 172.21.15.59:0/3694782639 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844005270 con 0x7fa8540b3640 2023-10-16T14:26:42.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.903+0000 7fa849ffb640 1 -- 172.21.15.59:0/3694782639 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8440053d0 con 0x7fa8540b3640 2023-10-16T14:26:42.913 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.903+0000 7fa849ffb640 1 -- 172.21.15.59:0/3694782639 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84400b8d0 con 0x7fa8540b3640 2023-10-16T14:26:42.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.903+0000 7fa85a0d7640 1 -- 172.21.15.59:0/3694782639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8540c7d60 con 0x7fa8540b3640 2023-10-16T14:26:42.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.904+0000 7fa85a0d7640 1 -- 172.21.15.59:0/3694782639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8540c8ae0 con 0x7fa8540b3640 2023-10-16T14:26:42.914 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.905+0000 7fa85a0d7640 1 -- 172.21.15.59:0/3694782639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa85404e9b0 con 0x7fa8540b3640 2023-10-16T14:26:42.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.906+0000 7fa849ffb640 1 -- 172.21.15.59:0/3694782639 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa84400ba30 con 0x7fa8540b3640 2023-10-16T14:26:42.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.906+0000 7fa849ffb640 1 --2- 172.21.15.59:0/3694782639 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa83806ae70 0x7fa83806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:42.915 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.907+0000 7fa849ffb640 1 -- 172.21.15.59:0/3694782639 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fa8440899c0 con 0x7fa8540b3640 2023-10-16T14:26:42.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.907+0000 7fa8590d5640 1 --2- 172.21.15.59:0/3694782639 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa83806ae70 0x7fa83806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:42.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.909+0000 7fa8590d5640 1 --2- 172.21.15.59:0/3694782639 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa83806ae70 0x7fa83806d330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa850035000 tx=0x7fa850030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:42.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:42.912+0000 7fa849ffb640 1 -- 172.21.15.59:0/3694782639 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa8440546a0 con 0x7fa8540b3640 2023-10-16T14:26:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.109+0000 7fa85a0d7640 1 -- 172.21.15.59:0/3694782639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8540cbbf0 con 0x7fa8540b3640 2023-10-16T14:26:43.112 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.110+0000 7fa849ffb640 1 -- 172.21.15.59:0/3694782639 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa844057cc0 con 0x7fa8540b3640 2023-10-16T14:26:43.112 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.112+0000 7fa85a0d7640 1 -- 172.21.15.59:0/3694782639 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa83806ae70 msgr2=0x7fa83806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.112+0000 7fa85a0d7640 1 --2- 172.21.15.59:0/3694782639 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa83806ae70 0x7fa83806d330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa850035000 tx=0x7fa850030000 comp rx=0 tx=0).stop 2023-10-16T14:26:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.112+0000 7fa85a0d7640 1 -- 172.21.15.59:0/3694782639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8540b3640 msgr2=0x7fa8540b3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.112+0000 7fa85a0d7640 1 --2- 172.21.15.59:0/3694782639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8540b3640 0x7fa8540b3a50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa84400d770 tx=0x7fa84400dc30 comp rx=0 tx=0).stop 2023-10-16T14:26:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.112+0000 7fa85a0d7640 1 -- 172.21.15.59:0/3694782639 shutdown_connections 2023-10-16T14:26:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.112+0000 7fa85a0d7640 1 --2- 172.21.15.59:0/3694782639 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa83806ae70 0x7fa83806d330 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.112+0000 7fa85a0d7640 1 --2- 172.21.15.59:0/3694782639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8540c6f70 0x7fa8540b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.112+0000 7fa85a0d7640 1 --2- 172.21.15.59:0/3694782639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8540b3640 0x7fa8540b3a50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.112+0000 7fa85a0d7640 1 --2- 172.21.15.59:0/3694782639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa840003a10 0x7fa854155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:43.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.112+0000 7fa85a0d7640 1 -- 172.21.15.59:0/3694782639 >> 172.21.15.59:0/3694782639 conn(0x7fa8540cf4e0 msgr2=0x7fa85406d180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:43.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.113+0000 7fa85a0d7640 1 -- 172.21.15.59:0/3694782639 shutdown_connections 2023-10-16T14:26:43.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.113+0000 7fa85a0d7640 1 -- 172.21.15.59:0/3694782639 wait complete. 2023-10-16T14:26:43.135 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T14:26:43.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.350+0000 7f7b31343640 1 Processor -- start 2023-10-16T14:26:43.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.350+0000 7f7b31343640 1 -- start start 2023-10-16T14:26:43.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.352+0000 7f7b31343640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7b2c0cee50 0x7f7b2c165560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:43.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.352+0000 7f7b31343640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2c06da10 con 0x7f7b2c15b880 2023-10-16T14:26:43.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.352+0000 7f7b31343640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2c06dcf0 con 0x7f7b2c15a620 2023-10-16T14:26:43.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.352+0000 7f7b31343640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2c06d820 con 0x7f7b2c0cee50 2023-10-16T14:26:43.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.352+0000 7f7b237fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7b2c15b880 0x7f7b2c0ce740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51810/0 (socket says 172.21.15.59:51810) 2023-10-16T14:26:43.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.352+0000 7f7b237fe640 1 -- 172.21.15.59:0/2201498867 learned_addr learned my addr 172.21.15.59:0/2201498867 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:43.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.352+0000 7f7b30b42640 1 --2- 172.21.15.59:0/2201498867 >> v2:172.21.15.59:3300/0 conn(0x7f7b2c0cee50 0x7f7b2c165560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.353+0000 7f7b30b42640 1 -- 172.21.15.59:0/2201498867 >> v1:172.21.15.151:6789/0 conn(0x7f7b2c15a620 legacy=0x7f7b2c06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.353+0000 7f7b2b7fe640 1 -- 172.21.15.59:0/2201498867 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808761039 0 0) 0x7f7b2c06da10 con 0x7f7b2c15b880 2023-10-16T14:26:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.353+0000 7f7b30b42640 1 -- 172.21.15.59:0/2201498867 >> v1:172.21.15.59:6789/0 conn(0x7f7b2c15b880 legacy=0x7f7b2c0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.353+0000 7f7b30b42640 1 -- 172.21.15.59:0/2201498867 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2c0aafd0 con 0x7f7b2c0cee50 2023-10-16T14:26:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.354+0000 7f7b30b42640 1 --2- 172.21.15.59:0/2201498867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b2c0cee50 0x7f7b2c165560 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7b240097a0 tx=0x7f7b2402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1c204dc6a95a4e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:43.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.354+0000 7f7b2b7fe640 1 -- 172.21.15.59:0/2201498867 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b24030610 con 0x7f7b2c0cee50 2023-10-16T14:26:43.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.354+0000 7f7b2b7fe640 1 -- 172.21.15.59:0/2201498867 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b24030770 con 0x7f7b2c0cee50 2023-10-16T14:26:43.358 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.354+0000 7f7b2b7fe640 1 -- 172.21.15.59:0/2201498867 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b24030b00 con 0x7f7b2c0cee50 2023-10-16T14:26:43.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.355+0000 7f7b31343640 1 -- 172.21.15.59:0/2201498867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b2c0cee50 msgr2=0x7f7b2c165560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:43.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.355+0000 7f7b31343640 1 --2- 172.21.15.59:0/2201498867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b2c0cee50 0x7f7b2c165560 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7b240097a0 tx=0x7f7b2402b960 comp rx=0 tx=0).stop 2023-10-16T14:26:43.359 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.355+0000 7f7b31343640 1 -- 172.21.15.59:0/2201498867 shutdown_connections 2023-10-16T14:26:43.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.355+0000 7f7b31343640 1 --2- 172.21.15.59:0/2201498867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b2c0cee50 0x7f7b2c165560 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:43.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.355+0000 7f7b31343640 1 -- 172.21.15.59:0/2201498867 >> 172.21.15.59:0/2201498867 conn(0x7f7b2c06a200 msgr2=0x7f7b2c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:43.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.355+0000 7f7b31343640 1 -- 172.21.15.59:0/2201498867 shutdown_connections 2023-10-16T14:26:43.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.355+0000 7f7b31343640 1 -- 172.21.15.59:0/2201498867 wait complete. 2023-10-16T14:26:43.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.357+0000 7f7b31343640 1 Processor -- start 2023-10-16T14:26:43.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.357+0000 7f7b31343640 1 -- start start 2023-10-16T14:26:43.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.358+0000 7f7b31343640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b2c0cee50 0x7f7b2c09bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:43.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.358+0000 7f7b31343640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b2c15a620 0x7f7b2c158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:43.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.358+0000 7f7b31343640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b2c15b880 0x7f7b2c0caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:43.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.358+0000 7f7b31343640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c158910 con 0x7f7b2c15a620 2023-10-16T14:26:43.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.358+0000 7f7b31343640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c157d40 con 0x7f7b2c0cee50 2023-10-16T14:26:43.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.358+0000 7f7b31343640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c1592e0 con 0x7f7b2c15b880 2023-10-16T14:26:43.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.358+0000 7f7b237fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b2c15a620 0x7f7b2c158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:43.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.358+0000 7f7b237fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b2c15a620 0x7f7b2c158da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54816/0 (socket says 172.21.15.59:54816) 2023-10-16T14:26:43.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.358+0000 7f7b237fe640 1 -- 172.21.15.59:0/382045231 learned_addr learned my addr 172.21.15.59:0/382045231 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:43.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.359+0000 7f7b2bfff640 1 --2- 172.21.15.59:0/382045231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b2c0cee50 0x7f7b2c09bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:43.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.359+0000 7f7b237fe640 1 -- 172.21.15.59:0/382045231 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b2c15b880 msgr2=0x7f7b2c0caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:43.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.359+0000 7f7b237fe640 1 --2- 172.21.15.59:0/382045231 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b2c15b880 0x7f7b2c0caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:43.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.359+0000 7f7b237fe640 1 -- 172.21.15.59:0/382045231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b2c0cee50 msgr2=0x7f7b2c09bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:43.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.359+0000 7f7b237fe640 1 --2- 172.21.15.59:0/382045231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b2c0cee50 0x7f7b2c09bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:43.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.359+0000 7f7b237fe640 1 -- 172.21.15.59:0/382045231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b24009400 con 0x7f7b2c15a620 2023-10-16T14:26:43.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.359+0000 7f7b237fe640 1 --2- 172.21.15.59:0/382045231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b2c15a620 0x7f7b2c158da0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400c750 tx=0x7f7b1400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:43.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.359+0000 7f7b297fa640 1 -- 172.21.15.59:0/382045231 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400ce60 con 0x7f7b2c15a620 2023-10-16T14:26:43.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.359+0000 7f7b297fa640 1 -- 172.21.15.59:0/382045231 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1400a640 con 0x7f7b2c15a620 2023-10-16T14:26:43.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.359+0000 7f7b297fa640 1 -- 172.21.15.59:0/382045231 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400aa30 con 0x7f7b2c15a620 2023-10-16T14:26:43.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.359+0000 7f7b31343640 1 -- 172.21.15.59:0/382045231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2c157fe0 con 0x7f7b2c15a620 2023-10-16T14:26:43.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.360+0000 7f7b31343640 1 -- 172.21.15.59:0/382045231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2c1585a0 con 0x7f7b2c15a620 2023-10-16T14:26:43.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.361+0000 7f7b31343640 1 -- 172.21.15.59:0/382045231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b2c158ac0 con 0x7f7b2c15a620 2023-10-16T14:26:43.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.362+0000 7f7b297fa640 1 -- 172.21.15.59:0/382045231 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7b1400ab90 con 0x7f7b2c15a620 2023-10-16T14:26:43.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.363+0000 7f7b297fa640 1 --2- 172.21.15.59:0/382045231 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7b0c06ae70 0x7f7b0c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:43.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.363+0000 7f7b297fa640 1 -- 172.21.15.59:0/382045231 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f7b14088e40 con 0x7f7b2c15a620 2023-10-16T14:26:43.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.364+0000 7f7b2bfff640 1 --2- 172.21.15.59:0/382045231 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7b0c06ae70 0x7f7b0c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:43.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.365+0000 7f7b2bfff640 1 --2- 172.21.15.59:0/382045231 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7b0c06ae70 0x7f7b0c06d330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c000f60 tx=0x7f7b1c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:43.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.367+0000 7f7b297fa640 1 -- 172.21.15.59:0/382045231 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7b2c158ac0 con 0x7f7b2c15a620 2023-10-16T14:26:43.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.560+0000 7f7b31343640 1 -- 172.21.15.59:0/382045231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7b2c067440 con 0x7f7b2c15a620 2023-10-16T14:26:43.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.561+0000 7f7b297fa640 1 -- 172.21.15.59:0/382045231 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7b14018070 con 0x7f7b2c15a620 2023-10-16T14:26:43.564 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-16T14:26:43.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.564+0000 7f7b31343640 1 -- 172.21.15.59:0/382045231 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7b0c06ae70 msgr2=0x7f7b0c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:43.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.564+0000 7f7b31343640 1 --2- 172.21.15.59:0/382045231 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7b0c06ae70 0x7f7b0c06d330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c000f60 tx=0x7f7b1c009040 comp rx=0 tx=0).stop 2023-10-16T14:26:43.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.564+0000 7f7b31343640 1 -- 172.21.15.59:0/382045231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b2c15a620 msgr2=0x7f7b2c158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:43.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.564+0000 7f7b31343640 1 --2- 172.21.15.59:0/382045231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b2c15a620 0x7f7b2c158da0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400c750 tx=0x7f7b1400cc10 comp rx=0 tx=0).stop 2023-10-16T14:26:43.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.564+0000 7f7b31343640 1 -- 172.21.15.59:0/382045231 shutdown_connections 2023-10-16T14:26:43.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.564+0000 7f7b31343640 1 --2- 172.21.15.59:0/382045231 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7b0c06ae70 0x7f7b0c06d330 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:43.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.564+0000 7f7b31343640 1 --2- 172.21.15.59:0/382045231 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b2c15b880 0x7f7b2c0caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:43.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.564+0000 7f7b31343640 1 --2- 172.21.15.59:0/382045231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b2c15a620 0x7f7b2c158da0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:43.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.564+0000 7f7b31343640 1 --2- 172.21.15.59:0/382045231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b2c0cee50 0x7f7b2c09bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:43.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.564+0000 7f7b31343640 1 -- 172.21.15.59:0/382045231 >> 172.21.15.59:0/382045231 conn(0x7f7b2c06a200 msgr2=0x7f7b2c06d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:43.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.565+0000 7f7b31343640 1 -- 172.21.15.59:0/382045231 shutdown_connections 2023-10-16T14:26:43.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.565+0000 7f7b31343640 1 -- 172.21.15.59:0/382045231 wait complete. 2023-10-16T14:26:43.585 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T14:26:43.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.807+0000 7f80eb53e640 1 Processor -- start 2023-10-16T14:26:43.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.807+0000 7f80eb53e640 1 -- start start 2023-10-16T14:26:43.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.809+0000 7f80eb53e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80e415a830 0x7f80e40cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:43.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.809+0000 7f80eb53e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f80e4070a30 0x7f80e40c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:43.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.809+0000 7f80eb53e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e40cf040 con 0x7f80e40ca550 2023-10-16T14:26:43.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.809+0000 7f80eb53e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e40ce430 con 0x7f80e4070a30 2023-10-16T14:26:43.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.809+0000 7f80eb53e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e40ce710 con 0x7f80e415a830 2023-10-16T14:26:43.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.809+0000 7f80e8ad9640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f80e40ca550 0x7f80e4070320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51814/0 (socket says 172.21.15.59:51814) 2023-10-16T14:26:43.812 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.809+0000 7f80e8ad9640 1 -- 172.21.15.59:0/1358293951 learned_addr learned my addr 172.21.15.59:0/1358293951 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:43.815 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.810+0000 7f80e92da640 1 --2- 172.21.15.59:0/1358293951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80e415a830 0x7f80e40cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:43.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.810+0000 7f80e9adb640 1 --2- 172.21.15.59:0/1358293951 >> v2:172.21.15.151:3300/0 conn(0x7f80e4070a30 0x7f80e40c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:43.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.810+0000 7f80dbfff640 1 -- 172.21.15.59:0/1358293951 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400603181 0 0) 0x7f80e40cf040 con 0x7f80e40ca550 2023-10-16T14:26:43.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.810+0000 7f80dbfff640 1 -- 172.21.15.59:0/1358293951 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80d0003520 con 0x7f80e40ca550 2023-10-16T14:26:43.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.810+0000 7f80dbfff640 1 -- 172.21.15.59:0/1358293951 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 99964705 0 0) 0x7f80d0003520 con 0x7f80e40ca550 2023-10-16T14:26:43.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.810+0000 7f80dbfff640 1 -- 172.21.15.59:0/1358293951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80e415a830 msgr2=0x7f80e40cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:43.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.810+0000 7f80dbfff640 1 --2- 172.21.15.59:0/1358293951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80e415a830 0x7f80e40cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:43.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.810+0000 7f80dbfff640 1 -- 172.21.15.59:0/1358293951 >> v2:172.21.15.151:3300/0 conn(0x7f80e4070a30 msgr2=0x7f80e40c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:43.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.810+0000 7f80dbfff640 1 --2- 172.21.15.59:0/1358293951 >> v2:172.21.15.151:3300/0 conn(0x7f80e4070a30 0x7f80e40c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:43.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.810+0000 7f80dbfff640 1 -- 172.21.15.59:0/1358293951 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e40ce9f0 con 0x7f80e40ca550 2023-10-16T14:26:43.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.810+0000 7f80dbfff640 1 -- 172.21.15.59:0/1358293951 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f80d4001670 con 0x7f80e40ca550 2023-10-16T14:26:43.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.810+0000 7f80dbfff640 1 -- 172.21.15.59:0/1358293951 >> v1:172.21.15.59:6789/0 conn(0x7f80e40ca550 legacy=0x7f80e4070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:43.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.810+0000 7f80dbfff640 1 --2- 172.21.15.59:0/1358293951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80e415a830 0x7f80d0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:43.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.810+0000 7f80dbfff640 1 --2- 172.21.15.59:0/1358293951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80d0003f40 0x7f80d00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:43.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.811+0000 7f80dbfff640 1 --2- 172.21.15.59:0/1358293951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80d0004d00 0x7f80d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:43.818 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.811+0000 7f80dbfff640 1 -- 172.21.15.59:0/1358293951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e40ce430 con 0x7f80d0004d00 2023-10-16T14:26:43.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.811+0000 7f80dbfff640 1 -- 172.21.15.59:0/1358293951 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e40ce710 con 0x7f80d0003f40 2023-10-16T14:26:43.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.811+0000 7f80dbfff640 1 -- 172.21.15.59:0/1358293951 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d000b980 con 0x7f80e415a830 2023-10-16T14:26:43.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.811+0000 7f80e9adb640 1 --2- 172.21.15.59:0/1358293951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80d0004d00 0x7f80d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:43.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.811+0000 7f80e92da640 1 --2- 172.21.15.59:0/1358293951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80e415a830 0x7f80d0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:43.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.811+0000 7f80e8ad9640 1 --2- 172.21.15.59:0/1358293951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80d0003f40 0x7f80d00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.811+0000 7f80e9adb640 1 -- 172.21.15.59:0/1358293951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80e415a830 msgr2=0x7f80d0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.811+0000 7f80e9adb640 1 --2- 172.21.15.59:0/1358293951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80e415a830 0x7f80d0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:43.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.811+0000 7f80e9adb640 1 -- 172.21.15.59:0/1358293951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80d0003f40 msgr2=0x7f80d00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.811+0000 7f80e9adb640 1 --2- 172.21.15.59:0/1358293951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80d0003f40 0x7f80d00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.811+0000 7f80e9adb640 1 -- 172.21.15.59:0/1358293951 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d0003520 con 0x7f80d0004d00 2023-10-16T14:26:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.812+0000 7f80e9adb640 1 --2- 172.21.15.59:0/1358293951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80d0004d00 0x7f80d0005180 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00e170 tx=0x7f80d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237c7ffd777c5f7a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:43.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.813+0000 7f80dbfff640 1 -- 172.21.15.59:0/1358293951 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc02cc20 con 0x7f80d0004d00 2023-10-16T14:26:43.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.813+0000 7f80dbfff640 1 -- 172.21.15.59:0/1358293951 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc00f040 con 0x7f80d0004d00 2023-10-16T14:26:43.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.813+0000 7f80dbfff640 1 -- 172.21.15.59:0/1358293951 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc034440 con 0x7f80d0004d00 2023-10-16T14:26:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.813+0000 7f80eb53e640 1 -- 172.21.15.59:0/1358293951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80d0004d00 msgr2=0x7f80d0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.813+0000 7f80eb53e640 1 --2- 172.21.15.59:0/1358293951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80d0004d00 0x7f80d0005180 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00e170 tx=0x7f80d00057f0 comp rx=0 tx=0).stop 2023-10-16T14:26:43.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.813+0000 7f80e9adb640 1 -- 172.21.15.59:0/1358293951 reap_dead start 2023-10-16T14:26:43.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.813+0000 7f80eb53e640 1 -- 172.21.15.59:0/1358293951 shutdown_connections 2023-10-16T14:26:43.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.813+0000 7f80eb53e640 1 -- 172.21.15.59:0/1358293951 >> 172.21.15.59:0/1358293951 conn(0x7f80e40b0030 msgr2=0x7f80e40b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:43.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.814+0000 7f80eb53e640 1 -- 172.21.15.59:0/1358293951 shutdown_connections 2023-10-16T14:26:43.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.814+0000 7f80eb53e640 1 -- 172.21.15.59:0/1358293951 wait complete. 2023-10-16T14:26:43.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.816+0000 7f80eb53e640 1 Processor -- start 2023-10-16T14:26:43.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.816+0000 7f80eb53e640 1 -- start start 2023-10-16T14:26:43.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.817+0000 7f80eb53e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80d0004d00 0x7f80e414f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:43.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.817+0000 7f80eb53e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80e4151130 0x7f80e41530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:43.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.817+0000 7f80eb53e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80e41535f0 0x7f80e40c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:43.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.817+0000 7f80eb53e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e40c3730 con 0x7f80d0004d00 2023-10-16T14:26:43.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.817+0000 7f80eb53e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e40c3a10 con 0x7f80e41535f0 2023-10-16T14:26:43.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.817+0000 7f80eb53e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e40c3cf0 con 0x7f80e4151130 2023-10-16T14:26:43.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.817+0000 7f80e92da640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80d0004d00 0x7f80e414f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:43.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.817+0000 7f80e92da640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80d0004d00 0x7f80e414f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54832/0 (socket says 172.21.15.59:54832) 2023-10-16T14:26:43.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.817+0000 7f80e92da640 1 -- 172.21.15.59:0/2022835673 learned_addr learned my addr 172.21.15.59:0/2022835673 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:43.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.817+0000 7f80e8ad9640 1 --2- 172.21.15.59:0/2022835673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80e4151130 0x7f80e41530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:43.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.818+0000 7f80e9adb640 1 --2- 172.21.15.59:0/2022835673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80e41535f0 0x7f80e40c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:43.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.818+0000 7f80e92da640 1 -- 172.21.15.59:0/2022835673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80e4151130 msgr2=0x7f80e41530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:43.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.818+0000 7f80e92da640 1 --2- 172.21.15.59:0/2022835673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80e4151130 0x7f80e41530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:43.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.818+0000 7f80e92da640 1 -- 172.21.15.59:0/2022835673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80e41535f0 msgr2=0x7f80e40c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:43.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.818+0000 7f80e92da640 1 --2- 172.21.15.59:0/2022835673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80e41535f0 0x7f80e40c44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:43.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.818+0000 7f80e92da640 1 -- 172.21.15.59:0/2022835673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e40c3fd0 con 0x7f80d0004d00 2023-10-16T14:26:43.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.818+0000 7f80e92da640 1 --2- 172.21.15.59:0/2022835673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80d0004d00 0x7f80e414f330 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f80e0011600 tx=0x7f80e0011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:43.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.818+0000 7f80d9ffb640 1 -- 172.21.15.59:0/2022835673 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e000f920 con 0x7f80d0004d00 2023-10-16T14:26:43.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.818+0000 7f80d9ffb640 1 -- 172.21.15.59:0/2022835673 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e000fa80 con 0x7f80d0004d00 2023-10-16T14:26:43.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.818+0000 7f80d9ffb640 1 -- 172.21.15.59:0/2022835673 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e000fdf0 con 0x7f80d0004d00 2023-10-16T14:26:43.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.818+0000 7f80eb53e640 1 -- 172.21.15.59:0/2022835673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e414f870 con 0x7f80d0004d00 2023-10-16T14:26:43.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.818+0000 7f80eb53e640 1 -- 172.21.15.59:0/2022835673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e40c4a30 con 0x7f80d0004d00 2023-10-16T14:26:43.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.820+0000 7f80eb53e640 1 -- 172.21.15.59:0/2022835673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e4073ef0 con 0x7f80d0004d00 2023-10-16T14:26:43.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.821+0000 7f80d9ffb640 1 -- 172.21.15.59:0/2022835673 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f80e0015460 con 0x7f80d0004d00 2023-10-16T14:26:43.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.821+0000 7f80d9ffb640 1 --2- 172.21.15.59:0/2022835673 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f80c806aea0 0x7f80c806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:43.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.822+0000 7f80d9ffb640 1 -- 172.21.15.59:0/2022835673 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f80e0089e90 con 0x7f80d0004d00 2023-10-16T14:26:43.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.822+0000 7f80e8ad9640 1 --2- 172.21.15.59:0/2022835673 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f80c806aea0 0x7f80c806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:43.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.824+0000 7f80e8ad9640 1 --2- 172.21.15.59:0/2022835673 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f80c806aea0 0x7f80c806d360 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f80e40b2fa0 tx=0x7f80d4000f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:43.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:43.826+0000 7f80d9ffb640 1 -- 172.21.15.59:0/2022835673 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f80e0054b70 con 0x7f80d0004d00 2023-10-16T14:26:44.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.020+0000 7f80eb53e640 1 -- 172.21.15.59:0/2022835673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f80e40c3870 con 0x7f80d0004d00 2023-10-16T14:26:44.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.021+0000 7f80d9ffb640 1 -- 172.21.15.59:0/2022835673 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f80e40c3870 con 0x7f80d0004d00 2023-10-16T14:26:44.024 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:44.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.023+0000 7f80eb53e640 1 -- 172.21.15.59:0/2022835673 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f80c806aea0 msgr2=0x7f80c806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:44.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.023+0000 7f80eb53e640 1 --2- 172.21.15.59:0/2022835673 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f80c806aea0 0x7f80c806d360 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f80e40b2fa0 tx=0x7f80d4000f50 comp rx=0 tx=0).stop 2023-10-16T14:26:44.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.023+0000 7f80eb53e640 1 -- 172.21.15.59:0/2022835673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80d0004d00 msgr2=0x7f80e414f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:44.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.023+0000 7f80eb53e640 1 --2- 172.21.15.59:0/2022835673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80d0004d00 0x7f80e414f330 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f80e0011600 tx=0x7f80e0011ac0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.024+0000 7f80eb53e640 1 -- 172.21.15.59:0/2022835673 shutdown_connections 2023-10-16T14:26:44.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.024+0000 7f80eb53e640 1 --2- 172.21.15.59:0/2022835673 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f80c806aea0 0x7f80c806d360 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.024+0000 7f80eb53e640 1 --2- 172.21.15.59:0/2022835673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80e41535f0 0x7f80e40c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.024+0000 7f80eb53e640 1 --2- 172.21.15.59:0/2022835673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80e4151130 0x7f80e41530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.024+0000 7f80eb53e640 1 --2- 172.21.15.59:0/2022835673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80d0004d00 0x7f80e414f330 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.024+0000 7f80eb53e640 1 -- 172.21.15.59:0/2022835673 >> 172.21.15.59:0/2022835673 conn(0x7f80e40b0030 msgr2=0x7f80e40c9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:44.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.024+0000 7f80eb53e640 1 -- 172.21.15.59:0/2022835673 shutdown_connections 2023-10-16T14:26:44.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.024+0000 7f80eb53e640 1 -- 172.21.15.59:0/2022835673 wait complete. 2023-10-16T14:26:44.045 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:26:44.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.269+0000 7f0e1f587640 1 Processor -- start 2023-10-16T14:26:44.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.269+0000 7f0e1f587640 1 -- start start 2023-10-16T14:26:44.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.271+0000 7f0e1f587640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0e180cd980 0x7f0e180cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:44.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.271+0000 7f0e1f587640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e18159c00 0x7f0e1815d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:44.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.271+0000 7f0e1f587640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e18154110 con 0x7f0e1815def0 2023-10-16T14:26:44.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.271+0000 7f0e1f587640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e1815d1f0 con 0x7f0e18159c00 2023-10-16T14:26:44.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.271+0000 7f0e1f587640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e1815a4c0 con 0x7f0e180cd980 2023-10-16T14:26:44.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.271+0000 7f0e1dd84640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e18159c00 0x7f0e1815d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:44.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.271+0000 7f0e1dd84640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e18159c00 0x7f0e1815d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54844/0 (socket says 172.21.15.59:54844) 2023-10-16T14:26:44.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.271+0000 7f0e1dd84640 1 -- 172.21.15.59:0/397126764 learned_addr learned my addr 172.21.15.59:0/397126764 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:44.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.272+0000 7f0e1e585640 1 --2- 172.21.15.59:0/397126764 >> v2:172.21.15.151:3300/0 conn(0x7f0e180cd980 0x7f0e180cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:44.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.272+0000 7f0e1dd84640 1 -- 172.21.15.59:0/397126764 >> v2:172.21.15.151:3300/0 conn(0x7f0e180cd980 msgr2=0x7f0e180cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:44.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.272+0000 7f0e1dd84640 1 --2- 172.21.15.59:0/397126764 >> v2:172.21.15.151:3300/0 conn(0x7f0e180cd980 0x7f0e180cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.272+0000 7f0e1dd84640 1 -- 172.21.15.59:0/397126764 >> v1:172.21.15.151:6789/0 conn(0x7f0e1815def0 legacy=0x7f0e1806bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:44.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.272+0000 7f0e1dd84640 1 -- 172.21.15.59:0/397126764 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1815a7a0 con 0x7f0e18159c00 2023-10-16T14:26:44.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.272+0000 7f0e1e585640 1 --2- 172.21.15.59:0/397126764 >> v2:172.21.15.151:3300/0 conn(0x7f0e180cd980 0x7f0e180cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:44.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.273+0000 7f0e1dd84640 1 --2- 172.21.15.59:0/397126764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e18159c00 0x7f0e1815d9b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0e1806e320 tx=0x7f0e0802db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cfdc84c7edcd411 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:44.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.273+0000 7f0e1d583640 1 -- 172.21.15.59:0/397126764 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0802f8e0 con 0x7f0e18159c00 2023-10-16T14:26:44.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.273+0000 7f0e1d583640 1 -- 172.21.15.59:0/397126764 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e0802fa40 con 0x7f0e18159c00 2023-10-16T14:26:44.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.273+0000 7f0e1d583640 1 -- 172.21.15.59:0/397126764 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e0802fdd0 con 0x7f0e18159c00 2023-10-16T14:26:44.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.274+0000 7f0e1f587640 1 -- 172.21.15.59:0/397126764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e18159c00 msgr2=0x7f0e1815d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:44.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.274+0000 7f0e1f587640 1 --2- 172.21.15.59:0/397126764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e18159c00 0x7f0e1815d9b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0e1806e320 tx=0x7f0e0802db20 comp rx=0 tx=0).stop 2023-10-16T14:26:44.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.274+0000 7f0e1f587640 1 -- 172.21.15.59:0/397126764 shutdown_connections 2023-10-16T14:26:44.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.274+0000 7f0e1f587640 1 --2- 172.21.15.59:0/397126764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e18159c00 0x7f0e1815d9b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.274+0000 7f0e1f587640 1 --2- 172.21.15.59:0/397126764 >> v2:172.21.15.151:3300/0 conn(0x7f0e180cd980 0x7f0e180cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.274+0000 7f0e1f587640 1 -- 172.21.15.59:0/397126764 >> 172.21.15.59:0/397126764 conn(0x7f0e1806a470 msgr2=0x7f0e180afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:44.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.274+0000 7f0e1f587640 1 -- 172.21.15.59:0/397126764 shutdown_connections 2023-10-16T14:26:44.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.274+0000 7f0e1f587640 1 -- 172.21.15.59:0/397126764 wait complete. 2023-10-16T14:26:44.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.276+0000 7f0e1f587640 1 Processor -- start 2023-10-16T14:26:44.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.276+0000 7f0e1f587640 1 -- start start 2023-10-16T14:26:44.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.277+0000 7f0e1f587640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e180cd980 0x7f0e180cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:44.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.277+0000 7f0e1f587640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e18159c00 0x7f0e180c1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:44.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.277+0000 7f0e1f587640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e180c4a60 0x7f0e180cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:44.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.277+0000 7f0e1f587640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e18156080 con 0x7f0e180cd980 2023-10-16T14:26:44.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.277+0000 7f0e1f587640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180cb500 con 0x7f0e180c4a60 2023-10-16T14:26:44.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.277+0000 7f0e1f587640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180cb7e0 con 0x7f0e18159c00 2023-10-16T14:26:44.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.277+0000 7f0e1e585640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e180cd980 0x7f0e180cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:44.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.277+0000 7f0e1e585640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e180cd980 0x7f0e180cc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54846/0 (socket says 172.21.15.59:54846) 2023-10-16T14:26:44.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.277+0000 7f0e1e585640 1 -- 172.21.15.59:0/2047153814 learned_addr learned my addr 172.21.15.59:0/2047153814 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:44.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.278+0000 7f0e1dd84640 1 --2- 172.21.15.59:0/2047153814 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e18159c00 0x7f0e180c1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:44.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.278+0000 7f0e1ed86640 1 --2- 172.21.15.59:0/2047153814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e180c4a60 0x7f0e180cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:44.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.278+0000 7f0e1e585640 1 -- 172.21.15.59:0/2047153814 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e18159c00 msgr2=0x7f0e180c1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:44.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.278+0000 7f0e1e585640 1 --2- 172.21.15.59:0/2047153814 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e18159c00 0x7f0e180c1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.278+0000 7f0e1e585640 1 -- 172.21.15.59:0/2047153814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e180c4a60 msgr2=0x7f0e180cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:44.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.278+0000 7f0e1e585640 1 --2- 172.21.15.59:0/2047153814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e180c4a60 0x7f0e180cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.278+0000 7f0e1e585640 1 -- 172.21.15.59:0/2047153814 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e080094d0 con 0x7f0e180cd980 2023-10-16T14:26:44.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.278+0000 7f0e1ed86640 1 --2- 172.21.15.59:0/2047153814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e180c4a60 0x7f0e180cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:44.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.278+0000 7f0e1e585640 1 --2- 172.21.15.59:0/2047153814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e180cd980 0x7f0e180cc2e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0e1400c7f0 tx=0x7f0e1400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:44.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.279+0000 7f0e0effd640 1 -- 172.21.15.59:0/2047153814 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e14005b90 con 0x7f0e180cd980 2023-10-16T14:26:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.279+0000 7f0e0effd640 1 -- 172.21.15.59:0/2047153814 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e14005cf0 con 0x7f0e180cd980 2023-10-16T14:26:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.279+0000 7f0e0effd640 1 -- 172.21.15.59:0/2047153814 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e14007a30 con 0x7f0e180cd980 2023-10-16T14:26:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.279+0000 7f0e1f587640 1 -- 172.21.15.59:0/2047153814 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e180cbac0 con 0x7f0e180cd980 2023-10-16T14:26:44.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.279+0000 7f0e1f587640 1 -- 172.21.15.59:0/2047153814 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e180cb1f0 con 0x7f0e180cd980 2023-10-16T14:26:44.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.280+0000 7f0e1f587640 1 -- 172.21.15.59:0/2047153814 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e181561c0 con 0x7f0e180cd980 2023-10-16T14:26:44.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.281+0000 7f0e0effd640 1 -- 172.21.15.59:0/2047153814 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0e14007b90 con 0x7f0e180cd980 2023-10-16T14:26:44.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.282+0000 7f0e0effd640 1 --2- 172.21.15.59:0/2047153814 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0dfc06ae70 0x7f0dfc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:44.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.282+0000 7f0e0effd640 1 -- 172.21.15.59:0/2047153814 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f0e140898e0 con 0x7f0e180cd980 2023-10-16T14:26:44.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.283+0000 7f0e1dd84640 1 --2- 172.21.15.59:0/2047153814 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0dfc06ae70 0x7f0dfc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:44.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.284+0000 7f0e1dd84640 1 --2- 172.21.15.59:0/2047153814 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0dfc06ae70 0x7f0dfc06d330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0e08038000 tx=0x7f0e08008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:44.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.286+0000 7f0e0effd640 1 -- 172.21.15.59:0/2047153814 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0e14054650 con 0x7f0e180cd980 2023-10-16T14:26:44.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.483+0000 7f0e1f587640 1 -- 172.21.15.59:0/2047153814 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e1804e9b0 con 0x7f0e180cd980 2023-10-16T14:26:44.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.486+0000 7f0e0effd640 1 -- 172.21.15.59:0/2047153814 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18445 (secure 0 0 0) 0x7f0e1401e090 con 0x7f0e180cd980 2023-10-16T14:26:44.489 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:44.489 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:26:29.634854+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:26:44.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.488+0000 7f0e1f587640 1 -- 172.21.15.59:0/2047153814 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0dfc06ae70 msgr2=0x7f0dfc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:44.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.488+0000 7f0e1f587640 1 --2- 172.21.15.59:0/2047153814 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0dfc06ae70 0x7f0dfc06d330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0e08038000 tx=0x7f0e08008030 comp rx=0 tx=0).stop 2023-10-16T14:26:44.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.489+0000 7f0e1f587640 1 -- 172.21.15.59:0/2047153814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e180cd980 msgr2=0x7f0e180cc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:44.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.489+0000 7f0e1f587640 1 --2- 172.21.15.59:0/2047153814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e180cd980 0x7f0e180cc2e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0e1400c7f0 tx=0x7f0e1400cbf0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.489+0000 7f0e1f587640 1 -- 172.21.15.59:0/2047153814 shutdown_connections 2023-10-16T14:26:44.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.489+0000 7f0e1f587640 1 --2- 172.21.15.59:0/2047153814 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0dfc06ae70 0x7f0dfc06d330 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.489+0000 7f0e1f587640 1 --2- 172.21.15.59:0/2047153814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e180c4a60 0x7f0e180cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.489+0000 7f0e1f587640 1 --2- 172.21.15.59:0/2047153814 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e18159c00 0x7f0e180c1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.489+0000 7f0e1f587640 1 --2- 172.21.15.59:0/2047153814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e180cd980 0x7f0e180cc2e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.489+0000 7f0e1f587640 1 -- 172.21.15.59:0/2047153814 >> 172.21.15.59:0/2047153814 conn(0x7f0e1806a470 msgr2=0x7f0e180b02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:44.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.489+0000 7f0e1f587640 1 -- 172.21.15.59:0/2047153814 shutdown_connections 2023-10-16T14:26:44.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.489+0000 7f0e1f587640 1 -- 172.21.15.59:0/2047153814 wait complete. 2023-10-16T14:26:44.510 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T14:25:46.371818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T14:25:47.145341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T14:25:50.758038+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T14:26:44.511 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:26:44.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.732+0000 7ff686905640 1 Processor -- start 2023-10-16T14:26:44.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.732+0000 7ff686905640 1 -- start start 2023-10-16T14:26:44.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.733+0000 7ff686905640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff680160ee0 0x7ff6801654e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:44.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.733+0000 7ff686905640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6800c9060 0x7ff6800caca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:44.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.734+0000 7ff686905640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6800cc8b0 con 0x7ff6800cb1e0 2023-10-16T14:26:44.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.734+0000 7ff686905640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff680165a20 con 0x7ff6800c9060 2023-10-16T14:26:44.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.734+0000 7ff686905640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800c9cc0 con 0x7ff680160ee0 2023-10-16T14:26:44.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.734+0000 7ff67f7fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6800c9060 0x7ff6800caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:44.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.734+0000 7ff67f7fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6800c9060 0x7ff6800caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54858/0 (socket says 172.21.15.59:54858) 2023-10-16T14:26:44.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.734+0000 7ff67f7fe640 1 -- 172.21.15.59:0/610682719 learned_addr learned my addr 172.21.15.59:0/610682719 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:44.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.734+0000 7ff67f7fe640 1 -- 172.21.15.59:0/610682719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff680160ee0 msgr2=0x7ff6801654e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:44.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.734+0000 7ff67ffff640 1 --2- 172.21.15.59:0/610682719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff680160ee0 0x7ff6801654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:44.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.734+0000 7ff67f7fe640 1 --2- 172.21.15.59:0/610682719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff680160ee0 0x7ff6801654e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.734+0000 7ff67f7fe640 1 -- 172.21.15.59:0/610682719 >> v1:172.21.15.151:6789/0 conn(0x7ff6800cb1e0 legacy=0x7ff6800ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:44.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.734+0000 7ff67f7fe640 1 -- 172.21.15.59:0/610682719 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6800cb650 con 0x7ff6800c9060 2023-10-16T14:26:44.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.734+0000 7ff67ffff640 1 --2- 172.21.15.59:0/610682719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff680160ee0 0x7ff6801654e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:44.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.736+0000 7ff67f7fe640 1 --2- 172.21.15.59:0/610682719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6800c9060 0x7ff6800caca0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff674009870 tx=0x7ff67402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8424b0ecf957b98 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:44.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.736+0000 7ff67effd640 1 -- 172.21.15.59:0/610682719 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff674031640 con 0x7ff6800c9060 2023-10-16T14:26:44.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.736+0000 7ff67effd640 1 -- 172.21.15.59:0/610682719 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6740317a0 con 0x7ff6800c9060 2023-10-16T14:26:44.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.736+0000 7ff67effd640 1 -- 172.21.15.59:0/610682719 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff674031b30 con 0x7ff6800c9060 2023-10-16T14:26:44.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.736+0000 7ff686905640 1 -- 172.21.15.59:0/610682719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6800c9060 msgr2=0x7ff6800caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:44.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.736+0000 7ff686905640 1 --2- 172.21.15.59:0/610682719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6800c9060 0x7ff6800caca0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff674009870 tx=0x7ff67402b8f0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.737+0000 7ff686905640 1 -- 172.21.15.59:0/610682719 shutdown_connections 2023-10-16T14:26:44.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.737+0000 7ff686905640 1 --2- 172.21.15.59:0/610682719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6800c9060 0x7ff6800caca0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.737+0000 7ff686905640 1 --2- 172.21.15.59:0/610682719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff680160ee0 0x7ff6801654e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.737+0000 7ff686905640 1 -- 172.21.15.59:0/610682719 >> 172.21.15.59:0/610682719 conn(0x7ff6800b0030 msgr2=0x7ff6800b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:44.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.737+0000 7ff686905640 1 -- 172.21.15.59:0/610682719 shutdown_connections 2023-10-16T14:26:44.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.737+0000 7ff686905640 1 -- 172.21.15.59:0/610682719 wait complete. 2023-10-16T14:26:44.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.739+0000 7ff686905640 1 Processor -- start 2023-10-16T14:26:44.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.739+0000 7ff686905640 1 -- start start 2023-10-16T14:26:44.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.740+0000 7ff686905640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6800c9060 0x7ff6800c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.740+0000 7ff686905640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6800cb1e0 0x7ff6800c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.740+0000 7ff686905640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff680160ee0 0x7ff6801f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.740+0000 7ff686905640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800c41a0 con 0x7ff6800c9060 2023-10-16T14:26:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.740+0000 7ff686905640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800c3590 con 0x7ff680160ee0 2023-10-16T14:26:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.740+0000 7ff686905640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800c3870 con 0x7ff6800cb1e0 2023-10-16T14:26:44.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.740+0000 7ff67ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6800c9060 0x7ff6800c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:44.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.740+0000 7ff67ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6800c9060 0x7ff6800c55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54866/0 (socket says 172.21.15.59:54866) 2023-10-16T14:26:44.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.740+0000 7ff67ffff640 1 -- 172.21.15.59:0/199459835 learned_addr learned my addr 172.21.15.59:0/199459835 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:44.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.740+0000 7ff67f7fe640 1 --2- 172.21.15.59:0/199459835 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6800cb1e0 0x7ff6800c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:44.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.740+0000 7ff684ea2640 1 --2- 172.21.15.59:0/199459835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff680160ee0 0x7ff6801f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:44.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.740+0000 7ff67ffff640 1 -- 172.21.15.59:0/199459835 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6800cb1e0 msgr2=0x7ff6800c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:44.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.740+0000 7ff67ffff640 1 --2- 172.21.15.59:0/199459835 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6800cb1e0 0x7ff6800c5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.740+0000 7ff67ffff640 1 -- 172.21.15.59:0/199459835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff680160ee0 msgr2=0x7ff6801f5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:44.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.740+0000 7ff67ffff640 1 --2- 172.21.15.59:0/199459835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff680160ee0 0x7ff6801f5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.740+0000 7ff67ffff640 1 -- 172.21.15.59:0/199459835 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6740094d0 con 0x7ff6800c9060 2023-10-16T14:26:44.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.741+0000 7ff67ffff640 1 --2- 172.21.15.59:0/199459835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6800c9060 0x7ff6800c55d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff67000c7f0 tx=0x7ff67000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:44.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.741+0000 7ff67cff9640 1 -- 172.21.15.59:0/199459835 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff670007820 con 0x7ff6800c9060 2023-10-16T14:26:44.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.741+0000 7ff67cff9640 1 -- 172.21.15.59:0/199459835 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff670007980 con 0x7ff6800c9060 2023-10-16T14:26:44.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.741+0000 7ff67cff9640 1 -- 172.21.15.59:0/199459835 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff670007cf0 con 0x7ff6800c9060 2023-10-16T14:26:44.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.741+0000 7ff686905640 1 -- 172.21.15.59:0/199459835 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6800c3b50 con 0x7ff6800c9060 2023-10-16T14:26:44.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.741+0000 7ff686905640 1 -- 172.21.15.59:0/199459835 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6800c3020 con 0x7ff6800c9060 2023-10-16T14:26:44.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.743+0000 7ff686905640 1 -- 172.21.15.59:0/199459835 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff680073ef0 con 0x7ff6800c9060 2023-10-16T14:26:44.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.743+0000 7ff67cff9640 1 -- 172.21.15.59:0/199459835 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff6700113f0 con 0x7ff6800c9060 2023-10-16T14:26:44.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.744+0000 7ff67cff9640 1 --2- 172.21.15.59:0/199459835 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff66c06ae70 0x7ff66c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:44.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.744+0000 7ff67cff9640 1 -- 172.21.15.59:0/199459835 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff670089d20 con 0x7ff6800c9060 2023-10-16T14:26:44.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.745+0000 7ff67f7fe640 1 --2- 172.21.15.59:0/199459835 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff66c06ae70 0x7ff66c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:44.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.746+0000 7ff67f7fe640 1 --2- 172.21.15.59:0/199459835 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff66c06ae70 0x7ff66c06d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff674036000 tx=0x7ff67403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:44.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.749+0000 7ff67cff9640 1 -- 172.21.15.59:0/199459835 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff670054a00 con 0x7ff6800c9060 2023-10-16T14:26:44.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.943+0000 7ff686905640 1 -- 172.21.15.59:0/199459835 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6800cc1a0 con 0x7ff6800c9060 2023-10-16T14:26:44.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.943+0000 7ff67cff9640 1 -- 172.21.15.59:0/199459835 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff67001f0a0 con 0x7ff6800c9060 2023-10-16T14:26:44.946 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:26:44.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.946+0000 7ff686905640 1 -- 172.21.15.59:0/199459835 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff66c06ae70 msgr2=0x7ff66c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:44.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.946+0000 7ff686905640 1 --2- 172.21.15.59:0/199459835 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff66c06ae70 0x7ff66c06d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff674036000 tx=0x7ff67403c040 comp rx=0 tx=0).stop 2023-10-16T14:26:44.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.946+0000 7ff686905640 1 -- 172.21.15.59:0/199459835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6800c9060 msgr2=0x7ff6800c55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:44.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.946+0000 7ff686905640 1 --2- 172.21.15.59:0/199459835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6800c9060 0x7ff6800c55d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff67000c7f0 tx=0x7ff67000ccb0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.946+0000 7ff686905640 1 -- 172.21.15.59:0/199459835 shutdown_connections 2023-10-16T14:26:44.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.946+0000 7ff686905640 1 --2- 172.21.15.59:0/199459835 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff66c06ae70 0x7ff66c06d330 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.946+0000 7ff686905640 1 --2- 172.21.15.59:0/199459835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff680160ee0 0x7ff6801f5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.946+0000 7ff686905640 1 --2- 172.21.15.59:0/199459835 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6800cb1e0 0x7ff6800c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.946+0000 7ff686905640 1 --2- 172.21.15.59:0/199459835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6800c9060 0x7ff6800c55d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:44.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.946+0000 7ff686905640 1 -- 172.21.15.59:0/199459835 >> 172.21.15.59:0/199459835 conn(0x7ff6800b0030 msgr2=0x7ff6800cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:44.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.946+0000 7ff686905640 1 -- 172.21.15.59:0/199459835 shutdown_connections 2023-10-16T14:26:44.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:44.946+0000 7ff686905640 1 -- 172.21.15.59:0/199459835 wait complete. 2023-10-16T14:26:44.966 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T14:26:45.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.193+0000 7f4aeded0640 1 Processor -- start 2023-10-16T14:26:45.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.194+0000 7f4aeded0640 1 -- start start 2023-10-16T14:26:45.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.195+0000 7f4aeded0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ae80ca820 0x7f4ae8071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:45.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.195+0000 7f4aeded0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4ae80c8ea0 0x7f4ae80c9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:45.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.195+0000 7f4aeded0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae8072480 con 0x7f4ae8159890 2023-10-16T14:26:45.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.195+0000 7f4aeded0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae80cd0c0 con 0x7f4ae80c8ea0 2023-10-16T14:26:45.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.195+0000 7f4aeded0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae80cc540 con 0x7f4ae80ca820 2023-10-16T14:26:45.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.196+0000 7f4adeffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ae80ca820 0x7f4ae8071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:45.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.196+0000 7f4ae7fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4ae80c8ea0 0x7f4ae80c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:45.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.196+0000 7f4ae77fe640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f4ae8159890 0x7f4ae80ca110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.59:50870/0 (socket says 172.21.15.59:50870) 2023-10-16T14:26:45.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.196+0000 7f4ae7fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4ae80c8ea0 0x7f4ae80c9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.59:40984/0 (socket says 172.21.15.59:40984) 2023-10-16T14:26:45.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.196+0000 7f4ae77fe640 1 -- 172.21.15.59:0/1007419494 learned_addr learned my addr 172.21.15.59:0/1007419494 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:45.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.196+0000 7f4adeffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ae80ca820 0x7f4ae8071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.59:39730/0 (socket says 172.21.15.59:39730) 2023-10-16T14:26:45.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.197+0000 7f4adeffd640 1 -- 172.21.15.59:0/1007419494 >> v2:172.21.15.151:3300/0 conn(0x7f4ae80c8ea0 msgr2=0x7f4ae80c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:45.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.197+0000 7f4adeffd640 1 --2- 172.21.15.59:0/1007419494 >> v2:172.21.15.151:3300/0 conn(0x7f4ae80c8ea0 0x7f4ae80c9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.197+0000 7f4adeffd640 1 -- 172.21.15.59:0/1007419494 >> v1:172.21.15.151:6789/0 conn(0x7f4ae8159890 legacy=0x7f4ae80ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:45.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.197+0000 7f4adeffd640 1 -- 172.21.15.59:0/1007419494 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae80cc820 con 0x7f4ae80ca820 2023-10-16T14:26:45.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.198+0000 7f4adeffd640 1 --2- 172.21.15.59:0/1007419494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ae80ca820 0x7f4ae8071f40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00097a0 tx=0x7f4ad002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cbddf2ff81a8032 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:45.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.199+0000 7f4ae6ffd640 1 -- 172.21.15.59:0/1007419494 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0031830 con 0x7f4ae80ca820 2023-10-16T14:26:45.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.199+0000 7f4ae6ffd640 1 -- 172.21.15.59:0/1007419494 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad0031990 con 0x7f4ae80ca820 2023-10-16T14:26:45.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.199+0000 7f4ae6ffd640 1 -- 172.21.15.59:0/1007419494 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0031d20 con 0x7f4ae80ca820 2023-10-16T14:26:45.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.199+0000 7f4aeded0640 1 -- 172.21.15.59:0/1007419494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ae80ca820 msgr2=0x7f4ae8071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:45.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.199+0000 7f4aeded0640 1 --2- 172.21.15.59:0/1007419494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ae80ca820 0x7f4ae8071f40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00097a0 tx=0x7f4ad002b8d0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.200+0000 7f4aeded0640 1 -- 172.21.15.59:0/1007419494 shutdown_connections 2023-10-16T14:26:45.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.200+0000 7f4aeded0640 1 --2- 172.21.15.59:0/1007419494 >> v2:172.21.15.151:3300/0 conn(0x7f4ae80c8ea0 0x7f4ae80c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.200+0000 7f4aeded0640 1 --2- 172.21.15.59:0/1007419494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ae80ca820 0x7f4ae8071f40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.200+0000 7f4aeded0640 1 -- 172.21.15.59:0/1007419494 >> 172.21.15.59:0/1007419494 conn(0x7f4ae80b0030 msgr2=0x7f4ae80b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:45.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.200+0000 7f4aeded0640 1 -- 172.21.15.59:0/1007419494 shutdown_connections 2023-10-16T14:26:45.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.200+0000 7f4aeded0640 1 -- 172.21.15.59:0/1007419494 wait complete. 2023-10-16T14:26:45.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.202+0000 7f4aeded0640 1 Processor -- start 2023-10-16T14:26:45.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.202+0000 7f4aeded0640 1 -- start start 2023-10-16T14:26:45.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.203+0000 7f4aeded0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ae80c8ea0 0x7f4ae80acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:45.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.203+0000 7f4aeded0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ae80ca820 0x7f4ae814ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:45.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.203+0000 7f4aeded0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ae8159890 0x7f4ae814bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:45.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.203+0000 7f4aeded0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae815af50 con 0x7f4ae80ca820 2023-10-16T14:26:45.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.203+0000 7f4aeded0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae80c6b30 con 0x7f4ae80c8ea0 2023-10-16T14:26:45.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.203+0000 7f4aeded0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae815b180 con 0x7f4ae8159890 2023-10-16T14:26:45.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.203+0000 7f4adeffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ae80ca820 0x7f4ae814ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:45.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.203+0000 7f4adeffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ae80ca820 0x7f4ae814ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54880/0 (socket says 172.21.15.59:54880) 2023-10-16T14:26:45.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.203+0000 7f4adeffd640 1 -- 172.21.15.59:0/1751907309 learned_addr learned my addr 172.21.15.59:0/1751907309 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:45.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.203+0000 7f4ae77fe640 1 --2- 172.21.15.59:0/1751907309 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ae80c8ea0 0x7f4ae80acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:45.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.203+0000 7f4ae7fff640 1 --2- 172.21.15.59:0/1751907309 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ae8159890 0x7f4ae814bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:45.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.203+0000 7f4adeffd640 1 -- 172.21.15.59:0/1751907309 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ae8159890 msgr2=0x7f4ae814bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:45.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.203+0000 7f4adeffd640 1 --2- 172.21.15.59:0/1751907309 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ae8159890 0x7f4ae814bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.203+0000 7f4adeffd640 1 -- 172.21.15.59:0/1751907309 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ae80c8ea0 msgr2=0x7f4ae80acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:45.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.203+0000 7f4adeffd640 1 --2- 172.21.15.59:0/1751907309 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ae80c8ea0 0x7f4ae80acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.203+0000 7f4adeffd640 1 -- 172.21.15.59:0/1751907309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad0009400 con 0x7f4ae80ca820 2023-10-16T14:26:45.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.204+0000 7f4adeffd640 1 --2- 172.21.15.59:0/1751907309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ae80ca820 0x7f4ae814ba20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4ad002b910 tx=0x7f4ad00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:45.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.204+0000 7f4ae4ff9640 1 -- 172.21.15.59:0/1751907309 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad003a8f0 con 0x7f4ae80ca820 2023-10-16T14:26:45.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.204+0000 7f4ae4ff9640 1 -- 172.21.15.59:0/1751907309 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad003aa50 con 0x7f4ae80ca820 2023-10-16T14:26:45.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.204+0000 7f4ae4ff9640 1 -- 172.21.15.59:0/1751907309 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad003ae00 con 0x7f4ae80ca820 2023-10-16T14:26:45.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.204+0000 7f4aeded0640 1 -- 172.21.15.59:0/1751907309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae80c6290 con 0x7f4ae80ca820 2023-10-16T14:26:45.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.204+0000 7f4aeded0640 1 -- 172.21.15.59:0/1751907309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae80c6850 con 0x7f4ae80ca820 2023-10-16T14:26:45.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.205+0000 7f4aeded0640 1 -- 172.21.15.59:0/1751907309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae8073ef0 con 0x7f4ae80ca820 2023-10-16T14:26:45.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.206+0000 7f4ae4ff9640 1 -- 172.21.15.59:0/1751907309 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4ad004d450 con 0x7f4ae80ca820 2023-10-16T14:26:45.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.207+0000 7f4ae4ff9640 1 --2- 172.21.15.59:0/1751907309 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4ac806ae70 0x7f4ac806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:45.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.208+0000 7f4ae4ff9640 1 -- 172.21.15.59:0/1751907309 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f4ad00aba30 con 0x7f4ae80ca820 2023-10-16T14:26:45.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.208+0000 7f4ae77fe640 1 --2- 172.21.15.59:0/1751907309 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4ac806ae70 0x7f4ac806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:45.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.209+0000 7f4ae77fe640 1 --2- 172.21.15.59:0/1751907309 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4ac806ae70 0x7f4ac806d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8000f60 tx=0x7f4ad8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:45.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.212+0000 7f4ae4ff9640 1 -- 172.21.15.59:0/1751907309 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ad0076710 con 0x7f4ae80ca820 2023-10-16T14:26:45.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.406+0000 7f4aeded0640 1 -- 172.21.15.59:0/1751907309 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ae8070cd0 con 0x7f4ae80ca820 2023-10-16T14:26:45.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.407+0000 7f4ae4ff9640 1 -- 172.21.15.59:0/1751907309 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4ad00350a0 con 0x7f4ae80ca820 2023-10-16T14:26:45.410 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:45.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.410+0000 7f4aeded0640 1 -- 172.21.15.59:0/1751907309 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4ac806ae70 msgr2=0x7f4ac806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:45.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.410+0000 7f4aeded0640 1 --2- 172.21.15.59:0/1751907309 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4ac806ae70 0x7f4ac806d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8000f60 tx=0x7f4ad8009040 comp rx=0 tx=0).stop 2023-10-16T14:26:45.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.410+0000 7f4aeded0640 1 -- 172.21.15.59:0/1751907309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ae80ca820 msgr2=0x7f4ae814ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:45.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.410+0000 7f4aeded0640 1 --2- 172.21.15.59:0/1751907309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ae80ca820 0x7f4ae814ba20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4ad002b910 tx=0x7f4ad00046c0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.410+0000 7f4aeded0640 1 -- 172.21.15.59:0/1751907309 shutdown_connections 2023-10-16T14:26:45.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.410+0000 7f4aeded0640 1 --2- 172.21.15.59:0/1751907309 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4ac806ae70 0x7f4ac806d330 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.410+0000 7f4aeded0640 1 --2- 172.21.15.59:0/1751907309 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ae8159890 0x7f4ae814bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.410+0000 7f4aeded0640 1 --2- 172.21.15.59:0/1751907309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ae80ca820 0x7f4ae814ba20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.410+0000 7f4aeded0640 1 --2- 172.21.15.59:0/1751907309 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ae80c8ea0 0x7f4ae80acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.410+0000 7f4aeded0640 1 -- 172.21.15.59:0/1751907309 >> 172.21.15.59:0/1751907309 conn(0x7f4ae80b0030 msgr2=0x7f4ae80c9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:45.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.410+0000 7f4aeded0640 1 -- 172.21.15.59:0/1751907309 shutdown_connections 2023-10-16T14:26:45.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.410+0000 7f4aeded0640 1 -- 172.21.15.59:0/1751907309 wait complete. 2023-10-16T14:26:45.431 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T14:26:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.646+0000 7f53211c4640 1 Processor -- start 2023-10-16T14:26:45.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.646+0000 7f53211c4640 1 -- start start 2023-10-16T14:26:45.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.647+0000 7f53211c4640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f531c0cf030 0x7f531c06ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.647+0000 7f53211c4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f531c06d360 0x7f531c0ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.647+0000 7f53211c4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f531c1550f0 con 0x7f531c154d10 2023-10-16T14:26:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.648+0000 7f53211c4640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f531c06db50 con 0x7f531c0cf030 2023-10-16T14:26:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.648+0000 7f53211c4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f531c0b13f0 con 0x7f531c06d360 2023-10-16T14:26:45.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.648+0000 7f53137fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f531c0cf030 0x7f531c06ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.648+0000 7f53137fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f531c0cf030 0x7f531c06ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54884/0 (socket says 172.21.15.59:54884) 2023-10-16T14:26:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.648+0000 7f53137fe640 1 -- 172.21.15.59:0/3465701687 learned_addr learned my addr 172.21.15.59:0/3465701687 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.648+0000 7f53209c3640 1 --2- 172.21.15.59:0/3465701687 >> v2:172.21.15.151:3300/0 conn(0x7f531c06d360 0x7f531c0ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.648+0000 7f53137fe640 1 -- 172.21.15.59:0/3465701687 >> v2:172.21.15.151:3300/0 conn(0x7f531c06d360 msgr2=0x7f531c0ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:45.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.648+0000 7f53137fe640 1 --2- 172.21.15.59:0/3465701687 >> v2:172.21.15.151:3300/0 conn(0x7f531c06d360 0x7f531c0ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.648+0000 7f53137fe640 1 -- 172.21.15.59:0/3465701687 >> v1:172.21.15.151:6789/0 conn(0x7f531c154d10 legacy=0x7f531c0ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:45.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.648+0000 7f53137fe640 1 -- 172.21.15.59:0/3465701687 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c0b16d0 con 0x7f531c0cf030 2023-10-16T14:26:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.649+0000 7f53137fe640 1 --2- 172.21.15.59:0/3465701687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f531c0cf030 0x7f531c06ce20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f531c06c090 tx=0x7f530402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae837fa93c59220c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.650+0000 7f531b7fe640 1 -- 172.21.15.59:0/3465701687 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304031870 con 0x7f531c0cf030 2023-10-16T14:26:45.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.650+0000 7f531b7fe640 1 -- 172.21.15.59:0/3465701687 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53040319d0 con 0x7f531c0cf030 2023-10-16T14:26:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.650+0000 7f531b7fe640 1 -- 172.21.15.59:0/3465701687 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304031d60 con 0x7f531c0cf030 2023-10-16T14:26:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.650+0000 7f53211c4640 1 -- 172.21.15.59:0/3465701687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f531c0cf030 msgr2=0x7f531c06ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.650+0000 7f53211c4640 1 --2- 172.21.15.59:0/3465701687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f531c0cf030 0x7f531c06ce20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f531c06c090 tx=0x7f530402b910 comp rx=0 tx=0).stop 2023-10-16T14:26:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.650+0000 7f53211c4640 1 -- 172.21.15.59:0/3465701687 shutdown_connections 2023-10-16T14:26:45.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.650+0000 7f53211c4640 1 --2- 172.21.15.59:0/3465701687 >> v2:172.21.15.151:3300/0 conn(0x7f531c06d360 0x7f531c0ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.650+0000 7f53211c4640 1 --2- 172.21.15.59:0/3465701687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f531c0cf030 0x7f531c06ce20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.650+0000 7f53211c4640 1 -- 172.21.15.59:0/3465701687 >> 172.21.15.59:0/3465701687 conn(0x7f531c06a200 msgr2=0x7f531c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:45.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.651+0000 7f53211c4640 1 -- 172.21.15.59:0/3465701687 shutdown_connections 2023-10-16T14:26:45.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.651+0000 7f53211c4640 1 -- 172.21.15.59:0/3465701687 wait complete. 2023-10-16T14:26:45.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.652+0000 7f53211c4640 1 Processor -- start 2023-10-16T14:26:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.652+0000 7f53211c4640 1 -- start start 2023-10-16T14:26:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.653+0000 7f53211c4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f531c06d360 0x7f531c1565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.653+0000 7f53211c4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f531c0cf030 0x7f531c1f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.653+0000 7f53211c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f531c154d10 0x7f531c152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:45.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.653+0000 7f53211c4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c159c60 con 0x7f531c0cf030 2023-10-16T14:26:45.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.653+0000 7f53211c4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c159f40 con 0x7f531c154d10 2023-10-16T14:26:45.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.653+0000 7f53211c4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531c15a220 con 0x7f531c06d360 2023-10-16T14:26:45.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.654+0000 7f53137fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f531c0cf030 0x7f531c1f2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:45.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.654+0000 7f53137fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f531c0cf030 0x7f531c1f2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54892/0 (socket says 172.21.15.59:54892) 2023-10-16T14:26:45.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.654+0000 7f53137fe640 1 -- 172.21.15.59:0/3373029452 learned_addr learned my addr 172.21.15.59:0/3373029452 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:45.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.654+0000 7f53137fe640 1 -- 172.21.15.59:0/3373029452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f531c06d360 msgr2=0x7f531c1565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:45.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.654+0000 7f53209c3640 1 --2- 172.21.15.59:0/3373029452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f531c154d10 0x7f531c152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:45.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.654+0000 7f531bfff640 1 --2- 172.21.15.59:0/3373029452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f531c06d360 0x7f531c1565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:45.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.654+0000 7f53137fe640 1 --2- 172.21.15.59:0/3373029452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f531c06d360 0x7f531c1565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.654+0000 7f53137fe640 1 -- 172.21.15.59:0/3373029452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f531c154d10 msgr2=0x7f531c152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:45.661 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.654+0000 7f53137fe640 1 --2- 172.21.15.59:0/3373029452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f531c154d10 0x7f531c152d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.654+0000 7f53137fe640 1 -- 172.21.15.59:0/3373029452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53040094d0 con 0x7f531c0cf030 2023-10-16T14:26:45.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.654+0000 7f531bfff640 1 --2- 172.21.15.59:0/3373029452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f531c06d360 0x7f531c1565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:45.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.654+0000 7f53137fe640 1 --2- 172.21.15.59:0/3373029452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f531c0cf030 0x7f531c1f2ec0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5304000c00 tx=0x7f53040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:45.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.655+0000 7f53197fa640 1 -- 172.21.15.59:0/3373029452 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530403abe0 con 0x7f531c0cf030 2023-10-16T14:26:45.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.655+0000 7f53197fa640 1 -- 172.21.15.59:0/3373029452 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530403ad40 con 0x7f531c0cf030 2023-10-16T14:26:45.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.655+0000 7f53197fa640 1 -- 172.21.15.59:0/3373029452 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304044610 con 0x7f531c0cf030 2023-10-16T14:26:45.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.655+0000 7f53211c4640 1 -- 172.21.15.59:0/3373029452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531c15a500 con 0x7f531c0cf030 2023-10-16T14:26:45.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.655+0000 7f53211c4640 1 -- 172.21.15.59:0/3373029452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531c1f3400 con 0x7f531c0cf030 2023-10-16T14:26:45.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.656+0000 7f53211c4640 1 -- 172.21.15.59:0/3373029452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531c15aa20 con 0x7f531c0cf030 2023-10-16T14:26:45.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.657+0000 7f53197fa640 1 -- 172.21.15.59:0/3373029452 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f530404d450 con 0x7f531c0cf030 2023-10-16T14:26:45.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.658+0000 7f53197fa640 1 --2- 172.21.15.59:0/3373029452 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f52fc06aea0 0x7f52fc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:45.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.658+0000 7f53197fa640 1 -- 172.21.15.59:0/3373029452 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f530402d040 con 0x7f531c0cf030 2023-10-16T14:26:45.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.659+0000 7f531bfff640 1 --2- 172.21.15.59:0/3373029452 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f52fc06aea0 0x7f52fc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:45.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.660+0000 7f531bfff640 1 --2- 172.21.15.59:0/3373029452 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f52fc06aea0 0x7f52fc06d360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f530c004520 tx=0x7f530c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:45.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.662+0000 7f53197fa640 1 -- 172.21.15.59:0/3373029452 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5304076cc0 con 0x7f531c0cf030 2023-10-16T14:26:45.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.863+0000 7f53211c4640 1 -- 172.21.15.59:0/3373029452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f531c04e9b0 con 0x7f531c0cf030 2023-10-16T14:26:45.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.864+0000 7f53197fa640 1 -- 172.21.15.59:0/3373029452 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5304035020 con 0x7f531c0cf030 2023-10-16T14:26:45.867 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-16T14:26:45.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.868+0000 7f53211c4640 1 -- 172.21.15.59:0/3373029452 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f52fc06aea0 msgr2=0x7f52fc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:45.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.868+0000 7f53211c4640 1 --2- 172.21.15.59:0/3373029452 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f52fc06aea0 0x7f52fc06d360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f530c004520 tx=0x7f530c009040 comp rx=0 tx=0).stop 2023-10-16T14:26:45.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.868+0000 7f53211c4640 1 -- 172.21.15.59:0/3373029452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f531c0cf030 msgr2=0x7f531c1f2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:45.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.868+0000 7f53211c4640 1 --2- 172.21.15.59:0/3373029452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f531c0cf030 0x7f531c1f2ec0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5304000c00 tx=0x7f53040046c0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.868+0000 7f53211c4640 1 -- 172.21.15.59:0/3373029452 shutdown_connections 2023-10-16T14:26:45.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.868+0000 7f53211c4640 1 --2- 172.21.15.59:0/3373029452 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f52fc06aea0 0x7f52fc06d360 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.868+0000 7f53211c4640 1 --2- 172.21.15.59:0/3373029452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f531c154d10 0x7f531c152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.868+0000 7f53211c4640 1 --2- 172.21.15.59:0/3373029452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f531c0cf030 0x7f531c1f2ec0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.868+0000 7f53211c4640 1 --2- 172.21.15.59:0/3373029452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f531c06d360 0x7f531c1565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:45.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.868+0000 7f53211c4640 1 -- 172.21.15.59:0/3373029452 >> 172.21.15.59:0/3373029452 conn(0x7f531c06a200 msgr2=0x7f531c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:45.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.868+0000 7f53211c4640 1 -- 172.21.15.59:0/3373029452 shutdown_connections 2023-10-16T14:26:45.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:45.868+0000 7f53211c4640 1 -- 172.21.15.59:0/3373029452 wait complete. 2023-10-16T14:26:45.890 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T14:26:46.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.119+0000 7fd210c60640 1 Processor -- start 2023-10-16T14:26:46.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.120+0000 7fd210c60640 1 -- start start 2023-10-16T14:26:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.121+0000 7fd210c60640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd20c15c940 0x7fd20c0d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.121+0000 7fd210c60640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd20c0b6fe0 0x7fd20c0d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.121+0000 7fd210c60640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20c0ce810 con 0x7fd20c0d0d80 2023-10-16T14:26:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.121+0000 7fd210c60640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20c0d1740 con 0x7fd20c0b6fe0 2023-10-16T14:26:46.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.121+0000 7fd210c60640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c0b5b40 con 0x7fd20c15c940 2023-10-16T14:26:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.121+0000 7fd20bfff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd20c0b6fe0 0x7fd20c0d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.122+0000 7fd20bfff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd20c0b6fe0 0x7fd20c0d1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54898/0 (socket says 172.21.15.59:54898) 2023-10-16T14:26:46.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.122+0000 7fd20bfff640 1 -- 172.21.15.59:0/3316845907 learned_addr learned my addr 172.21.15.59:0/3316845907 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:46.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.122+0000 7fd20b7fe640 1 --2- 172.21.15.59:0/3316845907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd20c15c940 0x7fd20c0d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:46.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.122+0000 7fd20bfff640 1 -- 172.21.15.59:0/3316845907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd20c15c940 msgr2=0x7fd20c0d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:46.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.122+0000 7fd20bfff640 1 --2- 172.21.15.59:0/3316845907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd20c15c940 0x7fd20c0d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:46.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.122+0000 7fd20bfff640 1 -- 172.21.15.59:0/3316845907 >> v1:172.21.15.59:6789/0 conn(0x7fd20c0d0d80 legacy=0x7fd20c160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:46.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.122+0000 7fd20bfff640 1 -- 172.21.15.59:0/3316845907 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c0ce250 con 0x7fd20c0b6fe0 2023-10-16T14:26:46.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.122+0000 7fd20affd640 1 -- 172.21.15.59:0/3316845907 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578166574 0 0) 0x7fd20c0ce810 con 0x7fd20c0d0d80 2023-10-16T14:26:46.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.123+0000 7fd20bfff640 1 --2- 172.21.15.59:0/3316845907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd20c0b6fe0 0x7fd20c0d1200 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd204009e50 tx=0x7fd20402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8536f51b2151fefe server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:46.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.123+0000 7fd20affd640 1 -- 172.21.15.59:0/3316845907 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20402ca70 con 0x7fd20c0b6fe0 2023-10-16T14:26:46.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.124+0000 7fd20affd640 1 -- 172.21.15.59:0/3316845907 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20402cbd0 con 0x7fd20c0b6fe0 2023-10-16T14:26:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.124+0000 7fd20affd640 1 -- 172.21.15.59:0/3316845907 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2040343f0 con 0x7fd20c0b6fe0 2023-10-16T14:26:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.124+0000 7fd210c60640 1 -- 172.21.15.59:0/3316845907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd20c0b6fe0 msgr2=0x7fd20c0d1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.124+0000 7fd210c60640 1 --2- 172.21.15.59:0/3316845907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd20c0b6fe0 0x7fd20c0d1200 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd204009e50 tx=0x7fd20402bed0 comp rx=0 tx=0).stop 2023-10-16T14:26:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.124+0000 7fd210c60640 1 -- 172.21.15.59:0/3316845907 shutdown_connections 2023-10-16T14:26:46.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.124+0000 7fd210c60640 1 --2- 172.21.15.59:0/3316845907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd20c0b6fe0 0x7fd20c0d1200 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:46.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.124+0000 7fd210c60640 1 --2- 172.21.15.59:0/3316845907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd20c15c940 0x7fd20c0d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:46.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.124+0000 7fd210c60640 1 -- 172.21.15.59:0/3316845907 >> 172.21.15.59:0/3316845907 conn(0x7fd20c09bb30 msgr2=0x7fd20c0d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:46.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.124+0000 7fd210c60640 1 -- 172.21.15.59:0/3316845907 shutdown_connections 2023-10-16T14:26:46.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.124+0000 7fd210c60640 1 -- 172.21.15.59:0/3316845907 wait complete. 2023-10-16T14:26:46.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.126+0000 7fd210c60640 1 Processor -- start 2023-10-16T14:26:46.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.126+0000 7fd210c60640 1 -- start start 2023-10-16T14:26:46.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.127+0000 7fd210c60640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd20c0b6fe0 0x7fd20c15f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:46.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.127+0000 7fd210c60640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd20c0d0d80 0x7fd20c158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:46.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.127+0000 7fd210c60640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd20c15c940 0x7fd20c0c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:46.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.127+0000 7fd210c60640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c0c77e0 con 0x7fd20c0d0d80 2023-10-16T14:26:46.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.127+0000 7fd210c60640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c0c7ac0 con 0x7fd20c15c940 2023-10-16T14:26:46.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.127+0000 7fd210c60640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c0c7da0 con 0x7fd20c0b6fe0 2023-10-16T14:26:46.134 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.128+0000 7fd203fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd20c0d0d80 0x7fd20c158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:46.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.128+0000 7fd203fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd20c0d0d80 0x7fd20c158460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54910/0 (socket says 172.21.15.59:54910) 2023-10-16T14:26:46.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.128+0000 7fd203fff640 1 -- 172.21.15.59:0/2005344158 learned_addr learned my addr 172.21.15.59:0/2005344158 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:46.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.128+0000 7fd20bfff640 1 --2- 172.21.15.59:0/2005344158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd20c15c940 0x7fd20c0c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:46.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.128+0000 7fd203fff640 1 -- 172.21.15.59:0/2005344158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd20c0b6fe0 msgr2=0x7fd20c15f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:46.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.128+0000 7fd20b7fe640 1 --2- 172.21.15.59:0/2005344158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd20c0b6fe0 0x7fd20c15f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:46.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.128+0000 7fd203fff640 1 --2- 172.21.15.59:0/2005344158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd20c0b6fe0 0x7fd20c15f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:46.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.128+0000 7fd203fff640 1 -- 172.21.15.59:0/2005344158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd20c15c940 msgr2=0x7fd20c0c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:46.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.128+0000 7fd203fff640 1 --2- 172.21.15.59:0/2005344158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd20c15c940 0x7fd20c0c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:46.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.128+0000 7fd203fff640 1 -- 172.21.15.59:0/2005344158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd204009b30 con 0x7fd20c0d0d80 2023-10-16T14:26:46.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.128+0000 7fd20bfff640 1 --2- 172.21.15.59:0/2005344158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd20c15c940 0x7fd20c0c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:46.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.128+0000 7fd203fff640 1 --2- 172.21.15.59:0/2005344158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd20c0d0d80 0x7fd20c158460 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400c410 tx=0x7fd1f400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:46.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.129+0000 7fd208ff9640 1 -- 172.21.15.59:0/2005344158 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40035f0 con 0x7fd20c0d0d80 2023-10-16T14:26:46.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.129+0000 7fd208ff9640 1 -- 172.21.15.59:0/2005344158 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f4003770 con 0x7fd20c0d0d80 2023-10-16T14:26:46.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.129+0000 7fd208ff9640 1 -- 172.21.15.59:0/2005344158 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4003b20 con 0x7fd20c0d0d80 2023-10-16T14:26:46.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.129+0000 7fd210c60640 1 -- 172.21.15.59:0/2005344158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20c0c61a0 con 0x7fd20c0d0d80 2023-10-16T14:26:46.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.129+0000 7fd210c60640 1 -- 172.21.15.59:0/2005344158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20c15fd50 con 0x7fd20c0d0d80 2023-10-16T14:26:46.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.130+0000 7fd210c60640 1 -- 172.21.15.59:0/2005344158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20c0c6000 con 0x7fd20c0d0d80 2023-10-16T14:26:46.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.131+0000 7fd208ff9640 1 -- 172.21.15.59:0/2005344158 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd1f4003c80 con 0x7fd20c0d0d80 2023-10-16T14:26:46.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.132+0000 7fd208ff9640 1 --2- 172.21.15.59:0/2005344158 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd1ec06ae70 0x7fd1ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:46.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.133+0000 7fd208ff9640 1 -- 172.21.15.59:0/2005344158 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fd1f4088f70 con 0x7fd20c0d0d80 2023-10-16T14:26:46.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.133+0000 7fd20b7fe640 1 --2- 172.21.15.59:0/2005344158 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd1ec06ae70 0x7fd1ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:46.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.134+0000 7fd20b7fe640 1 --2- 172.21.15.59:0/2005344158 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd1ec06ae70 0x7fd1ec06d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc006fd0 tx=0x7fd1fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:46.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.137+0000 7fd208ff9640 1 -- 172.21.15.59:0/2005344158 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd20c0c6000 con 0x7fd20c0d0d80 2023-10-16T14:26:46.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.333+0000 7fd210c60640 1 -- 172.21.15.59:0/2005344158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd20c0c66c0 con 0x7fd20c0d0d80 2023-10-16T14:26:46.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.334+0000 7fd208ff9640 1 -- 172.21.15.59:0/2005344158 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd20c0c66c0 con 0x7fd20c0d0d80 2023-10-16T14:26:46.337 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:46.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.337+0000 7fd210c60640 1 -- 172.21.15.59:0/2005344158 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd1ec06ae70 msgr2=0x7fd1ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:46.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.337+0000 7fd210c60640 1 --2- 172.21.15.59:0/2005344158 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd1ec06ae70 0x7fd1ec06d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc006fd0 tx=0x7fd1fc008040 comp rx=0 tx=0).stop 2023-10-16T14:26:46.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.337+0000 7fd210c60640 1 -- 172.21.15.59:0/2005344158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd20c0d0d80 msgr2=0x7fd20c158460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:46.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.337+0000 7fd210c60640 1 --2- 172.21.15.59:0/2005344158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd20c0d0d80 0x7fd20c158460 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400c410 tx=0x7fd1f400c8d0 comp rx=0 tx=0).stop 2023-10-16T14:26:46.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.337+0000 7fd210c60640 1 -- 172.21.15.59:0/2005344158 shutdown_connections 2023-10-16T14:26:46.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.337+0000 7fd210c60640 1 --2- 172.21.15.59:0/2005344158 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd1ec06ae70 0x7fd1ec06d330 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:46.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.337+0000 7fd210c60640 1 --2- 172.21.15.59:0/2005344158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd20c15c940 0x7fd20c0c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:46.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.337+0000 7fd210c60640 1 --2- 172.21.15.59:0/2005344158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd20c0d0d80 0x7fd20c158460 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:46.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.337+0000 7fd210c60640 1 --2- 172.21.15.59:0/2005344158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd20c0b6fe0 0x7fd20c15f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:46.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.337+0000 7fd210c60640 1 -- 172.21.15.59:0/2005344158 >> 172.21.15.59:0/2005344158 conn(0x7fd20c09bb30 msgr2=0x7fd20c0ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:46.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.337+0000 7fd210c60640 1 -- 172.21.15.59:0/2005344158 shutdown_connections 2023-10-16T14:26:46.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.337+0000 7fd210c60640 1 -- 172.21.15.59:0/2005344158 wait complete. 2023-10-16T14:26:46.369 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T14:26:46.370 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:26:46.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.600+0000 7fa86ffff640 1 Processor -- start 2023-10-16T14:26:46.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.600+0000 7fa86ffff640 1 -- start start 2023-10-16T14:26:46.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.601+0000 7fa86ffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8700af8f0 0x7fa8700cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:46.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.601+0000 7fa86ffff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa8700cf8a0 0x7fa87006b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:46.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.601+0000 7fa86ffff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8700cac90 con 0x7fa8700affa0 2023-10-16T14:26:46.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.601+0000 7fa86ffff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8700cb810 con 0x7fa8700cf8a0 2023-10-16T14:26:46.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.601+0000 7fa86ffff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700caee0 con 0x7fa8700af8f0 2023-10-16T14:26:46.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.602+0000 7fa86e7fc640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa8700cf8a0 0x7fa87006b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:46.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.602+0000 7fa86effd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8700af8f0 0x7fa8700cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:46.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.602+0000 7fa86effd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8700af8f0 0x7fa8700cf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.59:39764/0 (socket says 172.21.15.59:39764) 2023-10-16T14:26:46.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.602+0000 7fa86e7fc640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa8700cf8a0 0x7fa87006b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.59:41028/0 (socket says 172.21.15.59:41028) 2023-10-16T14:26:46.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.602+0000 7fa86effd640 1 -- 172.21.15.59:0/2186973925 learned_addr learned my addr 172.21.15.59:0/2186973925 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:46.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.603+0000 7fa86effd640 1 -- 172.21.15.59:0/2186973925 >> v2:172.21.15.151:3300/0 conn(0x7fa8700cf8a0 msgr2=0x7fa87006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:46.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.603+0000 7fa86effd640 1 --2- 172.21.15.59:0/2186973925 >> v2:172.21.15.151:3300/0 conn(0x7fa8700cf8a0 0x7fa87006b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:46.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.603+0000 7fa86effd640 1 -- 172.21.15.59:0/2186973925 >> v1:172.21.15.151:6789/0 conn(0x7fa8700affa0 legacy=0x7fa87015c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:46.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.603+0000 7fa86effd640 1 -- 172.21.15.59:0/2186973925 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8700cb1c0 con 0x7fa8700af8f0 2023-10-16T14:26:46.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.603+0000 7fa86e7fc640 1 --2- 172.21.15.59:0/2186973925 >> v2:172.21.15.151:3300/0 conn(0x7fa8700cf8a0 0x7fa87006b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:26:46.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.605+0000 7fa86effd640 1 --2- 172.21.15.59:0/2186973925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8700af8f0 0x7fa8700cf360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa860009e50 tx=0x7fa86002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a0a851d6929f5fc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:46.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.605+0000 7fa86dffb640 1 -- 172.21.15.59:0/2186973925 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86002cb00 con 0x7fa8700af8f0 2023-10-16T14:26:46.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.606+0000 7fa86dffb640 1 -- 172.21.15.59:0/2186973925 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86002cc60 con 0x7fa8700af8f0 2023-10-16T14:26:46.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.606+0000 7fa86dffb640 1 -- 172.21.15.59:0/2186973925 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8600343f0 con 0x7fa8700af8f0 2023-10-16T14:26:46.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.606+0000 7fa86ffff640 1 -- 172.21.15.59:0/2186973925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8700af8f0 msgr2=0x7fa8700cf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:46.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.606+0000 7fa86ffff640 1 --2- 172.21.15.59:0/2186973925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8700af8f0 0x7fa8700cf360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa860009e50 tx=0x7fa86002bf60 comp rx=0 tx=0).stop 2023-10-16T14:26:46.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.607+0000 7fa86ffff640 1 -- 172.21.15.59:0/2186973925 shutdown_connections 2023-10-16T14:26:46.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.607+0000 7fa86ffff640 1 --2- 172.21.15.59:0/2186973925 >> v2:172.21.15.151:3300/0 conn(0x7fa8700cf8a0 0x7fa87006b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:46.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.607+0000 7fa86ffff640 1 --2- 172.21.15.59:0/2186973925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8700af8f0 0x7fa8700cf360 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:46.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.607+0000 7fa86ffff640 1 -- 172.21.15.59:0/2186973925 >> 172.21.15.59:0/2186973925 conn(0x7fa8700d0640 msgr2=0x7fa8700d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:46.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.607+0000 7fa86ffff640 1 -- 172.21.15.59:0/2186973925 shutdown_connections 2023-10-16T14:26:46.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.607+0000 7fa86ffff640 1 -- 172.21.15.59:0/2186973925 wait complete. 2023-10-16T14:26:46.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.609+0000 7fa86ffff640 1 Processor -- start 2023-10-16T14:26:46.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.609+0000 7fa86ffff640 1 -- start start 2023-10-16T14:26:46.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.610+0000 7fa86ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8700af8f0 0x7fa8700b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:46.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.610+0000 7fa86ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8700affa0 0x7fa8700ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:46.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.610+0000 7fa86ffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8700cf8a0 0x7fa8700c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:46.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.610+0000 7fa86ffff640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700b5c70 con 0x7fa8700af8f0 2023-10-16T14:26:46.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.610+0000 7fa86ffff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8701523c0 con 0x7fa8700affa0 2023-10-16T14:26:46.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.610+0000 7fa86ffff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8700b4690 con 0x7fa8700cf8a0 2023-10-16T14:26:46.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.611+0000 7fa86effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8700af8f0 0x7fa8700b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:46.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.611+0000 7fa86effd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8700af8f0 0x7fa8700b5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54926/0 (socket says 172.21.15.59:54926) 2023-10-16T14:26:46.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.611+0000 7fa86effd640 1 -- 172.21.15.59:0/1927756566 learned_addr learned my addr 172.21.15.59:0/1927756566 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:46.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.611+0000 7fa86e7fc640 1 --2- 172.21.15.59:0/1927756566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8700affa0 0x7fa8700ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:46.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.611+0000 7fa86f7fe640 1 --2- 172.21.15.59:0/1927756566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8700cf8a0 0x7fa8700c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:46.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.611+0000 7fa86effd640 1 -- 172.21.15.59:0/1927756566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8700cf8a0 msgr2=0x7fa8700c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:46.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.611+0000 7fa86effd640 1 --2- 172.21.15.59:0/1927756566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8700cf8a0 0x7fa8700c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:46.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.611+0000 7fa86effd640 1 -- 172.21.15.59:0/1927756566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8700affa0 msgr2=0x7fa8700ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:46.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.611+0000 7fa86effd640 1 --2- 172.21.15.59:0/1927756566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8700affa0 0x7fa8700ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:46.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.611+0000 7fa86effd640 1 -- 172.21.15.59:0/1927756566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa858009400 con 0x7fa8700af8f0 2023-10-16T14:26:46.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.611+0000 7fa86f7fe640 1 --2- 172.21.15.59:0/1927756566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8700cf8a0 0x7fa8700c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:46.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.612+0000 7fa86effd640 1 --2- 172.21.15.59:0/1927756566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8700af8f0 0x7fa8700b5730 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa860000f80 tx=0x7fa860004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:46.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.612+0000 7fa8677fe640 1 -- 172.21.15.59:0/1927756566 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa860009510 con 0x7fa8700af8f0 2023-10-16T14:26:46.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.612+0000 7fa8677fe640 1 -- 172.21.15.59:0/1927756566 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86003e450 con 0x7fa8700af8f0 2023-10-16T14:26:46.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.612+0000 7fa8677fe640 1 -- 172.21.15.59:0/1927756566 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86003e7e0 con 0x7fa8700af8f0 2023-10-16T14:26:46.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.612+0000 7fa86ffff640 1 -- 172.21.15.59:0/1927756566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa860009b30 con 0x7fa8700af8f0 2023-10-16T14:26:46.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.612+0000 7fa86ffff640 1 -- 172.21.15.59:0/1927756566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8700b4c50 con 0x7fa8700af8f0 2023-10-16T14:26:46.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.613+0000 7fa86ffff640 1 -- 172.21.15.59:0/1927756566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87004e9b0 con 0x7fa8700af8f0 2023-10-16T14:26:46.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.614+0000 7fa8677fe640 1 -- 172.21.15.59:0/1927756566 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa86003e940 con 0x7fa8700af8f0 2023-10-16T14:26:46.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.615+0000 7fa8677fe640 1 --2- 172.21.15.59:0/1927756566 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa85006ae70 0x7fa85006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:46.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.615+0000 7fa8677fe640 1 -- 172.21.15.59:0/1927756566 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fa8600ac9a0 con 0x7fa8700af8f0 2023-10-16T14:26:46.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.616+0000 7fa86e7fc640 1 --2- 172.21.15.59:0/1927756566 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa85006ae70 0x7fa85006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:46.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.617+0000 7fa86e7fc640 1 --2- 172.21.15.59:0/1927756566 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa85006ae70 0x7fa85006d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa8700c4640 tx=0x7fa858008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:46.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.620+0000 7fa8677fe640 1 -- 172.21.15.59:0/1927756566 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa8600777b0 con 0x7fa8700af8f0 2023-10-16T14:26:46.819 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.817+0000 7fa86ffff640 1 -- 172.21.15.59:0/1927756566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8700b64d0 con 0x7fa8700af8f0 2023-10-16T14:26:46.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.821+0000 7fa8677fe640 1 -- 172.21.15.59:0/1927756566 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18445 (secure 0 0 0) 0x7fa860033e80 con 0x7fa8700af8f0 2023-10-16T14:26:46.824 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:46.824 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:26:29.634854+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:26:46.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.824+0000 7fa86ffff640 1 -- 172.21.15.59:0/1927756566 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa85006ae70 msgr2=0x7fa85006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:46.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.824+0000 7fa86ffff640 1 --2- 172.21.15.59:0/1927756566 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa85006ae70 0x7fa85006d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa8700c4640 tx=0x7fa858008040 comp rx=0 tx=0).stop 2023-10-16T14:26:46.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.824+0000 7fa86ffff640 1 -- 172.21.15.59:0/1927756566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8700af8f0 msgr2=0x7fa8700b5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:46.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.824+0000 7fa86ffff640 1 --2- 172.21.15.59:0/1927756566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8700af8f0 0x7fa8700b5730 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa860000f80 tx=0x7fa860004a40 comp rx=0 tx=0).stop 2023-10-16T14:26:46.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.824+0000 7fa86ffff640 1 -- 172.21.15.59:0/1927756566 shutdown_connections 2023-10-16T14:26:46.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.824+0000 7fa86ffff640 1 --2- 172.21.15.59:0/1927756566 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa85006ae70 0x7fa85006d330 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:46.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.824+0000 7fa86ffff640 1 --2- 172.21.15.59:0/1927756566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8700cf8a0 0x7fa8700c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:46.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.824+0000 7fa86ffff640 1 --2- 172.21.15.59:0/1927756566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8700affa0 0x7fa8700ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:46.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.824+0000 7fa86ffff640 1 --2- 172.21.15.59:0/1927756566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8700af8f0 0x7fa8700b5730 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:46.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.824+0000 7fa86ffff640 1 -- 172.21.15.59:0/1927756566 >> 172.21.15.59:0/1927756566 conn(0x7fa8700d0640 msgr2=0x7fa8700b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:46.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.824+0000 7fa86ffff640 1 -- 172.21.15.59:0/1927756566 shutdown_connections 2023-10-16T14:26:46.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:46.824+0000 7fa86ffff640 1 -- 172.21.15.59:0/1927756566 wait complete. 2023-10-16T14:26:46.847 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T14:25:46.371818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T14:25:47.145341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T14:25:50.758038+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T14:26:46.848 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:26:47.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.072+0000 7f8266e6d640 1 Processor -- start 2023-10-16T14:26:47.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.072+0000 7f8266e6d640 1 -- start start 2023-10-16T14:26:47.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.073+0000 7f8266e6d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f82600c8930 0x7f826015e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:47.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.073+0000 7f8266e6d640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82600c8e40 con 0x7f82600cb400 2023-10-16T14:26:47.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.073+0000 7f8266e6d640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82600c9090 con 0x7f8260070400 2023-10-16T14:26:47.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.073+0000 7f8266e6d640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82600c9370 con 0x7f82600c8930 2023-10-16T14:26:47.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.074+0000 7f826566a640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f82600cb400 0x7f826015af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51846/0 (socket says 172.21.15.59:51846) 2023-10-16T14:26:47.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.074+0000 7f826566a640 1 -- 172.21.15.59:0/3908905106 learned_addr learned my addr 172.21.15.59:0/3908905106 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.074+0000 7f826666c640 1 --2- 172.21.15.59:0/3908905106 >> v2:172.21.15.151:3300/0 conn(0x7f82600c8930 0x7f826015e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.074+0000 7f8264e69640 1 -- 172.21.15.59:0/3908905106 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069503589 0 0) 0x7f82600c8e40 con 0x7f82600cb400 2023-10-16T14:26:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.074+0000 7f8264e69640 1 -- 172.21.15.59:0/3908905106 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f824c003520 con 0x7f82600cb400 2023-10-16T14:26:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.075+0000 7f8264e69640 1 -- 172.21.15.59:0/3908905106 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 333754669 0 0) 0x7f824c003520 con 0x7f82600cb400 2023-10-16T14:26:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.075+0000 7f8264e69640 1 -- 172.21.15.59:0/3908905106 >> v2:172.21.15.151:3300/0 conn(0x7f82600c8930 msgr2=0x7f826015e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.075+0000 7f8264e69640 1 --2- 172.21.15.59:0/3908905106 >> v2:172.21.15.151:3300/0 conn(0x7f82600c8930 0x7f826015e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.075+0000 7f8264e69640 1 -- 172.21.15.59:0/3908905106 >> v1:172.21.15.151:6789/0 conn(0x7f8260070400 legacy=0x7f82600cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.075+0000 7f8264e69640 1 -- 172.21.15.59:0/3908905106 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82600c9650 con 0x7f82600cb400 2023-10-16T14:26:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.075+0000 7f8264e69640 1 -- 172.21.15.59:0/3908905106 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f8250001670 con 0x7f82600cb400 2023-10-16T14:26:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.075+0000 7f8264e69640 1 -- 172.21.15.59:0/3908905106 >> v1:172.21.15.59:6789/0 conn(0x7f82600cb400 legacy=0x7f826015af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.075+0000 7f8264e69640 1 --2- 172.21.15.59:0/3908905106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f824c0039c0 0x7f824c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.075+0000 7f8264e69640 1 --2- 172.21.15.59:0/3908905106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f824c0047c0 0x7f824c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.075+0000 7f8264e69640 1 --2- 172.21.15.59:0/3908905106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f824c005180 0x7f824c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.075+0000 7f8264e69640 1 -- 172.21.15.59:0/3908905106 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82600c9370 con 0x7f824c005180 2023-10-16T14:26:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.075+0000 7f8264e69640 1 -- 172.21.15.59:0/3908905106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c00c080 con 0x7f824c0047c0 2023-10-16T14:26:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.075+0000 7f8264e69640 1 -- 172.21.15.59:0/3908905106 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824c00c240 con 0x7f824c0039c0 2023-10-16T14:26:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.075+0000 7f826666c640 1 --2- 172.21.15.59:0/3908905106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f824c005180 0x7f824c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.075+0000 7f8265e6b640 1 --2- 172.21.15.59:0/3908905106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f824c0039c0 0x7f824c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.075+0000 7f826566a640 1 --2- 172.21.15.59:0/3908905106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f824c0047c0 0x7f824c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.076+0000 7f826666c640 1 -- 172.21.15.59:0/3908905106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f824c0039c0 msgr2=0x7f824c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.076+0000 7f826666c640 1 --2- 172.21.15.59:0/3908905106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f824c0039c0 0x7f824c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.076+0000 7f826666c640 1 -- 172.21.15.59:0/3908905106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f824c0047c0 msgr2=0x7f824c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.076+0000 7f826666c640 1 --2- 172.21.15.59:0/3908905106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f824c0047c0 0x7f824c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.076+0000 7f826666c640 1 -- 172.21.15.59:0/3908905106 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c003520 con 0x7f824c005180 2023-10-16T14:26:47.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.077+0000 7f826666c640 1 -- 172.21.15.59:0/3908905106 reap_dead start 2023-10-16T14:26:47.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.077+0000 7f826666c640 1 --2- 172.21.15.59:0/3908905106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f824c005180 0x7f824c00b980 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8258009f90 tx=0x7f824c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492c1674b63d6cd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:47.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.077+0000 7f8264e69640 1 -- 172.21.15.59:0/3908905106 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825802cc20 con 0x7f824c005180 2023-10-16T14:26:47.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.077+0000 7f8264e69640 1 -- 172.21.15.59:0/3908905106 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825800f040 con 0x7f824c005180 2023-10-16T14:26:47.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.077+0000 7f8264e69640 1 -- 172.21.15.59:0/3908905106 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258034440 con 0x7f824c005180 2023-10-16T14:26:47.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.078+0000 7f8266e6d640 1 -- 172.21.15.59:0/3908905106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f824c005180 msgr2=0x7f824c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:47.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.078+0000 7f8266e6d640 1 --2- 172.21.15.59:0/3908905106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f824c005180 0x7f824c00b980 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8258009f90 tx=0x7f824c0057f0 comp rx=0 tx=0).stop 2023-10-16T14:26:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.078+0000 7f8266e6d640 1 -- 172.21.15.59:0/3908905106 shutdown_connections 2023-10-16T14:26:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.078+0000 7f8266e6d640 1 --2- 172.21.15.59:0/3908905106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f824c005180 0x7f824c00b980 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.078+0000 7f8266e6d640 1 -- 172.21.15.59:0/3908905106 >> 172.21.15.59:0/3908905106 conn(0x7f826006a470 msgr2=0x7f82600afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.078+0000 7f8266e6d640 1 -- 172.21.15.59:0/3908905106 shutdown_connections 2023-10-16T14:26:47.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.078+0000 7f8266e6d640 1 -- 172.21.15.59:0/3908905106 wait complete. 2023-10-16T14:26:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.080+0000 7f8266e6d640 1 Processor -- start 2023-10-16T14:26:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.080+0000 7f8266e6d640 1 -- start start 2023-10-16T14:26:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.081+0000 7f8266e6d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f824c005180 0x7f82600b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.081+0000 7f8266e6d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82600c53b0 0x7f8260159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:47.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.081+0000 7f8266e6d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8260150290 0x7f82601506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.081+0000 7f8266e6d640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82600c6bc0 con 0x7f8260150290 2023-10-16T14:26:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.081+0000 7f8266e6d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82600c6730 con 0x7f824c005180 2023-10-16T14:26:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.081+0000 7f8266e6d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82600c5b20 con 0x7f82600c53b0 2023-10-16T14:26:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.082+0000 7f826666c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8260150290 0x7f82601506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:47.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.082+0000 7f826666c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8260150290 0x7f82601506f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54950/0 (socket says 172.21.15.59:54950) 2023-10-16T14:26:47.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.082+0000 7f826666c640 1 -- 172.21.15.59:0/56949594 learned_addr learned my addr 172.21.15.59:0/56949594 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:47.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.082+0000 7f826566a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82600c53b0 0x7f8260159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:47.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.082+0000 7f8265e6b640 1 --2- 172.21.15.59:0/56949594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f824c005180 0x7f82600b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:47.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.082+0000 7f826666c640 1 -- 172.21.15.59:0/56949594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82600c53b0 msgr2=0x7f8260159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:47.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.082+0000 7f826666c640 1 --2- 172.21.15.59:0/56949594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82600c53b0 0x7f8260159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.082+0000 7f826666c640 1 -- 172.21.15.59:0/56949594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f824c005180 msgr2=0x7f82600b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.082+0000 7f826666c640 1 --2- 172.21.15.59:0/56949594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f824c005180 0x7f82600b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.082+0000 7f826666c640 1 -- 172.21.15.59:0/56949594 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82600c5e00 con 0x7f8260150290 2023-10-16T14:26:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.083+0000 7f826666c640 1 --2- 172.21.15.59:0/56949594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8260150290 0x7f82601506f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f825800e230 tx=0x7f8258009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.083+0000 7f82567fc640 1 -- 172.21.15.59:0/56949594 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825802cea0 con 0x7f8260150290 2023-10-16T14:26:47.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.083+0000 7f82567fc640 1 -- 172.21.15.59:0/56949594 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825803d400 con 0x7f8260150290 2023-10-16T14:26:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.083+0000 7f82567fc640 1 -- 172.21.15.59:0/56949594 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825803d7b0 con 0x7f8260150290 2023-10-16T14:26:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.083+0000 7f8266e6d640 1 -- 172.21.15.59:0/56949594 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82600c60e0 con 0x7f8260150290 2023-10-16T14:26:47.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.083+0000 7f8266e6d640 1 -- 172.21.15.59:0/56949594 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82600c5810 con 0x7f8260150290 2023-10-16T14:26:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.085+0000 7f8266e6d640 1 -- 172.21.15.59:0/56949594 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82600c68e0 con 0x7f8260150290 2023-10-16T14:26:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.085+0000 7f82567fc640 1 -- 172.21.15.59:0/56949594 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f825803b040 con 0x7f8260150290 2023-10-16T14:26:47.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.086+0000 7f82567fc640 1 --2- 172.21.15.59:0/56949594 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f824406aea0 0x7f824406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:47.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.086+0000 7f82567fc640 1 -- 172.21.15.59:0/56949594 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f82580aad50 con 0x7f8260150290 2023-10-16T14:26:47.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.087+0000 7f8265e6b640 1 --2- 172.21.15.59:0/56949594 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f824406aea0 0x7f824406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:47.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.088+0000 7f8265e6b640 1 --2- 172.21.15.59:0/56949594 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f824406aea0 0x7f824406d360 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f825c005410 tx=0x7f825c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:47.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.091+0000 7f82567fc640 1 -- 172.21.15.59:0/56949594 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f82600c68e0 con 0x7f8260150290 2023-10-16T14:26:47.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.282+0000 7f8266e6d640 1 -- 172.21.15.59:0/56949594 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82600c68a0 con 0x7f8260150290 2023-10-16T14:26:47.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.282+0000 7f82567fc640 1 -- 172.21.15.59:0/56949594 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8258039020 con 0x7f8260150290 2023-10-16T14:26:47.285 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:26:47.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.285+0000 7f8266e6d640 1 -- 172.21.15.59:0/56949594 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f824406aea0 msgr2=0x7f824406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:47.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.285+0000 7f8266e6d640 1 --2- 172.21.15.59:0/56949594 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f824406aea0 0x7f824406d360 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f825c005410 tx=0x7f825c009040 comp rx=0 tx=0).stop 2023-10-16T14:26:47.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.285+0000 7f8266e6d640 1 -- 172.21.15.59:0/56949594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8260150290 msgr2=0x7f82601506f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:47.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.285+0000 7f8266e6d640 1 --2- 172.21.15.59:0/56949594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8260150290 0x7f82601506f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f825800e230 tx=0x7f8258009750 comp rx=0 tx=0).stop 2023-10-16T14:26:47.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.285+0000 7f8266e6d640 1 -- 172.21.15.59:0/56949594 shutdown_connections 2023-10-16T14:26:47.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.285+0000 7f8266e6d640 1 --2- 172.21.15.59:0/56949594 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f824406aea0 0x7f824406d360 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:47.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.285+0000 7f8266e6d640 1 --2- 172.21.15.59:0/56949594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8260150290 0x7f82601506f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:47.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.285+0000 7f8266e6d640 1 --2- 172.21.15.59:0/56949594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82600c53b0 0x7f8260159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:47.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.285+0000 7f8266e6d640 1 --2- 172.21.15.59:0/56949594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f824c005180 0x7f82600b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:47.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.285+0000 7f8266e6d640 1 -- 172.21.15.59:0/56949594 >> 172.21.15.59:0/56949594 conn(0x7f826006a470 msgr2=0x7f82600afe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:47.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.285+0000 7f8266e6d640 1 -- 172.21.15.59:0/56949594 shutdown_connections 2023-10-16T14:26:47.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.285+0000 7f8266e6d640 1 -- 172.21.15.59:0/56949594 wait complete. 2023-10-16T14:26:47.306 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T14:26:47.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.531+0000 7f7ab5db8640 1 Processor -- start 2023-10-16T14:26:47.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.531+0000 7f7ab5db8640 1 -- start start 2023-10-16T14:26:47.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.532+0000 7f7ab5db8640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7ab0154d10 0x7f7ab00ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:47.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.532+0000 7f7ab5db8640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab01550f0 con 0x7f7ab00cee60 2023-10-16T14:26:47.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.532+0000 7f7ab5db8640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab006db50 con 0x7f7ab006d530 2023-10-16T14:26:47.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.532+0000 7f7ab5db8640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab00cf310 con 0x7f7ab0154d10 2023-10-16T14:26:47.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.533+0000 7f7ab4db6640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7ab0154d10 0x7f7ab00ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:47.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.533+0000 7f7ab4db6640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7ab0154d10 0x7f7ab00ce920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54958/0 (socket says 172.21.15.59:54958) 2023-10-16T14:26:47.536 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.533+0000 7f7ab4db6640 1 -- 172.21.15.59:0/4035562578 learned_addr learned my addr 172.21.15.59:0/4035562578 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:47.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.533+0000 7f7ab4db6640 1 -- 172.21.15.59:0/4035562578 >> v1:172.21.15.151:6789/0 conn(0x7f7ab006d530 legacy=0x7f7ab00ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:47.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.533+0000 7f7ab4db6640 1 -- 172.21.15.59:0/4035562578 >> v1:172.21.15.59:6789/0 conn(0x7f7ab00cee60 legacy=0x7f7ab006ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:47.537 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.533+0000 7f7ab4db6640 1 -- 172.21.15.59:0/4035562578 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab00b13f0 con 0x7f7ab0154d10 2023-10-16T14:26:47.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.533+0000 7f7aaf7fe640 1 -- 172.21.15.59:0/4035562578 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330728561 0 0) 0x7f7ab01550f0 con 0x7f7ab00cee60 2023-10-16T14:26:47.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.534+0000 7f7ab4db6640 1 --2- 172.21.15.59:0/4035562578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ab0154d10 0x7f7ab00ce920 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009870 tx=0x7f7aa002b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4fde9de401e366 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:47.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.535+0000 7f7aaf7fe640 1 -- 172.21.15.59:0/4035562578 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0030850 con 0x7f7ab0154d10 2023-10-16T14:26:47.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.535+0000 7f7aaf7fe640 1 -- 172.21.15.59:0/4035562578 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa00309b0 con 0x7f7ab0154d10 2023-10-16T14:26:47.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.535+0000 7f7aaf7fe640 1 -- 172.21.15.59:0/4035562578 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0030d40 con 0x7f7ab0154d10 2023-10-16T14:26:47.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.535+0000 7f7ab5db8640 1 -- 172.21.15.59:0/4035562578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ab0154d10 msgr2=0x7f7ab00ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.535+0000 7f7ab5db8640 1 --2- 172.21.15.59:0/4035562578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ab0154d10 0x7f7ab00ce920 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009870 tx=0x7f7aa002b990 comp rx=0 tx=0).stop 2023-10-16T14:26:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.535+0000 7f7ab5db8640 1 -- 172.21.15.59:0/4035562578 shutdown_connections 2023-10-16T14:26:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.535+0000 7f7ab5db8640 1 --2- 172.21.15.59:0/4035562578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ab0154d10 0x7f7ab00ce920 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.535+0000 7f7ab5db8640 1 -- 172.21.15.59:0/4035562578 >> 172.21.15.59:0/4035562578 conn(0x7f7ab006a200 msgr2=0x7f7ab006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:47.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.536+0000 7f7ab5db8640 1 -- 172.21.15.59:0/4035562578 shutdown_connections 2023-10-16T14:26:47.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.536+0000 7f7ab5db8640 1 -- 172.21.15.59:0/4035562578 wait complete. 2023-10-16T14:26:47.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.537+0000 7f7ab5db8640 1 Processor -- start 2023-10-16T14:26:47.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.537+0000 7f7ab5db8640 1 -- start start 2023-10-16T14:26:47.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.538+0000 7f7ab5db8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ab006d530 0x7f7ab015e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:47.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.538+0000 7f7ab5db8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ab00cee60 0x7f7ab01f1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:47.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.538+0000 7f7ab5db8640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ab0154d10 0x7f7ab00c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:47.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.538+0000 7f7ab5db8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab0158a80 con 0x7f7ab006d530 2023-10-16T14:26:47.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.538+0000 7f7ab5db8640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab00720d0 con 0x7f7ab00cee60 2023-10-16T14:26:47.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.538+0000 7f7ab5db8640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab00c7c30 con 0x7f7ab0154d10 2023-10-16T14:26:47.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.539+0000 7f7ab4db6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ab006d530 0x7f7ab015e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:47.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.539+0000 7f7ab4db6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ab006d530 0x7f7ab015e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54964/0 (socket says 172.21.15.59:54964) 2023-10-16T14:26:47.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.539+0000 7f7ab4db6640 1 -- 172.21.15.59:0/3647869614 learned_addr learned my addr 172.21.15.59:0/3647869614 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:47.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.539+0000 7f7aaffff640 1 --2- 172.21.15.59:0/3647869614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ab00cee60 0x7f7ab01f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:47.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.539+0000 7f7ab55b7640 1 --2- 172.21.15.59:0/3647869614 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ab0154d10 0x7f7ab00c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:47.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.539+0000 7f7ab4db6640 1 -- 172.21.15.59:0/3647869614 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ab0154d10 msgr2=0x7f7ab00c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:47.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.539+0000 7f7ab4db6640 1 --2- 172.21.15.59:0/3647869614 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ab0154d10 0x7f7ab00c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:47.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.539+0000 7f7ab4db6640 1 -- 172.21.15.59:0/3647869614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ab00cee60 msgr2=0x7f7ab01f1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:47.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.539+0000 7f7ab4db6640 1 --2- 172.21.15.59:0/3647869614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ab00cee60 0x7f7ab01f1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:47.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.539+0000 7f7ab4db6640 1 -- 172.21.15.59:0/3647869614 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa00094d0 con 0x7f7ab006d530 2023-10-16T14:26:47.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.539+0000 7f7ab55b7640 1 --2- 172.21.15.59:0/3647869614 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ab0154d10 0x7f7ab00c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:47.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.540+0000 7f7ab4db6640 1 --2- 172.21.15.59:0/3647869614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ab006d530 0x7f7ab015e680 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0000c00 tx=0x7f7aa0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:47.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.540+0000 7f7aad7fa640 1 -- 172.21.15.59:0/3647869614 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0039b60 con 0x7f7ab006d530 2023-10-16T14:26:47.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.540+0000 7f7aad7fa640 1 -- 172.21.15.59:0/3647869614 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa0039cc0 con 0x7f7ab006d530 2023-10-16T14:26:47.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.540+0000 7f7aad7fa640 1 -- 172.21.15.59:0/3647869614 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0043650 con 0x7f7ab006d530 2023-10-16T14:26:47.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.540+0000 7f7ab5db8640 1 -- 172.21.15.59:0/3647869614 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab00c7f10 con 0x7f7ab006d530 2023-10-16T14:26:47.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.540+0000 7f7ab5db8640 1 -- 172.21.15.59:0/3647869614 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab015ebc0 con 0x7f7ab006d530 2023-10-16T14:26:47.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.541+0000 7f7ab5db8640 1 -- 172.21.15.59:0/3647869614 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab00c8430 con 0x7f7ab006d530 2023-10-16T14:26:47.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.542+0000 7f7aad7fa640 1 -- 172.21.15.59:0/3647869614 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7aa002e070 con 0x7f7ab006d530 2023-10-16T14:26:47.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.543+0000 7f7aad7fa640 1 --2- 172.21.15.59:0/3647869614 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7a9006ae70 0x7f7a9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:47.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.543+0000 7f7aad7fa640 1 -- 172.21.15.59:0/3647869614 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f7aa00aba60 con 0x7f7ab006d530 2023-10-16T14:26:47.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.544+0000 7f7aaffff640 1 --2- 172.21.15.59:0/3647869614 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7a9006ae70 0x7f7a9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:47.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.545+0000 7f7aaffff640 1 --2- 172.21.15.59:0/3647869614 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7a9006ae70 0x7f7a9006d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7a98000f60 tx=0x7f7a98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:47.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.547+0000 7f7aad7fa640 1 -- 172.21.15.59:0/3647869614 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7ab00c8430 con 0x7f7ab006d530 2023-10-16T14:26:47.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.743+0000 7f7ab5db8640 1 -- 172.21.15.59:0/3647869614 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ab00c8430 con 0x7f7ab006d530 2023-10-16T14:26:47.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.744+0000 7f7aad7fa640 1 -- 172.21.15.59:0/3647869614 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ab00c8430 con 0x7f7ab006d530 2023-10-16T14:26:47.747 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:47.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.746+0000 7f7ab5db8640 1 -- 172.21.15.59:0/3647869614 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7a9006ae70 msgr2=0x7f7a9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:47.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.746+0000 7f7ab5db8640 1 --2- 172.21.15.59:0/3647869614 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7a9006ae70 0x7f7a9006d330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7a98000f60 tx=0x7f7a98009040 comp rx=0 tx=0).stop 2023-10-16T14:26:47.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.747+0000 7f7ab5db8640 1 -- 172.21.15.59:0/3647869614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ab006d530 msgr2=0x7f7ab015e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:47.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.747+0000 7f7ab5db8640 1 --2- 172.21.15.59:0/3647869614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ab006d530 0x7f7ab015e680 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0000c00 tx=0x7f7aa0004730 comp rx=0 tx=0).stop 2023-10-16T14:26:47.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.747+0000 7f7ab5db8640 1 -- 172.21.15.59:0/3647869614 shutdown_connections 2023-10-16T14:26:47.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.747+0000 7f7ab5db8640 1 --2- 172.21.15.59:0/3647869614 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7a9006ae70 0x7f7a9006d330 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:47.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.747+0000 7f7ab5db8640 1 --2- 172.21.15.59:0/3647869614 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ab0154d10 0x7f7ab00c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.747+0000 7f7ab5db8640 1 --2- 172.21.15.59:0/3647869614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ab00cee60 0x7f7ab01f1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.747+0000 7f7ab5db8640 1 --2- 172.21.15.59:0/3647869614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ab006d530 0x7f7ab015e680 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.747+0000 7f7ab5db8640 1 -- 172.21.15.59:0/3647869614 >> 172.21.15.59:0/3647869614 conn(0x7f7ab006a200 msgr2=0x7f7ab00cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.747+0000 7f7ab5db8640 1 -- 172.21.15.59:0/3647869614 shutdown_connections 2023-10-16T14:26:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.747+0000 7f7ab5db8640 1 -- 172.21.15.59:0/3647869614 wait complete. 2023-10-16T14:26:47.769 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T14:26:47.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.997+0000 7fa028f0a640 1 Processor -- start 2023-10-16T14:26:48.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.997+0000 7fa028f0a640 1 -- start start 2023-10-16T14:26:48.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.998+0000 7fa028f0a640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa02415c940 0x7fa0240d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:48.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.998+0000 7fa028f0a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa0240d0d80 0x7fa0240d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:48.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.999+0000 7fa028f0a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0240ce810 con 0x7fa024160520 2023-10-16T14:26:48.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.999+0000 7fa028f0a640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0240d1740 con 0x7fa02415c940 2023-10-16T14:26:48.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.999+0000 7fa028f0a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0240b5b40 con 0x7fa0240d0d80 2023-10-16T14:26:48.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.999+0000 7fa0237fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa02415c940 0x7fa0240d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:48.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.999+0000 7fa0237fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa02415c940 0x7fa0240d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54978/0 (socket says 172.21.15.59:54978) 2023-10-16T14:26:48.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.999+0000 7fa0237fe640 1 -- 172.21.15.59:0/322883647 learned_addr learned my addr 172.21.15.59:0/322883647 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:48.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:47.999+0000 7fa022ffd640 1 --2- 172.21.15.59:0/322883647 >> v2:172.21.15.151:3300/0 conn(0x7fa0240d0d80 0x7fa0240d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:48.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.000+0000 7fa0237fe640 1 -- 172.21.15.59:0/322883647 >> v2:172.21.15.151:3300/0 conn(0x7fa0240d0d80 msgr2=0x7fa0240d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:48.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.000+0000 7fa0237fe640 1 --2- 172.21.15.59:0/322883647 >> v2:172.21.15.151:3300/0 conn(0x7fa0240d0d80 0x7fa0240d1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.000+0000 7fa0237fe640 1 -- 172.21.15.59:0/322883647 >> v1:172.21.15.151:6789/0 conn(0x7fa024160520 legacy=0x7fa024160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:48.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.000+0000 7fa0237fe640 1 -- 172.21.15.59:0/322883647 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0240ce250 con 0x7fa02415c940 2023-10-16T14:26:48.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.001+0000 7fa0237fe640 1 --2- 172.21.15.59:0/322883647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa02415c940 0x7fa0240d0400 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa0240b88e0 tx=0x7fa01402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af06eba2a2970532 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:48.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.001+0000 7fa0227fc640 1 -- 172.21.15.59:0/322883647 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01402c9f0 con 0x7fa02415c940 2023-10-16T14:26:48.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.001+0000 7fa0227fc640 1 -- 172.21.15.59:0/322883647 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01402cb50 con 0x7fa02415c940 2023-10-16T14:26:48.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.001+0000 7fa0227fc640 1 -- 172.21.15.59:0/322883647 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0140343f0 con 0x7fa02415c940 2023-10-16T14:26:48.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.002+0000 7fa028f0a640 1 -- 172.21.15.59:0/322883647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa02415c940 msgr2=0x7fa0240d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:48.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.002+0000 7fa028f0a640 1 --2- 172.21.15.59:0/322883647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa02415c940 0x7fa0240d0400 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa0240b88e0 tx=0x7fa01402be50 comp rx=0 tx=0).stop 2023-10-16T14:26:48.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.002+0000 7fa028f0a640 1 -- 172.21.15.59:0/322883647 shutdown_connections 2023-10-16T14:26:48.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.002+0000 7fa028f0a640 1 --2- 172.21.15.59:0/322883647 >> v2:172.21.15.151:3300/0 conn(0x7fa0240d0d80 0x7fa0240d1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.002+0000 7fa028f0a640 1 --2- 172.21.15.59:0/322883647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa02415c940 0x7fa0240d0400 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.002+0000 7fa028f0a640 1 -- 172.21.15.59:0/322883647 >> 172.21.15.59:0/322883647 conn(0x7fa02409bb30 msgr2=0x7fa0240d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:48.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.002+0000 7fa028f0a640 1 -- 172.21.15.59:0/322883647 shutdown_connections 2023-10-16T14:26:48.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.002+0000 7fa028f0a640 1 -- 172.21.15.59:0/322883647 wait complete. 2023-10-16T14:26:48.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.004+0000 7fa028f0a640 1 Processor -- start 2023-10-16T14:26:48.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.004+0000 7fa028f0a640 1 -- start start 2023-10-16T14:26:48.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.005+0000 7fa028f0a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0240d0d80 0x7fa024151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:48.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.005+0000 7fa028f0a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa02415c940 0x7fa024153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:48.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.005+0000 7fa028f0a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa024160520 0x7fa0240cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:48.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.005+0000 7fa028f0a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02415f7e0 con 0x7fa0240d0d80 2023-10-16T14:26:48.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.005+0000 7fa028f0a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0241520f0 con 0x7fa02415c940 2023-10-16T14:26:48.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.005+0000 7fa028f0a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02415ebd0 con 0x7fa024160520 2023-10-16T14:26:48.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.005+0000 7fa0237fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0240d0d80 0x7fa024151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:48.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.005+0000 7fa0237fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0240d0d80 0x7fa024151bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54980/0 (socket says 172.21.15.59:54980) 2023-10-16T14:26:48.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.005+0000 7fa0237fe640 1 -- 172.21.15.59:0/2936333962 learned_addr learned my addr 172.21.15.59:0/2936333962 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:48.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.006+0000 7fa0237fe640 1 -- 172.21.15.59:0/2936333962 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa024160520 msgr2=0x7fa0240cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:48.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.006+0000 7fa0237fe640 1 --2- 172.21.15.59:0/2936333962 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa024160520 0x7fa0240cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.006+0000 7fa0237fe640 1 -- 172.21.15.59:0/2936333962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa02415c940 msgr2=0x7fa024153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:48.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.006+0000 7fa0237fe640 1 --2- 172.21.15.59:0/2936333962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa02415c940 0x7fa024153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.006+0000 7fa0237fe640 1 -- 172.21.15.59:0/2936333962 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa014009b30 con 0x7fa0240d0d80 2023-10-16T14:26:48.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.006+0000 7fa0237fe640 1 --2- 172.21.15.59:0/2936333962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0240d0d80 0x7fa024151bb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa014000f80 tx=0x7fa014004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:48.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.006+0000 7fa01bfff640 1 -- 172.21.15.59:0/2936333962 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa014009510 con 0x7fa0240d0d80 2023-10-16T14:26:48.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.006+0000 7fa01bfff640 1 -- 172.21.15.59:0/2936333962 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01403e450 con 0x7fa0240d0d80 2023-10-16T14:26:48.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.006+0000 7fa01bfff640 1 -- 172.21.15.59:0/2936333962 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01403e800 con 0x7fa0240d0d80 2023-10-16T14:26:48.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.006+0000 7fa028f0a640 1 -- 172.21.15.59:0/2936333962 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa02415eeb0 con 0x7fa0240d0d80 2023-10-16T14:26:48.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.007+0000 7fa028f0a640 1 -- 172.21.15.59:0/2936333962 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa02415f470 con 0x7fa0240d0d80 2023-10-16T14:26:48.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.008+0000 7fa028f0a640 1 -- 172.21.15.59:0/2936333962 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa02404e9b0 con 0x7fa0240d0d80 2023-10-16T14:26:48.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.009+0000 7fa01bfff640 1 -- 172.21.15.59:0/2936333962 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa01403e960 con 0x7fa0240d0d80 2023-10-16T14:26:48.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.010+0000 7fa01bfff640 1 --2- 172.21.15.59:0/2936333962 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa00406aea0 0x7fa00406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:48.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.010+0000 7fa01bfff640 1 -- 172.21.15.59:0/2936333962 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fa0140ac720 con 0x7fa0240d0d80 2023-10-16T14:26:48.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.011+0000 7fa022ffd640 1 --2- 172.21.15.59:0/2936333962 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa00406aea0 0x7fa00406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:48.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.012+0000 7fa022ffd640 1 --2- 172.21.15.59:0/2936333962 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa00406aea0 0x7fa00406d360 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa00c006fd0 tx=0x7fa00c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:48.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.015+0000 7fa01bfff640 1 -- 172.21.15.59:0/2936333962 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa0140774a0 con 0x7fa0240d0d80 2023-10-16T14:26:48.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.207+0000 7fa028f0a640 1 -- 172.21.15.59:0/2936333962 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa0240a04e0 con 0x7fa0240d0d80 2023-10-16T14:26:48.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.208+0000 7fa01bfff640 1 -- 172.21.15.59:0/2936333962 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa01407aac0 con 0x7fa0240d0d80 2023-10-16T14:26:48.211 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-16T14:26:48.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.210+0000 7fa028f0a640 1 -- 172.21.15.59:0/2936333962 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa00406aea0 msgr2=0x7fa00406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:48.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.211+0000 7fa028f0a640 1 --2- 172.21.15.59:0/2936333962 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa00406aea0 0x7fa00406d360 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa00c006fd0 tx=0x7fa00c008040 comp rx=0 tx=0).stop 2023-10-16T14:26:48.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.211+0000 7fa028f0a640 1 -- 172.21.15.59:0/2936333962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0240d0d80 msgr2=0x7fa024151bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:48.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.211+0000 7fa028f0a640 1 --2- 172.21.15.59:0/2936333962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0240d0d80 0x7fa024151bb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa014000f80 tx=0x7fa014004a40 comp rx=0 tx=0).stop 2023-10-16T14:26:48.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.211+0000 7fa028f0a640 1 -- 172.21.15.59:0/2936333962 shutdown_connections 2023-10-16T14:26:48.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.211+0000 7fa028f0a640 1 --2- 172.21.15.59:0/2936333962 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa00406aea0 0x7fa00406d360 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.211+0000 7fa028f0a640 1 --2- 172.21.15.59:0/2936333962 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa024160520 0x7fa0240cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.211+0000 7fa028f0a640 1 --2- 172.21.15.59:0/2936333962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa02415c940 0x7fa024153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.211+0000 7fa028f0a640 1 --2- 172.21.15.59:0/2936333962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0240d0d80 0x7fa024151bb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.211+0000 7fa028f0a640 1 -- 172.21.15.59:0/2936333962 >> 172.21.15.59:0/2936333962 conn(0x7fa02409bb30 msgr2=0x7fa0240b8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:48.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.211+0000 7fa028f0a640 1 -- 172.21.15.59:0/2936333962 shutdown_connections 2023-10-16T14:26:48.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.211+0000 7fa028f0a640 1 -- 172.21.15.59:0/2936333962 wait complete. 2023-10-16T14:26:48.231 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T14:26:48.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.455+0000 7f6c708ad640 1 Processor -- start 2023-10-16T14:26:48.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.456+0000 7f6c708ad640 1 -- start start 2023-10-16T14:26:48.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.457+0000 7f6c708ad640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6c6c0ca3a0 0x7f6c6c0ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:48.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.457+0000 7f6c708ad640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c6c0ccae0 0x7f6c6c0ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:48.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.457+0000 7f6c708ad640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c6c159ca0 con 0x7f6c6c0ad940 2023-10-16T14:26:48.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.457+0000 7f6c708ad640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6c0b34c0 con 0x7f6c6c0ccae0 2023-10-16T14:26:48.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.457+0000 7f6c708ad640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6c0b2fd0 con 0x7f6c6c0ca3a0 2023-10-16T14:26:48.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.458+0000 7f6c6bfff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c6c0ccae0 0x7f6c6c0ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:48.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.458+0000 7f6c6bfff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c6c0ccae0 0x7f6c6c0ceef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54996/0 (socket says 172.21.15.59:54996) 2023-10-16T14:26:48.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.458+0000 7f6c6bfff640 1 -- 172.21.15.59:0/3587510949 learned_addr learned my addr 172.21.15.59:0/3587510949 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:48.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.458+0000 7f6c62ffd640 1 --2- 172.21.15.59:0/3587510949 >> v2:172.21.15.151:3300/0 conn(0x7f6c6c0ca3a0 0x7f6c6c0ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:48.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.458+0000 7f6c6bfff640 1 -- 172.21.15.59:0/3587510949 >> v2:172.21.15.151:3300/0 conn(0x7f6c6c0ca3a0 msgr2=0x7f6c6c0ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:48.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.458+0000 7f6c6bfff640 1 --2- 172.21.15.59:0/3587510949 >> v2:172.21.15.151:3300/0 conn(0x7f6c6c0ca3a0 0x7f6c6c0ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.458+0000 7f6c6bfff640 1 -- 172.21.15.59:0/3587510949 >> v1:172.21.15.59:6789/0 conn(0x7f6c6c0ad940 legacy=0x7f6c6c06c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:48.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.458+0000 7f6c6bfff640 1 -- 172.21.15.59:0/3587510949 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c0cac20 con 0x7f6c6c0ccae0 2023-10-16T14:26:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.460+0000 7f6c6bfff640 1 --2- 172.21.15.59:0/3587510949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c6c0ccae0 0x7f6c6c0ceef0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c06be00 tx=0x7f6c6402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb9839dd1fb3a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.460+0000 7f6c6affd640 1 -- 172.21.15.59:0/3587510949 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64030860 con 0x7f6c6c0ccae0 2023-10-16T14:26:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.460+0000 7f6c6affd640 1 -- 172.21.15.59:0/3587510949 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c640309c0 con 0x7f6c6c0ccae0 2023-10-16T14:26:48.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.460+0000 7f6c6affd640 1 -- 172.21.15.59:0/3587510949 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64030d50 con 0x7f6c6c0ccae0 2023-10-16T14:26:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.461+0000 7f6c708ad640 1 -- 172.21.15.59:0/3587510949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c6c0ccae0 msgr2=0x7f6c6c0ceef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.461+0000 7f6c708ad640 1 --2- 172.21.15.59:0/3587510949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c6c0ccae0 0x7f6c6c0ceef0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c06be00 tx=0x7f6c6402b9a0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.461+0000 7f6c708ad640 1 -- 172.21.15.59:0/3587510949 shutdown_connections 2023-10-16T14:26:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.461+0000 7f6c708ad640 1 --2- 172.21.15.59:0/3587510949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c6c0ccae0 0x7f6c6c0ceef0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.461+0000 7f6c708ad640 1 --2- 172.21.15.59:0/3587510949 >> v2:172.21.15.151:3300/0 conn(0x7f6c6c0ca3a0 0x7f6c6c0ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.461+0000 7f6c708ad640 1 -- 172.21.15.59:0/3587510949 >> 172.21.15.59:0/3587510949 conn(0x7f6c6c06a200 msgr2=0x7f6c6c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:48.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.461+0000 7f6c708ad640 1 -- 172.21.15.59:0/3587510949 shutdown_connections 2023-10-16T14:26:48.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.461+0000 7f6c708ad640 1 -- 172.21.15.59:0/3587510949 wait complete. 2023-10-16T14:26:48.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.463+0000 7f6c708ad640 1 Processor -- start 2023-10-16T14:26:48.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.463+0000 7f6c708ad640 1 -- start start 2023-10-16T14:26:48.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.464+0000 7f6c708ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c6c0ad940 0x7f6c6c0c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:48.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.464+0000 7f6c708ad640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c6c0ca3a0 0x7f6c6c1f1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.464+0000 7f6c708ad640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c6c0ccae0 0x7f6c6c0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.464+0000 7f6c708ad640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c152610 con 0x7f6c6c0ad940 2023-10-16T14:26:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.464+0000 7f6c708ad640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c1f5d40 con 0x7f6c6c0ca3a0 2023-10-16T14:26:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.464+0000 7f6c708ad640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c152330 con 0x7f6c6c0ccae0 2023-10-16T14:26:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.464+0000 7f6c6b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c6c0ad940 0x7f6c6c0c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:48.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.464+0000 7f6c6b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c6c0ad940 0x7f6c6c0c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55004/0 (socket says 172.21.15.59:55004) 2023-10-16T14:26:48.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.464+0000 7f6c6b7fe640 1 -- 172.21.15.59:0/350629511 learned_addr learned my addr 172.21.15.59:0/350629511 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:48.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.465+0000 7f6c6b7fe640 1 -- 172.21.15.59:0/350629511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c6c0ccae0 msgr2=0x7f6c6c0b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:48.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.465+0000 7f6c6b7fe640 1 --2- 172.21.15.59:0/350629511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c6c0ccae0 0x7f6c6c0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.470 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.465+0000 7f6c6b7fe640 1 -- 172.21.15.59:0/350629511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c6c0ca3a0 msgr2=0x7f6c6c1f1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:48.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.465+0000 7f6c62ffd640 1 --2- 172.21.15.59:0/350629511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c6c0ca3a0 0x7f6c6c1f1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:48.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.465+0000 7f6c6b7fe640 1 --2- 172.21.15.59:0/350629511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c6c0ca3a0 0x7f6c6c1f1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.465+0000 7f6c6b7fe640 1 -- 172.21.15.59:0/350629511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c640094d0 con 0x7f6c6c0ad940 2023-10-16T14:26:48.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.465+0000 7f6c6b7fe640 1 --2- 172.21.15.59:0/350629511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c6c0ad940 0x7f6c6c0c80f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00c8a0 tx=0x7f6c5c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:48.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.465+0000 7f6c68ff9640 1 -- 172.21.15.59:0/350629511 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c003b70 con 0x7f6c6c0ad940 2023-10-16T14:26:48.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.465+0000 7f6c68ff9640 1 -- 172.21.15.59:0/350629511 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c003cf0 con 0x7f6c6c0ad940 2023-10-16T14:26:48.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.465+0000 7f6c68ff9640 1 -- 172.21.15.59:0/350629511 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c00aa90 con 0x7f6c6c0ad940 2023-10-16T14:26:48.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.465+0000 7f6c708ad640 1 -- 172.21.15.59:0/350629511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6c1f56f0 con 0x7f6c6c0ad940 2023-10-16T14:26:48.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.466+0000 7f6c708ad640 1 -- 172.21.15.59:0/350629511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6c151fb0 con 0x7f6c6c0ad940 2023-10-16T14:26:48.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.467+0000 7f6c708ad640 1 -- 172.21.15.59:0/350629511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c6c1f5550 con 0x7f6c6c0ad940 2023-10-16T14:26:48.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.468+0000 7f6c68ff9640 1 -- 172.21.15.59:0/350629511 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6c5c00abf0 con 0x7f6c6c0ad940 2023-10-16T14:26:48.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.469+0000 7f6c68ff9640 1 --2- 172.21.15.59:0/350629511 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6c4c06ae70 0x7f6c4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:48.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.469+0000 7f6c68ff9640 1 -- 172.21.15.59:0/350629511 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f6c5c089760 con 0x7f6c6c0ad940 2023-10-16T14:26:48.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.469+0000 7f6c62ffd640 1 --2- 172.21.15.59:0/350629511 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6c4c06ae70 0x7f6c4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:48.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.470+0000 7f6c62ffd640 1 --2- 172.21.15.59:0/350629511 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6c4c06ae70 0x7f6c4c06d330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c1f54b0 tx=0x7f6c54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:48.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.473+0000 7f6c68ff9640 1 -- 172.21.15.59:0/350629511 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6c6c1f5550 con 0x7f6c6c0ad940 2023-10-16T14:26:48.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.665+0000 7f6c708ad640 1 -- 172.21.15.59:0/350629511 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6c6c1f5550 con 0x7f6c6c0ad940 2023-10-16T14:26:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.666+0000 7f6c68ff9640 1 -- 172.21.15.59:0/350629511 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6c6c1f5550 con 0x7f6c6c0ad940 2023-10-16T14:26:48.669 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:48.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.669+0000 7f6c708ad640 1 -- 172.21.15.59:0/350629511 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6c4c06ae70 msgr2=0x7f6c4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:48.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.669+0000 7f6c708ad640 1 --2- 172.21.15.59:0/350629511 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6c4c06ae70 0x7f6c4c06d330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c1f54b0 tx=0x7f6c54008040 comp rx=0 tx=0).stop 2023-10-16T14:26:48.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.669+0000 7f6c708ad640 1 -- 172.21.15.59:0/350629511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c6c0ad940 msgr2=0x7f6c6c0c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:48.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.669+0000 7f6c708ad640 1 --2- 172.21.15.59:0/350629511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c6c0ad940 0x7f6c6c0c80f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00c8a0 tx=0x7f6c5c00cd60 comp rx=0 tx=0).stop 2023-10-16T14:26:48.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.669+0000 7f6c708ad640 1 -- 172.21.15.59:0/350629511 shutdown_connections 2023-10-16T14:26:48.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.669+0000 7f6c708ad640 1 --2- 172.21.15.59:0/350629511 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6c4c06ae70 0x7f6c4c06d330 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.669+0000 7f6c708ad640 1 --2- 172.21.15.59:0/350629511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c6c0ccae0 0x7f6c6c0b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.669+0000 7f6c708ad640 1 --2- 172.21.15.59:0/350629511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c6c0ca3a0 0x7f6c6c1f1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.669+0000 7f6c708ad640 1 --2- 172.21.15.59:0/350629511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c6c0ad940 0x7f6c6c0c80f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.669+0000 7f6c708ad640 1 -- 172.21.15.59:0/350629511 >> 172.21.15.59:0/350629511 conn(0x7f6c6c06a200 msgr2=0x7f6c6c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.670+0000 7f6c708ad640 1 -- 172.21.15.59:0/350629511 shutdown_connections 2023-10-16T14:26:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.670+0000 7f6c708ad640 1 -- 172.21.15.59:0/350629511 wait complete. 2023-10-16T14:26:48.692 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-10-16T14:26:48.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.916+0000 7f3528c90640 1 Processor -- start 2023-10-16T14:26:48.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.917+0000 7f3528c90640 1 -- start start 2023-10-16T14:26:48.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.918+0000 7f3528c90640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f352415ce60 0x7f35240cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:48.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.918+0000 7f3528c90640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3524161620 con 0x7f352415ca80 2023-10-16T14:26:48.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.918+0000 7f3528c90640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35240cafa0 con 0x7f35240b0720 2023-10-16T14:26:48.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.918+0000 7f3528c90640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35240cb280 con 0x7f352415ce60 2023-10-16T14:26:48.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.919+0000 7f352259c640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f352415ca80 0x7f35240b0010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51882/0 (socket says 172.21.15.59:51882) 2023-10-16T14:26:48.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.919+0000 7f352259c640 1 -- 172.21.15.59:0/891963682 learned_addr learned my addr 172.21.15.59:0/891963682 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:48.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.919+0000 7f3522d9d640 1 --2- 172.21.15.59:0/891963682 >> v2:172.21.15.151:3300/0 conn(0x7f352415ce60 0x7f35240cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:48.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.919+0000 7f352159a640 1 -- 172.21.15.59:0/891963682 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834004195 0 0) 0x7f3524161620 con 0x7f352415ca80 2023-10-16T14:26:48.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.919+0000 7f352159a640 1 -- 172.21.15.59:0/891963682 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f350c003520 con 0x7f352415ca80 2023-10-16T14:26:48.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.919+0000 7f352159a640 1 -- 172.21.15.59:0/891963682 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1170440326 0 0) 0x7f350c003520 con 0x7f352415ca80 2023-10-16T14:26:48.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.920+0000 7f352159a640 1 -- 172.21.15.59:0/891963682 >> v2:172.21.15.151:3300/0 conn(0x7f352415ce60 msgr2=0x7f35240cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:48.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.920+0000 7f352159a640 1 --2- 172.21.15.59:0/891963682 >> v2:172.21.15.151:3300/0 conn(0x7f352415ce60 0x7f35240cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.920+0000 7f352159a640 1 -- 172.21.15.59:0/891963682 >> v1:172.21.15.151:6789/0 conn(0x7f35240b0720 legacy=0x7f35240cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:48.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.920+0000 7f352159a640 1 -- 172.21.15.59:0/891963682 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35240cb560 con 0x7f352415ca80 2023-10-16T14:26:48.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.920+0000 7f352159a640 1 -- 172.21.15.59:0/891963682 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f3514001690 con 0x7f352415ca80 2023-10-16T14:26:48.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.920+0000 7f352159a640 1 -- 172.21.15.59:0/891963682 >> v1:172.21.15.59:6789/0 conn(0x7f352415ca80 legacy=0x7f35240b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:48.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.920+0000 7f352159a640 1 --2- 172.21.15.59:0/891963682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350c003a30 0x7f350c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:48.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.920+0000 7f352159a640 1 --2- 172.21.15.59:0/891963682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f350c0047c0 0x7f350c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:48.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.920+0000 7f352159a640 1 --2- 172.21.15.59:0/891963682 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c0051d0 0x7f350c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:48.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.920+0000 7f352159a640 1 -- 172.21.15.59:0/891963682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35240cb280 con 0x7f350c003a30 2023-10-16T14:26:48.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.920+0000 7f352159a640 1 -- 172.21.15.59:0/891963682 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350c00c100 con 0x7f350c0047c0 2023-10-16T14:26:48.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.920+0000 7f352159a640 1 -- 172.21.15.59:0/891963682 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f350c00c2c0 con 0x7f350c0051d0 2023-10-16T14:26:48.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.920+0000 7f352259c640 1 --2- 172.21.15.59:0/891963682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350c003a30 0x7f350c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:48.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.920+0000 7f3521d9b640 1 --2- 172.21.15.59:0/891963682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f350c0047c0 0x7f350c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:48.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.920+0000 7f3522d9d640 1 --2- 172.21.15.59:0/891963682 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c0051d0 0x7f350c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:48.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.921+0000 7f352259c640 1 -- 172.21.15.59:0/891963682 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c0051d0 msgr2=0x7f350c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:48.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.921+0000 7f352259c640 1 --2- 172.21.15.59:0/891963682 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c0051d0 0x7f350c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.921+0000 7f352259c640 1 -- 172.21.15.59:0/891963682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f350c0047c0 msgr2=0x7f350c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:48.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.921+0000 7f352259c640 1 --2- 172.21.15.59:0/891963682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f350c0047c0 0x7f350c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.921+0000 7f352259c640 1 -- 172.21.15.59:0/891963682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c003520 con 0x7f350c003a30 2023-10-16T14:26:48.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.921+0000 7f3522d9d640 1 -- 172.21.15.59:0/891963682 reap_dead start 2023-10-16T14:26:48.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.922+0000 7f352259c640 1 --2- 172.21.15.59:0/891963682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350c003a30 0x7f350c003e50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f351400c160 tx=0x7f350c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d47a0a1ddfc594 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:48.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.922+0000 7f352159a640 1 -- 172.21.15.59:0/891963682 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514005ad0 con 0x7f350c003a30 2023-10-16T14:26:48.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.922+0000 7f352159a640 1 -- 172.21.15.59:0/891963682 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3514005c30 con 0x7f350c003a30 2023-10-16T14:26:48.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.922+0000 7f352159a640 1 -- 172.21.15.59:0/891963682 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514007070 con 0x7f350c003a30 2023-10-16T14:26:48.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.923+0000 7f3528c90640 1 -- 172.21.15.59:0/891963682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350c003a30 msgr2=0x7f350c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:48.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.923+0000 7f3528c90640 1 --2- 172.21.15.59:0/891963682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350c003a30 0x7f350c003e50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f351400c160 tx=0x7f350c0057f0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.923+0000 7f3528c90640 1 -- 172.21.15.59:0/891963682 shutdown_connections 2023-10-16T14:26:48.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.923+0000 7f3528c90640 1 --2- 172.21.15.59:0/891963682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350c003a30 0x7f350c003e50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.923+0000 7f3528c90640 1 -- 172.21.15.59:0/891963682 >> 172.21.15.59:0/891963682 conn(0x7f352406c1c0 msgr2=0x7f352406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:48.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.923+0000 7f3528c90640 1 -- 172.21.15.59:0/891963682 shutdown_connections 2023-10-16T14:26:48.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.923+0000 7f3528c90640 1 -- 172.21.15.59:0/891963682 wait complete. 2023-10-16T14:26:48.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.925+0000 7f3528c90640 1 Processor -- start 2023-10-16T14:26:48.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.925+0000 7f3528c90640 1 -- start start 2023-10-16T14:26:48.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.926+0000 7f3528c90640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c003a30 0x7f35240b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:48.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.926+0000 7f3528c90640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f352414ae20 0x7f35240c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:48.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.926+0000 7f3528c90640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35240b23e0 0x7f35240b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:48.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.926+0000 7f3528c90640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35240b2da0 con 0x7f35240b23e0 2023-10-16T14:26:48.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.926+0000 7f3528c90640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35240c2600 con 0x7f352414ae20 2023-10-16T14:26:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.926+0000 7f3528c90640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35240c3440 con 0x7f350c003a30 2023-10-16T14:26:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.926+0000 7f3522d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35240b23e0 0x7f35240b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.926+0000 7f3522d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35240b23e0 0x7f35240b2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55030/0 (socket says 172.21.15.59:55030) 2023-10-16T14:26:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.926+0000 7f3522d9d640 1 -- 172.21.15.59:0/425973514 learned_addr learned my addr 172.21.15.59:0/425973514 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.927+0000 7f3521d9b640 1 --2- 172.21.15.59:0/425973514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f352414ae20 0x7f35240c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.927+0000 7f352259c640 1 --2- 172.21.15.59:0/425973514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c003a30 0x7f35240b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.927+0000 7f3522d9d640 1 -- 172.21.15.59:0/425973514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c003a30 msgr2=0x7f35240b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.927+0000 7f3522d9d640 1 --2- 172.21.15.59:0/425973514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c003a30 0x7f35240b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.927+0000 7f3522d9d640 1 -- 172.21.15.59:0/425973514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f352414ae20 msgr2=0x7f35240c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.927+0000 7f3522d9d640 1 --2- 172.21.15.59:0/425973514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f352414ae20 0x7f35240c20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.927+0000 7f3522d9d640 1 -- 172.21.15.59:0/425973514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35240c2830 con 0x7f35240b23e0 2023-10-16T14:26:48.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.927+0000 7f352259c640 1 --2- 172.21.15.59:0/425973514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c003a30 0x7f35240b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:48.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.927+0000 7f3521d9b640 1 --2- 172.21.15.59:0/425973514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f352414ae20 0x7f35240c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:48.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.927+0000 7f3522d9d640 1 --2- 172.21.15.59:0/425973514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35240b23e0 0x7f35240b2860 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f352415d270 tx=0x7f351c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:48.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.927+0000 7f3512ffd640 1 -- 172.21.15.59:0/425973514 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c00e070 con 0x7f35240b23e0 2023-10-16T14:26:48.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.927+0000 7f3512ffd640 1 -- 172.21.15.59:0/425973514 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351c011de0 con 0x7f35240b23e0 2023-10-16T14:26:48.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.927+0000 7f3512ffd640 1 -- 172.21.15.59:0/425973514 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c003990 con 0x7f35240b23e0 2023-10-16T14:26:48.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.927+0000 7f3528c90640 1 -- 172.21.15.59:0/425973514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35240c2b10 con 0x7f35240b23e0 2023-10-16T14:26:48.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.928+0000 7f3528c90640 1 -- 172.21.15.59:0/425973514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35240c30d0 con 0x7f35240b23e0 2023-10-16T14:26:48.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.929+0000 7f3528c90640 1 -- 172.21.15.59:0/425973514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35240c3290 con 0x7f35240b23e0 2023-10-16T14:26:48.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.930+0000 7f3512ffd640 1 -- 172.21.15.59:0/425973514 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f351c003af0 con 0x7f35240b23e0 2023-10-16T14:26:48.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.931+0000 7f3512ffd640 1 --2- 172.21.15.59:0/425973514 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f350406ae70 0x7f350406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:48.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.931+0000 7f3512ffd640 1 -- 172.21.15.59:0/425973514 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f351c08a0e0 con 0x7f35240b23e0 2023-10-16T14:26:48.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.932+0000 7f352259c640 1 --2- 172.21.15.59:0/425973514 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f350406ae70 0x7f350406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:48.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.933+0000 7f352259c640 1 --2- 172.21.15.59:0/425973514 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f350406ae70 0x7f350406d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3514034000 tx=0x7f3514009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:48.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:48.936+0000 7f3512ffd640 1 -- 172.21.15.59:0/425973514 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f351c054e50 con 0x7f35240b23e0 2023-10-16T14:26:49.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.201+0000 7f3528c90640 1 -- 172.21.15.59:0/425973514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f3524073ef0 con 0x7f35240b23e0 2023-10-16T14:26:49.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.709+0000 7f3512ffd640 1 -- 172.21.15.59:0/425973514 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v82) v1 ==== 147+0+0 (secure 0 0 0) 0x7f351c058470 con 0x7f35240b23e0 2023-10-16T14:26:49.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.712+0000 7f3528c90640 1 -- 172.21.15.59:0/425973514 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f350406ae70 msgr2=0x7f350406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:49.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.712+0000 7f3528c90640 1 --2- 172.21.15.59:0/425973514 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f350406ae70 0x7f350406d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3514034000 tx=0x7f3514009030 comp rx=0 tx=0).stop 2023-10-16T14:26:49.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.712+0000 7f3528c90640 1 -- 172.21.15.59:0/425973514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35240b23e0 msgr2=0x7f35240b2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:49.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.712+0000 7f3528c90640 1 --2- 172.21.15.59:0/425973514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35240b23e0 0x7f35240b2860 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f352415d270 tx=0x7f351c0115a0 comp rx=0 tx=0).stop 2023-10-16T14:26:49.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.713+0000 7f3528c90640 1 -- 172.21.15.59:0/425973514 shutdown_connections 2023-10-16T14:26:49.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.713+0000 7f3528c90640 1 --2- 172.21.15.59:0/425973514 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f350406ae70 0x7f350406d330 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:49.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.713+0000 7f3528c90640 1 --2- 172.21.15.59:0/425973514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35240b23e0 0x7f35240b2860 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:49.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.713+0000 7f3528c90640 1 --2- 172.21.15.59:0/425973514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f352414ae20 0x7f35240c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:49.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.713+0000 7f3528c90640 1 --2- 172.21.15.59:0/425973514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f350c003a30 0x7f35240b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:49.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.713+0000 7f3528c90640 1 -- 172.21.15.59:0/425973514 >> 172.21.15.59:0/425973514 conn(0x7f352406c1c0 msgr2=0x7f35240cc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:49.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.713+0000 7f3528c90640 1 -- 172.21.15.59:0/425973514 shutdown_connections 2023-10-16T14:26:49.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.713+0000 7f3528c90640 1 -- 172.21.15.59:0/425973514 wait complete. 2023-10-16T14:26:49.740 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-16T14:26:49.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.974+0000 7fcc9f2fc640 1 Processor -- start 2023-10-16T14:26:49.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.975+0000 7fcc9f2fc640 1 -- start start 2023-10-16T14:26:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.976+0000 7fcc9f2fc640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc9815c580 0x7fcc980cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.976+0000 7fcc9f2fc640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcc980cdbb0 0x7fcc980cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:49.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.976+0000 7fcc9f2fc640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc980cb180 con 0x7fcc980c8b50 2023-10-16T14:26:49.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.976+0000 7fcc9f2fc640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc980cac40 con 0x7fcc9815c580 2023-10-16T14:26:49.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.976+0000 7fcc9f2fc640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc980cf440 con 0x7fcc980cdbb0 2023-10-16T14:26:49.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.977+0000 7fcc9d098640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc9815c580 0x7fcc980cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:49.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.977+0000 7fcc9d899640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcc980c8b50 0x7fcc9815cc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51894/0 (socket says 172.21.15.59:51894) 2023-10-16T14:26:49.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.977+0000 7fcc9d899640 1 -- 172.21.15.59:0/1610138408 learned_addr learned my addr 172.21.15.59:0/1610138408 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:49.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.977+0000 7fcc9c897640 1 --2- 172.21.15.59:0/1610138408 >> v2:172.21.15.151:3300/0 conn(0x7fcc980cdbb0 0x7fcc980cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:49.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.977+0000 7fcc9d098640 1 -- 172.21.15.59:0/1610138408 >> v2:172.21.15.151:3300/0 conn(0x7fcc980cdbb0 msgr2=0x7fcc980cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:49.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.977+0000 7fcc9d098640 1 --2- 172.21.15.59:0/1610138408 >> v2:172.21.15.151:3300/0 conn(0x7fcc980cdbb0 0x7fcc980cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:49.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.977+0000 7fcc9d098640 1 -- 172.21.15.59:0/1610138408 >> v1:172.21.15.59:6789/0 conn(0x7fcc980c8b50 legacy=0x7fcc9815cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:49.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.977+0000 7fcc9d098640 1 -- 172.21.15.59:0/1610138408 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc980ceec0 con 0x7fcc9815c580 2023-10-16T14:26:49.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.977+0000 7fcc8ffff640 1 -- 172.21.15.59:0/1610138408 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122051719 0 0) 0x7fcc980cb180 con 0x7fcc980c8b50 2023-10-16T14:26:49.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.978+0000 7fcc9d098640 1 --2- 172.21.15.59:0/1610138408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9815c580 0x7fcc980cd5f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcc980cbe80 tx=0x7fcc9402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a784e0196bc629 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:49.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.979+0000 7fcc8ffff640 1 -- 172.21.15.59:0/1610138408 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9402e070 con 0x7fcc9815c580 2023-10-16T14:26:49.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.979+0000 7fcc8ffff640 1 -- 172.21.15.59:0/1610138408 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc940315a0 con 0x7fcc9815c580 2023-10-16T14:26:49.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.979+0000 7fcc8ffff640 1 -- 172.21.15.59:0/1610138408 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc94031930 con 0x7fcc9815c580 2023-10-16T14:26:49.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.979+0000 7fcc9f2fc640 1 -- 172.21.15.59:0/1610138408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9815c580 msgr2=0x7fcc980cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:49.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.979+0000 7fcc9f2fc640 1 --2- 172.21.15.59:0/1610138408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9815c580 0x7fcc980cd5f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcc980cbe80 tx=0x7fcc9402b840 comp rx=0 tx=0).stop 2023-10-16T14:26:49.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.980+0000 7fcc9f2fc640 1 -- 172.21.15.59:0/1610138408 shutdown_connections 2023-10-16T14:26:49.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.980+0000 7fcc9f2fc640 1 --2- 172.21.15.59:0/1610138408 >> v2:172.21.15.151:3300/0 conn(0x7fcc980cdbb0 0x7fcc980cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:49.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.980+0000 7fcc9f2fc640 1 --2- 172.21.15.59:0/1610138408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc9815c580 0x7fcc980cd5f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:49.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.980+0000 7fcc9f2fc640 1 -- 172.21.15.59:0/1610138408 >> 172.21.15.59:0/1610138408 conn(0x7fcc980b0030 msgr2=0x7fcc980b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:49.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.980+0000 7fcc9f2fc640 1 -- 172.21.15.59:0/1610138408 shutdown_connections 2023-10-16T14:26:49.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.980+0000 7fcc9f2fc640 1 -- 172.21.15.59:0/1610138408 wait complete. 2023-10-16T14:26:49.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.981+0000 7fcc9f2fc640 1 Processor -- start 2023-10-16T14:26:49.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.982+0000 7fcc9f2fc640 1 -- start start 2023-10-16T14:26:49.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.982+0000 7fcc9f2fc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc980c8b50 0x7fcc980c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:49.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.982+0000 7fcc9f2fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc980cdbb0 0x7fcc9814da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:49.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.983+0000 7fcc9f2fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc9815c580 0x7fcc9814df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:49.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.983+0000 7fcc9f2fc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc980c2b30 con 0x7fcc980cdbb0 2023-10-16T14:26:49.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.983+0000 7fcc9f2fc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc980c5970 con 0x7fcc9815c580 2023-10-16T14:26:49.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.983+0000 7fcc9f2fc640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc980c5c50 con 0x7fcc980c8b50 2023-10-16T14:26:49.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.983+0000 7fcc9c897640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc980cdbb0 0x7fcc9814da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:49.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.983+0000 7fcc9c897640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc980cdbb0 0x7fcc9814da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55038/0 (socket says 172.21.15.59:55038) 2023-10-16T14:26:49.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.983+0000 7fcc9c897640 1 -- 172.21.15.59:0/2670995762 learned_addr learned my addr 172.21.15.59:0/2670995762 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:49.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.983+0000 7fcc9d098640 1 --2- 172.21.15.59:0/2670995762 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc980c8b50 0x7fcc980c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:49.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.983+0000 7fcc9c897640 1 -- 172.21.15.59:0/2670995762 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc980c8b50 msgr2=0x7fcc980c3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:49.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.983+0000 7fcc9d899640 1 --2- 172.21.15.59:0/2670995762 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc9815c580 0x7fcc9814df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:49.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.983+0000 7fcc9c897640 1 --2- 172.21.15.59:0/2670995762 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc980c8b50 0x7fcc980c3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:49.990 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.983+0000 7fcc9c897640 1 -- 172.21.15.59:0/2670995762 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc9815c580 msgr2=0x7fcc9814df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:49.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.983+0000 7fcc9c897640 1 --2- 172.21.15.59:0/2670995762 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc9815c580 0x7fcc9814df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:49.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.983+0000 7fcc9c897640 1 -- 172.21.15.59:0/2670995762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc94009400 con 0x7fcc980cdbb0 2023-10-16T14:26:49.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.983+0000 7fcc9d899640 1 --2- 172.21.15.59:0/2670995762 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc9815c580 0x7fcc9814df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:49.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.984+0000 7fcc9c897640 1 --2- 172.21.15.59:0/2670995762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc980cdbb0 0x7fcc9814da50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800d800 tx=0x7fcc8800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:49.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.984+0000 7fcc8dffb640 1 -- 172.21.15.59:0/2670995762 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8800b6c0 con 0x7fcc980cdbb0 2023-10-16T14:26:49.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.984+0000 7fcc8dffb640 1 -- 172.21.15.59:0/2670995762 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8800b820 con 0x7fcc980cdbb0 2023-10-16T14:26:49.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.984+0000 7fcc8dffb640 1 -- 172.21.15.59:0/2670995762 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8800bbb0 con 0x7fcc980cdbb0 2023-10-16T14:26:49.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.984+0000 7fcc9f2fc640 1 -- 172.21.15.59:0/2670995762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc980c5f30 con 0x7fcc980cdbb0 2023-10-16T14:26:49.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.984+0000 7fcc9f2fc640 1 -- 172.21.15.59:0/2670995762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc980c64f0 con 0x7fcc980cdbb0 2023-10-16T14:26:49.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.985+0000 7fcc9f2fc640 1 -- 172.21.15.59:0/2670995762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc980c6680 con 0x7fcc980cdbb0 2023-10-16T14:26:49.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.986+0000 7fcc8dffb640 1 -- 172.21.15.59:0/2670995762 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcc8800bd10 con 0x7fcc980cdbb0 2023-10-16T14:26:49.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.987+0000 7fcc8dffb640 1 --2- 172.21.15.59:0/2670995762 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fcc7c06ae70 0x7fcc7c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:49.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.987+0000 7fcc8dffb640 1 -- 172.21.15.59:0/2670995762 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fcc88089f80 con 0x7fcc980cdbb0 2023-10-16T14:26:49.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.988+0000 7fcc9d098640 1 --2- 172.21.15.59:0/2670995762 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fcc7c06ae70 0x7fcc7c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:49.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.989+0000 7fcc9d098640 1 --2- 172.21.15.59:0/2670995762 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fcc7c06ae70 0x7fcc7c06d330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcc94036000 tx=0x7fcc9403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:49.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:49.992+0000 7fcc8dffb640 1 -- 172.21.15.59:0/2670995762 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcc88054c60 con 0x7fcc980cdbb0 2023-10-16T14:26:50.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.186+0000 7fcc9f2fc640 1 -- 172.21.15.59:0/2670995762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcc98073ef0 con 0x7fcc980cdbb0 2023-10-16T14:26:50.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.193+0000 7fcc8dffb640 1 -- 172.21.15.59:0/2670995762 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcc88058280 con 0x7fcc980cdbb0 2023-10-16T14:26:50.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.196+0000 7fcc9f2fc640 1 -- 172.21.15.59:0/2670995762 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fcc7c06ae70 msgr2=0x7fcc7c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:50.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.196+0000 7fcc9f2fc640 1 --2- 172.21.15.59:0/2670995762 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fcc7c06ae70 0x7fcc7c06d330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcc94036000 tx=0x7fcc9403d040 comp rx=0 tx=0).stop 2023-10-16T14:26:50.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.196+0000 7fcc9f2fc640 1 -- 172.21.15.59:0/2670995762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc980cdbb0 msgr2=0x7fcc9814da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:50.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.196+0000 7fcc9f2fc640 1 --2- 172.21.15.59:0/2670995762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc980cdbb0 0x7fcc9814da50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800d800 tx=0x7fcc8800dcc0 comp rx=0 tx=0).stop 2023-10-16T14:26:50.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.196+0000 7fcc9f2fc640 1 -- 172.21.15.59:0/2670995762 shutdown_connections 2023-10-16T14:26:50.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.196+0000 7fcc9f2fc640 1 --2- 172.21.15.59:0/2670995762 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fcc7c06ae70 0x7fcc7c06d330 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:50.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.196+0000 7fcc9f2fc640 1 --2- 172.21.15.59:0/2670995762 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc9815c580 0x7fcc9814df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:50.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.196+0000 7fcc9f2fc640 1 --2- 172.21.15.59:0/2670995762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc980cdbb0 0x7fcc9814da50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:50.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.196+0000 7fcc9f2fc640 1 --2- 172.21.15.59:0/2670995762 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc980c8b50 0x7fcc980c3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:50.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.196+0000 7fcc9f2fc640 1 -- 172.21.15.59:0/2670995762 >> 172.21.15.59:0/2670995762 conn(0x7fcc980b0030 msgr2=0x7fcc981535c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:50.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.197+0000 7fcc9f2fc640 1 -- 172.21.15.59:0/2670995762 shutdown_connections 2023-10-16T14:26:50.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.197+0000 7fcc9f2fc640 1 -- 172.21.15.59:0/2670995762 wait complete. 2023-10-16T14:26:50.218 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-16T14:26:50.219 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T14:26:50.340 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-16T14:26:50.476 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-16T14:26:50.476 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:26:50.477 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T14:26:50.545 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:26:50.545 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T14:26:50.606 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:26:50.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.818+0000 7febe1143640 1 Processor -- start 2023-10-16T14:26:50.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.818+0000 7febe1143640 1 -- start start 2023-10-16T14:26:50.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.820+0000 7febe1143640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7febdc15cba0 0x7febdc15da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:50.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.820+0000 7febe1143640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febdc15d570 con 0x7febdc0cdd90 2023-10-16T14:26:50.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.820+0000 7febe1143640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febdc0ccd60 con 0x7febdc0cad30 2023-10-16T14:26:50.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.820+0000 7febe1143640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febdc15cf80 con 0x7febdc15cba0 2023-10-16T14:26:50.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.820+0000 7febdb7fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7febdc0cdd90 0x7febdc0cc650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:51902/0 (socket says 172.21.15.59:51902) 2023-10-16T14:26:50.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.820+0000 7febdb7fe640 1 -- 172.21.15.59:0/2433159370 learned_addr learned my addr 172.21.15.59:0/2433159370 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:50.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.821+0000 7febdbfff640 1 --2- 172.21.15.59:0/2433159370 >> v2:172.21.15.151:3300/0 conn(0x7febdc15cba0 0x7febdc15da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:50.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.821+0000 7febdaffd640 1 -- 172.21.15.59:0/2433159370 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477682673 0 0) 0x7febdc15d570 con 0x7febdc0cdd90 2023-10-16T14:26:50.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.821+0000 7febdaffd640 1 -- 172.21.15.59:0/2433159370 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febc4003520 con 0x7febdc0cdd90 2023-10-16T14:26:50.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.821+0000 7febdaffd640 1 -- 172.21.15.59:0/2433159370 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1965436507 0 0) 0x7febc4003520 con 0x7febdc0cdd90 2023-10-16T14:26:50.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.821+0000 7febdaffd640 1 -- 172.21.15.59:0/2433159370 >> v2:172.21.15.151:3300/0 conn(0x7febdc15cba0 msgr2=0x7febdc15da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:50.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.821+0000 7febdaffd640 1 --2- 172.21.15.59:0/2433159370 >> v2:172.21.15.151:3300/0 conn(0x7febdc15cba0 0x7febdc15da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:50.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.821+0000 7febdaffd640 1 -- 172.21.15.59:0/2433159370 >> v1:172.21.15.151:6789/0 conn(0x7febdc0cad30 legacy=0x7febdc1605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:50.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.822+0000 7febdaffd640 1 -- 172.21.15.59:0/2433159370 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc15df40 con 0x7febdc0cdd90 2023-10-16T14:26:50.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.822+0000 7febdaffd640 1 -- 172.21.15.59:0/2433159370 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7febd0001670 con 0x7febdc0cdd90 2023-10-16T14:26:50.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.822+0000 7febdaffd640 1 -- 172.21.15.59:0/2433159370 >> v1:172.21.15.59:6789/0 conn(0x7febdc0cdd90 legacy=0x7febdc0cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:50.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.822+0000 7febdaffd640 1 --2- 172.21.15.59:0/2433159370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febc4003970 0x7febc4003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:50.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.822+0000 7febdaffd640 1 --2- 172.21.15.59:0/2433159370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febc40047c0 0x7febc4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:50.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.822+0000 7febdaffd640 1 --2- 172.21.15.59:0/2433159370 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febc4005180 0x7febc400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:50.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.822+0000 7febdaffd640 1 -- 172.21.15.59:0/2433159370 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc15cf80 con 0x7febc40047c0 2023-10-16T14:26:50.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.822+0000 7febdaffd640 1 -- 172.21.15.59:0/2433159370 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc400bfd0 con 0x7febc4003970 2023-10-16T14:26:50.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.822+0000 7febdaffd640 1 -- 172.21.15.59:0/2433159370 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc400c190 con 0x7febc4005180 2023-10-16T14:26:50.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.822+0000 7febdb7fe640 1 --2- 172.21.15.59:0/2433159370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febc40047c0 0x7febc4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:50.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.822+0000 7febdb7fe640 1 -- 172.21.15.59:0/2433159370 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febc4005180 msgr2=0x7febc400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:50.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.822+0000 7febdb7fe640 1 --2- 172.21.15.59:0/2433159370 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febc4005180 0x7febc400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:50.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.822+0000 7febdb7fe640 1 -- 172.21.15.59:0/2433159370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febc4003970 msgr2=0x7febc4003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:50.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.822+0000 7febdbfff640 1 --2- 172.21.15.59:0/2433159370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febc4003970 0x7febc4003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:50.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.823+0000 7febdb7fe640 1 --2- 172.21.15.59:0/2433159370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febc4003970 0x7febc4003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:50.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.823+0000 7febdb7fe640 1 -- 172.21.15.59:0/2433159370 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc4003520 con 0x7febc40047c0 2023-10-16T14:26:50.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.823+0000 7febe0942640 1 -- 172.21.15.59:0/2433159370 reap_dead start 2023-10-16T14:26:50.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.823+0000 7febdbfff640 1 --2- 172.21.15.59:0/2433159370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febc4003970 0x7febc4003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:50.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.824+0000 7febdb7fe640 1 --2- 172.21.15.59:0/2433159370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febc40047c0 0x7febc4004c40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7febd000c190 tx=0x7febc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb933bdb104fa2e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:50.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.824+0000 7febdaffd640 1 -- 172.21.15.59:0/2433159370 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd0005ad0 con 0x7febc40047c0 2023-10-16T14:26:50.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.824+0000 7febdaffd640 1 -- 172.21.15.59:0/2433159370 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd0005c30 con 0x7febc40047c0 2023-10-16T14:26:50.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.824+0000 7febdaffd640 1 -- 172.21.15.59:0/2433159370 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd002c810 con 0x7febc40047c0 2023-10-16T14:26:50.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.824+0000 7febe1143640 1 -- 172.21.15.59:0/2433159370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febc40047c0 msgr2=0x7febc4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:50.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.824+0000 7febe1143640 1 --2- 172.21.15.59:0/2433159370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febc40047c0 0x7febc4004c40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7febd000c190 tx=0x7febc40057f0 comp rx=0 tx=0).stop 2023-10-16T14:26:50.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.825+0000 7febe1143640 1 -- 172.21.15.59:0/2433159370 shutdown_connections 2023-10-16T14:26:50.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.825+0000 7febe1143640 1 --2- 172.21.15.59:0/2433159370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febc40047c0 0x7febc4004c40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:50.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.825+0000 7febe1143640 1 -- 172.21.15.59:0/2433159370 >> 172.21.15.59:0/2433159370 conn(0x7febdc06a470 msgr2=0x7febdc0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:50.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.825+0000 7febe1143640 1 -- 172.21.15.59:0/2433159370 shutdown_connections 2023-10-16T14:26:50.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.825+0000 7febe1143640 1 -- 172.21.15.59:0/2433159370 wait complete. 2023-10-16T14:26:50.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.827+0000 7febe1143640 1 Processor -- start 2023-10-16T14:26:50.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.827+0000 7febe1143640 1 -- start start 2023-10-16T14:26:50.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.828+0000 7febe1143640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febdc070e30 0x7febdc1f6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:50.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.828+0000 7febe1143640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febdc145fa0 0x7febdc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:50.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.828+0000 7febe1143640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febdc160450 0x7febdc160900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:50.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.828+0000 7febe1143640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc0b2fc0 con 0x7febdc160450 2023-10-16T14:26:50.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.828+0000 7febe1143640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc1f6890 con 0x7febdc145fa0 2023-10-16T14:26:50.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.828+0000 7febe1143640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febdc071750 con 0x7febdc070e30 2023-10-16T14:26:50.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.828+0000 7febe0942640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febdc160450 0x7febdc160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:50.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.828+0000 7febe0942640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febdc160450 0x7febdc160900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55044/0 (socket says 172.21.15.59:55044) 2023-10-16T14:26:50.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.828+0000 7febe0942640 1 -- 172.21.15.59:0/353606471 learned_addr learned my addr 172.21.15.59:0/353606471 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:50.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.828+0000 7febdbfff640 1 --2- 172.21.15.59:0/353606471 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febdc070e30 0x7febdc1f6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:50.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.828+0000 7febdb7fe640 1 --2- 172.21.15.59:0/353606471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febdc145fa0 0x7febdc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:50.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.828+0000 7febe0942640 1 -- 172.21.15.59:0/353606471 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febdc070e30 msgr2=0x7febdc1f6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:50.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.829+0000 7febe0942640 1 --2- 172.21.15.59:0/353606471 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febdc070e30 0x7febdc1f6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:50.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.829+0000 7febe0942640 1 -- 172.21.15.59:0/353606471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febdc145fa0 msgr2=0x7febdc071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:50.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.829+0000 7febe0942640 1 --2- 172.21.15.59:0/353606471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febdc145fa0 0x7febdc071210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:50.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.829+0000 7febe0942640 1 -- 172.21.15.59:0/353606471 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc0b3210 con 0x7febdc160450 2023-10-16T14:26:50.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.829+0000 7febe0942640 1 --2- 172.21.15.59:0/353606471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febdc160450 0x7febdc160900 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7febdc0b0c70 tx=0x7febd400cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:50.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.829+0000 7febd8ff9640 1 -- 172.21.15.59:0/353606471 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4005d40 con 0x7febdc160450 2023-10-16T14:26:50.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.829+0000 7febd8ff9640 1 -- 172.21.15.59:0/353606471 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd400a610 con 0x7febdc160450 2023-10-16T14:26:50.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.829+0000 7febd8ff9640 1 -- 172.21.15.59:0/353606471 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4005ea0 con 0x7febdc160450 2023-10-16T14:26:50.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.829+0000 7febe1143640 1 -- 172.21.15.59:0/353606471 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febdc0b34f0 con 0x7febdc160450 2023-10-16T14:26:50.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.829+0000 7febe1143640 1 -- 172.21.15.59:0/353606471 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febdc0b3ab0 con 0x7febdc160450 2023-10-16T14:26:50.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.831+0000 7febe1143640 1 -- 172.21.15.59:0/353606471 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febdc04e9b0 con 0x7febdc160450 2023-10-16T14:26:50.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.832+0000 7febd8ff9640 1 -- 172.21.15.59:0/353606471 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7febd400aa00 con 0x7febdc160450 2023-10-16T14:26:50.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.832+0000 7febd8ff9640 1 --2- 172.21.15.59:0/353606471 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7febc806ae70 0x7febc806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:50.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.833+0000 7febd8ff9640 1 -- 172.21.15.59:0/353606471 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7febd4088a60 con 0x7febdc160450 2023-10-16T14:26:50.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.833+0000 7febdbfff640 1 --2- 172.21.15.59:0/353606471 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7febc806ae70 0x7febc806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:50.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.834+0000 7febdbfff640 1 --2- 172.21.15.59:0/353606471 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7febc806ae70 0x7febc806d330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7febdc074bb0 tx=0x7febcc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:50.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:50.837+0000 7febd8ff9640 1 -- 172.21.15.59:0/353606471 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7febd4053740 con 0x7febdc160450 2023-10-16T14:26:51.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.033+0000 7febe1143640 1 -- 172.21.15.59:0/353606471 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febdc0b42f0 con 0x7febdc160450 2023-10-16T14:26:51.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.034+0000 7febd8ff9640 1 -- 172.21.15.59:0/353606471 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18445 (secure 0 0 0) 0x7febd4056d60 con 0x7febdc160450 2023-10-16T14:26:51.037 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:51.038 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:26:29.634854+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:26:51.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.038+0000 7febe1143640 1 -- 172.21.15.59:0/353606471 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7febc806ae70 msgr2=0x7febc806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:51.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.038+0000 7febe1143640 1 --2- 172.21.15.59:0/353606471 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7febc806ae70 0x7febc806d330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7febdc074bb0 tx=0x7febcc008040 comp rx=0 tx=0).stop 2023-10-16T14:26:51.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.038+0000 7febe1143640 1 -- 172.21.15.59:0/353606471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febdc160450 msgr2=0x7febdc160900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:51.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.038+0000 7febe1143640 1 --2- 172.21.15.59:0/353606471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febdc160450 0x7febdc160900 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7febdc0b0c70 tx=0x7febd400cb20 comp rx=0 tx=0).stop 2023-10-16T14:26:51.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.038+0000 7febe1143640 1 -- 172.21.15.59:0/353606471 shutdown_connections 2023-10-16T14:26:51.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.038+0000 7febe1143640 1 --2- 172.21.15.59:0/353606471 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7febc806ae70 0x7febc806d330 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.038+0000 7febe1143640 1 --2- 172.21.15.59:0/353606471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febdc160450 0x7febdc160900 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.038+0000 7febe1143640 1 --2- 172.21.15.59:0/353606471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febdc145fa0 0x7febdc071210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.038+0000 7febe1143640 1 --2- 172.21.15.59:0/353606471 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febdc070e30 0x7febdc1f6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.038+0000 7febe1143640 1 -- 172.21.15.59:0/353606471 >> 172.21.15.59:0/353606471 conn(0x7febdc06a470 msgr2=0x7febdc15bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:51.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.038+0000 7febe1143640 1 -- 172.21.15.59:0/353606471 shutdown_connections 2023-10-16T14:26:51.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.038+0000 7febe1143640 1 -- 172.21.15.59:0/353606471 wait complete. 2023-10-16T14:26:51.060 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T14:25:46.371818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T14:25:47.145341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T14:25:50.758038+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T14:26:51.061 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:26:51.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.284+0000 7f1877075640 1 Processor -- start 2023-10-16T14:26:51.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.284+0000 7f1877075640 1 -- start start 2023-10-16T14:26:51.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.286+0000 7f1877075640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f18700cacf0 0x7f18700cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:51.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.286+0000 7f1877075640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f187015cb80 0x7f18700cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:51.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.286+0000 7f1877075640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18700cb0d0 0x7f187006bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:51.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.286+0000 7f1877075640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1870070170 con 0x7f18700cacf0 2023-10-16T14:26:51.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.286+0000 7f1877075640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18700cd360 con 0x7f187015cb80 2023-10-16T14:26:51.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.286+0000 7f1877075640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18700cc1e0 con 0x7f18700cb0d0 2023-10-16T14:26:51.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.286+0000 7f1876073640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f18700cacf0 0x7f18700cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:51.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.286+0000 7f1876073640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f18700cacf0 0x7f18700cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55046/0 (socket says 172.21.15.59:55046) 2023-10-16T14:26:51.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.286+0000 7f1876073640 1 -- 172.21.15.59:0/552827505 learned_addr learned my addr 172.21.15.59:0/552827505 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:51.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.287+0000 7f1876073640 1 -- 172.21.15.59:0/552827505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18700cb0d0 msgr2=0x7f187006bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:51.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.287+0000 7f1876073640 1 --2- 172.21.15.59:0/552827505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18700cb0d0 0x7f187006bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.287+0000 7f1876073640 1 -- 172.21.15.59:0/552827505 >> v2:172.21.15.151:3300/0 conn(0x7f187015cb80 msgr2=0x7f18700cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:51.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.287+0000 7f1875872640 1 --2- 172.21.15.59:0/552827505 >> v2:172.21.15.151:3300/0 conn(0x7f187015cb80 0x7f18700cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:51.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.287+0000 7f1876073640 1 --2- 172.21.15.59:0/552827505 >> v2:172.21.15.151:3300/0 conn(0x7f187015cb80 0x7f18700cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.287+0000 7f1876073640 1 -- 172.21.15.59:0/552827505 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18700ccac0 con 0x7f18700cacf0 2023-10-16T14:26:51.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.288+0000 7f1876073640 1 --2- 172.21.15.59:0/552827505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18700cacf0 0x7f18700cdc20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f18700cd9e0 tx=0x7f186c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c2e2a54c53b49c server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:51.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.289+0000 7f1875071640 1 -- 172.21.15.59:0/552827505 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c031860 con 0x7f18700cacf0 2023-10-16T14:26:51.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.289+0000 7f1875071640 1 -- 172.21.15.59:0/552827505 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c0319c0 con 0x7f18700cacf0 2023-10-16T14:26:51.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.289+0000 7f1875071640 1 -- 172.21.15.59:0/552827505 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c031d50 con 0x7f18700cacf0 2023-10-16T14:26:51.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.289+0000 7f1877075640 1 -- 172.21.15.59:0/552827505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18700cacf0 msgr2=0x7f18700cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:51.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.289+0000 7f1877075640 1 --2- 172.21.15.59:0/552827505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18700cacf0 0x7f18700cdc20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f18700cd9e0 tx=0x7f186c02b900 comp rx=0 tx=0).stop 2023-10-16T14:26:51.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.289+0000 7f1877075640 1 -- 172.21.15.59:0/552827505 shutdown_connections 2023-10-16T14:26:51.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.289+0000 7f1877075640 1 --2- 172.21.15.59:0/552827505 >> v2:172.21.15.151:3300/0 conn(0x7f187015cb80 0x7f18700cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.289+0000 7f1877075640 1 --2- 172.21.15.59:0/552827505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18700cb0d0 0x7f187006bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.289+0000 7f1877075640 1 --2- 172.21.15.59:0/552827505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18700cacf0 0x7f18700cdc20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.289+0000 7f1877075640 1 -- 172.21.15.59:0/552827505 >> 172.21.15.59:0/552827505 conn(0x7f187006a470 msgr2=0x7f18700afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:51.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.289+0000 7f1877075640 1 -- 172.21.15.59:0/552827505 shutdown_connections 2023-10-16T14:26:51.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.289+0000 7f1877075640 1 -- 172.21.15.59:0/552827505 wait complete. 2023-10-16T14:26:51.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.291+0000 7f1877075640 1 Processor -- start 2023-10-16T14:26:51.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.291+0000 7f1877075640 1 -- start start 2023-10-16T14:26:51.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.292+0000 7f1877075640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18700cacf0 0x7f18700b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:51.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.292+0000 7f1877075640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18700cb0d0 0x7f187015aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:51.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.292+0000 7f1877075640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f187015cb80 0x7f18700c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:51.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.292+0000 7f1877075640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18700c1fb0 con 0x7f18700cb0d0 2023-10-16T14:26:51.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.292+0000 7f1877075640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18700c2290 con 0x7f187015cb80 2023-10-16T14:26:51.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.292+0000 7f1877075640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18700c2570 con 0x7f18700cacf0 2023-10-16T14:26:51.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.292+0000 7f1875872640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18700cb0d0 0x7f187015aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:51.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.293+0000 7f1875872640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18700cb0d0 0x7f187015aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55060/0 (socket says 172.21.15.59:55060) 2023-10-16T14:26:51.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.293+0000 7f1875872640 1 -- 172.21.15.59:0/1022684534 learned_addr learned my addr 172.21.15.59:0/1022684534 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:51.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.293+0000 7f1876874640 1 --2- 172.21.15.59:0/1022684534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f187015cb80 0x7f18700c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:51.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.293+0000 7f1876073640 1 --2- 172.21.15.59:0/1022684534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18700cacf0 0x7f18700b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:51.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.293+0000 7f1875872640 1 -- 172.21.15.59:0/1022684534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18700cacf0 msgr2=0x7f18700b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:51.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.293+0000 7f1875872640 1 --2- 172.21.15.59:0/1022684534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18700cacf0 0x7f18700b2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.293+0000 7f1875872640 1 -- 172.21.15.59:0/1022684534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f187015cb80 msgr2=0x7f18700c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:51.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.293+0000 7f1875872640 1 --2- 172.21.15.59:0/1022684534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f187015cb80 0x7f18700c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.293+0000 7f1875872640 1 -- 172.21.15.59:0/1022684534 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c0094d0 con 0x7f18700cb0d0 2023-10-16T14:26:51.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.293+0000 7f1875872640 1 --2- 172.21.15.59:0/1022684534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18700cb0d0 0x7f187015aab0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f186000c7f0 tx=0x7f186000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:51.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.294+0000 7f1866ffd640 1 -- 172.21.15.59:0/1022684534 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860004220 con 0x7f18700cb0d0 2023-10-16T14:26:51.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.294+0000 7f1866ffd640 1 -- 172.21.15.59:0/1022684534 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1860004380 con 0x7f18700cb0d0 2023-10-16T14:26:51.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.294+0000 7f1866ffd640 1 -- 172.21.15.59:0/1022684534 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860007840 con 0x7f18700cb0d0 2023-10-16T14:26:51.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.294+0000 7f1877075640 1 -- 172.21.15.59:0/1022684534 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18700c2850 con 0x7f18700cb0d0 2023-10-16T14:26:51.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.294+0000 7f1877075640 1 -- 172.21.15.59:0/1022684534 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18700b2740 con 0x7f18700cb0d0 2023-10-16T14:26:51.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.295+0000 7f1877075640 1 -- 172.21.15.59:0/1022684534 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18700c2d70 con 0x7f18700cb0d0 2023-10-16T14:26:51.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.296+0000 7f1866ffd640 1 -- 172.21.15.59:0/1022684534 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1860007bb0 con 0x7f18700cb0d0 2023-10-16T14:26:51.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.297+0000 7f1866ffd640 1 --2- 172.21.15.59:0/1022684534 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f185406ae70 0x7f185406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:51.303 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.297+0000 7f1866ffd640 1 -- 172.21.15.59:0/1022684534 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f1860089950 con 0x7f18700cb0d0 2023-10-16T14:26:51.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.298+0000 7f1876073640 1 --2- 172.21.15.59:0/1022684534 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f185406ae70 0x7f185406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:51.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.299+0000 7f1876073640 1 --2- 172.21.15.59:0/1022684534 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f185406ae70 0x7f185406d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f186c036000 tx=0x7f186c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:51.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.302+0000 7f1866ffd640 1 -- 172.21.15.59:0/1022684534 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f18700c2d70 con 0x7f18700cb0d0 2023-10-16T14:26:51.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.497+0000 7f1877075640 1 -- 172.21.15.59:0/1022684534 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18700c2d70 con 0x7f18700cb0d0 2023-10-16T14:26:51.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.498+0000 7f1866ffd640 1 -- 172.21.15.59:0/1022684534 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f18700c2d70 con 0x7f18700cb0d0 2023-10-16T14:26:51.500 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:26:51.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.501+0000 7f1877075640 1 -- 172.21.15.59:0/1022684534 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f185406ae70 msgr2=0x7f185406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:51.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.501+0000 7f1877075640 1 --2- 172.21.15.59:0/1022684534 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f185406ae70 0x7f185406d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f186c036000 tx=0x7f186c03c040 comp rx=0 tx=0).stop 2023-10-16T14:26:51.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.501+0000 7f1877075640 1 -- 172.21.15.59:0/1022684534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18700cb0d0 msgr2=0x7f187015aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:51.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.501+0000 7f1877075640 1 --2- 172.21.15.59:0/1022684534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18700cb0d0 0x7f187015aab0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f186000c7f0 tx=0x7f186000ccb0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.501+0000 7f1877075640 1 -- 172.21.15.59:0/1022684534 shutdown_connections 2023-10-16T14:26:51.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.501+0000 7f1877075640 1 --2- 172.21.15.59:0/1022684534 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f185406ae70 0x7f185406d330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.501+0000 7f1877075640 1 --2- 172.21.15.59:0/1022684534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f187015cb80 0x7f18700c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.501+0000 7f1877075640 1 --2- 172.21.15.59:0/1022684534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18700cb0d0 0x7f187015aab0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.501+0000 7f1877075640 1 --2- 172.21.15.59:0/1022684534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18700cacf0 0x7f18700b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.501+0000 7f1877075640 1 -- 172.21.15.59:0/1022684534 >> 172.21.15.59:0/1022684534 conn(0x7f187006a470 msgr2=0x7f18700c8910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:51.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.501+0000 7f1877075640 1 -- 172.21.15.59:0/1022684534 shutdown_connections 2023-10-16T14:26:51.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.501+0000 7f1877075640 1 -- 172.21.15.59:0/1022684534 wait complete. 2023-10-16T14:26:51.521 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T14:26:51.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.742+0000 7effad375640 1 Processor -- start 2023-10-16T14:26:51.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.743+0000 7effad375640 1 -- start start 2023-10-16T14:26:51.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.744+0000 7effad375640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7effa80cf030 0x7effa806ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:51.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.744+0000 7effad375640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effa806d360 0x7effa80ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:51.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.744+0000 7effad375640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa81550f0 con 0x7effa8154d10 2023-10-16T14:26:51.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.744+0000 7effad375640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa806db50 con 0x7effa80cf030 2023-10-16T14:26:51.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.744+0000 7effad375640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa80b13f0 con 0x7effa806d360 2023-10-16T14:26:51.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.744+0000 7effa77fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7effa80cf030 0x7effa806ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:51.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.745+0000 7effa77fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7effa80cf030 0x7effa806ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55068/0 (socket says 172.21.15.59:55068) 2023-10-16T14:26:51.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.745+0000 7effa77fe640 1 -- 172.21.15.59:0/1853501266 learned_addr learned my addr 172.21.15.59:0/1853501266 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:51.749 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.745+0000 7effa77fe640 1 -- 172.21.15.59:0/1853501266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effa806d360 msgr2=0x7effa80ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:51.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.745+0000 7effacb74640 1 --2- 172.21.15.59:0/1853501266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effa806d360 0x7effa80ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:51.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.745+0000 7effa77fe640 1 --2- 172.21.15.59:0/1853501266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effa806d360 0x7effa80ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.745+0000 7effa77fe640 1 -- 172.21.15.59:0/1853501266 >> v1:172.21.15.151:6789/0 conn(0x7effa8154d10 legacy=0x7effa80ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:51.750 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.745+0000 7effa77fe640 1 -- 172.21.15.59:0/1853501266 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa80b16d0 con 0x7effa80cf030 2023-10-16T14:26:51.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.745+0000 7effacb74640 1 --2- 172.21.15.59:0/1853501266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effa806d360 0x7effa80ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:51.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.746+0000 7effa77fe640 1 --2- 172.21.15.59:0/1853501266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa80cf030 0x7effa806ce20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009870 tx=0x7eff9c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19c9172d5b35c27 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:51.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.747+0000 7effa6ffd640 1 -- 172.21.15.59:0/1853501266 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c031640 con 0x7effa80cf030 2023-10-16T14:26:51.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.747+0000 7effa6ffd640 1 -- 172.21.15.59:0/1853501266 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c0317a0 con 0x7effa80cf030 2023-10-16T14:26:51.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.747+0000 7effa6ffd640 1 -- 172.21.15.59:0/1853501266 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c031b30 con 0x7effa80cf030 2023-10-16T14:26:51.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.747+0000 7effad375640 1 -- 172.21.15.59:0/1853501266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa80cf030 msgr2=0x7effa806ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:51.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.747+0000 7effad375640 1 --2- 172.21.15.59:0/1853501266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa80cf030 0x7effa806ce20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009870 tx=0x7eff9c02b8f0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.748+0000 7effad375640 1 -- 172.21.15.59:0/1853501266 shutdown_connections 2023-10-16T14:26:51.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.748+0000 7effad375640 1 --2- 172.21.15.59:0/1853501266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effa806d360 0x7effa80ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.748+0000 7effad375640 1 --2- 172.21.15.59:0/1853501266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa80cf030 0x7effa806ce20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.748+0000 7effad375640 1 -- 172.21.15.59:0/1853501266 >> 172.21.15.59:0/1853501266 conn(0x7effa806a200 msgr2=0x7effa806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:51.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.748+0000 7effad375640 1 -- 172.21.15.59:0/1853501266 shutdown_connections 2023-10-16T14:26:51.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.748+0000 7effad375640 1 -- 172.21.15.59:0/1853501266 wait complete. 2023-10-16T14:26:51.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.749+0000 7effad375640 1 Processor -- start 2023-10-16T14:26:51.755 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.750+0000 7effad375640 1 -- start start 2023-10-16T14:26:51.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.750+0000 7effad375640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effa806d360 0x7effa81587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:51.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.751+0000 7effad375640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effa80cf030 0x7effa81f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:51.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.751+0000 7effad375640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa8154d10 0x7effa80c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:51.758 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.751+0000 7effad375640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa80cb620 con 0x7effa8154d10 2023-10-16T14:26:51.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.751+0000 7effad375640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa80cb340 con 0x7effa80cf030 2023-10-16T14:26:51.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.751+0000 7effad375640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa815cea0 con 0x7effa806d360 2023-10-16T14:26:51.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.751+0000 7effacb74640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa8154d10 0x7effa80c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:51.759 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.751+0000 7effacb74640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa8154d10 0x7effa80c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55084/0 (socket says 172.21.15.59:55084) 2023-10-16T14:26:51.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.751+0000 7effacb74640 1 -- 172.21.15.59:0/1565040483 learned_addr learned my addr 172.21.15.59:0/1565040483 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:51.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.751+0000 7effa7fff640 1 --2- 172.21.15.59:0/1565040483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effa806d360 0x7effa81587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:51.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.751+0000 7effa77fe640 1 --2- 172.21.15.59:0/1565040483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effa80cf030 0x7effa81f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:51.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.751+0000 7effacb74640 1 -- 172.21.15.59:0/1565040483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effa806d360 msgr2=0x7effa81587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:51.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.751+0000 7effacb74640 1 --2- 172.21.15.59:0/1565040483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effa806d360 0x7effa81587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.751+0000 7effacb74640 1 -- 172.21.15.59:0/1565040483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effa80cf030 msgr2=0x7effa81f2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:51.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.751+0000 7effacb74640 1 --2- 172.21.15.59:0/1565040483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effa80cf030 0x7effa81f2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.751+0000 7effacb74640 1 -- 172.21.15.59:0/1565040483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c0094d0 con 0x7effa8154d10 2023-10-16T14:26:51.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.751+0000 7effa77fe640 1 --2- 172.21.15.59:0/1565040483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effa80cf030 0x7effa81f2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:51.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.752+0000 7effacb74640 1 --2- 172.21.15.59:0/1565040483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa8154d10 0x7effa80c57e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7effa000c7f0 tx=0x7effa000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:51.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.752+0000 7effa4ff9640 1 -- 172.21.15.59:0/1565040483 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0007820 con 0x7effa8154d10 2023-10-16T14:26:51.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.752+0000 7effa4ff9640 1 -- 172.21.15.59:0/1565040483 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa0007980 con 0x7effa8154d10 2023-10-16T14:26:51.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.752+0000 7effa4ff9640 1 -- 172.21.15.59:0/1565040483 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0007d70 con 0x7effa8154d10 2023-10-16T14:26:51.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.752+0000 7effad375640 1 -- 172.21.15.59:0/1565040483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa815d180 con 0x7effa8154d10 2023-10-16T14:26:51.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.752+0000 7effad375640 1 -- 172.21.15.59:0/1565040483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa815e7f0 con 0x7effa8154d10 2023-10-16T14:26:51.763 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.753+0000 7effad375640 1 -- 172.21.15.59:0/1565040483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa815d370 con 0x7effa8154d10 2023-10-16T14:26:51.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.754+0000 7effa4ff9640 1 -- 172.21.15.59:0/1565040483 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7effa00113f0 con 0x7effa8154d10 2023-10-16T14:26:51.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.755+0000 7effa4ff9640 1 --2- 172.21.15.59:0/1565040483 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7eff9406ae70 0x7eff9406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:51.764 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.755+0000 7effa4ff9640 1 -- 172.21.15.59:0/1565040483 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7effa0089c80 con 0x7effa8154d10 2023-10-16T14:26:51.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.756+0000 7effa7fff640 1 --2- 172.21.15.59:0/1565040483 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7eff9406ae70 0x7eff9406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:51.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.757+0000 7effa7fff640 1 --2- 172.21.15.59:0/1565040483 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7eff9406ae70 0x7eff9406d330 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7effa80cee90 tx=0x7eff980094d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:51.765 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.760+0000 7effa4ff9640 1 -- 172.21.15.59:0/1565040483 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7effa00549f0 con 0x7effa8154d10 2023-10-16T14:26:51.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.954+0000 7effad375640 1 -- 172.21.15.59:0/1565040483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7effa804e9b0 con 0x7effa8154d10 2023-10-16T14:26:51.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.955+0000 7effa4ff9640 1 -- 172.21.15.59:0/1565040483 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7effa0058010 con 0x7effa8154d10 2023-10-16T14:26:51.959 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:51.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.958+0000 7effad375640 1 -- 172.21.15.59:0/1565040483 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7eff9406ae70 msgr2=0x7eff9406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:51.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.958+0000 7effad375640 1 --2- 172.21.15.59:0/1565040483 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7eff9406ae70 0x7eff9406d330 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7effa80cee90 tx=0x7eff980094d0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.958+0000 7effad375640 1 -- 172.21.15.59:0/1565040483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa8154d10 msgr2=0x7effa80c57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:51.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.958+0000 7effad375640 1 --2- 172.21.15.59:0/1565040483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa8154d10 0x7effa80c57e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7effa000c7f0 tx=0x7effa000ccb0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.959+0000 7effad375640 1 -- 172.21.15.59:0/1565040483 shutdown_connections 2023-10-16T14:26:51.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.959+0000 7effad375640 1 --2- 172.21.15.59:0/1565040483 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7eff9406ae70 0x7eff9406d330 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.959+0000 7effad375640 1 --2- 172.21.15.59:0/1565040483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effa8154d10 0x7effa80c57e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.959+0000 7effad375640 1 --2- 172.21.15.59:0/1565040483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effa80cf030 0x7effa81f2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.959+0000 7effad375640 1 --2- 172.21.15.59:0/1565040483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effa806d360 0x7effa81587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:51.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.959+0000 7effad375640 1 -- 172.21.15.59:0/1565040483 >> 172.21.15.59:0/1565040483 conn(0x7effa806a200 msgr2=0x7effa80b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:51.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.959+0000 7effad375640 1 -- 172.21.15.59:0/1565040483 shutdown_connections 2023-10-16T14:26:51.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:51.959+0000 7effad375640 1 -- 172.21.15.59:0/1565040483 wait complete. 2023-10-16T14:26:51.980 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T14:26:52.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.190+0000 7fcbd10bb640 1 Processor -- start 2023-10-16T14:26:52.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.191+0000 7fcbd10bb640 1 -- start start 2023-10-16T14:26:52.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.192+0000 7fcbd10bb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbcc0ad940 0x7fcbcc06c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:52.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.192+0000 7fcbd10bb640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcbcc0cf0c0 0x7fcbcc15d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:52.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.192+0000 7fcbd10bb640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbcc159ca0 con 0x7fcbcc06cbf0 2023-10-16T14:26:52.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.192+0000 7fcbd10bb640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbcc0b34c0 con 0x7fcbcc0cf0c0 2023-10-16T14:26:52.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.192+0000 7fcbd10bb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc0b2fd0 con 0x7fcbcc0ad940 2023-10-16T14:26:52.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.192+0000 7fcbcbfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbcc0ad940 0x7fcbcc06c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:52.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.192+0000 7fcbd08ba640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcbcc0cf0c0 0x7fcbcc15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:52.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.192+0000 7fcbcbfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbcc0ad940 0x7fcbcc06c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.59:56776/0 (socket says 172.21.15.59:56776) 2023-10-16T14:26:52.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.192+0000 7fcbcbfff640 1 -- 172.21.15.59:0/1460321688 learned_addr learned my addr 172.21.15.59:0/1460321688 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:52.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.193+0000 7fcbcbfff640 1 -- 172.21.15.59:0/1460321688 >> v2:172.21.15.151:3300/0 conn(0x7fcbcc0cf0c0 msgr2=0x7fcbcc15d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:52.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.193+0000 7fcbcbfff640 1 --2- 172.21.15.59:0/1460321688 >> v2:172.21.15.151:3300/0 conn(0x7fcbcc0cf0c0 0x7fcbcc15d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:52.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.193+0000 7fcbcbfff640 1 -- 172.21.15.59:0/1460321688 >> v1:172.21.15.151:6789/0 conn(0x7fcbcc06cbf0 legacy=0x7fcbcc0ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:52.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.193+0000 7fcbcbfff640 1 -- 172.21.15.59:0/1460321688 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbcc0cac20 con 0x7fcbcc0ad940 2023-10-16T14:26:52.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.194+0000 7fcbcbfff640 1 --2- 172.21.15.59:0/1460321688 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbcc0ad940 0x7fcbcc06c6b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc009870 tx=0x7fcbbc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cac36d081d4bfcc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:52.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.195+0000 7fcbcaffd640 1 -- 172.21.15.59:0/1460321688 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc030840 con 0x7fcbcc0ad940 2023-10-16T14:26:52.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.195+0000 7fcbcaffd640 1 -- 172.21.15.59:0/1460321688 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbbc0309a0 con 0x7fcbcc0ad940 2023-10-16T14:26:52.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.195+0000 7fcbcaffd640 1 -- 172.21.15.59:0/1460321688 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc030d30 con 0x7fcbcc0ad940 2023-10-16T14:26:52.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.195+0000 7fcbd10bb640 1 -- 172.21.15.59:0/1460321688 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbcc0ad940 msgr2=0x7fcbcc06c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:52.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.195+0000 7fcbd10bb640 1 --2- 172.21.15.59:0/1460321688 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbcc0ad940 0x7fcbcc06c6b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc009870 tx=0x7fcbbc02b980 comp rx=0 tx=0).stop 2023-10-16T14:26:52.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.196+0000 7fcbd10bb640 1 -- 172.21.15.59:0/1460321688 shutdown_connections 2023-10-16T14:26:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.196+0000 7fcbd10bb640 1 --2- 172.21.15.59:0/1460321688 >> v2:172.21.15.151:3300/0 conn(0x7fcbcc0cf0c0 0x7fcbcc15d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.196+0000 7fcbd10bb640 1 --2- 172.21.15.59:0/1460321688 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbcc0ad940 0x7fcbcc06c6b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.196+0000 7fcbd10bb640 1 -- 172.21.15.59:0/1460321688 >> 172.21.15.59:0/1460321688 conn(0x7fcbcc06a200 msgr2=0x7fcbcc06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.196+0000 7fcbd10bb640 1 -- 172.21.15.59:0/1460321688 shutdown_connections 2023-10-16T14:26:52.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.196+0000 7fcbd10bb640 1 -- 172.21.15.59:0/1460321688 wait complete. 2023-10-16T14:26:52.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.197+0000 7fcbd10bb640 1 Processor -- start 2023-10-16T14:26:52.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.198+0000 7fcbd10bb640 1 -- start start 2023-10-16T14:26:52.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.198+0000 7fcbd10bb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbcc0ad940 0x7fcbcc0c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:52.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.199+0000 7fcbd10bb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbcc0cf0c0 0x7fcbcc0978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:52.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.199+0000 7fcbd10bb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbcc0c55d0 0x7fcbcc15c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:52.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.199+0000 7fcbd10bb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc0afb30 con 0x7fcbcc0cf0c0 2023-10-16T14:26:52.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.199+0000 7fcbd10bb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc0c4f50 con 0x7fcbcc0ad940 2023-10-16T14:26:52.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.199+0000 7fcbd10bb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc0af190 con 0x7fcbcc0c55d0 2023-10-16T14:26:52.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.199+0000 7fcbcb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbcc0cf0c0 0x7fcbcc0978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:52.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.199+0000 7fcbcb7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbcc0cf0c0 0x7fcbcc0978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34408/0 (socket says 172.21.15.59:34408) 2023-10-16T14:26:52.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.199+0000 7fcbcb7fe640 1 -- 172.21.15.59:0/2749632769 learned_addr learned my addr 172.21.15.59:0/2749632769 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:52.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.199+0000 7fcbcbfff640 1 --2- 172.21.15.59:0/2749632769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbcc0ad940 0x7fcbcc0c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:52.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.199+0000 7fcbd08ba640 1 --2- 172.21.15.59:0/2749632769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbcc0c55d0 0x7fcbcc15c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:52.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.200+0000 7fcbcb7fe640 1 -- 172.21.15.59:0/2749632769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbcc0c55d0 msgr2=0x7fcbcc15c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:52.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.200+0000 7fcbcb7fe640 1 --2- 172.21.15.59:0/2749632769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbcc0c55d0 0x7fcbcc15c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:52.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.200+0000 7fcbcb7fe640 1 -- 172.21.15.59:0/2749632769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbcc0ad940 msgr2=0x7fcbcc0c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:52.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.200+0000 7fcbcb7fe640 1 --2- 172.21.15.59:0/2749632769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbcc0ad940 0x7fcbcc0c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:52.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.200+0000 7fcbcb7fe640 1 -- 172.21.15.59:0/2749632769 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbbc0094d0 con 0x7fcbcc0cf0c0 2023-10-16T14:26:52.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.200+0000 7fcbd08ba640 1 --2- 172.21.15.59:0/2749632769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbcc0c55d0 0x7fcbcc15c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:26:52.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.200+0000 7fcbcb7fe640 1 --2- 172.21.15.59:0/2749632769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbcc0cf0c0 0x7fcbcc0978a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000c870 tx=0x7fcbc000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:52.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.200+0000 7fcbc8ff9640 1 -- 172.21.15.59:0/2749632769 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0003b70 con 0x7fcbcc0cf0c0 2023-10-16T14:26:52.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.200+0000 7fcbc8ff9640 1 -- 172.21.15.59:0/2749632769 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc0003cf0 con 0x7fcbcc0cf0c0 2023-10-16T14:26:52.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.200+0000 7fcbc8ff9640 1 -- 172.21.15.59:0/2749632769 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc000aa90 con 0x7fcbcc0cf0c0 2023-10-16T14:26:52.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.200+0000 7fcbd10bb640 1 -- 172.21.15.59:0/2749632769 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbcc0af470 con 0x7fcbcc0cf0c0 2023-10-16T14:26:52.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.201+0000 7fcbd10bb640 1 -- 172.21.15.59:0/2749632769 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbcc097de0 con 0x7fcbcc0cf0c0 2023-10-16T14:26:52.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.202+0000 7fcbd10bb640 1 -- 172.21.15.59:0/2749632769 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbcc0afc70 con 0x7fcbcc0cf0c0 2023-10-16T14:26:52.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.203+0000 7fcbc8ff9640 1 -- 172.21.15.59:0/2749632769 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcbc000abf0 con 0x7fcbcc0cf0c0 2023-10-16T14:26:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.204+0000 7fcbc8ff9640 1 --2- 172.21.15.59:0/2749632769 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fcbb806ae70 0x7fcbb806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.204+0000 7fcbc8ff9640 1 -- 172.21.15.59:0/2749632769 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fcbc0089750 con 0x7fcbcc0cf0c0 2023-10-16T14:26:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.204+0000 7fcbcbfff640 1 --2- 172.21.15.59:0/2749632769 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fcbb806ae70 0x7fcbb806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:52.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.205+0000 7fcbcbfff640 1 --2- 172.21.15.59:0/2749632769 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fcbb806ae70 0x7fcbb806d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc036000 tx=0x7fcbbc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:52.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.208+0000 7fcbc8ff9640 1 -- 172.21.15.59:0/2749632769 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcbcc0afc70 con 0x7fcbcc0cf0c0 2023-10-16T14:26:52.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.405+0000 7fcbd10bb640 1 -- 172.21.15.59:0/2749632769 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcbcc0afc70 con 0x7fcbcc0cf0c0 2023-10-16T14:26:52.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.406+0000 7fcbc8ff9640 1 -- 172.21.15.59:0/2749632769 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcbcc0afc70 con 0x7fcbcc0cf0c0 2023-10-16T14:26:52.408 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-16T14:26:52.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.409+0000 7fcbd10bb640 1 -- 172.21.15.59:0/2749632769 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fcbb806ae70 msgr2=0x7fcbb806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:52.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.409+0000 7fcbd10bb640 1 --2- 172.21.15.59:0/2749632769 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fcbb806ae70 0x7fcbb806d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc036000 tx=0x7fcbbc008030 comp rx=0 tx=0).stop 2023-10-16T14:26:52.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.409+0000 7fcbd10bb640 1 -- 172.21.15.59:0/2749632769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbcc0cf0c0 msgr2=0x7fcbcc0978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:52.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.409+0000 7fcbd10bb640 1 --2- 172.21.15.59:0/2749632769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbcc0cf0c0 0x7fcbcc0978a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000c870 tx=0x7fcbc000cd30 comp rx=0 tx=0).stop 2023-10-16T14:26:52.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.409+0000 7fcbd10bb640 1 -- 172.21.15.59:0/2749632769 shutdown_connections 2023-10-16T14:26:52.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.409+0000 7fcbd10bb640 1 --2- 172.21.15.59:0/2749632769 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fcbb806ae70 0x7fcbb806d330 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:52.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.409+0000 7fcbd10bb640 1 --2- 172.21.15.59:0/2749632769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbcc0c55d0 0x7fcbcc15c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:52.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.409+0000 7fcbd10bb640 1 --2- 172.21.15.59:0/2749632769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbcc0cf0c0 0x7fcbcc0978a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:52.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.409+0000 7fcbd10bb640 1 --2- 172.21.15.59:0/2749632769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbcc0ad940 0x7fcbcc0c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:52.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.409+0000 7fcbd10bb640 1 -- 172.21.15.59:0/2749632769 >> 172.21.15.59:0/2749632769 conn(0x7fcbcc06a200 msgr2=0x7fcbcc0c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:52.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.409+0000 7fcbd10bb640 1 -- 172.21.15.59:0/2749632769 shutdown_connections 2023-10-16T14:26:52.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.409+0000 7fcbd10bb640 1 -- 172.21.15.59:0/2749632769 wait complete. 2023-10-16T14:26:52.431 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T14:26:52.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.658+0000 7feff89c5640 1 Processor -- start 2023-10-16T14:26:52.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.658+0000 7feff89c5640 1 -- start start 2023-10-16T14:26:52.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.659+0000 7feff89c5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feff415cbf0 0x7feff40d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:52.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.659+0000 7feff89c5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7feff40b8400 0x7feff40d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:52.662 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.659+0000 7feff89c5640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff415cfd0 con 0x7feff40b4410 2023-10-16T14:26:52.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.659+0000 7feff89c5640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff40d0dc0 con 0x7feff40b8400 2023-10-16T14:26:52.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.659+0000 7feff89c5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff40d30b0 con 0x7feff415cbf0 2023-10-16T14:26:52.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.660+0000 7feff2d9d640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7feff40b4410 0x7feff40b5ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38664/0 (socket says 172.21.15.59:38664) 2023-10-16T14:26:52.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.660+0000 7feff2d9d640 1 -- 172.21.15.59:0/518700560 learned_addr learned my addr 172.21.15.59:0/518700560 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:52.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.660+0000 7feff1d9b640 1 --2- 172.21.15.59:0/518700560 >> v2:172.21.15.151:3300/0 conn(0x7feff40b8400 0x7feff40d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:52.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.660+0000 7feff159a640 1 -- 172.21.15.59:0/518700560 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481603845 0 0) 0x7feff415cfd0 con 0x7feff40b4410 2023-10-16T14:26:52.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.660+0000 7feff159a640 1 -- 172.21.15.59:0/518700560 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefe0003520 con 0x7feff40b4410 2023-10-16T14:26:52.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.660+0000 7feff259c640 1 --2- 172.21.15.59:0/518700560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feff415cbf0 0x7feff40d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:52.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.661+0000 7feff159a640 1 -- 172.21.15.59:0/518700560 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2591497908 0 0) 0x7fefe0003520 con 0x7feff40b4410 2023-10-16T14:26:52.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.661+0000 7feff159a640 1 -- 172.21.15.59:0/518700560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feff415cbf0 msgr2=0x7feff40d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:52.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.661+0000 7feff159a640 1 --2- 172.21.15.59:0/518700560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feff415cbf0 0x7feff40d29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:52.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.661+0000 7feff159a640 1 -- 172.21.15.59:0/518700560 >> v2:172.21.15.151:3300/0 conn(0x7feff40b8400 msgr2=0x7feff40d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:52.667 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.661+0000 7feff159a640 1 --2- 172.21.15.59:0/518700560 >> v2:172.21.15.151:3300/0 conn(0x7feff40b8400 0x7feff40d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:52.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.661+0000 7feff159a640 1 -- 172.21.15.59:0/518700560 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff40d0700 con 0x7feff40b4410 2023-10-16T14:26:52.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.661+0000 7feff159a640 1 -- 172.21.15.59:0/518700560 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7fefec001670 con 0x7feff40b4410 2023-10-16T14:26:52.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.661+0000 7feff159a640 1 -- 172.21.15.59:0/518700560 >> v1:172.21.15.59:6789/0 conn(0x7feff40b4410 legacy=0x7feff40b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:52.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.661+0000 7feff159a640 1 --2- 172.21.15.59:0/518700560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefe0003970 0x7fefe0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:52.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.661+0000 7feff159a640 1 --2- 172.21.15.59:0/518700560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe00047c0 0x7fefe0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:52.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.661+0000 7feff159a640 1 --2- 172.21.15.59:0/518700560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feff415cbf0 0x7fefe0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:52.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.661+0000 7feff159a640 1 -- 172.21.15.59:0/518700560 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff40d0dc0 con 0x7fefe00047c0 2023-10-16T14:26:52.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.661+0000 7feff159a640 1 -- 172.21.15.59:0/518700560 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff40d30b0 con 0x7fefe0003970 2023-10-16T14:26:52.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.661+0000 7feff159a640 1 -- 172.21.15.59:0/518700560 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe000b980 con 0x7feff415cbf0 2023-10-16T14:26:52.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.661+0000 7feff1d9b640 1 --2- 172.21.15.59:0/518700560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe00047c0 0x7fefe0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:52.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.662+0000 7feff1d9b640 1 -- 172.21.15.59:0/518700560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feff415cbf0 msgr2=0x7fefe0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:52.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.662+0000 7feff1d9b640 1 --2- 172.21.15.59:0/518700560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feff415cbf0 0x7fefe0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:52.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.662+0000 7feff1d9b640 1 -- 172.21.15.59:0/518700560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefe0003970 msgr2=0x7fefe0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:52.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.662+0000 7feff1d9b640 1 --2- 172.21.15.59:0/518700560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefe0003970 0x7fefe0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:52.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.662+0000 7feff1d9b640 1 -- 172.21.15.59:0/518700560 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe0003520 con 0x7fefe00047c0 2023-10-16T14:26:52.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.663+0000 7feff1d9b640 1 --2- 172.21.15.59:0/518700560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe00047c0 0x7fefe0004c40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009ac0 tx=0x7fefe00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac846dcb22795bd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:52.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.663+0000 7feff159a640 1 -- 172.21.15.59:0/518700560 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc02c710 con 0x7fefe00047c0 2023-10-16T14:26:52.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.663+0000 7feff159a640 1 -- 172.21.15.59:0/518700560 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefdc02c870 con 0x7fefe00047c0 2023-10-16T14:26:52.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.663+0000 7feff159a640 1 -- 172.21.15.59:0/518700560 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc02cc00 con 0x7fefe00047c0 2023-10-16T14:26:52.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.664+0000 7feff89c5640 1 -- 172.21.15.59:0/518700560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe00047c0 msgr2=0x7fefe0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:52.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.664+0000 7feff89c5640 1 --2- 172.21.15.59:0/518700560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe00047c0 0x7fefe0004c40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009ac0 tx=0x7fefe00057f0 comp rx=0 tx=0).stop 2023-10-16T14:26:52.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.664+0000 7feff2d9d640 1 -- 172.21.15.59:0/518700560 reap_dead start 2023-10-16T14:26:52.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.664+0000 7feff89c5640 1 -- 172.21.15.59:0/518700560 shutdown_connections 2023-10-16T14:26:52.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.664+0000 7feff89c5640 1 -- 172.21.15.59:0/518700560 >> 172.21.15.59:0/518700560 conn(0x7feff4071900 msgr2=0x7feff4071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:52.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.664+0000 7feff89c5640 1 -- 172.21.15.59:0/518700560 shutdown_connections 2023-10-16T14:26:52.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.664+0000 7feff89c5640 1 -- 172.21.15.59:0/518700560 wait complete. 2023-10-16T14:26:52.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.666+0000 7feff89c5640 1 Processor -- start 2023-10-16T14:26:52.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.666+0000 7feff89c5640 1 -- start start 2023-10-16T14:26:52.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.667+0000 7feff89c5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefe00047c0 0x7feff4150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:52.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.667+0000 7feff89c5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feff41514e0 0x7feff415d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.667+0000 7feff89c5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feff40ccf50 0x7feff40cd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.667+0000 7feff89c5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff40cd940 con 0x7feff41514e0 2023-10-16T14:26:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.667+0000 7feff89c5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff40c65f0 con 0x7fefe00047c0 2023-10-16T14:26:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.667+0000 7feff89c5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff41511b0 con 0x7feff40ccf50 2023-10-16T14:26:52.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.667+0000 7feff1d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feff41514e0 0x7feff415d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:52.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.667+0000 7feff1d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feff41514e0 0x7feff415d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34426/0 (socket says 172.21.15.59:34426) 2023-10-16T14:26:52.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.667+0000 7feff1d9b640 1 -- 172.21.15.59:0/2063938513 learned_addr learned my addr 172.21.15.59:0/2063938513 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:52.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.667+0000 7feff2d9d640 1 --2- 172.21.15.59:0/2063938513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feff40ccf50 0x7feff40cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:52.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.667+0000 7feff259c640 1 --2- 172.21.15.59:0/2063938513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefe00047c0 0x7feff4150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:52.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.668+0000 7feff1d9b640 1 -- 172.21.15.59:0/2063938513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feff40ccf50 msgr2=0x7feff40cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:52.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.668+0000 7feff1d9b640 1 --2- 172.21.15.59:0/2063938513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feff40ccf50 0x7feff40cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:52.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.668+0000 7feff1d9b640 1 -- 172.21.15.59:0/2063938513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefe00047c0 msgr2=0x7feff4150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:52.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.668+0000 7feff1d9b640 1 --2- 172.21.15.59:0/2063938513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefe00047c0 0x7feff4150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:52.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.668+0000 7feff1d9b640 1 -- 172.21.15.59:0/2063938513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff40c6890 con 0x7feff41514e0 2023-10-16T14:26:52.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.668+0000 7feff2d9d640 1 --2- 172.21.15.59:0/2063938513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feff40ccf50 0x7feff40cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.668+0000 7feff259c640 1 --2- 172.21.15.59:0/2063938513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefe00047c0 0x7feff4150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.668+0000 7feff1d9b640 1 --2- 172.21.15.59:0/2063938513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feff41514e0 0x7feff415d4a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fefdc02c2b0 tx=0x7fefdc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.668+0000 7fefeaffd640 1 -- 172.21.15.59:0/2063938513 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc003810 con 0x7feff41514e0 2023-10-16T14:26:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.668+0000 7fefeaffd640 1 -- 172.21.15.59:0/2063938513 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefdc02de90 con 0x7feff41514e0 2023-10-16T14:26:52.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.668+0000 7fefeaffd640 1 -- 172.21.15.59:0/2063938513 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc003b70 con 0x7feff41514e0 2023-10-16T14:26:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.668+0000 7feff89c5640 1 -- 172.21.15.59:0/2063938513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff415e8e0 con 0x7feff41514e0 2023-10-16T14:26:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.668+0000 7feff89c5640 1 -- 172.21.15.59:0/2063938513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff40c6b70 con 0x7feff41514e0 2023-10-16T14:26:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.670+0000 7feff89c5640 1 -- 172.21.15.59:0/2063938513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff4073ef0 con 0x7feff41514e0 2023-10-16T14:26:52.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.671+0000 7fefeaffd640 1 -- 172.21.15.59:0/2063938513 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fefdc003cd0 con 0x7feff41514e0 2023-10-16T14:26:52.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.672+0000 7fefeaffd640 1 --2- 172.21.15.59:0/2063938513 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fefd406aea0 0x7fefd406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:52.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.672+0000 7fefeaffd640 1 -- 172.21.15.59:0/2063938513 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fefdc0abaa0 con 0x7feff41514e0 2023-10-16T14:26:52.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.673+0000 7feff259c640 1 --2- 172.21.15.59:0/2063938513 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fefd406aea0 0x7fefd406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:52.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.674+0000 7feff259c640 1 --2- 172.21.15.59:0/2063938513 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fefd406aea0 0x7fefd406d360 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fefe4007340 tx=0x7fefe400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:52.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.677+0000 7fefeaffd640 1 -- 172.21.15.59:0/2063938513 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fefdc076930 con 0x7feff41514e0 2023-10-16T14:26:52.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.877+0000 7feff89c5640 1 -- 172.21.15.59:0/2063938513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7feff415b200 con 0x7feff41514e0 2023-10-16T14:26:52.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.878+0000 7fefeaffd640 1 -- 172.21.15.59:0/2063938513 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fefdc079f50 con 0x7feff41514e0 2023-10-16T14:26:52.881 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:52.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.880+0000 7feff89c5640 1 -- 172.21.15.59:0/2063938513 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fefd406aea0 msgr2=0x7fefd406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:52.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.880+0000 7feff89c5640 1 --2- 172.21.15.59:0/2063938513 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fefd406aea0 0x7fefd406d360 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fefe4007340 tx=0x7fefe400b040 comp rx=0 tx=0).stop 2023-10-16T14:26:52.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.880+0000 7feff89c5640 1 -- 172.21.15.59:0/2063938513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feff41514e0 msgr2=0x7feff415d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:52.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.880+0000 7feff89c5640 1 --2- 172.21.15.59:0/2063938513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feff41514e0 0x7feff415d4a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fefdc02c2b0 tx=0x7fefdc004730 comp rx=0 tx=0).stop 2023-10-16T14:26:52.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.880+0000 7feff89c5640 1 -- 172.21.15.59:0/2063938513 shutdown_connections 2023-10-16T14:26:52.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.880+0000 7feff89c5640 1 --2- 172.21.15.59:0/2063938513 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fefd406aea0 0x7fefd406d360 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:52.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.880+0000 7feff89c5640 1 --2- 172.21.15.59:0/2063938513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feff40ccf50 0x7feff40cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:52.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.880+0000 7feff89c5640 1 --2- 172.21.15.59:0/2063938513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feff41514e0 0x7feff415d4a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:52.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.880+0000 7feff89c5640 1 --2- 172.21.15.59:0/2063938513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefe00047c0 0x7feff4150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:52.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.880+0000 7feff89c5640 1 -- 172.21.15.59:0/2063938513 >> 172.21.15.59:0/2063938513 conn(0x7feff4071900 msgr2=0x7feff4071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:52.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.880+0000 7feff89c5640 1 -- 172.21.15.59:0/2063938513 shutdown_connections 2023-10-16T14:26:52.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:52.880+0000 7feff89c5640 1 -- 172.21.15.59:0/2063938513 wait complete. 2023-10-16T14:26:52.904 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T14:26:53.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.133+0000 7f18791b6640 1 Processor -- start 2023-10-16T14:26:53.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.133+0000 7f18791b6640 1 -- start start 2023-10-16T14:26:53.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.135+0000 7f18791b6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f187415aa60 0x7f18740c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:53.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.135+0000 7f18791b6640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187415ae40 con 0x7f18740b08c0 2023-10-16T14:26:53.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.135+0000 7f18791b6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187406cbc0 con 0x7f187406c760 2023-10-16T14:26:53.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.135+0000 7f18791b6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18740b1580 con 0x7f187415aa60 2023-10-16T14:26:53.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.136+0000 7f187359e640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f18740b08c0 0x7f18740b1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38678/0 (socket says 172.21.15.59:38678) 2023-10-16T14:26:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.136+0000 7f187359e640 1 -- 172.21.15.59:0/4253224197 learned_addr learned my addr 172.21.15.59:0/4253224197 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.136+0000 7f1872d9d640 1 --2- 172.21.15.59:0/4253224197 >> v2:172.21.15.151:3300/0 conn(0x7f187415aa60 0x7f18740c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.136+0000 7f187259c640 1 -- 172.21.15.59:0/4253224197 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277877880 0 0) 0x7f187415ae40 con 0x7f18740b08c0 2023-10-16T14:26:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.136+0000 7f187259c640 1 -- 172.21.15.59:0/4253224197 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1860003520 con 0x7f18740b08c0 2023-10-16T14:26:53.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.137+0000 7f187259c640 1 -- 172.21.15.59:0/4253224197 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1369882366 0 0) 0x7f1860003520 con 0x7f18740b08c0 2023-10-16T14:26:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.137+0000 7f187259c640 1 -- 172.21.15.59:0/4253224197 >> v2:172.21.15.151:3300/0 conn(0x7f187415aa60 msgr2=0x7f18740c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.137+0000 7f187259c640 1 --2- 172.21.15.59:0/4253224197 >> v2:172.21.15.151:3300/0 conn(0x7f187415aa60 0x7f18740c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.137+0000 7f187259c640 1 -- 172.21.15.59:0/4253224197 >> v1:172.21.15.151:6789/0 conn(0x7f187406c760 legacy=0x7f18740b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.137+0000 7f187259c640 1 -- 172.21.15.59:0/4253224197 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18740c98f0 con 0x7f18740b08c0 2023-10-16T14:26:53.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.137+0000 7f187259c640 1 -- 172.21.15.59:0/4253224197 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f186c0019f0 con 0x7f18740b08c0 2023-10-16T14:26:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.137+0000 7f187259c640 1 -- 172.21.15.59:0/4253224197 >> v1:172.21.15.59:6789/0 conn(0x7f18740b08c0 legacy=0x7f18740b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.137+0000 7f187259c640 1 --2- 172.21.15.59:0/4253224197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18600039c0 0x7f1860003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.137+0000 7f187259c640 1 --2- 172.21.15.59:0/4253224197 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18600047c0 0x7f1860004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.137+0000 7f187259c640 1 --2- 172.21.15.59:0/4253224197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18600051d0 0x7f186000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:53.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.137+0000 7f187259c640 1 -- 172.21.15.59:0/4253224197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18740b1580 con 0x7f18600051d0 2023-10-16T14:26:53.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.137+0000 7f187259c640 1 -- 172.21.15.59:0/4253224197 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186000c120 con 0x7f18600039c0 2023-10-16T14:26:53.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.137+0000 7f187259c640 1 -- 172.21.15.59:0/4253224197 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186000c2e0 con 0x7f18600047c0 2023-10-16T14:26:53.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.137+0000 7f187359e640 1 --2- 172.21.15.59:0/4253224197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18600051d0 0x7f186000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:53.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.138+0000 7f186a59c640 1 --2- 172.21.15.59:0/4253224197 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18600047c0 0x7f1860004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:53.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.138+0000 7f1872d9d640 1 --2- 172.21.15.59:0/4253224197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18600039c0 0x7f1860003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:53.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.138+0000 7f187359e640 1 -- 172.21.15.59:0/4253224197 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18600047c0 msgr2=0x7f1860004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:53.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.138+0000 7f187359e640 1 --2- 172.21.15.59:0/4253224197 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18600047c0 0x7f1860004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.138+0000 7f187359e640 1 -- 172.21.15.59:0/4253224197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18600039c0 msgr2=0x7f1860003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:53.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.138+0000 7f187359e640 1 --2- 172.21.15.59:0/4253224197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18600039c0 0x7f1860003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.138+0000 7f187359e640 1 -- 172.21.15.59:0/4253224197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1860003520 con 0x7f18600051d0 2023-10-16T14:26:53.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.138+0000 7f1872d9d640 1 --2- 172.21.15.59:0/4253224197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18600039c0 0x7f1860003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:53.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.139+0000 7f187359e640 1 -- 172.21.15.59:0/4253224197 reap_dead start 2023-10-16T14:26:53.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.139+0000 7f187359e640 1 --2- 172.21.15.59:0/4253224197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18600051d0 0x7f186000b980 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f18740ae160 tx=0x7f18600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2aeb3dc4cbdb37 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:53.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.139+0000 7f187259c640 1 -- 172.21.15.59:0/4253224197 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c034630 con 0x7f18600051d0 2023-10-16T14:26:53.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.139+0000 7f187259c640 1 -- 172.21.15.59:0/4253224197 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c02f070 con 0x7f18600051d0 2023-10-16T14:26:53.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.139+0000 7f187259c640 1 -- 172.21.15.59:0/4253224197 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c0349d0 con 0x7f18600051d0 2023-10-16T14:26:53.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.140+0000 7f18791b6640 1 -- 172.21.15.59:0/4253224197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18600051d0 msgr2=0x7f186000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:53.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.140+0000 7f18791b6640 1 --2- 172.21.15.59:0/4253224197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18600051d0 0x7f186000b980 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f18740ae160 tx=0x7f18600057f0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.140+0000 7f18791b6640 1 -- 172.21.15.59:0/4253224197 shutdown_connections 2023-10-16T14:26:53.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.140+0000 7f18791b6640 1 --2- 172.21.15.59:0/4253224197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18600051d0 0x7f186000b980 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.140+0000 7f18791b6640 1 -- 172.21.15.59:0/4253224197 >> 172.21.15.59:0/4253224197 conn(0x7f18740cb1b0 msgr2=0x7f18740cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:53.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.140+0000 7f18791b6640 1 -- 172.21.15.59:0/4253224197 shutdown_connections 2023-10-16T14:26:53.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.140+0000 7f18791b6640 1 -- 172.21.15.59:0/4253224197 wait complete. 2023-10-16T14:26:53.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.142+0000 7f18791b6640 1 Processor -- start 2023-10-16T14:26:53.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.142+0000 7f18791b6640 1 -- start start 2023-10-16T14:26:53.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.143+0000 7f18791b6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18600051d0 0x7f18740c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:53.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.143+0000 7f18791b6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18740c2260 0x7f18740acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:53.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.143+0000 7f18791b6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f187415c770 0x7f187415cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:53.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.143+0000 7f18791b6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187415e040 con 0x7f187415c770 2023-10-16T14:26:53.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.143+0000 7f18791b6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18740c7fd0 con 0x7f18740c2260 2023-10-16T14:26:53.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.143+0000 7f18791b6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18740c8200 con 0x7f18600051d0 2023-10-16T14:26:53.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.143+0000 7f187359e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f187415c770 0x7f187415cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:53.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.143+0000 7f187359e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f187415c770 0x7f187415cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34446/0 (socket says 172.21.15.59:34446) 2023-10-16T14:26:53.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.143+0000 7f187359e640 1 -- 172.21.15.59:0/3071412570 learned_addr learned my addr 172.21.15.59:0/3071412570 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:53.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.143+0000 7f1872d9d640 1 --2- 172.21.15.59:0/3071412570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18600051d0 0x7f18740c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:53.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.144+0000 7f186a59c640 1 --2- 172.21.15.59:0/3071412570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18740c2260 0x7f18740acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:53.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.144+0000 7f187359e640 1 -- 172.21.15.59:0/3071412570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18600051d0 msgr2=0x7f18740c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:53.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.144+0000 7f187359e640 1 --2- 172.21.15.59:0/3071412570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18600051d0 0x7f18740c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.144+0000 7f187359e640 1 -- 172.21.15.59:0/3071412570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18740c2260 msgr2=0x7f18740acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:53.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.144+0000 7f187359e640 1 --2- 172.21.15.59:0/3071412570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18740c2260 0x7f18740acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.144+0000 7f187359e640 1 -- 172.21.15.59:0/3071412570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18740c84e0 con 0x7f187415c770 2023-10-16T14:26:53.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.144+0000 7f187359e640 1 --2- 172.21.15.59:0/3071412570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f187415c770 0x7f187415cbf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f186c02cae0 tx=0x7f187406cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:53.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.144+0000 7f186bfff640 1 -- 172.21.15.59:0/3071412570 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c004d60 con 0x7f187415c770 2023-10-16T14:26:53.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.144+0000 7f186bfff640 1 -- 172.21.15.59:0/3071412570 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c03f470 con 0x7f187415c770 2023-10-16T14:26:53.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.144+0000 7f186bfff640 1 -- 172.21.15.59:0/3071412570 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c03f7e0 con 0x7f187415c770 2023-10-16T14:26:53.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.144+0000 7f18791b6640 1 -- 172.21.15.59:0/3071412570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187415bf70 con 0x7f187415c770 2023-10-16T14:26:53.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.145+0000 7f18791b6640 1 -- 172.21.15.59:0/3071412570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f187415bc20 con 0x7f187415c770 2023-10-16T14:26:53.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.146+0000 7f18791b6640 1 -- 172.21.15.59:0/3071412570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f187415bde0 con 0x7f187415c770 2023-10-16T14:26:53.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.147+0000 7f186bfff640 1 -- 172.21.15.59:0/3071412570 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f186c031030 con 0x7f187415c770 2023-10-16T14:26:53.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.148+0000 7f186bfff640 1 --2- 172.21.15.59:0/3071412570 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f185406aea0 0x7f185406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:53.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.148+0000 7f186bfff640 1 -- 172.21.15.59:0/3071412570 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f186c0aafe0 con 0x7f187415c770 2023-10-16T14:26:53.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.148+0000 7f1872d9d640 1 --2- 172.21.15.59:0/3071412570 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f185406aea0 0x7f185406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:53.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.150+0000 7f1872d9d640 1 --2- 172.21.15.59:0/3071412570 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f185406aea0 0x7f185406d360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f18741f57b0 tx=0x7f1864008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:53.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.152+0000 7f186bfff640 1 -- 172.21.15.59:0/3071412570 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f186c075db0 con 0x7f187415c770 2023-10-16T14:26:53.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.358+0000 7f18791b6640 1 -- 172.21.15.59:0/3071412570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f18740cafb0 con 0x7f187415c770 2023-10-16T14:26:53.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.359+0000 7f186bfff640 1 -- 172.21.15.59:0/3071412570 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f186c044080 con 0x7f187415c770 2023-10-16T14:26:53.361 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2023-10-16T14:26:53.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.361+0000 7f18791b6640 1 -- 172.21.15.59:0/3071412570 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f185406aea0 msgr2=0x7f185406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:53.364 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.361+0000 7f18791b6640 1 --2- 172.21.15.59:0/3071412570 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f185406aea0 0x7f185406d360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f18741f57b0 tx=0x7f1864008040 comp rx=0 tx=0).stop 2023-10-16T14:26:53.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.361+0000 7f18791b6640 1 -- 172.21.15.59:0/3071412570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f187415c770 msgr2=0x7f187415cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:53.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.361+0000 7f18791b6640 1 --2- 172.21.15.59:0/3071412570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f187415c770 0x7f187415cbf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f186c02cae0 tx=0x7f187406cd50 comp rx=0 tx=0).stop 2023-10-16T14:26:53.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.362+0000 7f18791b6640 1 -- 172.21.15.59:0/3071412570 shutdown_connections 2023-10-16T14:26:53.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.362+0000 7f18791b6640 1 --2- 172.21.15.59:0/3071412570 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f185406aea0 0x7f185406d360 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.362+0000 7f18791b6640 1 --2- 172.21.15.59:0/3071412570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f187415c770 0x7f187415cbf0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.362+0000 7f18791b6640 1 --2- 172.21.15.59:0/3071412570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18740c2260 0x7f18740acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.362+0000 7f18791b6640 1 --2- 172.21.15.59:0/3071412570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18600051d0 0x7f18740c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.362+0000 7f18791b6640 1 -- 172.21.15.59:0/3071412570 >> 172.21.15.59:0/3071412570 conn(0x7f18740cb1b0 msgr2=0x7f18740cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:53.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.362+0000 7f18791b6640 1 -- 172.21.15.59:0/3071412570 shutdown_connections 2023-10-16T14:26:53.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.362+0000 7f18791b6640 1 -- 172.21.15.59:0/3071412570 wait complete. 2023-10-16T14:26:53.382 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:26:53.382 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T14:26:53.436 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:26:53.663 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.660+0000 7f47ef483640 1 Processor -- start 2023-10-16T14:26:53.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.661+0000 7f47ef483640 1 -- start start 2023-10-16T14:26:53.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.662+0000 7f47ef483640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f47e80ca660 0x7f47e80c9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:53.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.662+0000 7f47ef483640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e815acb0 con 0x7f47e815a8d0 2023-10-16T14:26:53.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.662+0000 7f47ef483640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e80c1c60 con 0x7f47e80cb250 2023-10-16T14:26:53.665 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.662+0000 7f47ef483640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e815e350 con 0x7f47e80ca660 2023-10-16T14:26:53.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.663+0000 7f47ee481640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f47e815a8d0 0x7f47e80cab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38688/0 (socket says 172.21.15.59:38688) 2023-10-16T14:26:53.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.663+0000 7f47ee481640 1 -- 172.21.15.59:0/3689582095 learned_addr learned my addr 172.21.15.59:0/3689582095 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:53.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.663+0000 7f47eec82640 1 --2- 172.21.15.59:0/3689582095 >> v2:172.21.15.151:3300/0 conn(0x7f47e80ca660 0x7f47e80c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:53.668 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.663+0000 7f47ed47f640 1 -- 172.21.15.59:0/3689582095 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139886412 0 0) 0x7f47e4001290 con 0x7f47e815a8d0 2023-10-16T14:26:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.663+0000 7f47ed47f640 1 -- 172.21.15.59:0/3689582095 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47d4003520 con 0x7f47e815a8d0 2023-10-16T14:26:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.664+0000 7f47ed47f640 1 -- 172.21.15.59:0/3689582095 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3856012676 0 0) 0x7f47d4003520 con 0x7f47e815a8d0 2023-10-16T14:26:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.664+0000 7f47ed47f640 1 -- 172.21.15.59:0/3689582095 >> v2:172.21.15.151:3300/0 conn(0x7f47e80ca660 msgr2=0x7f47e80c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.664+0000 7f47ed47f640 1 --2- 172.21.15.59:0/3689582095 >> v2:172.21.15.151:3300/0 conn(0x7f47e80ca660 0x7f47e80c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.664+0000 7f47ed47f640 1 -- 172.21.15.59:0/3689582095 >> v1:172.21.15.151:6789/0 conn(0x7f47e80cb250 legacy=0x7f47e80c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.664+0000 7f47ed47f640 1 -- 172.21.15.59:0/3689582095 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e815e630 con 0x7f47e815a8d0 2023-10-16T14:26:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.664+0000 7f47ed47f640 1 -- 172.21.15.59:0/3689582095 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f47e4001980 con 0x7f47e815a8d0 2023-10-16T14:26:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.664+0000 7f47ed47f640 1 -- 172.21.15.59:0/3689582095 >> v1:172.21.15.59:6789/0 conn(0x7f47e815a8d0 legacy=0x7f47e80cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:53.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.664+0000 7f47ed47f640 1 --2- 172.21.15.59:0/3689582095 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47d40039c0 0x7f47d4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.664+0000 7f47ed47f640 1 --2- 172.21.15.59:0/3689582095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d40047c0 0x7f47d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.664+0000 7f47ed47f640 1 --2- 172.21.15.59:0/3689582095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47d4005180 0x7f47d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.664+0000 7f47ed47f640 1 -- 172.21.15.59:0/3689582095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e815e350 con 0x7f47d40047c0 2023-10-16T14:26:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.664+0000 7f47ed47f640 1 -- 172.21.15.59:0/3689582095 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d400c0b0 con 0x7f47d4005180 2023-10-16T14:26:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.664+0000 7f47ed47f640 1 -- 172.21.15.59:0/3689582095 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d400c270 con 0x7f47d40039c0 2023-10-16T14:26:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.664+0000 7f47edc80640 1 --2- 172.21.15.59:0/3689582095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d40047c0 0x7f47d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.665+0000 7f47edc80640 1 -- 172.21.15.59:0/3689582095 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47d40039c0 msgr2=0x7f47d4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.665+0000 7f47edc80640 1 --2- 172.21.15.59:0/3689582095 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47d40039c0 0x7f47d4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.665+0000 7f47edc80640 1 -- 172.21.15.59:0/3689582095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47d4005180 msgr2=0x7f47d400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.665+0000 7f47edc80640 1 --2- 172.21.15.59:0/3689582095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47d4005180 0x7f47d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.665+0000 7f47edc80640 1 -- 172.21.15.59:0/3689582095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d4003520 con 0x7f47d40047c0 2023-10-16T14:26:53.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.665+0000 7f47eec82640 1 -- 172.21.15.59:0/3689582095 reap_dead start 2023-10-16T14:26:53.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.666+0000 7f47edc80640 1 --2- 172.21.15.59:0/3689582095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d40047c0 0x7f47d4004c40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f47d8001750 tx=0x7f47d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6968d55e9d7ebd2f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:53.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.666+0000 7f47ed47f640 1 -- 172.21.15.59:0/3689582095 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d80052d0 con 0x7f47d40047c0 2023-10-16T14:26:53.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.666+0000 7f47ed47f640 1 -- 172.21.15.59:0/3689582095 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d802e050 con 0x7f47d40047c0 2023-10-16T14:26:53.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.666+0000 7f47ed47f640 1 -- 172.21.15.59:0/3689582095 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d8003830 con 0x7f47d40047c0 2023-10-16T14:26:53.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.667+0000 7f47ef483640 1 -- 172.21.15.59:0/3689582095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d40047c0 msgr2=0x7f47d4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:53.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.667+0000 7f47ef483640 1 --2- 172.21.15.59:0/3689582095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d40047c0 0x7f47d4004c40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f47d8001750 tx=0x7f47d40057f0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.667+0000 7f47ef483640 1 -- 172.21.15.59:0/3689582095 shutdown_connections 2023-10-16T14:26:53.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.667+0000 7f47ef483640 1 --2- 172.21.15.59:0/3689582095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47d40047c0 0x7f47d4004c40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.667+0000 7f47ef483640 1 -- 172.21.15.59:0/3689582095 >> 172.21.15.59:0/3689582095 conn(0x7f47e806a470 msgr2=0x7f47e80afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:53.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.667+0000 7f47ef483640 1 -- 172.21.15.59:0/3689582095 shutdown_connections 2023-10-16T14:26:53.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.667+0000 7f47ef483640 1 -- 172.21.15.59:0/3689582095 wait complete. 2023-10-16T14:26:53.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.669+0000 7f47ef483640 1 Processor -- start 2023-10-16T14:26:53.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.669+0000 7f47ef483640 1 -- start start 2023-10-16T14:26:53.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.670+0000 7f47ef483640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47d40047c0 0x7f47e81508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:53.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.670+0000 7f47ef483640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47e80c5440 0x7f47e80c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:53.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.670+0000 7f47ef483640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47e80cd530 0x7f47e80cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:53.678 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.670+0000 7f47ef483640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e8150de0 con 0x7f47e80cd530 2023-10-16T14:26:53.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.670+0000 7f47ef483640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e80cdef0 con 0x7f47d40047c0 2023-10-16T14:26:53.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.670+0000 7f47ef483640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e815bc00 con 0x7f47e80c5440 2023-10-16T14:26:53.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.670+0000 7f47eec82640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47e80cd530 0x7f47e80cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:53.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.670+0000 7f47eec82640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47e80cd530 0x7f47e80cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34466/0 (socket says 172.21.15.59:34466) 2023-10-16T14:26:53.679 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.670+0000 7f47eec82640 1 -- 172.21.15.59:0/694541021 learned_addr learned my addr 172.21.15.59:0/694541021 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:53.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.670+0000 7f47edc80640 1 --2- 172.21.15.59:0/694541021 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47e80c5440 0x7f47e80c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:53.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.670+0000 7f47ee481640 1 --2- 172.21.15.59:0/694541021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47d40047c0 0x7f47e81508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:53.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.670+0000 7f47eec82640 1 -- 172.21.15.59:0/694541021 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47e80c5440 msgr2=0x7f47e80c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:53.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.670+0000 7f47eec82640 1 --2- 172.21.15.59:0/694541021 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47e80c5440 0x7f47e80c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.680 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.670+0000 7f47eec82640 1 -- 172.21.15.59:0/694541021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47d40047c0 msgr2=0x7f47e81508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:53.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.670+0000 7f47eec82640 1 --2- 172.21.15.59:0/694541021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47d40047c0 0x7f47e81508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.670+0000 7f47eec82640 1 -- 172.21.15.59:0/694541021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e815aff0 con 0x7f47e80cd530 2023-10-16T14:26:53.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.670+0000 7f47ee481640 1 --2- 172.21.15.59:0/694541021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47d40047c0 0x7f47e81508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:53.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.671+0000 7f47eec82640 1 --2- 172.21.15.59:0/694541021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47e80cd530 0x7f47e80cd9b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f47e806e0a0 tx=0x7f47e000ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:53.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.671+0000 7f47deffd640 1 -- 172.21.15.59:0/694541021 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e0010040 con 0x7f47e80cd530 2023-10-16T14:26:53.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.671+0000 7f47deffd640 1 -- 172.21.15.59:0/694541021 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e000bb30 con 0x7f47e80cd530 2023-10-16T14:26:53.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.671+0000 7f47deffd640 1 -- 172.21.15.59:0/694541021 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e0014400 con 0x7f47e80cd530 2023-10-16T14:26:53.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.671+0000 7f47ef483640 1 -- 172.21.15.59:0/694541021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e815b2d0 con 0x7f47e80cd530 2023-10-16T14:26:53.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.671+0000 7f47ef483640 1 -- 172.21.15.59:0/694541021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e815b890 con 0x7f47e80cd530 2023-10-16T14:26:53.682 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.673+0000 7f47ef483640 1 -- 172.21.15.59:0/694541021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e804e9b0 con 0x7f47e80cd530 2023-10-16T14:26:53.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.673+0000 7f47deffd640 1 -- 172.21.15.59:0/694541021 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f47e0014560 con 0x7f47e80cd530 2023-10-16T14:26:53.683 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.674+0000 7f47deffd640 1 --2- 172.21.15.59:0/694541021 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f47cc06ae70 0x7f47cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:53.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.674+0000 7f47deffd640 1 -- 172.21.15.59:0/694541021 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f47e0089e30 con 0x7f47e80cd530 2023-10-16T14:26:53.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.675+0000 7f47ee481640 1 --2- 172.21.15.59:0/694541021 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f47cc06ae70 0x7f47cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:53.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.676+0000 7f47ee481640 1 --2- 172.21.15.59:0/694541021 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f47cc06ae70 0x7f47cc06d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f47e4001eb0 tx=0x7f47e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:53.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.679+0000 7f47deffd640 1 -- 172.21.15.59:0/694541021 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47e0054ba0 con 0x7f47e80cd530 2023-10-16T14:26:53.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.878+0000 7f47ef483640 1 -- 172.21.15.59:0/694541021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47e815bd40 con 0x7f47e80cd530 2023-10-16T14:26:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.879+0000 7f47deffd640 1 -- 172.21.15.59:0/694541021 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18445 (secure 0 0 0) 0x7f47e0018090 con 0x7f47e80cd530 2023-10-16T14:26:53.882 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:53.883 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:26:29.634854+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:26:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.882+0000 7f47ef483640 1 -- 172.21.15.59:0/694541021 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f47cc06ae70 msgr2=0x7f47cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.882+0000 7f47ef483640 1 --2- 172.21.15.59:0/694541021 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f47cc06ae70 0x7f47cc06d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f47e4001eb0 tx=0x7f47e4009040 comp rx=0 tx=0).stop 2023-10-16T14:26:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.882+0000 7f47ef483640 1 -- 172.21.15.59:0/694541021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47e80cd530 msgr2=0x7f47e80cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:53.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.882+0000 7f47ef483640 1 --2- 172.21.15.59:0/694541021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47e80cd530 0x7f47e80cd9b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f47e806e0a0 tx=0x7f47e000ef50 comp rx=0 tx=0).stop 2023-10-16T14:26:53.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.882+0000 7f47ef483640 1 -- 172.21.15.59:0/694541021 shutdown_connections 2023-10-16T14:26:53.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.882+0000 7f47ef483640 1 --2- 172.21.15.59:0/694541021 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f47cc06ae70 0x7f47cc06d330 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.882+0000 7f47ef483640 1 --2- 172.21.15.59:0/694541021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47e80cd530 0x7f47e80cd9b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.882+0000 7f47ef483640 1 --2- 172.21.15.59:0/694541021 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f47e80c5440 0x7f47e80c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.882+0000 7f47ef483640 1 --2- 172.21.15.59:0/694541021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47d40047c0 0x7f47e81508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:53.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.882+0000 7f47ef483640 1 -- 172.21.15.59:0/694541021 >> 172.21.15.59:0/694541021 conn(0x7f47e806a470 msgr2=0x7f47e80af390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:53.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.883+0000 7f47ef483640 1 -- 172.21.15.59:0/694541021 shutdown_connections 2023-10-16T14:26:53.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:53.883+0000 7f47ef483640 1 -- 172.21.15.59:0/694541021 wait complete. 2023-10-16T14:26:53.904 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T14:25:46.371818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T14:25:47.145341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T14:25:50.758038+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T14:26:53.905 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:26:54.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.134+0000 7f2587fff640 1 Processor -- start 2023-10-16T14:26:54.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.134+0000 7f2587fff640 1 -- start start 2023-10-16T14:26:54.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.136+0000 7f2587fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f258815b1b0 0x7f2588161210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:54.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.136+0000 7f2587fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25880c3c30 0x7f25880adb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:54.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.136+0000 7f2587fff640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25880ad120 con 0x7f2588161750 2023-10-16T14:26:54.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.136+0000 7f2587fff640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25880ad6e0 con 0x7f25880c3c30 2023-10-16T14:26:54.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.136+0000 7f2587fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25880aee20 con 0x7f258815b1b0 2023-10-16T14:26:54.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.136+0000 7f25877fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25880c3c30 0x7f25880adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:54.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.136+0000 7f25877fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25880c3c30 0x7f25880adb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34472/0 (socket says 172.21.15.59:34472) 2023-10-16T14:26:54.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.136+0000 7f25877fe640 1 -- 172.21.15.59:0/728984008 learned_addr learned my addr 172.21.15.59:0/728984008 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:54.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.136+0000 7f25867fc640 1 --1- 172.21.15.59:0/728984008 >> v1:172.21.15.59:6789/0 conn(0x7f2588161750 0x7f25880c3520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38690/0 (socket says 172.21.15.59:38690) 2023-10-16T14:26:54.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.137+0000 7f2586ffd640 1 --2- 172.21.15.59:0/728984008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f258815b1b0 0x7f2588161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:54.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.137+0000 7f25877fe640 1 -- 172.21.15.59:0/728984008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f258815b1b0 msgr2=0x7f2588161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:54.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.137+0000 7f25877fe640 1 --2- 172.21.15.59:0/728984008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f258815b1b0 0x7f2588161210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.137+0000 7f25877fe640 1 -- 172.21.15.59:0/728984008 >> v1:172.21.15.59:6789/0 conn(0x7f2588161750 legacy=0x7f25880c3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:54.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.137+0000 7f25877fe640 1 -- 172.21.15.59:0/728984008 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2588161d00 con 0x7f25880c3c30 2023-10-16T14:26:54.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.138+0000 7f25877fe640 1 --2- 172.21.15.59:0/728984008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25880c3c30 0x7f25880adb70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2580009870 tx=0x7f258002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183526cab237722a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:54.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.138+0000 7f2585ffb640 1 -- 172.21.15.59:0/728984008 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2580031640 con 0x7f25880c3c30 2023-10-16T14:26:54.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.138+0000 7f2585ffb640 1 -- 172.21.15.59:0/728984008 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25800317a0 con 0x7f25880c3c30 2023-10-16T14:26:54.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.138+0000 7f2585ffb640 1 -- 172.21.15.59:0/728984008 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2580031b30 con 0x7f25880c3c30 2023-10-16T14:26:54.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.139+0000 7f2587fff640 1 -- 172.21.15.59:0/728984008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25880c3c30 msgr2=0x7f25880adb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:54.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.139+0000 7f2587fff640 1 --2- 172.21.15.59:0/728984008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25880c3c30 0x7f25880adb70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2580009870 tx=0x7f258002b8f0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.139+0000 7f2587fff640 1 -- 172.21.15.59:0/728984008 shutdown_connections 2023-10-16T14:26:54.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.139+0000 7f2587fff640 1 --2- 172.21.15.59:0/728984008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25880c3c30 0x7f25880adb70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.144 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.139+0000 7f2587fff640 1 --2- 172.21.15.59:0/728984008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f258815b1b0 0x7f2588161210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.139+0000 7f2587fff640 1 -- 172.21.15.59:0/728984008 >> 172.21.15.59:0/728984008 conn(0x7f25880d0550 msgr2=0x7f25880d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:54.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.139+0000 7f2587fff640 1 -- 172.21.15.59:0/728984008 shutdown_connections 2023-10-16T14:26:54.145 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.139+0000 7f2587fff640 1 -- 172.21.15.59:0/728984008 wait complete. 2023-10-16T14:26:54.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.141+0000 7f2587fff640 1 Processor -- start 2023-10-16T14:26:54.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.141+0000 7f2587fff640 1 -- start start 2023-10-16T14:26:54.147 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.142+0000 7f2587fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25880c3c30 0x7f258814d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:54.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.142+0000 7f2587fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f258815b1b0 0x7f258815e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:54.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.142+0000 7f2587fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2588161750 0x7f25880c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:54.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.142+0000 7f2587fff640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258814dd60 con 0x7f2588161750 2023-10-16T14:26:54.148 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.142+0000 7f2587fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258815e620 con 0x7f258815b1b0 2023-10-16T14:26:54.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.142+0000 7f2587fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25880b46c0 con 0x7f25880c3c30 2023-10-16T14:26:54.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.143+0000 7f25877fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2588161750 0x7f25880c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:54.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.143+0000 7f2586ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25880c3c30 0x7f258814d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:54.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.143+0000 7f25877fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2588161750 0x7f25880c4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34484/0 (socket says 172.21.15.59:34484) 2023-10-16T14:26:54.149 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.143+0000 7f25877fe640 1 -- 172.21.15.59:0/3567812522 learned_addr learned my addr 172.21.15.59:0/3567812522 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:54.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.143+0000 7f25867fc640 1 --2- 172.21.15.59:0/3567812522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f258815b1b0 0x7f258815e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:54.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.143+0000 7f25877fe640 1 -- 172.21.15.59:0/3567812522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25880c3c30 msgr2=0x7f258814d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:54.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.143+0000 7f25877fe640 1 --2- 172.21.15.59:0/3567812522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25880c3c30 0x7f258814d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.143+0000 7f25877fe640 1 -- 172.21.15.59:0/3567812522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f258815b1b0 msgr2=0x7f258815e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:54.150 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.143+0000 7f25877fe640 1 --2- 172.21.15.59:0/3567812522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f258815b1b0 0x7f258815e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.143+0000 7f25877fe640 1 -- 172.21.15.59:0/3567812522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25800094d0 con 0x7f2588161750 2023-10-16T14:26:54.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.144+0000 7f25877fe640 1 --2- 172.21.15.59:0/3567812522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2588161750 0x7f25880c4010 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2580009870 tx=0x7f25800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:54.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.144+0000 7f256f7fe640 1 -- 172.21.15.59:0/3567812522 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258003ac60 con 0x7f2588161750 2023-10-16T14:26:54.151 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.144+0000 7f256f7fe640 1 -- 172.21.15.59:0/3567812522 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258003ade0 con 0x7f2588161750 2023-10-16T14:26:54.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.144+0000 7f256f7fe640 1 -- 172.21.15.59:0/3567812522 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2580044630 con 0x7f2588161750 2023-10-16T14:26:54.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.144+0000 7f2587fff640 1 -- 172.21.15.59:0/3567812522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25880b49a0 con 0x7f2588161750 2023-10-16T14:26:54.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.144+0000 7f2587fff640 1 -- 172.21.15.59:0/3567812522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25880b4f60 con 0x7f2588161750 2023-10-16T14:26:54.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.145+0000 7f2587fff640 1 -- 172.21.15.59:0/3567812522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f258804e9b0 con 0x7f2588161750 2023-10-16T14:26:54.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.146+0000 7f256f7fe640 1 -- 172.21.15.59:0/3567812522 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f258002f050 con 0x7f2588161750 2023-10-16T14:26:54.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.147+0000 7f256f7fe640 1 --2- 172.21.15.59:0/3567812522 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f257406ae70 0x7f257406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:54.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.147+0000 7f256f7fe640 1 -- 172.21.15.59:0/3567812522 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f25800ab7e0 con 0x7f2588161750 2023-10-16T14:26:54.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.148+0000 7f2586ffd640 1 --2- 172.21.15.59:0/3567812522 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f257406ae70 0x7f257406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:54.154 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.149+0000 7f2586ffd640 1 --2- 172.21.15.59:0/3567812522 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f257406ae70 0x7f257406d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2578009fd0 tx=0x7f2578009920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:54.155 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.151+0000 7f256f7fe640 1 -- 172.21.15.59:0/3567812522 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2580076430 con 0x7f2588161750 2023-10-16T14:26:54.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.344+0000 7f2587fff640 1 -- 172.21.15.59:0/3567812522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f25880af700 con 0x7f2588161750 2023-10-16T14:26:54.348 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.345+0000 7f256f7fe640 1 -- 172.21.15.59:0/3567812522 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2580079a50 con 0x7f2588161750 2023-10-16T14:26:54.348 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:26:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.348+0000 7f2587fff640 1 -- 172.21.15.59:0/3567812522 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f257406ae70 msgr2=0x7f257406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.348+0000 7f2587fff640 1 --2- 172.21.15.59:0/3567812522 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f257406ae70 0x7f257406d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2578009fd0 tx=0x7f2578009920 comp rx=0 tx=0).stop 2023-10-16T14:26:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.348+0000 7f2587fff640 1 -- 172.21.15.59:0/3567812522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2588161750 msgr2=0x7f25880c4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.348+0000 7f2587fff640 1 --2- 172.21.15.59:0/3567812522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2588161750 0x7f25880c4010 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2580009870 tx=0x7f25800046c0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.348+0000 7f2587fff640 1 -- 172.21.15.59:0/3567812522 shutdown_connections 2023-10-16T14:26:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.348+0000 7f2587fff640 1 --2- 172.21.15.59:0/3567812522 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f257406ae70 0x7f257406d330 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.348+0000 7f2587fff640 1 --2- 172.21.15.59:0/3567812522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2588161750 0x7f25880c4010 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.348+0000 7f2587fff640 1 --2- 172.21.15.59:0/3567812522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f258815b1b0 0x7f258815e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.348+0000 7f2587fff640 1 --2- 172.21.15.59:0/3567812522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25880c3c30 0x7f258814d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.348+0000 7f2587fff640 1 -- 172.21.15.59:0/3567812522 >> 172.21.15.59:0/3567812522 conn(0x7f25880d0550 msgr2=0x7f2588163550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:54.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.348+0000 7f2587fff640 1 -- 172.21.15.59:0/3567812522 shutdown_connections 2023-10-16T14:26:54.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.348+0000 7f2587fff640 1 -- 172.21.15.59:0/3567812522 wait complete. 2023-10-16T14:26:54.369 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T14:26:54.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.596+0000 7f2fd14a2640 1 Processor -- start 2023-10-16T14:26:54.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.596+0000 7f2fd14a2640 1 -- start start 2023-10-16T14:26:54.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.597+0000 7f2fd14a2640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2fcc160ee0 0x7f2fcc1654e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:54.600 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.597+0000 7f2fd14a2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fcc0c9060 0x7f2fcc0caca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:54.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.597+0000 7f2fd14a2640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fcc0cc8b0 con 0x7f2fcc0cb1e0 2023-10-16T14:26:54.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.597+0000 7f2fd14a2640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fcc165a20 con 0x7f2fcc160ee0 2023-10-16T14:26:54.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.597+0000 7f2fd14a2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc0c9cc0 con 0x7f2fcc0c9060 2023-10-16T14:26:54.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.598+0000 7f2fcaffd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2fcc160ee0 0x7f2fcc1654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:54.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.598+0000 7f2fcb7fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2fcc0cb1e0 0x7f2fcc0ce490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38704/0 (socket says 172.21.15.59:38704) 2023-10-16T14:26:54.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.598+0000 7f2fcb7fe640 1 -- 172.21.15.59:0/1678957829 learned_addr learned my addr 172.21.15.59:0/1678957829 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:54.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.598+0000 7f2fcaffd640 1 -- 172.21.15.59:0/1678957829 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fcc0c9060 msgr2=0x7f2fcc0caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:54.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.598+0000 7f2fcaffd640 1 --2- 172.21.15.59:0/1678957829 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fcc0c9060 0x7f2fcc0caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.598+0000 7f2fcaffd640 1 -- 172.21.15.59:0/1678957829 >> v1:172.21.15.59:6789/0 conn(0x7f2fcc0cb1e0 legacy=0x7f2fcc0ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:54.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.598+0000 7f2fcaffd640 1 -- 172.21.15.59:0/1678957829 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc0cb650 con 0x7f2fcc160ee0 2023-10-16T14:26:54.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.598+0000 7f2fc9ffb640 1 -- 172.21.15.59:0/1678957829 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100137016 0 0) 0x7f2fcc0cc8b0 con 0x7f2fcc0cb1e0 2023-10-16T14:26:54.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.600+0000 7f2fcaffd640 1 --2- 172.21.15.59:0/1678957829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fcc160ee0 0x7f2fcc1654e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009d90 tx=0x7f2fbc02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95038453dfbda0ad server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:54.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.600+0000 7f2fc9ffb640 1 -- 172.21.15.59:0/1678957829 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc02cc50 con 0x7f2fcc160ee0 2023-10-16T14:26:54.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.600+0000 7f2fc9ffb640 1 -- 172.21.15.59:0/1678957829 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc02cdb0 con 0x7f2fcc160ee0 2023-10-16T14:26:54.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.600+0000 7f2fc9ffb640 1 -- 172.21.15.59:0/1678957829 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc034660 con 0x7f2fcc160ee0 2023-10-16T14:26:54.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.600+0000 7f2fd14a2640 1 -- 172.21.15.59:0/1678957829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fcc160ee0 msgr2=0x7f2fcc1654e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:54.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.600+0000 7f2fd14a2640 1 --2- 172.21.15.59:0/1678957829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fcc160ee0 0x7f2fcc1654e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009d90 tx=0x7f2fbc02bea0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.601+0000 7f2fd14a2640 1 -- 172.21.15.59:0/1678957829 shutdown_connections 2023-10-16T14:26:54.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.601+0000 7f2fd14a2640 1 --2- 172.21.15.59:0/1678957829 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fcc0c9060 0x7f2fcc0caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.601+0000 7f2fd14a2640 1 --2- 172.21.15.59:0/1678957829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fcc160ee0 0x7f2fcc1654e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.601+0000 7f2fd14a2640 1 -- 172.21.15.59:0/1678957829 >> 172.21.15.59:0/1678957829 conn(0x7f2fcc0b0030 msgr2=0x7f2fcc0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:54.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.601+0000 7f2fd14a2640 1 -- 172.21.15.59:0/1678957829 shutdown_connections 2023-10-16T14:26:54.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.601+0000 7f2fd14a2640 1 -- 172.21.15.59:0/1678957829 wait complete. 2023-10-16T14:26:54.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.603+0000 7f2fd14a2640 1 Processor -- start 2023-10-16T14:26:54.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.603+0000 7f2fd14a2640 1 -- start start 2023-10-16T14:26:54.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.604+0000 7f2fd14a2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fcc0c9060 0x7f2fcc158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:54.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.604+0000 7f2fd14a2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fcc0cb1e0 0x7f2fcc15a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:54.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.604+0000 7f2fd14a2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fcc160ee0 0x7f2fcc0aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:54.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.604+0000 7f2fd14a2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc159080 con 0x7f2fcc0c9060 2023-10-16T14:26:54.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.604+0000 7f2fd14a2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc0c5f20 con 0x7f2fcc0cb1e0 2023-10-16T14:26:54.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.604+0000 7f2fd14a2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc0c2100 con 0x7f2fcc160ee0 2023-10-16T14:26:54.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.604+0000 7f2fcaffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fcc0c9060 0x7f2fcc158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:54.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.604+0000 7f2fcaffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fcc0c9060 0x7f2fcc158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34512/0 (socket says 172.21.15.59:34512) 2023-10-16T14:26:54.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.604+0000 7f2fcaffd640 1 -- 172.21.15.59:0/3865012240 learned_addr learned my addr 172.21.15.59:0/3865012240 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:54.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.605+0000 7f2fca7fc640 1 --2- 172.21.15.59:0/3865012240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fcc0cb1e0 0x7f2fcc15a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:54.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.605+0000 7f2fcb7fe640 1 --2- 172.21.15.59:0/3865012240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fcc160ee0 0x7f2fcc0aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:54.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.605+0000 7f2fcaffd640 1 -- 172.21.15.59:0/3865012240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fcc160ee0 msgr2=0x7f2fcc0aeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:54.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.605+0000 7f2fcaffd640 1 --2- 172.21.15.59:0/3865012240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fcc160ee0 0x7f2fcc0aeb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.605+0000 7f2fcaffd640 1 -- 172.21.15.59:0/3865012240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fcc0cb1e0 msgr2=0x7f2fcc15a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:54.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.605+0000 7f2fcaffd640 1 --2- 172.21.15.59:0/3865012240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fcc0cb1e0 0x7f2fcc15a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.605+0000 7f2fcaffd640 1 -- 172.21.15.59:0/3865012240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc009a70 con 0x7f2fcc0c9060 2023-10-16T14:26:54.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.605+0000 7f2fca7fc640 1 --2- 172.21.15.59:0/3865012240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fcc0cb1e0 0x7f2fcc15a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:54.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.605+0000 7f2fcaffd640 1 --2- 172.21.15.59:0/3865012240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fcc0c9060 0x7f2fcc158b40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc037040 tx=0x7f2fbc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:54.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.605+0000 7f2fc37fe640 1 -- 172.21.15.59:0/3865012240 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc03e610 con 0x7f2fcc0c9060 2023-10-16T14:26:54.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.605+0000 7f2fc37fe640 1 -- 172.21.15.59:0/3865012240 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc03e770 con 0x7f2fcc0c9060 2023-10-16T14:26:54.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.605+0000 7f2fc37fe640 1 -- 172.21.15.59:0/3865012240 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc03eb60 con 0x7f2fcc0c9060 2023-10-16T14:26:54.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.605+0000 7f2fd14a2640 1 -- 172.21.15.59:0/3865012240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fcc0c23e0 con 0x7f2fcc0c9060 2023-10-16T14:26:54.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.606+0000 7f2fd14a2640 1 -- 172.21.15.59:0/3865012240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fcc0c29a0 con 0x7f2fcc0c9060 2023-10-16T14:26:54.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.607+0000 7f2fd14a2640 1 -- 172.21.15.59:0/3865012240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fcc073ef0 con 0x7f2fcc0c9060 2023-10-16T14:26:54.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.608+0000 7f2fc37fe640 1 -- 172.21.15.59:0/3865012240 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2fbc03b050 con 0x7f2fcc0c9060 2023-10-16T14:26:54.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.609+0000 7f2fc37fe640 1 --2- 172.21.15.59:0/3865012240 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f2fac06ae70 0x7f2fac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:54.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.609+0000 7f2fc37fe640 1 -- 172.21.15.59:0/3865012240 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f2fbc0ac350 con 0x7f2fcc0c9060 2023-10-16T14:26:54.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.609+0000 7f2fca7fc640 1 --2- 172.21.15.59:0/3865012240 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f2fac06ae70 0x7f2fac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:54.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.610+0000 7f2fca7fc640 1 --2- 172.21.15.59:0/3865012240 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f2fac06ae70 0x7f2fac06d330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc1f9890 tx=0x7f2fb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:54.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.618+0000 7f2fc37fe640 1 -- 172.21.15.59:0/3865012240 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2fbc0770c0 con 0x7f2fcc0c9060 2023-10-16T14:26:54.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.813+0000 7f2fd14a2640 1 -- 172.21.15.59:0/3865012240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2fcc0cc140 con 0x7f2fcc0c9060 2023-10-16T14:26:54.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.814+0000 7f2fc37fe640 1 -- 172.21.15.59:0/3865012240 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2fbc07a6e0 con 0x7f2fcc0c9060 2023-10-16T14:26:54.817 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:54.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.817+0000 7f2fd14a2640 1 -- 172.21.15.59:0/3865012240 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f2fac06ae70 msgr2=0x7f2fac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:54.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.817+0000 7f2fd14a2640 1 --2- 172.21.15.59:0/3865012240 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f2fac06ae70 0x7f2fac06d330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc1f9890 tx=0x7f2fb4008040 comp rx=0 tx=0).stop 2023-10-16T14:26:54.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.817+0000 7f2fd14a2640 1 -- 172.21.15.59:0/3865012240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fcc0c9060 msgr2=0x7f2fcc158b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:54.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.817+0000 7f2fd14a2640 1 --2- 172.21.15.59:0/3865012240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fcc0c9060 0x7f2fcc158b40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc037040 tx=0x7f2fbc004a40 comp rx=0 tx=0).stop 2023-10-16T14:26:54.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.817+0000 7f2fd14a2640 1 -- 172.21.15.59:0/3865012240 shutdown_connections 2023-10-16T14:26:54.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.817+0000 7f2fd14a2640 1 --2- 172.21.15.59:0/3865012240 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f2fac06ae70 0x7f2fac06d330 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.817+0000 7f2fd14a2640 1 --2- 172.21.15.59:0/3865012240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fcc160ee0 0x7f2fcc0aeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.817+0000 7f2fd14a2640 1 --2- 172.21.15.59:0/3865012240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fcc0cb1e0 0x7f2fcc15a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.817+0000 7f2fd14a2640 1 --2- 172.21.15.59:0/3865012240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fcc0c9060 0x7f2fcc158b40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:54.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.817+0000 7f2fd14a2640 1 -- 172.21.15.59:0/3865012240 >> 172.21.15.59:0/3865012240 conn(0x7f2fcc0b0030 msgr2=0x7f2fcc15f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:54.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.818+0000 7f2fd14a2640 1 -- 172.21.15.59:0/3865012240 shutdown_connections 2023-10-16T14:26:54.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:54.818+0000 7f2fd14a2640 1 -- 172.21.15.59:0/3865012240 wait complete. 2023-10-16T14:26:54.839 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T14:26:55.065 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.062+0000 7faf28eea640 1 Processor -- start 2023-10-16T14:26:55.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.062+0000 7faf28eea640 1 -- start start 2023-10-16T14:26:55.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.064+0000 7faf28eea640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7faf2415c8e0 0x7faf240cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.064+0000 7faf28eea640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf2406d230 0x7faf2406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.064+0000 7faf28eea640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf240ce920 0x7faf240ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.064+0000 7faf28eea640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2406df90 con 0x7faf240ce920 2023-10-16T14:26:55.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.064+0000 7faf28eea640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf240cf2d0 con 0x7faf2415c8e0 2023-10-16T14:26:55.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.064+0000 7faf28eea640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf240cdac0 con 0x7faf2406d230 2023-10-16T14:26:55.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.064+0000 7faf23fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf240ce920 0x7faf240ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:55.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.064+0000 7faf23fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf240ce920 0x7faf240ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34520/0 (socket says 172.21.15.59:34520) 2023-10-16T14:26:55.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.064+0000 7faf23fff640 1 -- 172.21.15.59:0/855664416 learned_addr learned my addr 172.21.15.59:0/855664416 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:55.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.065+0000 7faf237fe640 1 --2- 172.21.15.59:0/855664416 >> v2:172.21.15.151:3300/0 conn(0x7faf2415c8e0 0x7faf240cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:55.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.065+0000 7faf1bfff640 1 --2- 172.21.15.59:0/855664416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf2406d230 0x7faf2406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:55.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.065+0000 7faf23fff640 1 -- 172.21.15.59:0/855664416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf2406d230 msgr2=0x7faf2406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:55.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.065+0000 7faf23fff640 1 --2- 172.21.15.59:0/855664416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf2406d230 0x7faf2406d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.065+0000 7faf23fff640 1 -- 172.21.15.59:0/855664416 >> v2:172.21.15.151:3300/0 conn(0x7faf2415c8e0 msgr2=0x7faf240cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:55.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.065+0000 7faf23fff640 1 --2- 172.21.15.59:0/855664416 >> v2:172.21.15.151:3300/0 conn(0x7faf2415c8e0 0x7faf240cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.065+0000 7faf23fff640 1 -- 172.21.15.59:0/855664416 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf240cd1f0 con 0x7faf240ce920 2023-10-16T14:26:55.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.066+0000 7faf23fff640 1 --2- 172.21.15.59:0/855664416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf240ce920 0x7faf240ced90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faf2406c180 tx=0x7faf1c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3534dfceefd058b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:55.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.067+0000 7faf22ffd640 1 -- 172.21.15.59:0/855664416 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c02ca80 con 0x7faf240ce920 2023-10-16T14:26:55.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.067+0000 7faf22ffd640 1 -- 172.21.15.59:0/855664416 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c02cbe0 con 0x7faf240ce920 2023-10-16T14:26:55.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.067+0000 7faf22ffd640 1 -- 172.21.15.59:0/855664416 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0343f0 con 0x7faf240ce920 2023-10-16T14:26:55.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.067+0000 7faf28eea640 1 -- 172.21.15.59:0/855664416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf240ce920 msgr2=0x7faf240ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:55.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.067+0000 7faf28eea640 1 --2- 172.21.15.59:0/855664416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf240ce920 0x7faf240ced90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faf2406c180 tx=0x7faf1c02bee0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.067+0000 7faf28eea640 1 -- 172.21.15.59:0/855664416 shutdown_connections 2023-10-16T14:26:55.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.067+0000 7faf28eea640 1 --2- 172.21.15.59:0/855664416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf240ce920 0x7faf240ced90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.067+0000 7faf28eea640 1 --2- 172.21.15.59:0/855664416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf2406d230 0x7faf2406d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.067+0000 7faf28eea640 1 --2- 172.21.15.59:0/855664416 >> v2:172.21.15.151:3300/0 conn(0x7faf2415c8e0 0x7faf240cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.067+0000 7faf28eea640 1 -- 172.21.15.59:0/855664416 >> 172.21.15.59:0/855664416 conn(0x7faf2406a200 msgr2=0x7faf2406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:55.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.067+0000 7faf28eea640 1 -- 172.21.15.59:0/855664416 shutdown_connections 2023-10-16T14:26:55.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.067+0000 7faf28eea640 1 -- 172.21.15.59:0/855664416 wait complete. 2023-10-16T14:26:55.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.069+0000 7faf28eea640 1 Processor -- start 2023-10-16T14:26:55.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.069+0000 7faf28eea640 1 -- start start 2023-10-16T14:26:55.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.070+0000 7faf28eea640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf2406d230 0x7faf24157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.070+0000 7faf28eea640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf240ce920 0x7faf2409b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.070+0000 7faf28eea640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf2415c8e0 0x7faf2409ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.070+0000 7faf28eea640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf240c5770 con 0x7faf240ce920 2023-10-16T14:26:55.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.070+0000 7faf28eea640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf240c5a50 con 0x7faf2415c8e0 2023-10-16T14:26:55.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.070+0000 7faf28eea640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf240c5d30 con 0x7faf2406d230 2023-10-16T14:26:55.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.070+0000 7faf1bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf240ce920 0x7faf2409b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:55.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.071+0000 7faf1bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf240ce920 0x7faf2409b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34526/0 (socket says 172.21.15.59:34526) 2023-10-16T14:26:55.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.071+0000 7faf1bfff640 1 -- 172.21.15.59:0/1974902749 learned_addr learned my addr 172.21.15.59:0/1974902749 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:55.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.071+0000 7faf237fe640 1 --2- 172.21.15.59:0/1974902749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf2406d230 0x7faf24157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:55.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.071+0000 7faf23fff640 1 --2- 172.21.15.59:0/1974902749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf2415c8e0 0x7faf2409ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:55.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.071+0000 7faf1bfff640 1 -- 172.21.15.59:0/1974902749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf2406d230 msgr2=0x7faf24157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:55.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.071+0000 7faf1bfff640 1 --2- 172.21.15.59:0/1974902749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf2406d230 0x7faf24157ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.071+0000 7faf1bfff640 1 -- 172.21.15.59:0/1974902749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf2415c8e0 msgr2=0x7faf2409ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:55.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.071+0000 7faf1bfff640 1 --2- 172.21.15.59:0/1974902749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf2415c8e0 0x7faf2409ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.071+0000 7faf1bfff640 1 -- 172.21.15.59:0/1974902749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c009b30 con 0x7faf240ce920 2023-10-16T14:26:55.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.071+0000 7faf23fff640 1 --2- 172.21.15.59:0/1974902749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf2415c8e0 0x7faf2409ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:55.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.071+0000 7faf1bfff640 1 --2- 172.21.15.59:0/1974902749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf240ce920 0x7faf2409b540 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00e9b0 tx=0x7faf0c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:55.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.071+0000 7faf20ff9640 1 -- 172.21.15.59:0/1974902749 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c009670 con 0x7faf240ce920 2023-10-16T14:26:55.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.072+0000 7faf20ff9640 1 -- 172.21.15.59:0/1974902749 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c00c9a0 con 0x7faf240ce920 2023-10-16T14:26:55.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.072+0000 7faf20ff9640 1 -- 172.21.15.59:0/1974902749 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c00cd50 con 0x7faf240ce920 2023-10-16T14:26:55.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.072+0000 7faf28eea640 1 -- 172.21.15.59:0/1974902749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf240c6010 con 0x7faf240ce920 2023-10-16T14:26:55.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.072+0000 7faf28eea640 1 -- 172.21.15.59:0/1974902749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf24158010 con 0x7faf240ce920 2023-10-16T14:26:55.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.073+0000 7faf28eea640 1 -- 172.21.15.59:0/1974902749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf240c5530 con 0x7faf240ce920 2023-10-16T14:26:55.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.074+0000 7faf20ff9640 1 -- 172.21.15.59:0/1974902749 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faf0c013470 con 0x7faf240ce920 2023-10-16T14:26:55.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.075+0000 7faf20ff9640 1 --2- 172.21.15.59:0/1974902749 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7faf0406aea0 0x7faf0406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.075+0000 7faf20ff9640 1 -- 172.21.15.59:0/1974902749 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7faf0c089b60 con 0x7faf240ce920 2023-10-16T14:26:55.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.076+0000 7faf237fe640 1 --2- 172.21.15.59:0/1974902749 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7faf0406aea0 0x7faf0406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:55.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.077+0000 7faf237fe640 1 --2- 172.21.15.59:0/1974902749 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7faf0406aea0 0x7faf0406d360 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faf14006fd0 tx=0x7faf14008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:55.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.079+0000 7faf20ff9640 1 -- 172.21.15.59:0/1974902749 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf240c5530 con 0x7faf240ce920 2023-10-16T14:26:55.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.263+0000 7faf28eea640 1 -- 172.21.15.59:0/1974902749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf240c5530 con 0x7faf240ce920 2023-10-16T14:26:55.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.264+0000 7faf20ff9640 1 -- 172.21.15.59:0/1974902749 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf240c5530 con 0x7faf240ce920 2023-10-16T14:26:55.267 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-16T14:26:55.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.266+0000 7faf28eea640 1 -- 172.21.15.59:0/1974902749 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7faf0406aea0 msgr2=0x7faf0406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:55.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.266+0000 7faf28eea640 1 --2- 172.21.15.59:0/1974902749 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7faf0406aea0 0x7faf0406d360 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faf14006fd0 tx=0x7faf14008040 comp rx=0 tx=0).stop 2023-10-16T14:26:55.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.266+0000 7faf28eea640 1 -- 172.21.15.59:0/1974902749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf240ce920 msgr2=0x7faf2409b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:55.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.266+0000 7faf28eea640 1 --2- 172.21.15.59:0/1974902749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf240ce920 0x7faf2409b540 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00e9b0 tx=0x7faf0c00ee70 comp rx=0 tx=0).stop 2023-10-16T14:26:55.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.267+0000 7faf28eea640 1 -- 172.21.15.59:0/1974902749 shutdown_connections 2023-10-16T14:26:55.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.267+0000 7faf28eea640 1 --2- 172.21.15.59:0/1974902749 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7faf0406aea0 0x7faf0406d360 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.267+0000 7faf28eea640 1 --2- 172.21.15.59:0/1974902749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf2415c8e0 0x7faf2409ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.267+0000 7faf28eea640 1 --2- 172.21.15.59:0/1974902749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf240ce920 0x7faf2409b540 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.267+0000 7faf28eea640 1 --2- 172.21.15.59:0/1974902749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf2406d230 0x7faf24157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.267+0000 7faf28eea640 1 -- 172.21.15.59:0/1974902749 >> 172.21.15.59:0/1974902749 conn(0x7faf2406a200 msgr2=0x7faf240af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:55.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.267+0000 7faf28eea640 1 -- 172.21.15.59:0/1974902749 shutdown_connections 2023-10-16T14:26:55.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.267+0000 7faf28eea640 1 -- 172.21.15.59:0/1974902749 wait complete. 2023-10-16T14:26:55.286 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T14:26:55.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.508+0000 7f3a6759e640 1 Processor -- start 2023-10-16T14:26:55.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.508+0000 7f3a6759e640 1 -- start start 2023-10-16T14:26:55.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.509+0000 7f3a6759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6815c940 0x7f3a680d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.510+0000 7f3a6759e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3a680b6fe0 0x7f3a680d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.510+0000 7f3a6759e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a680ce810 con 0x7f3a680d0d80 2023-10-16T14:26:55.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.510+0000 7f3a6759e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a680d1740 con 0x7f3a680b6fe0 2023-10-16T14:26:55.513 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.510+0000 7f3a6759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680b5b40 con 0x7f3a6815c940 2023-10-16T14:26:55.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.510+0000 7f3a66d9d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3a680b6fe0 0x7f3a680d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:55.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.510+0000 7f3a6659c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6815c940 0x7f3a680d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:55.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.510+0000 7f3a66d9d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3a680b6fe0 0x7f3a680d1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.59:50086/0 (socket says 172.21.15.59:50086) 2023-10-16T14:26:55.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.510+0000 7f3a66d9d640 1 -- 172.21.15.59:0/3621414907 learned_addr learned my addr 172.21.15.59:0/3621414907 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:55.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.511+0000 7f3a6659c640 1 -- 172.21.15.59:0/3621414907 >> v2:172.21.15.151:3300/0 conn(0x7f3a680b6fe0 msgr2=0x7f3a680d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:55.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.511+0000 7f3a6659c640 1 --2- 172.21.15.59:0/3621414907 >> v2:172.21.15.151:3300/0 conn(0x7f3a680b6fe0 0x7f3a680d1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.511+0000 7f3a6659c640 1 -- 172.21.15.59:0/3621414907 >> v1:172.21.15.151:6789/0 conn(0x7f3a680d0d80 legacy=0x7f3a68160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:55.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.511+0000 7f3a6659c640 1 -- 172.21.15.59:0/3621414907 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a680ce250 con 0x7f3a6815c940 2023-10-16T14:26:55.515 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.511+0000 7f3a66d9d640 1 --2- 172.21.15.59:0/3621414907 >> v2:172.21.15.151:3300/0 conn(0x7f3a680b6fe0 0x7f3a680d1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:26:55.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.513+0000 7f3a6659c640 1 --2- 172.21.15.59:0/3621414907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6815c940 0x7f3a680d0400 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009d90 tx=0x7f3a5802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ec492169b947146 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:55.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.514+0000 7f3a6559a640 1 -- 172.21.15.59:0/3621414907 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5802cbc0 con 0x7f3a6815c940 2023-10-16T14:26:55.516 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.514+0000 7f3a6559a640 1 -- 172.21.15.59:0/3621414907 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5802cd20 con 0x7f3a6815c940 2023-10-16T14:26:55.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.514+0000 7f3a6559a640 1 -- 172.21.15.59:0/3621414907 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a58034660 con 0x7f3a6815c940 2023-10-16T14:26:55.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.514+0000 7f3a6759e640 1 -- 172.21.15.59:0/3621414907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6815c940 msgr2=0x7f3a680d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:55.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.514+0000 7f3a6759e640 1 --2- 172.21.15.59:0/3621414907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6815c940 0x7f3a680d0400 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009d90 tx=0x7f3a5802be10 comp rx=0 tx=0).stop 2023-10-16T14:26:55.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.514+0000 7f3a6759e640 1 -- 172.21.15.59:0/3621414907 shutdown_connections 2023-10-16T14:26:55.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.514+0000 7f3a6759e640 1 --2- 172.21.15.59:0/3621414907 >> v2:172.21.15.151:3300/0 conn(0x7f3a680b6fe0 0x7f3a680d1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.514+0000 7f3a6759e640 1 --2- 172.21.15.59:0/3621414907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6815c940 0x7f3a680d0400 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.514+0000 7f3a6759e640 1 -- 172.21.15.59:0/3621414907 >> 172.21.15.59:0/3621414907 conn(0x7f3a6809bb30 msgr2=0x7f3a680d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:55.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.514+0000 7f3a6759e640 1 -- 172.21.15.59:0/3621414907 shutdown_connections 2023-10-16T14:26:55.519 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.514+0000 7f3a6759e640 1 -- 172.21.15.59:0/3621414907 wait complete. 2023-10-16T14:26:55.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.516+0000 7f3a6759e640 1 Processor -- start 2023-10-16T14:26:55.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.516+0000 7f3a6759e640 1 -- start start 2023-10-16T14:26:55.520 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.517+0000 7f3a6759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a680b6fe0 0x7f3a68156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.517+0000 7f3a6759e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a680d0d80 0x7f3a680cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.517+0000 7f3a6759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a6815c940 0x7f3a6815a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.517+0000 7f3a6759e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680ca0b0 con 0x7f3a680d0d80 2023-10-16T14:26:55.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.517+0000 7f3a6759e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680ca390 con 0x7f3a6815c940 2023-10-16T14:26:55.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.517+0000 7f3a6759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a680ca670 con 0x7f3a680b6fe0 2023-10-16T14:26:55.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.518+0000 7f3a65d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a680d0d80 0x7f3a680cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:55.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.518+0000 7f3a65d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a680d0d80 0x7f3a680cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34536/0 (socket says 172.21.15.59:34536) 2023-10-16T14:26:55.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.518+0000 7f3a65d9b640 1 -- 172.21.15.59:0/631301675 learned_addr learned my addr 172.21.15.59:0/631301675 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:55.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.518+0000 7f3a66d9d640 1 --2- 172.21.15.59:0/631301675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a6815c940 0x7f3a6815a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:55.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.518+0000 7f3a6659c640 1 --2- 172.21.15.59:0/631301675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a680b6fe0 0x7f3a68156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:55.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.518+0000 7f3a65d9b640 1 -- 172.21.15.59:0/631301675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a680b6fe0 msgr2=0x7f3a68156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:55.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.518+0000 7f3a65d9b640 1 --2- 172.21.15.59:0/631301675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a680b6fe0 0x7f3a68156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.518+0000 7f3a65d9b640 1 -- 172.21.15.59:0/631301675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a6815c940 msgr2=0x7f3a6815a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:55.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.518+0000 7f3a65d9b640 1 --2- 172.21.15.59:0/631301675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a6815c940 0x7f3a6815a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.518+0000 7f3a65d9b640 1 -- 172.21.15.59:0/631301675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a600094d0 con 0x7f3a680d0d80 2023-10-16T14:26:55.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.519+0000 7f3a65d9b640 1 --2- 172.21.15.59:0/631301675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a680d0d80 0x7f3a680cb150 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3a5000c400 tx=0x7f3a5000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:55.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.519+0000 7f3a5effd640 1 -- 172.21.15.59:0/631301675 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a500052d0 con 0x7f3a680d0d80 2023-10-16T14:26:55.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.519+0000 7f3a5effd640 1 -- 172.21.15.59:0/631301675 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a50005430 con 0x7f3a680d0d80 2023-10-16T14:26:55.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.519+0000 7f3a5effd640 1 -- 172.21.15.59:0/631301675 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a50003830 con 0x7f3a680d0d80 2023-10-16T14:26:55.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.519+0000 7f3a6759e640 1 -- 172.21.15.59:0/631301675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a58009a70 con 0x7f3a680d0d80 2023-10-16T14:26:55.525 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.519+0000 7f3a6759e640 1 -- 172.21.15.59:0/631301675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a680cac30 con 0x7f3a680d0d80 2023-10-16T14:26:55.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.520+0000 7f3a6759e640 1 -- 172.21.15.59:0/631301675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6804e9b0 con 0x7f3a680d0d80 2023-10-16T14:26:55.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.522+0000 7f3a5effd640 1 -- 172.21.15.59:0/631301675 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3a50003990 con 0x7f3a680d0d80 2023-10-16T14:26:55.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.522+0000 7f3a5effd640 1 --2- 172.21.15.59:0/631301675 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f3a4806ae70 0x7f3a4806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.523+0000 7f3a5effd640 1 -- 172.21.15.59:0/631301675 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f3a50088f60 con 0x7f3a680d0d80 2023-10-16T14:26:55.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.523+0000 7f3a6659c640 1 --2- 172.21.15.59:0/631301675 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f3a4806ae70 0x7f3a4806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:55.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.524+0000 7f3a6659c640 1 --2- 172.21.15.59:0/631301675 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f3a4806ae70 0x7f3a4806d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3a58036000 tx=0x7f3a58030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:55.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.527+0000 7f3a5effd640 1 -- 172.21.15.59:0/631301675 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3a50053c40 con 0x7f3a680d0d80 2023-10-16T14:26:55.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.709+0000 7f3a6759e640 1 -- 172.21.15.59:0/631301675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3a68072f50 con 0x7f3a680d0d80 2023-10-16T14:26:55.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.710+0000 7f3a5effd640 1 -- 172.21.15.59:0/631301675 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3a500170a0 con 0x7f3a680d0d80 2023-10-16T14:26:55.713 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.712+0000 7f3a6759e640 1 -- 172.21.15.59:0/631301675 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f3a4806ae70 msgr2=0x7f3a4806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.712+0000 7f3a6759e640 1 --2- 172.21.15.59:0/631301675 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f3a4806ae70 0x7f3a4806d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3a58036000 tx=0x7f3a58030000 comp rx=0 tx=0).stop 2023-10-16T14:26:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.712+0000 7f3a6759e640 1 -- 172.21.15.59:0/631301675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a680d0d80 msgr2=0x7f3a680cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.712+0000 7f3a6759e640 1 --2- 172.21.15.59:0/631301675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a680d0d80 0x7f3a680cb150 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3a5000c400 tx=0x7f3a5000c8c0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.712+0000 7f3a6759e640 1 -- 172.21.15.59:0/631301675 shutdown_connections 2023-10-16T14:26:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.712+0000 7f3a6759e640 1 --2- 172.21.15.59:0/631301675 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f3a4806ae70 0x7f3a4806d330 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.712+0000 7f3a6759e640 1 --2- 172.21.15.59:0/631301675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a6815c940 0x7f3a6815a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.712+0000 7f3a6759e640 1 --2- 172.21.15.59:0/631301675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a680d0d80 0x7f3a680cb150 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.712+0000 7f3a6759e640 1 --2- 172.21.15.59:0/631301675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a680b6fe0 0x7f3a68156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.712+0000 7f3a6759e640 1 -- 172.21.15.59:0/631301675 >> 172.21.15.59:0/631301675 conn(0x7f3a6809bb30 msgr2=0x7f3a680b74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:55.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.713+0000 7f3a6759e640 1 -- 172.21.15.59:0/631301675 shutdown_connections 2023-10-16T14:26:55.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.713+0000 7f3a6759e640 1 -- 172.21.15.59:0/631301675 wait complete. 2023-10-16T14:26:55.733 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T14:26:55.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.943+0000 7f00dcad7640 1 Processor -- start 2023-10-16T14:26:55.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.943+0000 7f00dcad7640 1 -- start start 2023-10-16T14:26:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.944+0000 7f00dcad7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00d8161310 0x7f00d80ab860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.944+0000 7f00dcad7640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d80c9c70 con 0x7f00d815cc20 2023-10-16T14:26:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.944+0000 7f00dcad7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d80cca90 con 0x7f00d80b01b0 2023-10-16T14:26:55.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.944+0000 7f00dcad7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d80c9490 con 0x7f00d8161310 2023-10-16T14:26:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.945+0000 7f00d659c640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f00d815cc20 0x7f00d80c8d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38708/0 (socket says 172.21.15.59:38708) 2023-10-16T14:26:55.949 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.945+0000 7f00d659c640 1 -- 172.21.15.59:0/3026831464 learned_addr learned my addr 172.21.15.59:0/3026831464 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:55.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.945+0000 7f00d5d9b640 1 --2- 172.21.15.59:0/3026831464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00d8161310 0x7f00d80ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:55.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.945+0000 7f00d559a640 1 -- 172.21.15.59:0/3026831464 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050370204 0 0) 0x7f00d80c9c70 con 0x7f00d815cc20 2023-10-16T14:26:55.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.945+0000 7f00d559a640 1 -- 172.21.15.59:0/3026831464 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00c4003520 con 0x7f00d815cc20 2023-10-16T14:26:55.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.946+0000 7f00d559a640 1 -- 172.21.15.59:0/3026831464 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3200597159 0 0) 0x7f00c4003520 con 0x7f00d815cc20 2023-10-16T14:26:55.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.946+0000 7f00d559a640 1 -- 172.21.15.59:0/3026831464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00d8161310 msgr2=0x7f00d80ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:55.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.946+0000 7f00d559a640 1 --2- 172.21.15.59:0/3026831464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00d8161310 0x7f00d80ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.946+0000 7f00d559a640 1 -- 172.21.15.59:0/3026831464 >> v1:172.21.15.151:6789/0 conn(0x7f00d80b01b0 legacy=0x7f00d80ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:55.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.946+0000 7f00d559a640 1 -- 172.21.15.59:0/3026831464 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d815d000 con 0x7f00d815cc20 2023-10-16T14:26:55.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.946+0000 7f00d559a640 1 -- 172.21.15.59:0/3026831464 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f00c8001670 con 0x7f00d815cc20 2023-10-16T14:26:55.951 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.946+0000 7f00d559a640 1 -- 172.21.15.59:0/3026831464 >> v1:172.21.15.59:6789/0 conn(0x7f00d815cc20 legacy=0x7f00d80c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:55.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.946+0000 7f00d559a640 1 --2- 172.21.15.59:0/3026831464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00c40039a0 0x7f00c4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.946+0000 7f00d559a640 1 --2- 172.21.15.59:0/3026831464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00d8161310 0x7f00c40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.946+0000 7f00d559a640 1 --2- 172.21.15.59:0/3026831464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00c4004d00 0x7f00c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.946+0000 7f00d559a640 1 -- 172.21.15.59:0/3026831464 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d80c9490 con 0x7f00c4004d00 2023-10-16T14:26:55.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.946+0000 7f00d559a640 1 -- 172.21.15.59:0/3026831464 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c400ba60 con 0x7f00c40039a0 2023-10-16T14:26:55.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.946+0000 7f00d559a640 1 -- 172.21.15.59:0/3026831464 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c400bc20 con 0x7f00d8161310 2023-10-16T14:26:55.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.946+0000 7f00d6d9d640 1 --2- 172.21.15.59:0/3026831464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00c4004d00 0x7f00c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:55.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.947+0000 7f00d5d9b640 1 --2- 172.21.15.59:0/3026831464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00d8161310 0x7f00c40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:55.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.947+0000 7f00d6d9d640 1 -- 172.21.15.59:0/3026831464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00d8161310 msgr2=0x7f00c40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:55.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.947+0000 7f00d6d9d640 1 --2- 172.21.15.59:0/3026831464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00d8161310 0x7f00c40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.947+0000 7f00d6d9d640 1 -- 172.21.15.59:0/3026831464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00c40039a0 msgr2=0x7f00c4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.947+0000 7f00d6d9d640 1 --2- 172.21.15.59:0/3026831464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00c40039a0 0x7f00c4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.947+0000 7f00d6d9d640 1 -- 172.21.15.59:0/3026831464 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c4003520 con 0x7f00c4004d00 2023-10-16T14:26:55.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.948+0000 7f00d6d9d640 1 --2- 172.21.15.59:0/3026831464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00c4004d00 0x7f00c4005180 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f00d0001720 tx=0x7f00c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f84aa5a7fc12c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:55.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.948+0000 7f00d559a640 1 -- 172.21.15.59:0/3026831464 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d00052d0 con 0x7f00c4004d00 2023-10-16T14:26:55.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.948+0000 7f00d559a640 1 -- 172.21.15.59:0/3026831464 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d002e050 con 0x7f00c4004d00 2023-10-16T14:26:55.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.948+0000 7f00d559a640 1 -- 172.21.15.59:0/3026831464 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d00035f0 con 0x7f00c4004d00 2023-10-16T14:26:55.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.949+0000 7f00dcad7640 1 -- 172.21.15.59:0/3026831464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00c4004d00 msgr2=0x7f00c4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:55.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.949+0000 7f00dcad7640 1 --2- 172.21.15.59:0/3026831464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00c4004d00 0x7f00c4005180 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f00d0001720 tx=0x7f00c40057f0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.949+0000 7f00d6d9d640 1 -- 172.21.15.59:0/3026831464 reap_dead start 2023-10-16T14:26:55.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.949+0000 7f00dcad7640 1 -- 172.21.15.59:0/3026831464 shutdown_connections 2023-10-16T14:26:55.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.949+0000 7f00dcad7640 1 -- 172.21.15.59:0/3026831464 >> 172.21.15.59:0/3026831464 conn(0x7f00d80cb1b0 msgr2=0x7f00d80cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:55.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.949+0000 7f00dcad7640 1 -- 172.21.15.59:0/3026831464 shutdown_connections 2023-10-16T14:26:55.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.949+0000 7f00dcad7640 1 -- 172.21.15.59:0/3026831464 wait complete. 2023-10-16T14:26:55.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.952+0000 7f00dcad7640 1 Processor -- start 2023-10-16T14:26:55.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.952+0000 7f00dcad7640 1 -- start start 2023-10-16T14:26:55.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.953+0000 7f00dcad7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00c4004d00 0x7f00d815f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.953+0000 7f00dcad7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00d8156820 0x7f00d8156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.953+0000 7f00dcad7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00d81571e0 0x7f00d815d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.953+0000 7f00dcad7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d8151140 con 0x7f00d8156820 2023-10-16T14:26:55.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.953+0000 7f00dcad7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d8157660 con 0x7f00c4004d00 2023-10-16T14:26:55.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.953+0000 7f00dcad7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d80ac410 con 0x7f00d81571e0 2023-10-16T14:26:55.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.954+0000 7f00d5d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00d8156820 0x7f00d8156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:55.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.954+0000 7f00d5d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00d8156820 0x7f00d8156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34554/0 (socket says 172.21.15.59:34554) 2023-10-16T14:26:55.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.954+0000 7f00d5d9b640 1 -- 172.21.15.59:0/2211330268 learned_addr learned my addr 172.21.15.59:0/2211330268 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:55.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.954+0000 7f00d659c640 1 --2- 172.21.15.59:0/2211330268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00c4004d00 0x7f00d815f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:55.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.954+0000 7f00d6d9d640 1 --2- 172.21.15.59:0/2211330268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00d81571e0 0x7f00d815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:55.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.954+0000 7f00d5d9b640 1 -- 172.21.15.59:0/2211330268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00d81571e0 msgr2=0x7f00d815d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.954+0000 7f00d5d9b640 1 --2- 172.21.15.59:0/2211330268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00d81571e0 0x7f00d815d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.954+0000 7f00d5d9b640 1 -- 172.21.15.59:0/2211330268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00c4004d00 msgr2=0x7f00d815f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.954+0000 7f00d5d9b640 1 --2- 172.21.15.59:0/2211330268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00c4004d00 0x7f00d815f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.954+0000 7f00d5d9b640 1 -- 172.21.15.59:0/2211330268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d80ac6f0 con 0x7f00d8156820 2023-10-16T14:26:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.955+0000 7f00d5d9b640 1 --2- 172.21.15.59:0/2211330268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00d8156820 0x7f00d8156ca0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f00c0007f30 tx=0x7f00c0011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.955+0000 7f00ceffd640 1 -- 172.21.15.59:0/2211330268 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c000e030 con 0x7f00d8156820 2023-10-16T14:26:55.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.955+0000 7f00ceffd640 1 -- 172.21.15.59:0/2211330268 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c0016470 con 0x7f00d8156820 2023-10-16T14:26:55.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.955+0000 7f00ceffd640 1 -- 172.21.15.59:0/2211330268 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c0016820 con 0x7f00d8156820 2023-10-16T14:26:55.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.955+0000 7f00dcad7640 1 -- 172.21.15.59:0/2211330268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d80ac9d0 con 0x7f00d8156820 2023-10-16T14:26:55.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.955+0000 7f00dcad7640 1 -- 172.21.15.59:0/2211330268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d80acf90 con 0x7f00d8156820 2023-10-16T14:26:55.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.956+0000 7f00dcad7640 1 -- 172.21.15.59:0/2211330268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d8073ef0 con 0x7f00d8156820 2023-10-16T14:26:55.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.957+0000 7f00ceffd640 1 -- 172.21.15.59:0/2211330268 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f00c0016980 con 0x7f00d8156820 2023-10-16T14:26:55.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.958+0000 7f00ceffd640 1 --2- 172.21.15.59:0/2211330268 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f00b806ae70 0x7f00b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.958+0000 7f00ceffd640 1 -- 172.21.15.59:0/2211330268 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f00c000f070 con 0x7f00d8156820 2023-10-16T14:26:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.959+0000 7f00d659c640 1 --2- 172.21.15.59:0/2211330268 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f00b806ae70 0x7f00b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.960+0000 7f00d659c640 1 --2- 172.21.15.59:0/2211330268 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f00b806ae70 0x7f00b806d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f00c8001eb0 tx=0x7f00c80016e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:55.962+0000 7f00ceffd640 1 -- 172.21.15.59:0/2211330268 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f00c00556d0 con 0x7f00d8156820 2023-10-16T14:26:56.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.172+0000 7f00dcad7640 1 -- 172.21.15.59:0/2211330268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f00d80b46b0 con 0x7f00d8156820 2023-10-16T14:26:56.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.172+0000 7f00ceffd640 1 -- 172.21.15.59:0/2211330268 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f00c0058cf0 con 0x7f00d8156820 2023-10-16T14:26:56.175 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2023-10-16T14:26:56.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.175+0000 7f00dcad7640 1 -- 172.21.15.59:0/2211330268 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f00b806ae70 msgr2=0x7f00b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:56.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.175+0000 7f00dcad7640 1 --2- 172.21.15.59:0/2211330268 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f00b806ae70 0x7f00b806d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f00c8001eb0 tx=0x7f00c80016e0 comp rx=0 tx=0).stop 2023-10-16T14:26:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.175+0000 7f00dcad7640 1 -- 172.21.15.59:0/2211330268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00d8156820 msgr2=0x7f00d8156ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.175+0000 7f00dcad7640 1 --2- 172.21.15.59:0/2211330268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00d8156820 0x7f00d8156ca0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f00c0007f30 tx=0x7f00c0011660 comp rx=0 tx=0).stop 2023-10-16T14:26:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.176+0000 7f00dcad7640 1 -- 172.21.15.59:0/2211330268 shutdown_connections 2023-10-16T14:26:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.176+0000 7f00dcad7640 1 --2- 172.21.15.59:0/2211330268 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f00b806ae70 0x7f00b806d330 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:56.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.176+0000 7f00dcad7640 1 --2- 172.21.15.59:0/2211330268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00d81571e0 0x7f00d815d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:56.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.176+0000 7f00dcad7640 1 --2- 172.21.15.59:0/2211330268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00d8156820 0x7f00d8156ca0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:56.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.176+0000 7f00dcad7640 1 --2- 172.21.15.59:0/2211330268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00c4004d00 0x7f00d815f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:56.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.176+0000 7f00dcad7640 1 -- 172.21.15.59:0/2211330268 >> 172.21.15.59:0/2211330268 conn(0x7f00d80cb1b0 msgr2=0x7f00d80afa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:56.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.176+0000 7f00dcad7640 1 -- 172.21.15.59:0/2211330268 shutdown_connections 2023-10-16T14:26:56.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.176+0000 7f00dcad7640 1 -- 172.21.15.59:0/2211330268 wait complete. 2023-10-16T14:26:56.198 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi059.front.sepia.ceph.com... 2023-10-16T14:26:56.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:56.199 DEBUG:teuthology.orchestra.run.smithi059:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-16T14:26:56.299 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T14:26:56.300 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-16T14:26:56.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:26:56.301 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T14:26:56.354 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:26:56.355 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T14:26:56.415 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:26:56.416 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T14:26:56.470 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:26:56.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.693+0000 7f14b3fff640 1 Processor -- start 2023-10-16T14:26:56.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.693+0000 7f14b3fff640 1 -- start start 2023-10-16T14:26:56.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.694+0000 7f14b3fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f14b40af8f0 0x7f14b40cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:56.697 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.694+0000 7f14b3fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14b40cf8a0 0x7f14b406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:56.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.694+0000 7f14b3fff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b40cac90 con 0x7f14b40affa0 2023-10-16T14:26:56.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.694+0000 7f14b3fff640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b40cb810 con 0x7f14b40cf8a0 2023-10-16T14:26:56.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.694+0000 7f14b3fff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b40caee0 con 0x7f14b40af8f0 2023-10-16T14:26:56.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.695+0000 7f14b27fc640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14b40cf8a0 0x7f14b406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:56.698 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.695+0000 7f14b27fc640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f14b40cf8a0 0x7f14b406b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34566/0 (socket says 172.21.15.59:34566) 2023-10-16T14:26:56.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.695+0000 7f14b27fc640 1 -- 172.21.15.59:0/3301675667 learned_addr learned my addr 172.21.15.59:0/3301675667 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:56.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.695+0000 7f14b2ffd640 1 --2- 172.21.15.59:0/3301675667 >> v2:172.21.15.151:3300/0 conn(0x7f14b40af8f0 0x7f14b40cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:56.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.695+0000 7f14b27fc640 1 -- 172.21.15.59:0/3301675667 >> v2:172.21.15.151:3300/0 conn(0x7f14b40af8f0 msgr2=0x7f14b40cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:56.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.695+0000 7f14b27fc640 1 --2- 172.21.15.59:0/3301675667 >> v2:172.21.15.151:3300/0 conn(0x7f14b40af8f0 0x7f14b40cf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:56.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.695+0000 7f14b27fc640 1 -- 172.21.15.59:0/3301675667 >> v1:172.21.15.151:6789/0 conn(0x7f14b40affa0 legacy=0x7f14b415c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:56.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.696+0000 7f14b27fc640 1 -- 172.21.15.59:0/3301675667 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b40cb1c0 con 0x7f14b40cf8a0 2023-10-16T14:26:56.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.697+0000 7f14b27fc640 1 --2- 172.21.15.59:0/3301675667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40cf8a0 0x7f14b406b900 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f14b4071b00 tx=0x7f149c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2570724f5d002189 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:56.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.697+0000 7f14b1ffb640 1 -- 172.21.15.59:0/3301675667 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c031870 con 0x7f14b40cf8a0 2023-10-16T14:26:56.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.697+0000 7f14b1ffb640 1 -- 172.21.15.59:0/3301675667 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149c0319d0 con 0x7f14b40cf8a0 2023-10-16T14:26:56.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.697+0000 7f14b1ffb640 1 -- 172.21.15.59:0/3301675667 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c031d60 con 0x7f14b40cf8a0 2023-10-16T14:26:56.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.698+0000 7f14b3fff640 1 -- 172.21.15.59:0/3301675667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40cf8a0 msgr2=0x7f14b406b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:56.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.698+0000 7f14b3fff640 1 --2- 172.21.15.59:0/3301675667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40cf8a0 0x7f14b406b900 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f14b4071b00 tx=0x7f149c02b910 comp rx=0 tx=0).stop 2023-10-16T14:26:56.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.698+0000 7f14b3fff640 1 -- 172.21.15.59:0/3301675667 shutdown_connections 2023-10-16T14:26:56.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.698+0000 7f14b3fff640 1 --2- 172.21.15.59:0/3301675667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40cf8a0 0x7f14b406b900 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:56.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.698+0000 7f14b3fff640 1 --2- 172.21.15.59:0/3301675667 >> v2:172.21.15.151:3300/0 conn(0x7f14b40af8f0 0x7f14b40cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:56.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.698+0000 7f14b3fff640 1 -- 172.21.15.59:0/3301675667 >> 172.21.15.59:0/3301675667 conn(0x7f14b40d0640 msgr2=0x7f14b40d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:56.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.698+0000 7f14b3fff640 1 -- 172.21.15.59:0/3301675667 shutdown_connections 2023-10-16T14:26:56.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.698+0000 7f14b3fff640 1 -- 172.21.15.59:0/3301675667 wait complete. 2023-10-16T14:26:56.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.700+0000 7f14b3fff640 1 Processor -- start 2023-10-16T14:26:56.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.700+0000 7f14b3fff640 1 -- start start 2023-10-16T14:26:56.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.701+0000 7f14b3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40af8f0 0x7f14b40c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:56.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.701+0000 7f14b3fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14b40affa0 0x7f14b406e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:56.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.701+0000 7f14b3fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14b40cf8a0 0x7f14b4159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:56.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.701+0000 7f14b3fff640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b415d3c0 con 0x7f14b40af8f0 2023-10-16T14:26:56.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.701+0000 7f14b3fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40c7240 con 0x7f14b40affa0 2023-10-16T14:26:56.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.701+0000 7f14b3fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b41f59e0 con 0x7f14b40cf8a0 2023-10-16T14:26:56.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.701+0000 7f14b2ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40af8f0 0x7f14b40c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:56.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.702+0000 7f14b2ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40af8f0 0x7f14b40c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34574/0 (socket says 172.21.15.59:34574) 2023-10-16T14:26:56.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.702+0000 7f14b2ffd640 1 -- 172.21.15.59:0/1890258637 learned_addr learned my addr 172.21.15.59:0/1890258637 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:56.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.702+0000 7f14b2ffd640 1 -- 172.21.15.59:0/1890258637 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14b40cf8a0 msgr2=0x7f14b4159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:56.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.702+0000 7f14b2ffd640 1 --2- 172.21.15.59:0/1890258637 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14b40cf8a0 0x7f14b4159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:56.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.702+0000 7f14b2ffd640 1 -- 172.21.15.59:0/1890258637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14b40affa0 msgr2=0x7f14b406e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:56.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.702+0000 7f14b2ffd640 1 --2- 172.21.15.59:0/1890258637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14b40affa0 0x7f14b406e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:56.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.702+0000 7f14b2ffd640 1 -- 172.21.15.59:0/1890258637 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c0094d0 con 0x7f14b40af8f0 2023-10-16T14:26:56.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.702+0000 7f14b2ffd640 1 --2- 172.21.15.59:0/1890258637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40af8f0 0x7f14b40c6d00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f14a400ce40 tx=0x7f14a400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:56.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.703+0000 7f14ab7fe640 1 -- 172.21.15.59:0/1890258637 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4003b90 con 0x7f14b40af8f0 2023-10-16T14:26:56.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.703+0000 7f14ab7fe640 1 -- 172.21.15.59:0/1890258637 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a4003cf0 con 0x7f14b40af8f0 2023-10-16T14:26:56.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.703+0000 7f14ab7fe640 1 -- 172.21.15.59:0/1890258637 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4004240 con 0x7f14b40af8f0 2023-10-16T14:26:56.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.703+0000 7f14b3fff640 1 -- 172.21.15.59:0/1890258637 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b41f5cc0 con 0x7f14b40af8f0 2023-10-16T14:26:56.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.703+0000 7f14b3fff640 1 -- 172.21.15.59:0/1890258637 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b41f6280 con 0x7f14b40af8f0 2023-10-16T14:26:56.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.704+0000 7f14b3fff640 1 -- 172.21.15.59:0/1890258637 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b404e9b0 con 0x7f14b40af8f0 2023-10-16T14:26:56.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.705+0000 7f14ab7fe640 1 -- 172.21.15.59:0/1890258637 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f14a40043a0 con 0x7f14b40af8f0 2023-10-16T14:26:56.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.707+0000 7f14ab7fe640 1 --2- 172.21.15.59:0/1890258637 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f149406ae70 0x7f149406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:56.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.707+0000 7f14ab7fe640 1 -- 172.21.15.59:0/1890258637 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f14a4012070 con 0x7f14b40af8f0 2023-10-16T14:26:56.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.708+0000 7f14b27fc640 1 --2- 172.21.15.59:0/1890258637 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f149406ae70 0x7f149406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:56.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.709+0000 7f14b27fc640 1 --2- 172.21.15.59:0/1890258637 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f149406ae70 0x7f149406d330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f149c036000 tx=0x7f149c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:56.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.711+0000 7f14ab7fe640 1 -- 172.21.15.59:0/1890258637 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f14a40550a0 con 0x7f14b40af8f0 2023-10-16T14:26:56.916 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.914+0000 7f14b3fff640 1 -- 172.21.15.59:0/1890258637 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14b40cea50 con 0x7f14b40af8f0 2023-10-16T14:26:56.918 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.916+0000 7f14ab7fe640 1 -- 172.21.15.59:0/1890258637 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18445 (secure 0 0 0) 0x7f14a4003e60 con 0x7f14b40af8f0 2023-10-16T14:26:56.919 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:56.919 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:26:29.634854+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:26:56.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.919+0000 7f14b3fff640 1 -- 172.21.15.59:0/1890258637 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f149406ae70 msgr2=0x7f149406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:56.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.919+0000 7f14b3fff640 1 --2- 172.21.15.59:0/1890258637 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f149406ae70 0x7f149406d330 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f149c036000 tx=0x7f149c030000 comp rx=0 tx=0).stop 2023-10-16T14:26:56.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.919+0000 7f14b3fff640 1 -- 172.21.15.59:0/1890258637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40af8f0 msgr2=0x7f14b40c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:56.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.919+0000 7f14b3fff640 1 --2- 172.21.15.59:0/1890258637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40af8f0 0x7f14b40c6d00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f14a400ce40 tx=0x7f14a400a660 comp rx=0 tx=0).stop 2023-10-16T14:26:56.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.919+0000 7f14b3fff640 1 -- 172.21.15.59:0/1890258637 shutdown_connections 2023-10-16T14:26:56.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.919+0000 7f14b3fff640 1 --2- 172.21.15.59:0/1890258637 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f149406ae70 0x7f149406d330 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:56.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.919+0000 7f14b3fff640 1 --2- 172.21.15.59:0/1890258637 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14b40cf8a0 0x7f14b4159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:56.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.919+0000 7f14b3fff640 1 --2- 172.21.15.59:0/1890258637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14b40affa0 0x7f14b406e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:56.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.919+0000 7f14b3fff640 1 --2- 172.21.15.59:0/1890258637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14b40af8f0 0x7f14b40c6d00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:56.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.919+0000 7f14b3fff640 1 -- 172.21.15.59:0/1890258637 >> 172.21.15.59:0/1890258637 conn(0x7f14b40d0640 msgr2=0x7f14b406f540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:56.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.919+0000 7f14b3fff640 1 -- 172.21.15.59:0/1890258637 shutdown_connections 2023-10-16T14:26:56.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:56.919+0000 7f14b3fff640 1 -- 172.21.15.59:0/1890258637 wait complete. 2023-10-16T14:26:56.941 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T14:25:46.371818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T14:25:47.145341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T14:25:50.758038+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T14:26:56.942 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:26:57.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.160+0000 7ff992e9b640 1 Processor -- start 2023-10-16T14:26:57.163 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.161+0000 7ff992e9b640 1 -- start start 2023-10-16T14:26:57.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.162+0000 7ff992e9b640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff98c0ca5d0 0x7ff98c06cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:57.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.162+0000 7ff992e9b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff98c06e0e0 0x7ff98c0ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:57.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.162+0000 7ff992e9b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff98c0ca9b0 0x7ff98c0ce550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:57.165 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.162+0000 7ff992e9b640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98c06d510 con 0x7ff98c0ca5d0 2023-10-16T14:26:57.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.162+0000 7ff992e9b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98c06c2a0 con 0x7ff98c0ca9b0 2023-10-16T14:26:57.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.162+0000 7ff992e9b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c0cea90 con 0x7ff98c06e0e0 2023-10-16T14:26:57.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.162+0000 7ff990c37640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff98c0ca5d0 0x7ff98c06cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:57.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.162+0000 7ff990c37640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff98c0ca5d0 0x7ff98c06cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34582/0 (socket says 172.21.15.59:34582) 2023-10-16T14:26:57.166 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.162+0000 7ff990c37640 1 -- 172.21.15.59:0/188589753 learned_addr learned my addr 172.21.15.59:0/188589753 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:57.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.163+0000 7ff990c37640 1 -- 172.21.15.59:0/188589753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff98c06e0e0 msgr2=0x7ff98c0ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:57.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.163+0000 7ff990c37640 1 --2- 172.21.15.59:0/188589753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff98c06e0e0 0x7ff98c0ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.168 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.163+0000 7ff990c37640 1 -- 172.21.15.59:0/188589753 >> v2:172.21.15.151:3300/0 conn(0x7ff98c0ca9b0 msgr2=0x7ff98c0ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:57.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.163+0000 7ff990c37640 1 --2- 172.21.15.59:0/188589753 >> v2:172.21.15.151:3300/0 conn(0x7ff98c0ca9b0 0x7ff98c0ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.163+0000 7ff990c37640 1 -- 172.21.15.59:0/188589753 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c0cafa0 con 0x7ff98c0ca5d0 2023-10-16T14:26:57.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.164+0000 7ff990c37640 1 --2- 172.21.15.59:0/188589753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff98c0ca5d0 0x7ff98c06cfd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff98c0c2850 tx=0x7ff98002b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd9f407c8e25b3d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:57.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.164+0000 7ff98b7fe640 1 -- 172.21.15.59:0/188589753 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff980031800 con 0x7ff98c0ca5d0 2023-10-16T14:26:57.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.164+0000 7ff98b7fe640 1 -- 172.21.15.59:0/188589753 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff980031960 con 0x7ff98c0ca5d0 2023-10-16T14:26:57.169 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.164+0000 7ff98b7fe640 1 -- 172.21.15.59:0/188589753 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff980031cf0 con 0x7ff98c0ca5d0 2023-10-16T14:26:57.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.165+0000 7ff992e9b640 1 -- 172.21.15.59:0/188589753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff98c0ca5d0 msgr2=0x7ff98c06cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:57.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.165+0000 7ff992e9b640 1 --2- 172.21.15.59:0/188589753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff98c0ca5d0 0x7ff98c06cfd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff98c0c2850 tx=0x7ff98002b8a0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.165+0000 7ff992e9b640 1 -- 172.21.15.59:0/188589753 shutdown_connections 2023-10-16T14:26:57.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.165+0000 7ff992e9b640 1 --2- 172.21.15.59:0/188589753 >> v2:172.21.15.151:3300/0 conn(0x7ff98c0ca9b0 0x7ff98c0ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.165+0000 7ff992e9b640 1 --2- 172.21.15.59:0/188589753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff98c06e0e0 0x7ff98c0ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.165+0000 7ff992e9b640 1 --2- 172.21.15.59:0/188589753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff98c0ca5d0 0x7ff98c06cfd0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.165+0000 7ff992e9b640 1 -- 172.21.15.59:0/188589753 >> 172.21.15.59:0/188589753 conn(0x7ff98c0b0870 msgr2=0x7ff98c0b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:57.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.165+0000 7ff992e9b640 1 -- 172.21.15.59:0/188589753 shutdown_connections 2023-10-16T14:26:57.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.165+0000 7ff992e9b640 1 -- 172.21.15.59:0/188589753 wait complete. 2023-10-16T14:26:57.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.167+0000 7ff992e9b640 1 Processor -- start 2023-10-16T14:26:57.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.168+0000 7ff992e9b640 1 -- start start 2023-10-16T14:26:57.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.169+0000 7ff992e9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff98c06e0e0 0x7ff98c152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:57.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.169+0000 7ff992e9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff98c0ca5d0 0x7ff98c0c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:57.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.169+0000 7ff992e9b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff98c0ca9b0 0x7ff98c0c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:57.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.169+0000 7ff992e9b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c150600 con 0x7ff98c0ca5d0 2023-10-16T14:26:57.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.169+0000 7ff992e9b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c0c25a0 con 0x7ff98c06e0e0 2023-10-16T14:26:57.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.169+0000 7ff992e9b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c1534e0 con 0x7ff98c0ca9b0 2023-10-16T14:26:57.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.169+0000 7ff98bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff98c0ca5d0 0x7ff98c0c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:57.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.169+0000 7ff98bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff98c0ca5d0 0x7ff98c0c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34588/0 (socket says 172.21.15.59:34588) 2023-10-16T14:26:57.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.169+0000 7ff98bfff640 1 -- 172.21.15.59:0/3365184389 learned_addr learned my addr 172.21.15.59:0/3365184389 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:57.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.169+0000 7ff990c37640 1 --2- 172.21.15.59:0/3365184389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff98c06e0e0 0x7ff98c152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:57.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.169+0000 7ff991438640 1 --2- 172.21.15.59:0/3365184389 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff98c0ca9b0 0x7ff98c0c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:57.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.170+0000 7ff98bfff640 1 -- 172.21.15.59:0/3365184389 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff98c0ca9b0 msgr2=0x7ff98c0c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:57.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.170+0000 7ff98bfff640 1 --2- 172.21.15.59:0/3365184389 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff98c0ca9b0 0x7ff98c0c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.170+0000 7ff98bfff640 1 -- 172.21.15.59:0/3365184389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff98c06e0e0 msgr2=0x7ff98c152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:57.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.170+0000 7ff98bfff640 1 --2- 172.21.15.59:0/3365184389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff98c06e0e0 0x7ff98c152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.170+0000 7ff98bfff640 1 -- 172.21.15.59:0/3365184389 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9800094d0 con 0x7ff98c0ca5d0 2023-10-16T14:26:57.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.170+0000 7ff991438640 1 --2- 172.21.15.59:0/3365184389 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff98c0ca9b0 0x7ff98c0c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:57.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.170+0000 7ff98bfff640 1 --2- 172.21.15.59:0/3365184389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff98c0ca5d0 0x7ff98c0c8140 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff97800b4a0 tx=0x7ff97800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:57.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.170+0000 7ff9897fa640 1 -- 172.21.15.59:0/3365184389 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff978010610 con 0x7ff98c0ca5d0 2023-10-16T14:26:57.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.170+0000 7ff9897fa640 1 -- 172.21.15.59:0/3365184389 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff978010770 con 0x7ff98c0ca5d0 2023-10-16T14:26:57.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.170+0000 7ff992e9b640 1 -- 172.21.15.59:0/3365184389 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98c0c2810 con 0x7ff98c0ca5d0 2023-10-16T14:26:57.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.170+0000 7ff9897fa640 1 -- 172.21.15.59:0/3365184389 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff978010b20 con 0x7ff98c0ca5d0 2023-10-16T14:26:57.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.170+0000 7ff992e9b640 1 -- 172.21.15.59:0/3365184389 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98c0c2dd0 con 0x7ff98c0ca5d0 2023-10-16T14:26:57.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.172+0000 7ff992e9b640 1 -- 172.21.15.59:0/3365184389 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff98c073ef0 con 0x7ff98c0ca5d0 2023-10-16T14:26:57.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.172+0000 7ff9897fa640 1 -- 172.21.15.59:0/3365184389 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff978010c80 con 0x7ff98c0ca5d0 2023-10-16T14:26:57.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.173+0000 7ff9897fa640 1 --2- 172.21.15.59:0/3365184389 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff97006ae70 0x7ff97006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:57.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.173+0000 7ff9897fa640 1 -- 172.21.15.59:0/3365184389 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff9780895d0 con 0x7ff98c0ca5d0 2023-10-16T14:26:57.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.174+0000 7ff990c37640 1 --2- 172.21.15.59:0/3365184389 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff97006ae70 0x7ff97006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:57.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.175+0000 7ff990c37640 1 --2- 172.21.15.59:0/3365184389 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff97006ae70 0x7ff97006d330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff980036000 tx=0x7ff98003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:57.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.177+0000 7ff9897fa640 1 -- 172.21.15.59:0/3365184389 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff9780542b0 con 0x7ff98c0ca5d0 2023-10-16T14:26:57.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.372+0000 7ff992e9b640 1 -- 172.21.15.59:0/3365184389 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff98c071bf0 con 0x7ff98c0ca5d0 2023-10-16T14:26:57.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.373+0000 7ff9897fa640 1 -- 172.21.15.59:0/3365184389 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff9780578d0 con 0x7ff98c0ca5d0 2023-10-16T14:26:57.376 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:26:57.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.376+0000 7ff992e9b640 1 -- 172.21.15.59:0/3365184389 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff97006ae70 msgr2=0x7ff97006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:57.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.376+0000 7ff992e9b640 1 --2- 172.21.15.59:0/3365184389 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff97006ae70 0x7ff97006d330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff980036000 tx=0x7ff98003c040 comp rx=0 tx=0).stop 2023-10-16T14:26:57.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.376+0000 7ff992e9b640 1 -- 172.21.15.59:0/3365184389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff98c0ca5d0 msgr2=0x7ff98c0c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:57.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.376+0000 7ff992e9b640 1 --2- 172.21.15.59:0/3365184389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff98c0ca5d0 0x7ff98c0c8140 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff97800b4a0 tx=0x7ff97800b960 comp rx=0 tx=0).stop 2023-10-16T14:26:57.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.376+0000 7ff992e9b640 1 -- 172.21.15.59:0/3365184389 shutdown_connections 2023-10-16T14:26:57.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.376+0000 7ff992e9b640 1 --2- 172.21.15.59:0/3365184389 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff97006ae70 0x7ff97006d330 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.376+0000 7ff992e9b640 1 --2- 172.21.15.59:0/3365184389 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff98c0ca9b0 0x7ff98c0c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.376+0000 7ff992e9b640 1 --2- 172.21.15.59:0/3365184389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff98c0ca5d0 0x7ff98c0c8140 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.376+0000 7ff992e9b640 1 --2- 172.21.15.59:0/3365184389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff98c06e0e0 0x7ff98c152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.376+0000 7ff992e9b640 1 -- 172.21.15.59:0/3365184389 >> 172.21.15.59:0/3365184389 conn(0x7ff98c0b0870 msgr2=0x7ff98c0af250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:57.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.377+0000 7ff992e9b640 1 -- 172.21.15.59:0/3365184389 shutdown_connections 2023-10-16T14:26:57.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.377+0000 7ff992e9b640 1 -- 172.21.15.59:0/3365184389 wait complete. 2023-10-16T14:26:57.398 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T14:26:57.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.619+0000 7faf9f061640 1 Processor -- start 2023-10-16T14:26:57.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.619+0000 7faf9f061640 1 -- start start 2023-10-16T14:26:57.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.620+0000 7faf9f061640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf9815a830 0x7faf980cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:57.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.620+0000 7faf9f061640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf98070a30 0x7faf980c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:57.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.620+0000 7faf9f061640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf980cf040 con 0x7faf980ca550 2023-10-16T14:26:57.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.620+0000 7faf9f061640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf980ce430 con 0x7faf98070a30 2023-10-16T14:26:57.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.620+0000 7faf9f061640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf980ce710 con 0x7faf9815a830 2023-10-16T14:26:57.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.621+0000 7faf9d5fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf98070a30 0x7faf980c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:57.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.621+0000 7faf9d5fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf98070a30 0x7faf980c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34590/0 (socket says 172.21.15.59:34590) 2023-10-16T14:26:57.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.621+0000 7faf9d5fe640 1 -- 172.21.15.59:0/1752333259 learned_addr learned my addr 172.21.15.59:0/1752333259 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:57.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.621+0000 7faf9cdfd640 1 --2- 172.21.15.59:0/1752333259 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf9815a830 0x7faf980cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:57.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.621+0000 7faf9d5fe640 1 -- 172.21.15.59:0/1752333259 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf9815a830 msgr2=0x7faf980cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:57.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.621+0000 7faf9d5fe640 1 --2- 172.21.15.59:0/1752333259 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf9815a830 0x7faf980cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.621+0000 7faf9d5fe640 1 -- 172.21.15.59:0/1752333259 >> v1:172.21.15.151:6789/0 conn(0x7faf980ca550 legacy=0x7faf98070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:57.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.621+0000 7faf9d5fe640 1 -- 172.21.15.59:0/1752333259 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf980ce9f0 con 0x7faf98070a30 2023-10-16T14:26:57.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.622+0000 7faf9d5fe640 1 --2- 172.21.15.59:0/1752333259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf98070a30 0x7faf980c8b50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7faf90009e50 tx=0x7faf9002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fbe8987cd76142e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:57.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.623+0000 7faf977fe640 1 -- 172.21.15.59:0/1752333259 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9002ca70 con 0x7faf98070a30 2023-10-16T14:26:57.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.623+0000 7faf977fe640 1 -- 172.21.15.59:0/1752333259 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9002cbd0 con 0x7faf98070a30 2023-10-16T14:26:57.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.623+0000 7faf977fe640 1 -- 172.21.15.59:0/1752333259 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf900343f0 con 0x7faf98070a30 2023-10-16T14:26:57.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.623+0000 7faf9f061640 1 -- 172.21.15.59:0/1752333259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf98070a30 msgr2=0x7faf980c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:57.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.623+0000 7faf9f061640 1 --2- 172.21.15.59:0/1752333259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf98070a30 0x7faf980c8b50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7faf90009e50 tx=0x7faf9002bed0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.624+0000 7faf9f061640 1 -- 172.21.15.59:0/1752333259 shutdown_connections 2023-10-16T14:26:57.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.624+0000 7faf9f061640 1 --2- 172.21.15.59:0/1752333259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf98070a30 0x7faf980c8b50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.624+0000 7faf9f061640 1 --2- 172.21.15.59:0/1752333259 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf9815a830 0x7faf980cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.624+0000 7faf9f061640 1 -- 172.21.15.59:0/1752333259 >> 172.21.15.59:0/1752333259 conn(0x7faf980b0030 msgr2=0x7faf980b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:57.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.624+0000 7faf9f061640 1 -- 172.21.15.59:0/1752333259 shutdown_connections 2023-10-16T14:26:57.629 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.624+0000 7faf9f061640 1 -- 172.21.15.59:0/1752333259 wait complete. 2023-10-16T14:26:57.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.626+0000 7faf9f061640 1 Processor -- start 2023-10-16T14:26:57.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.626+0000 7faf9f061640 1 -- start start 2023-10-16T14:26:57.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.627+0000 7faf9f061640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf98070a30 0x7faf980c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.627+0000 7faf9f061640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf980ca550 0x7faf981f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.627+0000 7faf9f061640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf9815a830 0x7faf98156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.627+0000 7faf9f061640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf981f2ea0 con 0x7faf980ca550 2023-10-16T14:26:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.627+0000 7faf9f061640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf980cc160 con 0x7faf9815a830 2023-10-16T14:26:57.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.627+0000 7faf9f061640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf980c7680 con 0x7faf98070a30 2023-10-16T14:26:57.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.627+0000 7faf97fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf980ca550 0x7faf981f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:57.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.628+0000 7faf97fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf980ca550 0x7faf981f2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34598/0 (socket says 172.21.15.59:34598) 2023-10-16T14:26:57.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.628+0000 7faf97fff640 1 -- 172.21.15.59:0/389323972 learned_addr learned my addr 172.21.15.59:0/389323972 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:57.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.628+0000 7faf9cdfd640 1 --2- 172.21.15.59:0/389323972 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf98070a30 0x7faf980c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:57.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.628+0000 7faf9d5fe640 1 --2- 172.21.15.59:0/389323972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf9815a830 0x7faf98156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:57.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.628+0000 7faf97fff640 1 -- 172.21.15.59:0/389323972 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf98070a30 msgr2=0x7faf980c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:57.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.628+0000 7faf97fff640 1 --2- 172.21.15.59:0/389323972 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf98070a30 0x7faf980c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.628+0000 7faf97fff640 1 -- 172.21.15.59:0/389323972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf9815a830 msgr2=0x7faf98156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:57.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.628+0000 7faf97fff640 1 --2- 172.21.15.59:0/389323972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf9815a830 0x7faf98156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.628+0000 7faf97fff640 1 -- 172.21.15.59:0/389323972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf90009b30 con 0x7faf980ca550 2023-10-16T14:26:57.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.628+0000 7faf97fff640 1 --2- 172.21.15.59:0/389323972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf980ca550 0x7faf981f2960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7faf8400c430 tx=0x7faf8400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:57.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.629+0000 7faf957fa640 1 -- 172.21.15.59:0/389323972 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84011790 con 0x7faf980ca550 2023-10-16T14:26:57.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.629+0000 7faf957fa640 1 -- 172.21.15.59:0/389323972 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf840118f0 con 0x7faf980ca550 2023-10-16T14:26:57.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.629+0000 7faf9f061640 1 -- 172.21.15.59:0/389323972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf980c7960 con 0x7faf980ca550 2023-10-16T14:26:57.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.629+0000 7faf957fa640 1 -- 172.21.15.59:0/389323972 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf84011ce0 con 0x7faf980ca550 2023-10-16T14:26:57.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.629+0000 7faf9f061640 1 -- 172.21.15.59:0/389323972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf980c7f20 con 0x7faf980ca550 2023-10-16T14:26:57.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.630+0000 7faf9f061640 1 -- 172.21.15.59:0/389323972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf980cc2d0 con 0x7faf980ca550 2023-10-16T14:26:57.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.631+0000 7faf957fa640 1 -- 172.21.15.59:0/389323972 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faf8401c460 con 0x7faf980ca550 2023-10-16T14:26:57.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.632+0000 7faf957fa640 1 --2- 172.21.15.59:0/389323972 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7faf7c06ae70 0x7faf7c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:57.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.633+0000 7faf957fa640 1 -- 172.21.15.59:0/389323972 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7faf84089870 con 0x7faf980ca550 2023-10-16T14:26:57.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.633+0000 7faf9cdfd640 1 --2- 172.21.15.59:0/389323972 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7faf7c06ae70 0x7faf7c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:57.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.634+0000 7faf9cdfd640 1 --2- 172.21.15.59:0/389323972 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7faf7c06ae70 0x7faf7c06d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faf8c006fd0 tx=0x7faf8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:57.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.637+0000 7faf957fa640 1 -- 172.21.15.59:0/389323972 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf84054680 con 0x7faf980ca550 2023-10-16T14:26:57.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.833+0000 7faf9f061640 1 -- 172.21.15.59:0/389323972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faf98073ef0 con 0x7faf980ca550 2023-10-16T14:26:57.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.834+0000 7faf957fa640 1 -- 172.21.15.59:0/389323972 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7faf84057ca0 con 0x7faf980ca550 2023-10-16T14:26:57.837 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.837+0000 7faf9f061640 1 -- 172.21.15.59:0/389323972 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7faf7c06ae70 msgr2=0x7faf7c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.837+0000 7faf9f061640 1 --2- 172.21.15.59:0/389323972 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7faf7c06ae70 0x7faf7c06d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faf8c006fd0 tx=0x7faf8c008040 comp rx=0 tx=0).stop 2023-10-16T14:26:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.837+0000 7faf9f061640 1 -- 172.21.15.59:0/389323972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf980ca550 msgr2=0x7faf981f2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.837+0000 7faf9f061640 1 --2- 172.21.15.59:0/389323972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf980ca550 0x7faf981f2960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7faf8400c430 tx=0x7faf8400c8f0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.837+0000 7faf9f061640 1 -- 172.21.15.59:0/389323972 shutdown_connections 2023-10-16T14:26:57.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.837+0000 7faf9f061640 1 --2- 172.21.15.59:0/389323972 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7faf7c06ae70 0x7faf7c06d330 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.837+0000 7faf9f061640 1 --2- 172.21.15.59:0/389323972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf9815a830 0x7faf98156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.837+0000 7faf9f061640 1 --2- 172.21.15.59:0/389323972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf980ca550 0x7faf981f2960 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.837+0000 7faf9f061640 1 --2- 172.21.15.59:0/389323972 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf98070a30 0x7faf980c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:57.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.837+0000 7faf9f061640 1 -- 172.21.15.59:0/389323972 >> 172.21.15.59:0/389323972 conn(0x7faf980b0030 msgr2=0x7faf980c4770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:57.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.837+0000 7faf9f061640 1 -- 172.21.15.59:0/389323972 shutdown_connections 2023-10-16T14:26:57.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:57.837+0000 7faf9f061640 1 -- 172.21.15.59:0/389323972 wait complete. 2023-10-16T14:26:57.861 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T14:26:58.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.089+0000 7fde69793640 1 Processor -- start 2023-10-16T14:26:58.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.089+0000 7fde69793640 1 -- start start 2023-10-16T14:26:58.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.090+0000 7fde69793640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde640d0d80 0x7fde640d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:58.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.090+0000 7fde69793640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde640ce810 con 0x7fde640b5fd0 2023-10-16T14:26:58.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.090+0000 7fde69793640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde640b5b40 con 0x7fde6415c940 2023-10-16T14:26:58.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.090+0000 7fde69793640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde640d1740 con 0x7fde640d0d80 2023-10-16T14:26:58.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.091+0000 7fde637fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde640d0d80 0x7fde640d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:58.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.091+0000 7fde68f92640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fde640b5fd0 0x7fde640b6420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38724/0 (socket says 172.21.15.59:38724) 2023-10-16T14:26:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.091+0000 7fde68f92640 1 -- 172.21.15.59:0/3330678314 learned_addr learned my addr 172.21.15.59:0/3330678314 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.091+0000 7fde637fe640 1 -- 172.21.15.59:0/3330678314 >> v1:172.21.15.151:6789/0 conn(0x7fde6415c940 legacy=0x7fde640d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:58.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.091+0000 7fde637fe640 1 -- 172.21.15.59:0/3330678314 >> v1:172.21.15.59:6789/0 conn(0x7fde640b5fd0 legacy=0x7fde640b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:58.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.091+0000 7fde637fe640 1 -- 172.21.15.59:0/3330678314 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde640d0b10 con 0x7fde640d0d80 2023-10-16T14:26:58.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.092+0000 7fde637fe640 1 --2- 172.21.15.59:0/3330678314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde640d0d80 0x7fde640d1200 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fde580097a0 tx=0x7fde5802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3202aadfd236bb59 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:58.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.093+0000 7fde62ffd640 1 -- 172.21.15.59:0/3330678314 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5802e070 con 0x7fde640d0d80 2023-10-16T14:26:58.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.093+0000 7fde62ffd640 1 -- 172.21.15.59:0/3330678314 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde580315a0 con 0x7fde640d0d80 2023-10-16T14:26:58.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.093+0000 7fde62ffd640 1 -- 172.21.15.59:0/3330678314 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58031930 con 0x7fde640d0d80 2023-10-16T14:26:58.103 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.093+0000 7fde69793640 1 -- 172.21.15.59:0/3330678314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde640d0d80 msgr2=0x7fde640d1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:58.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.093+0000 7fde69793640 1 --2- 172.21.15.59:0/3330678314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde640d0d80 0x7fde640d1200 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fde580097a0 tx=0x7fde5802b840 comp rx=0 tx=0).stop 2023-10-16T14:26:58.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.093+0000 7fde69793640 1 -- 172.21.15.59:0/3330678314 shutdown_connections 2023-10-16T14:26:58.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.093+0000 7fde69793640 1 --2- 172.21.15.59:0/3330678314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde640d0d80 0x7fde640d1200 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:58.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.093+0000 7fde69793640 1 -- 172.21.15.59:0/3330678314 >> 172.21.15.59:0/3330678314 conn(0x7fde6409bb30 msgr2=0x7fde640d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:58.104 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.093+0000 7fde69793640 1 -- 172.21.15.59:0/3330678314 shutdown_connections 2023-10-16T14:26:58.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.093+0000 7fde69793640 1 -- 172.21.15.59:0/3330678314 wait complete. 2023-10-16T14:26:58.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.095+0000 7fde69793640 1 Processor -- start 2023-10-16T14:26:58.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.095+0000 7fde69793640 1 -- start start 2023-10-16T14:26:58.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.096+0000 7fde69793640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde640b5fd0 0x7fde640c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:58.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.096+0000 7fde69793640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde640d0d80 0x7fde64159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:58.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.096+0000 7fde69793640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde6415c940 0x7fde64155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:58.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.096+0000 7fde69793640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde64157680 con 0x7fde640d0d80 2023-10-16T14:26:58.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.096+0000 7fde69793640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde640c8af0 con 0x7fde640b5fd0 2023-10-16T14:26:58.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.096+0000 7fde69793640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde640c8dd0 con 0x7fde6415c940 2023-10-16T14:26:58.106 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.097+0000 7fde637fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde640d0d80 0x7fde64159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:58.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.097+0000 7fde637fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde640d0d80 0x7fde64159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34628/0 (socket says 172.21.15.59:34628) 2023-10-16T14:26:58.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.097+0000 7fde637fe640 1 -- 172.21.15.59:0/1048605307 learned_addr learned my addr 172.21.15.59:0/1048605307 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:58.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.097+0000 7fde637fe640 1 -- 172.21.15.59:0/1048605307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde6415c940 msgr2=0x7fde64155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:58.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.097+0000 7fde68f92640 1 --2- 172.21.15.59:0/1048605307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde6415c940 0x7fde64155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:58.107 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.097+0000 7fde637fe640 1 --2- 172.21.15.59:0/1048605307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde6415c940 0x7fde64155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:58.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.097+0000 7fde637fe640 1 -- 172.21.15.59:0/1048605307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde640b5fd0 msgr2=0x7fde640c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:58.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.097+0000 7fde637fe640 1 --2- 172.21.15.59:0/1048605307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde640b5fd0 0x7fde640c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:58.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.097+0000 7fde637fe640 1 -- 172.21.15.59:0/1048605307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde58009400 con 0x7fde640d0d80 2023-10-16T14:26:58.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.098+0000 7fde637fe640 1 --2- 172.21.15.59:0/1048605307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde640d0d80 0x7fde64159540 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fde58000c00 tx=0x7fde580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:58.108 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.098+0000 7fde60ff9640 1 -- 172.21.15.59:0/1048605307 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58032900 con 0x7fde640d0d80 2023-10-16T14:26:58.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.098+0000 7fde60ff9640 1 -- 172.21.15.59:0/1048605307 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde58032a80 con 0x7fde640d0d80 2023-10-16T14:26:58.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.098+0000 7fde60ff9640 1 -- 172.21.15.59:0/1048605307 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58032e30 con 0x7fde640d0d80 2023-10-16T14:26:58.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.098+0000 7fde69793640 1 -- 172.21.15.59:0/1048605307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde641578f0 con 0x7fde640d0d80 2023-10-16T14:26:58.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.098+0000 7fde69793640 1 -- 172.21.15.59:0/1048605307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde640c90b0 con 0x7fde640d0d80 2023-10-16T14:26:58.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.099+0000 7fde69793640 1 -- 172.21.15.59:0/1048605307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde6404e9b0 con 0x7fde640d0d80 2023-10-16T14:26:58.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.100+0000 7fde60ff9640 1 -- 172.21.15.59:0/1048605307 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fde5803b3f0 con 0x7fde640d0d80 2023-10-16T14:26:58.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.101+0000 7fde60ff9640 1 --2- 172.21.15.59:0/1048605307 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fde5006ae70 0x7fde5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:58.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.101+0000 7fde60ff9640 1 -- 172.21.15.59:0/1048605307 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fde580aba20 con 0x7fde640d0d80 2023-10-16T14:26:58.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.102+0000 7fde63fff640 1 --2- 172.21.15.59:0/1048605307 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fde5006ae70 0x7fde5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:58.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.103+0000 7fde63fff640 1 --2- 172.21.15.59:0/1048605307 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fde5006ae70 0x7fde5006d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fde6415b760 tx=0x7fde54009230 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:58.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.106+0000 7fde60ff9640 1 -- 172.21.15.59:0/1048605307 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fde580767a0 con 0x7fde640d0d80 2023-10-16T14:26:58.301 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.299+0000 7fde69793640 1 -- 172.21.15.59:0/1048605307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fde640a04e0 con 0x7fde640d0d80 2023-10-16T14:26:58.302 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.300+0000 7fde60ff9640 1 -- 172.21.15.59:0/1048605307 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fde58079dc0 con 0x7fde640d0d80 2023-10-16T14:26:58.303 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-16T14:26:58.305 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.302+0000 7fde69793640 1 -- 172.21.15.59:0/1048605307 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fde5006ae70 msgr2=0x7fde5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:58.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.302+0000 7fde69793640 1 --2- 172.21.15.59:0/1048605307 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fde5006ae70 0x7fde5006d330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fde6415b760 tx=0x7fde54009230 comp rx=0 tx=0).stop 2023-10-16T14:26:58.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.302+0000 7fde69793640 1 -- 172.21.15.59:0/1048605307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde640d0d80 msgr2=0x7fde64159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:58.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.302+0000 7fde69793640 1 --2- 172.21.15.59:0/1048605307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde640d0d80 0x7fde64159540 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fde58000c00 tx=0x7fde580046c0 comp rx=0 tx=0).stop 2023-10-16T14:26:58.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.303+0000 7fde69793640 1 -- 172.21.15.59:0/1048605307 shutdown_connections 2023-10-16T14:26:58.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.303+0000 7fde69793640 1 --2- 172.21.15.59:0/1048605307 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fde5006ae70 0x7fde5006d330 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:58.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.303+0000 7fde69793640 1 --2- 172.21.15.59:0/1048605307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde6415c940 0x7fde64155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:58.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.303+0000 7fde69793640 1 --2- 172.21.15.59:0/1048605307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde640d0d80 0x7fde64159540 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:58.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.303+0000 7fde69793640 1 --2- 172.21.15.59:0/1048605307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde640b5fd0 0x7fde640c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:58.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.303+0000 7fde69793640 1 -- 172.21.15.59:0/1048605307 >> 172.21.15.59:0/1048605307 conn(0x7fde6409bb30 msgr2=0x7fde640b6420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:58.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.303+0000 7fde69793640 1 -- 172.21.15.59:0/1048605307 shutdown_connections 2023-10-16T14:26:58.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.303+0000 7fde69793640 1 -- 172.21.15.59:0/1048605307 wait complete. 2023-10-16T14:26:58.325 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T14:26:58.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.554+0000 7f7c712bb640 1 Processor -- start 2023-10-16T14:26:58.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.554+0000 7f7c712bb640 1 -- start start 2023-10-16T14:26:58.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.556+0000 7f7c712bb640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c6c0cf030 0x7f7c6c06ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:58.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.556+0000 7f7c712bb640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7c6c06d360 0x7f7c6c0ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:58.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.556+0000 7f7c712bb640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6c1550f0 con 0x7f7c6c154d10 2023-10-16T14:26:58.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.556+0000 7f7c712bb640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6c06db50 con 0x7f7c6c0cf030 2023-10-16T14:26:58.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.556+0000 7f7c712bb640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6c0b13f0 con 0x7f7c6c06d360 2023-10-16T14:26:58.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.556+0000 7f7c6b7fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c6c0cf030 0x7f7c6c06ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:58.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.556+0000 7f7c6b7fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c6c0cf030 0x7f7c6c06ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34632/0 (socket says 172.21.15.59:34632) 2023-10-16T14:26:58.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.556+0000 7f7c6b7fe640 1 -- 172.21.15.59:0/3126413252 learned_addr learned my addr 172.21.15.59:0/3126413252 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:58.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.556+0000 7f7c70aba640 1 --2- 172.21.15.59:0/3126413252 >> v2:172.21.15.151:3300/0 conn(0x7f7c6c06d360 0x7f7c6c0ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:58.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.557+0000 7f7c6b7fe640 1 -- 172.21.15.59:0/3126413252 >> v2:172.21.15.151:3300/0 conn(0x7f7c6c06d360 msgr2=0x7f7c6c0ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:58.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.557+0000 7f7c6b7fe640 1 --2- 172.21.15.59:0/3126413252 >> v2:172.21.15.151:3300/0 conn(0x7f7c6c06d360 0x7f7c6c0ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:58.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.557+0000 7f7c6b7fe640 1 -- 172.21.15.59:0/3126413252 >> v1:172.21.15.151:6789/0 conn(0x7f7c6c154d10 legacy=0x7f7c6c0ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:58.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.557+0000 7f7c6b7fe640 1 -- 172.21.15.59:0/3126413252 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c0b16d0 con 0x7f7c6c0cf030 2023-10-16T14:26:58.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.557+0000 7f7c70aba640 1 --2- 172.21.15.59:0/3126413252 >> v2:172.21.15.151:3300/0 conn(0x7f7c6c06d360 0x7f7c6c0ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:58.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.558+0000 7f7c6b7fe640 1 --2- 172.21.15.59:0/3126413252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c6c0cf030 0x7f7c6c06ce20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c06c090 tx=0x7f7c6002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ad91a0a9b1d57b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:58.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.559+0000 7f7c6affd640 1 -- 172.21.15.59:0/3126413252 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60031870 con 0x7f7c6c0cf030 2023-10-16T14:26:58.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.559+0000 7f7c6affd640 1 -- 172.21.15.59:0/3126413252 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c600319d0 con 0x7f7c6c0cf030 2023-10-16T14:26:58.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.559+0000 7f7c6affd640 1 -- 172.21.15.59:0/3126413252 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60031d60 con 0x7f7c6c0cf030 2023-10-16T14:26:58.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.559+0000 7f7c712bb640 1 -- 172.21.15.59:0/3126413252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c6c0cf030 msgr2=0x7f7c6c06ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:58.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.559+0000 7f7c712bb640 1 --2- 172.21.15.59:0/3126413252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c6c0cf030 0x7f7c6c06ce20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c06c090 tx=0x7f7c6002b910 comp rx=0 tx=0).stop 2023-10-16T14:26:58.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.559+0000 7f7c712bb640 1 -- 172.21.15.59:0/3126413252 shutdown_connections 2023-10-16T14:26:58.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.559+0000 7f7c712bb640 1 --2- 172.21.15.59:0/3126413252 >> v2:172.21.15.151:3300/0 conn(0x7f7c6c06d360 0x7f7c6c0ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:58.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.559+0000 7f7c712bb640 1 --2- 172.21.15.59:0/3126413252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c6c0cf030 0x7f7c6c06ce20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:58.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.559+0000 7f7c712bb640 1 -- 172.21.15.59:0/3126413252 >> 172.21.15.59:0/3126413252 conn(0x7f7c6c06a200 msgr2=0x7f7c6c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:58.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.560+0000 7f7c712bb640 1 -- 172.21.15.59:0/3126413252 shutdown_connections 2023-10-16T14:26:58.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.560+0000 7f7c712bb640 1 -- 172.21.15.59:0/3126413252 wait complete. 2023-10-16T14:26:58.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.561+0000 7f7c712bb640 1 Processor -- start 2023-10-16T14:26:58.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.561+0000 7f7c712bb640 1 -- start start 2023-10-16T14:26:58.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.562+0000 7f7c712bb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c6c06d360 0x7f7c6c153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:58.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.562+0000 7f7c712bb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c6c0cf030 0x7f7c6c0cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:58.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.562+0000 7f7c712bb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c6c154d10 0x7f7c6c159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:58.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.562+0000 7f7c712bb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c0cc400 con 0x7f7c6c06d360 2023-10-16T14:26:58.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.562+0000 7f7c712bb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c0cc6e0 con 0x7f7c6c154d10 2023-10-16T14:26:58.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.562+0000 7f7c712bb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c0cc9c0 con 0x7f7c6c0cf030 2023-10-16T14:26:58.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.563+0000 7f7c6bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c6c06d360 0x7f7c6c153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:58.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.563+0000 7f7c6bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c6c06d360 0x7f7c6c153500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34638/0 (socket says 172.21.15.59:34638) 2023-10-16T14:26:58.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.563+0000 7f7c6bfff640 1 -- 172.21.15.59:0/602633458 learned_addr learned my addr 172.21.15.59:0/602633458 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:58.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.563+0000 7f7c6b7fe640 1 --2- 172.21.15.59:0/602633458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c6c0cf030 0x7f7c6c0cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:58.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.563+0000 7f7c70aba640 1 --2- 172.21.15.59:0/602633458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c6c154d10 0x7f7c6c159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.563+0000 7f7c6bfff640 1 -- 172.21.15.59:0/602633458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c6c0cf030 msgr2=0x7f7c6c0cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.563+0000 7f7c6bfff640 1 --2- 172.21.15.59:0/602633458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c6c0cf030 0x7f7c6c0cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.563+0000 7f7c6bfff640 1 -- 172.21.15.59:0/602633458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c6c154d10 msgr2=0x7f7c6c159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.563+0000 7f7c6bfff640 1 --2- 172.21.15.59:0/602633458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c6c154d10 0x7f7c6c159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.564+0000 7f7c6bfff640 1 -- 172.21.15.59:0/602633458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c600094d0 con 0x7f7c6c06d360 2023-10-16T14:26:58.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.564+0000 7f7c6b7fe640 1 --2- 172.21.15.59:0/602633458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c6c0cf030 0x7f7c6c0cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:26:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.564+0000 7f7c6bfff640 1 --2- 172.21.15.59:0/602633458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c6c06d360 0x7f7c6c153500 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00c410 tx=0x7f7c5c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.564+0000 7f7c68ff9640 1 -- 172.21.15.59:0/602633458 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c0035f0 con 0x7f7c6c06d360 2023-10-16T14:26:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.564+0000 7f7c68ff9640 1 -- 172.21.15.59:0/602633458 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c003750 con 0x7f7c6c06d360 2023-10-16T14:26:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.564+0000 7f7c68ff9640 1 -- 172.21.15.59:0/602633458 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c003b40 con 0x7f7c6c06d360 2023-10-16T14:26:58.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.564+0000 7f7c712bb640 1 -- 172.21.15.59:0/602633458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6c0ccca0 con 0x7f7c6c06d360 2023-10-16T14:26:58.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.564+0000 7f7c712bb640 1 -- 172.21.15.59:0/602633458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6c0cd4a0 con 0x7f7c6c06d360 2023-10-16T14:26:58.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.565+0000 7f7c712bb640 1 -- 172.21.15.59:0/602633458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6c04e9b0 con 0x7f7c6c06d360 2023-10-16T14:26:58.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.566+0000 7f7c68ff9640 1 -- 172.21.15.59:0/602633458 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7c5c003ca0 con 0x7f7c6c06d360 2023-10-16T14:26:58.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.567+0000 7f7c68ff9640 1 --2- 172.21.15.59:0/602633458 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7c5806ae70 0x7f7c5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:58.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.568+0000 7f7c68ff9640 1 -- 172.21.15.59:0/602633458 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f7c5c088c20 con 0x7f7c6c06d360 2023-10-16T14:26:58.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.568+0000 7f7c6b7fe640 1 --2- 172.21.15.59:0/602633458 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7c5806ae70 0x7f7c5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:58.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.569+0000 7f7c6b7fe640 1 --2- 172.21.15.59:0/602633458 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7c5806ae70 0x7f7c5806d330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7c60036000 tx=0x7f7c6003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:58.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.572+0000 7f7c68ff9640 1 -- 172.21.15.59:0/602633458 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7c5c053900 con 0x7f7c6c06d360 2023-10-16T14:26:58.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.764+0000 7f7c712bb640 1 -- 172.21.15.59:0/602633458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7c6c15afa0 con 0x7f7c6c06d360 2023-10-16T14:26:58.768 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.765+0000 7f7c68ff9640 1 -- 172.21.15.59:0/602633458 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7c5c017020 con 0x7f7c6c06d360 2023-10-16T14:26:58.768 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:26:58.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.768+0000 7f7c712bb640 1 -- 172.21.15.59:0/602633458 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7c5806ae70 msgr2=0x7f7c5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:58.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.768+0000 7f7c712bb640 1 --2- 172.21.15.59:0/602633458 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7c5806ae70 0x7f7c5806d330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7c60036000 tx=0x7f7c6003c040 comp rx=0 tx=0).stop 2023-10-16T14:26:58.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.768+0000 7f7c712bb640 1 -- 172.21.15.59:0/602633458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c6c06d360 msgr2=0x7f7c6c153500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:58.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.768+0000 7f7c712bb640 1 --2- 172.21.15.59:0/602633458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c6c06d360 0x7f7c6c153500 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00c410 tx=0x7f7c5c00c8d0 comp rx=0 tx=0).stop 2023-10-16T14:26:58.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.768+0000 7f7c712bb640 1 -- 172.21.15.59:0/602633458 shutdown_connections 2023-10-16T14:26:58.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.768+0000 7f7c712bb640 1 --2- 172.21.15.59:0/602633458 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7c5806ae70 0x7f7c5806d330 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:58.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.768+0000 7f7c712bb640 1 --2- 172.21.15.59:0/602633458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c6c154d10 0x7f7c6c159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:58.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.768+0000 7f7c712bb640 1 --2- 172.21.15.59:0/602633458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c6c0cf030 0x7f7c6c0cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:58.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.768+0000 7f7c712bb640 1 --2- 172.21.15.59:0/602633458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c6c06d360 0x7f7c6c153500 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:58.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.768+0000 7f7c712bb640 1 -- 172.21.15.59:0/602633458 >> 172.21.15.59:0/602633458 conn(0x7f7c6c06a200 msgr2=0x7f7c6c0ca1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:58.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.769+0000 7f7c712bb640 1 -- 172.21.15.59:0/602633458 shutdown_connections 2023-10-16T14:26:58.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:58.769+0000 7f7c712bb640 1 -- 172.21.15.59:0/602633458 wait complete. 2023-10-16T14:26:58.792 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T14:26:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.011+0000 7f82e5f75640 1 Processor -- start 2023-10-16T14:26:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.011+0000 7f82e5f75640 1 -- start start 2023-10-16T14:26:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.012+0000 7f82e5f75640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f82e00cd0a0 0x7f82e00ce760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.013+0000 7f82e5f75640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e00cac20 con 0x7f82e00ceca0 2023-10-16T14:26:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.013+0000 7f82e5f75640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e006a6c0 con 0x7f82e015c9d0 2023-10-16T14:26:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.013+0000 7f82e5f75640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e00cc650 con 0x7f82e00cd0a0 2023-10-16T14:26:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.013+0000 7f82e5774640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f82e00ceca0 0x7f82e015cdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38734/0 (socket says 172.21.15.59:38734) 2023-10-16T14:26:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.013+0000 7f82e5774640 1 -- 172.21.15.59:0/779769307 learned_addr learned my addr 172.21.15.59:0/779769307 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:59.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.013+0000 7f82dffff640 1 --2- 172.21.15.59:0/779769307 >> v2:172.21.15.59:3300/0 conn(0x7f82e00cd0a0 0x7f82e00ce760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:59.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.013+0000 7f82df7fe640 1 -- 172.21.15.59:0/779769307 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595403452 0 0) 0x7f82e00cac20 con 0x7f82e00ceca0 2023-10-16T14:26:59.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.013+0000 7f82df7fe640 1 -- 172.21.15.59:0/779769307 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82d0003520 con 0x7f82e00ceca0 2023-10-16T14:26:59.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.014+0000 7f82dffff640 1 -- 172.21.15.59:0/779769307 >> v1:172.21.15.151:6789/0 conn(0x7f82e015c9d0 legacy=0x7f82e0069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:59.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.014+0000 7f82dffff640 1 -- 172.21.15.59:0/779769307 >> v1:172.21.15.59:6789/0 conn(0x7f82e00ceca0 legacy=0x7f82e015cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.014+0000 7f82dffff640 1 -- 172.21.15.59:0/779769307 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e006a9a0 con 0x7f82e00cd0a0 2023-10-16T14:26:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.015+0000 7f82dffff640 1 --2- 172.21.15.59:0/779769307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82e00cd0a0 0x7f82e00ce760 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0097a0 tx=0x7f82cc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59738f657dc9c631 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.015+0000 7f82df7fe640 1 -- 172.21.15.59:0/779769307 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc030610 con 0x7f82e00cd0a0 2023-10-16T14:26:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.015+0000 7f82df7fe640 1 -- 172.21.15.59:0/779769307 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82cc030770 con 0x7f82e00cd0a0 2023-10-16T14:26:59.019 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.015+0000 7f82df7fe640 1 -- 172.21.15.59:0/779769307 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc030b00 con 0x7f82e00cd0a0 2023-10-16T14:26:59.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.016+0000 7f82e5f75640 1 -- 172.21.15.59:0/779769307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82e00cd0a0 msgr2=0x7f82e00ce760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:59.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.016+0000 7f82e5f75640 1 --2- 172.21.15.59:0/779769307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82e00cd0a0 0x7f82e00ce760 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0097a0 tx=0x7f82cc02b960 comp rx=0 tx=0).stop 2023-10-16T14:26:59.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.016+0000 7f82e5f75640 1 -- 172.21.15.59:0/779769307 shutdown_connections 2023-10-16T14:26:59.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.016+0000 7f82e5f75640 1 --2- 172.21.15.59:0/779769307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82e00cd0a0 0x7f82e00ce760 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:59.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.016+0000 7f82e5f75640 1 -- 172.21.15.59:0/779769307 >> 172.21.15.59:0/779769307 conn(0x7f82e00cf4d0 msgr2=0x7f82e00cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:59.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.016+0000 7f82e5f75640 1 -- 172.21.15.59:0/779769307 shutdown_connections 2023-10-16T14:26:59.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.016+0000 7f82e5f75640 1 -- 172.21.15.59:0/779769307 wait complete. 2023-10-16T14:26:59.022 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.018+0000 7f82e5f75640 1 Processor -- start 2023-10-16T14:26:59.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.018+0000 7f82e5f75640 1 -- start start 2023-10-16T14:26:59.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.019+0000 7f82e5f75640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82e00cd0a0 0x7f82e014ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:59.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.019+0000 7f82e5f75640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82e00ceca0 0x7f82e00af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:59.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.019+0000 7f82e5f75640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82e015c9d0 0x7f82e00c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:59.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.019+0000 7f82e5f75640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00c65a0 con 0x7f82e015c9d0 2023-10-16T14:26:59.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.019+0000 7f82e5f75640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00b0090 con 0x7f82e00ceca0 2023-10-16T14:26:59.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.019+0000 7f82e5f75640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00b0370 con 0x7f82e00cd0a0 2023-10-16T14:26:59.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.019+0000 7f82e5774640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82e015c9d0 0x7f82e00c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:59.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.020+0000 7f82e5774640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82e015c9d0 0x7f82e00c8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34662/0 (socket says 172.21.15.59:34662) 2023-10-16T14:26:59.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.020+0000 7f82e5774640 1 -- 172.21.15.59:0/3501823408 learned_addr learned my addr 172.21.15.59:0/3501823408 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:59.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.020+0000 7f82e4f73640 1 --2- 172.21.15.59:0/3501823408 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82e00cd0a0 0x7f82e014ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.020+0000 7f82e5774640 1 -- 172.21.15.59:0/3501823408 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82e00cd0a0 msgr2=0x7f82e014ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.020+0000 7f82dffff640 1 --2- 172.21.15.59:0/3501823408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82e00ceca0 0x7f82e00af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.020+0000 7f82e5774640 1 --2- 172.21.15.59:0/3501823408 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82e00cd0a0 0x7f82e014ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.020+0000 7f82e5774640 1 -- 172.21.15.59:0/3501823408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82e00ceca0 msgr2=0x7f82e00af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:59.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.020+0000 7f82e5774640 1 --2- 172.21.15.59:0/3501823408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82e00ceca0 0x7f82e00af840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.020+0000 7f82e5774640 1 -- 172.21.15.59:0/3501823408 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc009400 con 0x7f82e015c9d0 2023-10-16T14:26:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.020+0000 7f82e4f73640 1 --2- 172.21.15.59:0/3501823408 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82e00cd0a0 0x7f82e014ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.020+0000 7f82dffff640 1 --2- 172.21.15.59:0/3501823408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82e00ceca0 0x7f82e00af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.020+0000 7f82e5774640 1 --2- 172.21.15.59:0/3501823408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82e015c9d0 0x7f82e00c8610 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f82d800cb40 tx=0x7f82d800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.021+0000 7f82dd7fa640 1 -- 172.21.15.59:0/3501823408 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d800aca0 con 0x7f82e015c9d0 2023-10-16T14:26:59.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.021+0000 7f82dd7fa640 1 -- 172.21.15.59:0/3501823408 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d800ae00 con 0x7f82e015c9d0 2023-10-16T14:26:59.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.021+0000 7f82dd7fa640 1 -- 172.21.15.59:0/3501823408 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8012620 con 0x7f82e015c9d0 2023-10-16T14:26:59.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.021+0000 7f82e5f75640 1 -- 172.21.15.59:0/3501823408 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e00b0650 con 0x7f82e015c9d0 2023-10-16T14:26:59.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.021+0000 7f82e5f75640 1 -- 172.21.15.59:0/3501823408 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e00afd80 con 0x7f82e015c9d0 2023-10-16T14:26:59.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.022+0000 7f82e5f75640 1 -- 172.21.15.59:0/3501823408 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e00c6a80 con 0x7f82e015c9d0 2023-10-16T14:26:59.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.023+0000 7f82dd7fa640 1 -- 172.21.15.59:0/3501823408 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f82d8007070 con 0x7f82e015c9d0 2023-10-16T14:26:59.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.024+0000 7f82dd7fa640 1 --2- 172.21.15.59:0/3501823408 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f82c406ae70 0x7f82c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:59.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.024+0000 7f82dd7fa640 1 -- 172.21.15.59:0/3501823408 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f82d8089a30 con 0x7f82e015c9d0 2023-10-16T14:26:59.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.025+0000 7f82e4f73640 1 --2- 172.21.15.59:0/3501823408 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f82c406ae70 0x7f82c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:59.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.026+0000 7f82e4f73640 1 --2- 172.21.15.59:0/3501823408 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f82c406ae70 0x7f82c406d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f82d4000fb0 tx=0x7f82d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:59.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.028+0000 7f82dd7fa640 1 -- 172.21.15.59:0/3501823408 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f82e00c6a80 con 0x7f82e015c9d0 2023-10-16T14:26:59.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.234+0000 7f82e5f75640 1 -- 172.21.15.59:0/3501823408 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f82e00c6a80 con 0x7f82e015c9d0 2023-10-16T14:26:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.235+0000 7f82dd7fa640 1 -- 172.21.15.59:0/3501823408 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f82e00c6a80 con 0x7f82e015c9d0 2023-10-16T14:26:59.238 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2023-10-16T14:26:59.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.238+0000 7f82e5f75640 1 -- 172.21.15.59:0/3501823408 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f82c406ae70 msgr2=0x7f82c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:59.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.238+0000 7f82e5f75640 1 --2- 172.21.15.59:0/3501823408 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f82c406ae70 0x7f82c406d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f82d4000fb0 tx=0x7f82d4009040 comp rx=0 tx=0).stop 2023-10-16T14:26:59.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.238+0000 7f82e5f75640 1 -- 172.21.15.59:0/3501823408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82e015c9d0 msgr2=0x7f82e00c8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:59.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.238+0000 7f82e5f75640 1 --2- 172.21.15.59:0/3501823408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82e015c9d0 0x7f82e00c8610 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f82d800cb40 tx=0x7f82d800a060 comp rx=0 tx=0).stop 2023-10-16T14:26:59.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.238+0000 7f82e5f75640 1 -- 172.21.15.59:0/3501823408 shutdown_connections 2023-10-16T14:26:59.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.238+0000 7f82e5f75640 1 --2- 172.21.15.59:0/3501823408 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f82c406ae70 0x7f82c406d330 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:59.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.238+0000 7f82e5f75640 1 --2- 172.21.15.59:0/3501823408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82e015c9d0 0x7f82e00c8610 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:59.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.238+0000 7f82e5f75640 1 --2- 172.21.15.59:0/3501823408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82e00ceca0 0x7f82e00af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:59.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.238+0000 7f82e5f75640 1 --2- 172.21.15.59:0/3501823408 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82e00cd0a0 0x7f82e014ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:59.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.238+0000 7f82e5f75640 1 -- 172.21.15.59:0/3501823408 >> 172.21.15.59:0/3501823408 conn(0x7f82e00cf4d0 msgr2=0x7f82e00b1550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:59.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.238+0000 7f82e5f75640 1 -- 172.21.15.59:0/3501823408 shutdown_connections 2023-10-16T14:26:59.243 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.238+0000 7f82e5f75640 1 -- 172.21.15.59:0/3501823408 wait complete. 2023-10-16T14:26:59.260 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:26:59.260 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T14:26:59.319 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:26:59.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.550+0000 7fca52f6e640 1 Processor -- start 2023-10-16T14:26:59.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.550+0000 7fca52f6e640 1 -- start start 2023-10-16T14:26:59.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.551+0000 7fca52f6e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca4c15a8d0 0x7fca4c0cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:59.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.551+0000 7fca52f6e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fca4c0ca660 0x7fca4c0cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:59.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.551+0000 7fca52f6e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4c15acb0 con 0x7fca4c06ff40 2023-10-16T14:26:59.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.551+0000 7fca52f6e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca4c0c1c60 con 0x7fca4c0ca660 2023-10-16T14:26:59.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.551+0000 7fca52f6e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c15e350 con 0x7fca4c15a8d0 2023-10-16T14:26:59.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.551+0000 7fca5276d640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fca4c06ff40 0x7fca4c06bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38742/0 (socket says 172.21.15.59:38742) 2023-10-16T14:26:59.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.551+0000 7fca5276d640 1 -- 172.21.15.59:0/3912782939 learned_addr learned my addr 172.21.15.59:0/3912782939 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:26:59.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.552+0000 7fca51f6c640 1 --2- 172.21.15.59:0/3912782939 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca4c15a8d0 0x7fca4c0cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:59.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.552+0000 7fca5176b640 1 --2- 172.21.15.59:0/3912782939 >> v2:172.21.15.151:3300/0 conn(0x7fca4c0ca660 0x7fca4c0cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:59.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.552+0000 7fca50f6a640 1 -- 172.21.15.59:0/3912782939 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897863435 0 0) 0x7fca44001490 con 0x7fca4c06ff40 2023-10-16T14:26:59.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.552+0000 7fca50f6a640 1 -- 172.21.15.59:0/3912782939 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca38003520 con 0x7fca4c06ff40 2023-10-16T14:26:59.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.552+0000 7fca50f6a640 1 -- 172.21.15.59:0/3912782939 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1561791623 0 0) 0x7fca38003520 con 0x7fca4c06ff40 2023-10-16T14:26:59.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.552+0000 7fca50f6a640 1 -- 172.21.15.59:0/3912782939 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca4c15a8d0 msgr2=0x7fca4c0cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:59.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.552+0000 7fca50f6a640 1 --2- 172.21.15.59:0/3912782939 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca4c15a8d0 0x7fca4c0cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:59.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.552+0000 7fca50f6a640 1 -- 172.21.15.59:0/3912782939 >> v2:172.21.15.151:3300/0 conn(0x7fca4c0ca660 msgr2=0x7fca4c0cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:59.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.552+0000 7fca50f6a640 1 --2- 172.21.15.59:0/3912782939 >> v2:172.21.15.151:3300/0 conn(0x7fca4c0ca660 0x7fca4c0cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:59.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.552+0000 7fca50f6a640 1 -- 172.21.15.59:0/3912782939 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c15e630 con 0x7fca4c06ff40 2023-10-16T14:26:59.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.552+0000 7fca50f6a640 1 -- 172.21.15.59:0/3912782939 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7fca44001b80 con 0x7fca4c06ff40 2023-10-16T14:26:59.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.552+0000 7fca50f6a640 1 -- 172.21.15.59:0/3912782939 >> v1:172.21.15.59:6789/0 conn(0x7fca4c06ff40 legacy=0x7fca4c06bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:59.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.552+0000 7fca50f6a640 1 --2- 172.21.15.59:0/3912782939 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca4c15a8d0 0x7fca38003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:59.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.552+0000 7fca50f6a640 1 --2- 172.21.15.59:0/3912782939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca38003ef0 0x7fca380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:59.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.553+0000 7fca50f6a640 1 --2- 172.21.15.59:0/3912782939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca38004d00 0x7fca38005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:59.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.553+0000 7fca50f6a640 1 -- 172.21.15.59:0/3912782939 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c0c1c60 con 0x7fca38003ef0 2023-10-16T14:26:59.560 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.553+0000 7fca50f6a640 1 -- 172.21.15.59:0/3912782939 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c15e350 con 0x7fca38004d00 2023-10-16T14:26:59.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.553+0000 7fca50f6a640 1 -- 172.21.15.59:0/3912782939 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3800b980 con 0x7fca4c15a8d0 2023-10-16T14:26:59.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.553+0000 7fca5176b640 1 --2- 172.21.15.59:0/3912782939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca38003ef0 0x7fca380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:59.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.553+0000 7fca5276d640 1 --2- 172.21.15.59:0/3912782939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca38004d00 0x7fca38005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:59.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.553+0000 7fca51f6c640 1 --2- 172.21.15.59:0/3912782939 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca4c15a8d0 0x7fca38003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:59.561 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.553+0000 7fca5176b640 1 -- 172.21.15.59:0/3912782939 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca4c15a8d0 msgr2=0x7fca38003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:59.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.553+0000 7fca5176b640 1 --2- 172.21.15.59:0/3912782939 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca4c15a8d0 0x7fca38003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:59.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.553+0000 7fca5176b640 1 -- 172.21.15.59:0/3912782939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca38004d00 msgr2=0x7fca38005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:26:59.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.553+0000 7fca5176b640 1 --2- 172.21.15.59:0/3912782939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca38004d00 0x7fca38005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:59.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.553+0000 7fca5176b640 1 -- 172.21.15.59:0/3912782939 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca38003520 con 0x7fca38003ef0 2023-10-16T14:26:59.562 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.554+0000 7fca5176b640 1 --2- 172.21.15.59:0/3912782939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca38003ef0 0x7fca380047c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009ac0 tx=0x7fca380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aced5f037455d2d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:59.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.555+0000 7fca50f6a640 1 -- 172.21.15.59:0/3912782939 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c02c6d0 con 0x7fca38003ef0 2023-10-16T14:26:59.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.555+0000 7fca50f6a640 1 -- 172.21.15.59:0/3912782939 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c02c830 con 0x7fca38003ef0 2023-10-16T14:26:59.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.555+0000 7fca50f6a640 1 -- 172.21.15.59:0/3912782939 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c02cbc0 con 0x7fca38003ef0 2023-10-16T14:26:59.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.555+0000 7fca52f6e640 1 -- 172.21.15.59:0/3912782939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca38003ef0 msgr2=0x7fca380047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:59.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.555+0000 7fca52f6e640 1 --2- 172.21.15.59:0/3912782939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca38003ef0 0x7fca380047c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009ac0 tx=0x7fca380057f0 comp rx=0 tx=0).stop 2023-10-16T14:26:59.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.555+0000 7fca5276d640 1 -- 172.21.15.59:0/3912782939 reap_dead start 2023-10-16T14:26:59.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.555+0000 7fca52f6e640 1 -- 172.21.15.59:0/3912782939 shutdown_connections 2023-10-16T14:26:59.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.556+0000 7fca52f6e640 1 -- 172.21.15.59:0/3912782939 >> 172.21.15.59:0/3912782939 conn(0x7fca4c06a470 msgr2=0x7fca4c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:59.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.556+0000 7fca52f6e640 1 -- 172.21.15.59:0/3912782939 shutdown_connections 2023-10-16T14:26:59.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.556+0000 7fca52f6e640 1 -- 172.21.15.59:0/3912782939 wait complete. 2023-10-16T14:26:59.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.557+0000 7fca52f6e640 1 Processor -- start 2023-10-16T14:26:59.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.558+0000 7fca52f6e640 1 -- start start 2023-10-16T14:26:59.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.559+0000 7fca52f6e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca38003ef0 0x7fca4c0c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:59.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.559+0000 7fca52f6e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca4c14d7e0 0x7fca4c15d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:59.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.559+0000 7fca52f6e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca4c15da20 0x7fca4c14e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:59.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.559+0000 7fca52f6e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c0c75d0 con 0x7fca4c14d7e0 2023-10-16T14:26:59.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.559+0000 7fca52f6e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c0c5790 con 0x7fca4c15da20 2023-10-16T14:26:59.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.559+0000 7fca52f6e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c15c440 con 0x7fca38003ef0 2023-10-16T14:26:59.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.559+0000 7fca5176b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca4c14d7e0 0x7fca4c15d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:59.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.559+0000 7fca5176b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca4c14d7e0 0x7fca4c15d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34678/0 (socket says 172.21.15.59:34678) 2023-10-16T14:26:59.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.559+0000 7fca5176b640 1 -- 172.21.15.59:0/3319487698 learned_addr learned my addr 172.21.15.59:0/3319487698 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:26:59.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.559+0000 7fca5276d640 1 --2- 172.21.15.59:0/3319487698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca4c15da20 0x7fca4c14e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:59.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.559+0000 7fca51f6c640 1 --2- 172.21.15.59:0/3319487698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca38003ef0 0x7fca4c0c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:59.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.559+0000 7fca5176b640 1 -- 172.21.15.59:0/3319487698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca38003ef0 msgr2=0x7fca4c0c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:59.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.559+0000 7fca5176b640 1 --2- 172.21.15.59:0/3319487698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca38003ef0 0x7fca4c0c6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:59.570 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.559+0000 7fca5176b640 1 -- 172.21.15.59:0/3319487698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca4c15da20 msgr2=0x7fca4c14e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:59.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.559+0000 7fca5176b640 1 --2- 172.21.15.59:0/3319487698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca4c15da20 0x7fca4c14e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:59.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.559+0000 7fca5176b640 1 -- 172.21.15.59:0/3319487698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c15c720 con 0x7fca4c14d7e0 2023-10-16T14:26:59.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.559+0000 7fca5276d640 1 --2- 172.21.15.59:0/3319487698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca4c15da20 0x7fca4c14e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:26:59.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.560+0000 7fca5176b640 1 --2- 172.21.15.59:0/3319487698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca4c14d7e0 0x7fca4c15d4e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fca3c02c2d0 tx=0x7fca3c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:59.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.560+0000 7fca427fc640 1 -- 172.21.15.59:0/3319487698 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c003810 con 0x7fca4c14d7e0 2023-10-16T14:26:59.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.560+0000 7fca427fc640 1 -- 172.21.15.59:0/3319487698 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c003970 con 0x7fca4c14d7e0 2023-10-16T14:26:59.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.560+0000 7fca427fc640 1 -- 172.21.15.59:0/3319487698 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c003ce0 con 0x7fca4c14d7e0 2023-10-16T14:26:59.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.560+0000 7fca52f6e640 1 -- 172.21.15.59:0/3319487698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4c15ca00 con 0x7fca4c14d7e0 2023-10-16T14:26:59.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.560+0000 7fca52f6e640 1 -- 172.21.15.59:0/3319487698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4c15cfc0 con 0x7fca4c14d7e0 2023-10-16T14:26:59.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.562+0000 7fca52f6e640 1 -- 172.21.15.59:0/3319487698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4c15d150 con 0x7fca4c14d7e0 2023-10-16T14:26:59.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.562+0000 7fca427fc640 1 -- 172.21.15.59:0/3319487698 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fca3c040450 con 0x7fca4c14d7e0 2023-10-16T14:26:59.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.563+0000 7fca427fc640 1 --2- 172.21.15.59:0/3319487698 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fca3006ae70 0x7fca3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:26:59.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.563+0000 7fca427fc640 1 -- 172.21.15.59:0/3319487698 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fca3c0ab950 con 0x7fca4c14d7e0 2023-10-16T14:26:59.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.564+0000 7fca51f6c640 1 --2- 172.21.15.59:0/3319487698 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fca3006ae70 0x7fca3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:26:59.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.565+0000 7fca51f6c640 1 --2- 172.21.15.59:0/3319487698 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fca3006ae70 0x7fca3006d330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fca48009880 tx=0x7fca48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:26:59.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.568+0000 7fca427fc640 1 -- 172.21.15.59:0/3319487698 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fca3c07a1e0 con 0x7fca4c14d7e0 2023-10-16T14:26:59.767 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.765+0000 7fca52f6e640 1 -- 172.21.15.59:0/3319487698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca4c04e9b0 con 0x7fca4c14d7e0 2023-10-16T14:26:59.769 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.767+0000 7fca427fc640 1 -- 172.21.15.59:0/3319487698 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18445 (secure 0 0 0) 0x7fca3c0044e0 con 0x7fca4c14d7e0 2023-10-16T14:26:59.770 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:26:59.770 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:26:29.634854+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:26:59.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.770+0000 7fca52f6e640 1 -- 172.21.15.59:0/3319487698 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fca3006ae70 msgr2=0x7fca3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.770+0000 7fca52f6e640 1 --2- 172.21.15.59:0/3319487698 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fca3006ae70 0x7fca3006d330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fca48009880 tx=0x7fca48008040 comp rx=0 tx=0).stop 2023-10-16T14:26:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.770+0000 7fca52f6e640 1 -- 172.21.15.59:0/3319487698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca4c14d7e0 msgr2=0x7fca4c15d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:26:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.770+0000 7fca52f6e640 1 --2- 172.21.15.59:0/3319487698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca4c14d7e0 0x7fca4c15d4e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fca3c02c2d0 tx=0x7fca3c004730 comp rx=0 tx=0).stop 2023-10-16T14:26:59.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.770+0000 7fca52f6e640 1 -- 172.21.15.59:0/3319487698 shutdown_connections 2023-10-16T14:26:59.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.770+0000 7fca52f6e640 1 --2- 172.21.15.59:0/3319487698 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fca3006ae70 0x7fca3006d330 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:59.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.770+0000 7fca52f6e640 1 --2- 172.21.15.59:0/3319487698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca4c15da20 0x7fca4c14e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:59.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.770+0000 7fca52f6e640 1 --2- 172.21.15.59:0/3319487698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca4c14d7e0 0x7fca4c15d4e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:59.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.770+0000 7fca52f6e640 1 --2- 172.21.15.59:0/3319487698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca38003ef0 0x7fca4c0c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:26:59.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.770+0000 7fca52f6e640 1 -- 172.21.15.59:0/3319487698 >> 172.21.15.59:0/3319487698 conn(0x7fca4c06a470 msgr2=0x7fca4c0af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:26:59.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.770+0000 7fca52f6e640 1 -- 172.21.15.59:0/3319487698 shutdown_connections 2023-10-16T14:26:59.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:26:59.770+0000 7fca52f6e640 1 -- 172.21.15.59:0/3319487698 wait complete. 2023-10-16T14:26:59.794 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T14:25:46.371818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T14:25:47.145341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T14:25:50.758038+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T14:26:59.795 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:27:00.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.020+0000 7f4af759e640 1 Processor -- start 2023-10-16T14:27:00.023 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.020+0000 7f4af759e640 1 -- start start 2023-10-16T14:27:00.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.022+0000 7f4af759e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4af80cb400 0x7f4af815e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:00.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.022+0000 7f4af759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4af80c8930 0x7f4af80707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:00.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.022+0000 7f4af759e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af80c8e40 con 0x7f4af8070400 2023-10-16T14:27:00.025 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.022+0000 7f4af759e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af80c9090 con 0x7f4af80cb400 2023-10-16T14:27:00.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.022+0000 7f4af759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af80c9370 con 0x7f4af80c8930 2023-10-16T14:27:00.026 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.023+0000 7f4af6d9d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4af80c8930 0x7f4af80707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:00.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.023+0000 7f4aeffff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4af80cb400 0x7f4af815e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:00.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.023+0000 7f4aeffff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4af80cb400 0x7f4af815e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.59:50226/0 (socket says 172.21.15.59:50226) 2023-10-16T14:27:00.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.023+0000 7f4af6d9d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4af80c8930 0x7f4af80707e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.59:57062/0 (socket says 172.21.15.59:57062) 2023-10-16T14:27:00.027 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.023+0000 7f4aeffff640 1 -- 172.21.15.59:0/2907864714 learned_addr learned my addr 172.21.15.59:0/2907864714 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:00.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.024+0000 7f4aeffff640 1 -- 172.21.15.59:0/2907864714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4af80c8930 msgr2=0x7f4af80707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:00.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.024+0000 7f4aeffff640 1 --2- 172.21.15.59:0/2907864714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4af80c8930 0x7f4af80707e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.028 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.024+0000 7f4aeffff640 1 -- 172.21.15.59:0/2907864714 >> v1:172.21.15.151:6789/0 conn(0x7f4af8070400 legacy=0x7f4af80cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:00.029 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.024+0000 7f4aeffff640 1 -- 172.21.15.59:0/2907864714 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af80c9650 con 0x7f4af80cb400 2023-10-16T14:27:00.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.025+0000 7f4aeffff640 1 --2- 172.21.15.59:0/2907864714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4af80cb400 0x7f4af815e210 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009870 tx=0x7f4ae002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f49cdc767a2c2acd server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:00.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.026+0000 7f4af5d9b640 1 -- 172.21.15.59:0/2907864714 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0030840 con 0x7f4af80cb400 2023-10-16T14:27:00.030 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.026+0000 7f4af5d9b640 1 -- 172.21.15.59:0/2907864714 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae00309a0 con 0x7f4af80cb400 2023-10-16T14:27:00.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.026+0000 7f4af5d9b640 1 -- 172.21.15.59:0/2907864714 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0030d30 con 0x7f4af80cb400 2023-10-16T14:27:00.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.027+0000 7f4af759e640 1 -- 172.21.15.59:0/2907864714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4af80cb400 msgr2=0x7f4af815e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:00.031 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.027+0000 7f4af759e640 1 --2- 172.21.15.59:0/2907864714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4af80cb400 0x7f4af815e210 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009870 tx=0x7f4ae002b980 comp rx=0 tx=0).stop 2023-10-16T14:27:00.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.027+0000 7f4af759e640 1 -- 172.21.15.59:0/2907864714 shutdown_connections 2023-10-16T14:27:00.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.027+0000 7f4af759e640 1 --2- 172.21.15.59:0/2907864714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4af80c8930 0x7f4af80707e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.032 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.027+0000 7f4af759e640 1 --2- 172.21.15.59:0/2907864714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4af80cb400 0x7f4af815e210 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.027+0000 7f4af759e640 1 -- 172.21.15.59:0/2907864714 >> 172.21.15.59:0/2907864714 conn(0x7f4af806a470 msgr2=0x7f4af80afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:00.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.027+0000 7f4af759e640 1 -- 172.21.15.59:0/2907864714 shutdown_connections 2023-10-16T14:27:00.033 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.027+0000 7f4af759e640 1 -- 172.21.15.59:0/2907864714 wait complete. 2023-10-16T14:27:00.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.030+0000 7f4af759e640 1 Processor -- start 2023-10-16T14:27:00.036 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.030+0000 7f4af759e640 1 -- start start 2023-10-16T14:27:00.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.031+0000 7f4af759e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4af8070400 0x7f4af814c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:00.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.031+0000 7f4af759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4af80c8930 0x7f4af80cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:00.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.031+0000 7f4af759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4af80cb400 0x7f4af81596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:00.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.031+0000 7f4af759e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af80ccb30 con 0x7f4af8070400 2023-10-16T14:27:00.037 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.031+0000 7f4af759e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af80cbeb0 con 0x7f4af80cb400 2023-10-16T14:27:00.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.031+0000 7f4af759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af80cc190 con 0x7f4af80c8930 2023-10-16T14:27:00.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.032+0000 7f4af659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4af8070400 0x7f4af814c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:00.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.032+0000 7f4af659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4af8070400 0x7f4af814c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34686/0 (socket says 172.21.15.59:34686) 2023-10-16T14:27:00.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.032+0000 7f4af659c640 1 -- 172.21.15.59:0/1166220280 learned_addr learned my addr 172.21.15.59:0/1166220280 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:00.038 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.032+0000 7f4af6d9d640 1 --2- 172.21.15.59:0/1166220280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4af80cb400 0x7f4af81596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:00.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.032+0000 7f4aeffff640 1 --2- 172.21.15.59:0/1166220280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4af80c8930 0x7f4af80cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:00.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.032+0000 7f4af659c640 1 -- 172.21.15.59:0/1166220280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4af80c8930 msgr2=0x7f4af80cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:00.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.032+0000 7f4af659c640 1 --2- 172.21.15.59:0/1166220280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4af80c8930 0x7f4af80cd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.039 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.032+0000 7f4af659c640 1 -- 172.21.15.59:0/1166220280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4af80cb400 msgr2=0x7f4af81596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:00.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.032+0000 7f4af659c640 1 --2- 172.21.15.59:0/1166220280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4af80cb400 0x7f4af81596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.032+0000 7f4af659c640 1 -- 172.21.15.59:0/1166220280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae00094d0 con 0x7f4af8070400 2023-10-16T14:27:00.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.033+0000 7f4af659c640 1 --2- 172.21.15.59:0/1166220280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4af8070400 0x7f4af814c860 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800c450 tx=0x7f4ae800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:00.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.033+0000 7f4aeeffd640 1 -- 172.21.15.59:0/1166220280 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae80052d0 con 0x7f4af8070400 2023-10-16T14:27:00.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.033+0000 7f4aeeffd640 1 -- 172.21.15.59:0/1166220280 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae8005430 con 0x7f4af8070400 2023-10-16T14:27:00.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.033+0000 7f4aeeffd640 1 -- 172.21.15.59:0/1166220280 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8012870 con 0x7f4af8070400 2023-10-16T14:27:00.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.033+0000 7f4af759e640 1 -- 172.21.15.59:0/1166220280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af80cc470 con 0x7f4af8070400 2023-10-16T14:27:00.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.033+0000 7f4af759e640 1 -- 172.21.15.59:0/1166220280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af80cdce0 con 0x7f4af8070400 2023-10-16T14:27:00.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.035+0000 7f4af759e640 1 -- 172.21.15.59:0/1166220280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af80cde70 con 0x7f4af8070400 2023-10-16T14:27:00.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.035+0000 7f4aeeffd640 1 -- 172.21.15.59:0/1166220280 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4ae80129d0 con 0x7f4af8070400 2023-10-16T14:27:00.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.037+0000 7f4aeeffd640 1 --2- 172.21.15.59:0/1166220280 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4ad806aec0 0x7f4ad806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:00.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.037+0000 7f4aeeffd640 1 -- 172.21.15.59:0/1166220280 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f4ae8089450 con 0x7f4af8070400 2023-10-16T14:27:00.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.038+0000 7f4aeffff640 1 --2- 172.21.15.59:0/1166220280 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4ad806aec0 0x7f4ad806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:00.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.039+0000 7f4aeffff640 1 --2- 172.21.15.59:0/1166220280 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4ad806aec0 0x7f4ad806d380 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0036000 tx=0x7f4ae003b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:00.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.042+0000 7f4aeeffd640 1 -- 172.21.15.59:0/1166220280 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4ae8054240 con 0x7f4af8070400 2023-10-16T14:27:00.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.237+0000 7f4af759e640 1 -- 172.21.15.59:0/1166220280 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4af80ccc70 con 0x7f4af8070400 2023-10-16T14:27:00.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.238+0000 7f4aeeffd640 1 -- 172.21.15.59:0/1166220280 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4af80ccc70 con 0x7f4af8070400 2023-10-16T14:27:00.242 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:27:00.244 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.241+0000 7f4af759e640 1 -- 172.21.15.59:0/1166220280 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4ad806aec0 msgr2=0x7f4ad806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:00.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.241+0000 7f4af759e640 1 --2- 172.21.15.59:0/1166220280 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4ad806aec0 0x7f4ad806d380 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0036000 tx=0x7f4ae003b040 comp rx=0 tx=0).stop 2023-10-16T14:27:00.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.241+0000 7f4af759e640 1 -- 172.21.15.59:0/1166220280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4af8070400 msgr2=0x7f4af814c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:00.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.241+0000 7f4af759e640 1 --2- 172.21.15.59:0/1166220280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4af8070400 0x7f4af814c860 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800c450 tx=0x7f4ae800c910 comp rx=0 tx=0).stop 2023-10-16T14:27:00.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.241+0000 7f4af759e640 1 -- 172.21.15.59:0/1166220280 shutdown_connections 2023-10-16T14:27:00.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.241+0000 7f4af759e640 1 --2- 172.21.15.59:0/1166220280 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4ad806aec0 0x7f4ad806d380 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.241+0000 7f4af759e640 1 --2- 172.21.15.59:0/1166220280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4af80cb400 0x7f4af81596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.241+0000 7f4af759e640 1 --2- 172.21.15.59:0/1166220280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4af80c8930 0x7f4af80cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.241+0000 7f4af759e640 1 --2- 172.21.15.59:0/1166220280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4af8070400 0x7f4af814c860 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.241+0000 7f4af759e640 1 -- 172.21.15.59:0/1166220280 >> 172.21.15.59:0/1166220280 conn(0x7f4af806a470 msgr2=0x7f4af815af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:00.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.242+0000 7f4af759e640 1 -- 172.21.15.59:0/1166220280 shutdown_connections 2023-10-16T14:27:00.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.242+0000 7f4af759e640 1 -- 172.21.15.59:0/1166220280 wait complete. 2023-10-16T14:27:00.262 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T14:27:00.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.492+0000 7fc4b7fff640 1 Processor -- start 2023-10-16T14:27:00.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.492+0000 7fc4b7fff640 1 -- start start 2023-10-16T14:27:00.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.494+0000 7fc4b7fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc4b80d0d80 0x7fc4b80d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:00.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.494+0000 7fc4b7fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc4b80b5fd0 0x7fc4b80b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:00.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.494+0000 7fc4b7fff640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b80ce810 con 0x7fc4b815c940 2023-10-16T14:27:00.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.494+0000 7fc4b7fff640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b80d1740 con 0x7fc4b80b5fd0 2023-10-16T14:27:00.497 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.494+0000 7fc4b7fff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b80b5b40 con 0x7fc4b80d0d80 2023-10-16T14:27:00.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.494+0000 7fc4b6ffd640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc4b815c940 0x7fc4b80d0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38748/0 (socket says 172.21.15.59:38748) 2023-10-16T14:27:00.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.494+0000 7fc4b6ffd640 1 -- 172.21.15.59:0/453699804 learned_addr learned my addr 172.21.15.59:0/453699804 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:00.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.494+0000 7fc4b77fe640 1 --2- 172.21.15.59:0/453699804 >> v2:172.21.15.59:3300/0 conn(0x7fc4b80b5fd0 0x7fc4b80b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:00.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.494+0000 7fc4b67fc640 1 --2- 172.21.15.59:0/453699804 >> v2:172.21.15.151:3300/0 conn(0x7fc4b80d0d80 0x7fc4b80d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:00.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.495+0000 7fc4b77fe640 1 -- 172.21.15.59:0/453699804 >> v2:172.21.15.151:3300/0 conn(0x7fc4b80d0d80 msgr2=0x7fc4b80d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:00.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.495+0000 7fc4b77fe640 1 --2- 172.21.15.59:0/453699804 >> v2:172.21.15.151:3300/0 conn(0x7fc4b80d0d80 0x7fc4b80d1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.495+0000 7fc4b77fe640 1 -- 172.21.15.59:0/453699804 >> v1:172.21.15.59:6789/0 conn(0x7fc4b815c940 legacy=0x7fc4b80d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:00.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.495+0000 7fc4b77fe640 1 -- 172.21.15.59:0/453699804 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b80d0b10 con 0x7fc4b80b5fd0 2023-10-16T14:27:00.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.495+0000 7fc4b5ffb640 1 -- 172.21.15.59:0/453699804 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761813976 0 0) 0x7fc4b80ce810 con 0x7fc4b815c940 2023-10-16T14:27:00.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.496+0000 7fc4b77fe640 1 --2- 172.21.15.59:0/453699804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b80b5fd0 0x7fc4b80b6420 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80b88e0 tx=0x7fc4b002be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a654fd80124c7ece server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:00.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.496+0000 7fc4b5ffb640 1 -- 172.21.15.59:0/453699804 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b002cbe0 con 0x7fc4b80b5fd0 2023-10-16T14:27:00.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.496+0000 7fc4b5ffb640 1 -- 172.21.15.59:0/453699804 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b002cd40 con 0x7fc4b80b5fd0 2023-10-16T14:27:00.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.496+0000 7fc4b5ffb640 1 -- 172.21.15.59:0/453699804 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0034660 con 0x7fc4b80b5fd0 2023-10-16T14:27:00.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.497+0000 7fc4b7fff640 1 -- 172.21.15.59:0/453699804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b80b5fd0 msgr2=0x7fc4b80b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:00.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.497+0000 7fc4b7fff640 1 --2- 172.21.15.59:0/453699804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b80b5fd0 0x7fc4b80b6420 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80b88e0 tx=0x7fc4b002be30 comp rx=0 tx=0).stop 2023-10-16T14:27:00.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.497+0000 7fc4b7fff640 1 -- 172.21.15.59:0/453699804 shutdown_connections 2023-10-16T14:27:00.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.497+0000 7fc4b7fff640 1 --2- 172.21.15.59:0/453699804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b80b5fd0 0x7fc4b80b6420 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.497+0000 7fc4b7fff640 1 --2- 172.21.15.59:0/453699804 >> v2:172.21.15.151:3300/0 conn(0x7fc4b80d0d80 0x7fc4b80d1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.497+0000 7fc4b7fff640 1 -- 172.21.15.59:0/453699804 >> 172.21.15.59:0/453699804 conn(0x7fc4b809bb30 msgr2=0x7fc4b80d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:00.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.497+0000 7fc4b7fff640 1 -- 172.21.15.59:0/453699804 shutdown_connections 2023-10-16T14:27:00.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.497+0000 7fc4b7fff640 1 -- 172.21.15.59:0/453699804 wait complete. 2023-10-16T14:27:00.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.500+0000 7fc4b7fff640 1 Processor -- start 2023-10-16T14:27:00.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.500+0000 7fc4b7fff640 1 -- start start 2023-10-16T14:27:00.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.502+0000 7fc4b7fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4b80b5fd0 0x7fc4b81f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:00.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.502+0000 7fc4b7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b80d0d80 0x7fc4b8158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:00.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.502+0000 7fc4b7fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4b815c940 0x7fc4b80cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:00.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.502+0000 7fc4b7fff640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b80c7110 con 0x7fc4b80d0d80 2023-10-16T14:27:00.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.502+0000 7fc4b7fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b80c6490 con 0x7fc4b815c940 2023-10-16T14:27:00.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.502+0000 7fc4b7fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b80c6770 con 0x7fc4b80b5fd0 2023-10-16T14:27:00.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.502+0000 7fc4b67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b80d0d80 0x7fc4b8158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:00.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.502+0000 7fc4b67fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b80d0d80 0x7fc4b8158b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34706/0 (socket says 172.21.15.59:34706) 2023-10-16T14:27:00.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.502+0000 7fc4b67fc640 1 -- 172.21.15.59:0/3776079926 learned_addr learned my addr 172.21.15.59:0/3776079926 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:00.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.503+0000 7fc4b67fc640 1 -- 172.21.15.59:0/3776079926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4b80b5fd0 msgr2=0x7fc4b81f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:00.508 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.503+0000 7fc4b77fe640 1 --2- 172.21.15.59:0/3776079926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4b815c940 0x7fc4b80cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:00.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.503+0000 7fc4b6ffd640 1 --2- 172.21.15.59:0/3776079926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4b80b5fd0 0x7fc4b81f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:00.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.503+0000 7fc4b67fc640 1 --2- 172.21.15.59:0/3776079926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4b80b5fd0 0x7fc4b81f4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.503+0000 7fc4b67fc640 1 -- 172.21.15.59:0/3776079926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4b815c940 msgr2=0x7fc4b80cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:00.509 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.503+0000 7fc4b67fc640 1 --2- 172.21.15.59:0/3776079926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4b815c940 0x7fc4b80cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.503+0000 7fc4b67fc640 1 -- 172.21.15.59:0/3776079926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b0009a70 con 0x7fc4b80d0d80 2023-10-16T14:27:00.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.503+0000 7fc4b67fc640 1 --2- 172.21.15.59:0/3776079926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b80d0d80 0x7fc4b8158b30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00e870 tx=0x7fc4ac00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:00.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.503+0000 7fc49ffff640 1 -- 172.21.15.59:0/3776079926 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac0094f0 con 0x7fc4b80d0d80 2023-10-16T14:27:00.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.503+0000 7fc49ffff640 1 -- 172.21.15.59:0/3776079926 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac00c940 con 0x7fc4b80d0d80 2023-10-16T14:27:00.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.503+0000 7fc49ffff640 1 -- 172.21.15.59:0/3776079926 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac00ccf0 con 0x7fc4b80d0d80 2023-10-16T14:27:00.510 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.503+0000 7fc4b7fff640 1 -- 172.21.15.59:0/3776079926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b80c6a50 con 0x7fc4b80d0d80 2023-10-16T14:27:00.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.504+0000 7fc4b7fff640 1 -- 172.21.15.59:0/3776079926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b81f54e0 con 0x7fc4b80d0d80 2023-10-16T14:27:00.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.505+0000 7fc4b7fff640 1 -- 172.21.15.59:0/3776079926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b804e9b0 con 0x7fc4b80d0d80 2023-10-16T14:27:00.511 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.506+0000 7fc49ffff640 1 -- 172.21.15.59:0/3776079926 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc4ac013470 con 0x7fc4b80d0d80 2023-10-16T14:27:00.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.507+0000 7fc49ffff640 1 --2- 172.21.15.59:0/3776079926 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc4a406ae70 0x7fc4a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:00.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.507+0000 7fc49ffff640 1 -- 172.21.15.59:0/3776079926 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fc4ac0899d0 con 0x7fc4b80d0d80 2023-10-16T14:27:00.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.507+0000 7fc4b6ffd640 1 --2- 172.21.15.59:0/3776079926 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc4a406ae70 0x7fc4a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:00.512 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.508+0000 7fc4b6ffd640 1 --2- 172.21.15.59:0/3776079926 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc4a406ae70 0x7fc4a406d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8000f60 tx=0x7fc4a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:00.514 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.511+0000 7fc49ffff640 1 -- 172.21.15.59:0/3776079926 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc4ac0547e0 con 0x7fc4b80d0d80 2023-10-16T14:27:00.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.705+0000 7fc4b7fff640 1 -- 172.21.15.59:0/3776079926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc4b80a04e0 con 0x7fc4b80d0d80 2023-10-16T14:27:00.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.706+0000 7fc49ffff640 1 -- 172.21.15.59:0/3776079926 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc4ac021020 con 0x7fc4b80d0d80 2023-10-16T14:27:00.709 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:27:00.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.709+0000 7fc4b7fff640 1 -- 172.21.15.59:0/3776079926 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc4a406ae70 msgr2=0x7fc4a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:00.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.709+0000 7fc4b7fff640 1 --2- 172.21.15.59:0/3776079926 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc4a406ae70 0x7fc4a406d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8000f60 tx=0x7fc4a8009040 comp rx=0 tx=0).stop 2023-10-16T14:27:00.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.709+0000 7fc4b7fff640 1 -- 172.21.15.59:0/3776079926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b80d0d80 msgr2=0x7fc4b8158b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:00.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.709+0000 7fc4b7fff640 1 --2- 172.21.15.59:0/3776079926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b80d0d80 0x7fc4b8158b30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00e870 tx=0x7fc4ac00ed30 comp rx=0 tx=0).stop 2023-10-16T14:27:00.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.710+0000 7fc4b7fff640 1 -- 172.21.15.59:0/3776079926 shutdown_connections 2023-10-16T14:27:00.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.710+0000 7fc4b7fff640 1 --2- 172.21.15.59:0/3776079926 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc4a406ae70 0x7fc4a406d330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.710+0000 7fc4b7fff640 1 --2- 172.21.15.59:0/3776079926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4b815c940 0x7fc4b80cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.710+0000 7fc4b7fff640 1 --2- 172.21.15.59:0/3776079926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b80d0d80 0x7fc4b8158b30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.710+0000 7fc4b7fff640 1 --2- 172.21.15.59:0/3776079926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4b80b5fd0 0x7fc4b81f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.710+0000 7fc4b7fff640 1 -- 172.21.15.59:0/3776079926 >> 172.21.15.59:0/3776079926 conn(0x7fc4b809bb30 msgr2=0x7fc4b806c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:00.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.710+0000 7fc4b7fff640 1 -- 172.21.15.59:0/3776079926 shutdown_connections 2023-10-16T14:27:00.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.710+0000 7fc4b7fff640 1 -- 172.21.15.59:0/3776079926 wait complete. 2023-10-16T14:27:00.735 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T14:27:00.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.961+0000 7efc47535640 1 Processor -- start 2023-10-16T14:27:00.964 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.961+0000 7efc47535640 1 -- start start 2023-10-16T14:27:00.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.963+0000 7efc47535640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc40154d10 0x7efc400ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:00.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.963+0000 7efc47535640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efc400cee60 0x7efc4006ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:00.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.963+0000 7efc47535640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc401550f0 con 0x7efc4006d360 2023-10-16T14:27:00.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.963+0000 7efc47535640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc400cf310 con 0x7efc40154d10 2023-10-16T14:27:00.966 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.963+0000 7efc47535640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4006db50 con 0x7efc400cee60 2023-10-16T14:27:00.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.963+0000 7efc46d34640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efc4006d360 0x7efc400ac1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38762/0 (socket says 172.21.15.59:38762) 2023-10-16T14:27:00.967 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.963+0000 7efc46533640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc40154d10 0x7efc400ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:00.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.963+0000 7efc46d34640 1 -- 172.21.15.59:0/235299322 learned_addr learned my addr 172.21.15.59:0/235299322 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:00.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.964+0000 7efc45d32640 1 --2- 172.21.15.59:0/235299322 >> v2:172.21.15.151:3300/0 conn(0x7efc400cee60 0x7efc4006ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:00.968 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.964+0000 7efc46533640 1 -- 172.21.15.59:0/235299322 >> v2:172.21.15.151:3300/0 conn(0x7efc400cee60 msgr2=0x7efc4006ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:00.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.964+0000 7efc46533640 1 --2- 172.21.15.59:0/235299322 >> v2:172.21.15.151:3300/0 conn(0x7efc400cee60 0x7efc4006ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.964+0000 7efc46533640 1 -- 172.21.15.59:0/235299322 >> v1:172.21.15.59:6789/0 conn(0x7efc4006d360 legacy=0x7efc400ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:00.969 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.964+0000 7efc46533640 1 -- 172.21.15.59:0/235299322 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc400b13f0 con 0x7efc40154d10 2023-10-16T14:27:00.970 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.964+0000 7efc45531640 1 -- 172.21.15.59:0/235299322 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389400783 0 0) 0x7efc401550f0 con 0x7efc4006d360 2023-10-16T14:27:00.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.965+0000 7efc46533640 1 --2- 172.21.15.59:0/235299322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc40154d10 0x7efc400ce920 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efc400adf10 tx=0x7efc3c02bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e0de3312b705f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:00.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.966+0000 7efc45531640 1 -- 172.21.15.59:0/235299322 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c02cc70 con 0x7efc40154d10 2023-10-16T14:27:00.976 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.966+0000 7efc45531640 1 -- 172.21.15.59:0/235299322 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c02cdd0 con 0x7efc40154d10 2023-10-16T14:27:00.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.966+0000 7efc45531640 1 -- 172.21.15.59:0/235299322 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c034660 con 0x7efc40154d10 2023-10-16T14:27:00.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.966+0000 7efc47535640 1 -- 172.21.15.59:0/235299322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc40154d10 msgr2=0x7efc400ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:00.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.966+0000 7efc47535640 1 --2- 172.21.15.59:0/235299322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc40154d10 0x7efc400ce920 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efc400adf10 tx=0x7efc3c02bec0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.977 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.967+0000 7efc47535640 1 -- 172.21.15.59:0/235299322 shutdown_connections 2023-10-16T14:27:00.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.967+0000 7efc47535640 1 --2- 172.21.15.59:0/235299322 >> v2:172.21.15.151:3300/0 conn(0x7efc400cee60 0x7efc4006ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.967+0000 7efc47535640 1 --2- 172.21.15.59:0/235299322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc40154d10 0x7efc400ce920 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.967+0000 7efc47535640 1 -- 172.21.15.59:0/235299322 >> 172.21.15.59:0/235299322 conn(0x7efc4006a200 msgr2=0x7efc4006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:00.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.967+0000 7efc47535640 1 -- 172.21.15.59:0/235299322 shutdown_connections 2023-10-16T14:27:00.978 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.967+0000 7efc47535640 1 -- 172.21.15.59:0/235299322 wait complete. 2023-10-16T14:27:00.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.968+0000 7efc47535640 1 Processor -- start 2023-10-16T14:27:00.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.969+0000 7efc47535640 1 -- start start 2023-10-16T14:27:00.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.969+0000 7efc47535640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc4006d360 0x7efc40071b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:00.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.969+0000 7efc47535640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc400cee60 0x7efc40070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:00.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.969+0000 7efc47535640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc40154d10 0x7efc400714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:00.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.969+0000 7efc47535640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc401f6480 con 0x7efc400cee60 2023-10-16T14:27:00.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.969+0000 7efc47535640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc400720b0 con 0x7efc40154d10 2023-10-16T14:27:00.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.969+0000 7efc47535640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc401f5870 con 0x7efc4006d360 2023-10-16T14:27:00.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.970+0000 7efc45d32640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc400cee60 0x7efc40070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:00.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.970+0000 7efc45d32640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc400cee60 0x7efc40070f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34730/0 (socket says 172.21.15.59:34730) 2023-10-16T14:27:00.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.970+0000 7efc45d32640 1 -- 172.21.15.59:0/1762917363 learned_addr learned my addr 172.21.15.59:0/1762917363 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:00.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.970+0000 7efc46d34640 1 --2- 172.21.15.59:0/1762917363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc40154d10 0x7efc400714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:00.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.970+0000 7efc46533640 1 --2- 172.21.15.59:0/1762917363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc4006d360 0x7efc40071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:00.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.970+0000 7efc45d32640 1 -- 172.21.15.59:0/1762917363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc4006d360 msgr2=0x7efc40071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:00.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.970+0000 7efc45d32640 1 --2- 172.21.15.59:0/1762917363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc4006d360 0x7efc40071b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.970+0000 7efc45d32640 1 -- 172.21.15.59:0/1762917363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc40154d10 msgr2=0x7efc400714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:00.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.970+0000 7efc45d32640 1 --2- 172.21.15.59:0/1762917363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc40154d10 0x7efc400714d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:00.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.970+0000 7efc45d32640 1 -- 172.21.15.59:0/1762917363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c009a70 con 0x7efc400cee60 2023-10-16T14:27:00.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.970+0000 7efc46d34640 1 --2- 172.21.15.59:0/1762917363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc40154d10 0x7efc400714d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:00.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.971+0000 7efc45d32640 1 --2- 172.21.15.59:0/1762917363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc400cee60 0x7efc40070f90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efc3000d800 tx=0x7efc3000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:00.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.971+0000 7efc36ffd640 1 -- 172.21.15.59:0/1762917363 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3000b6c0 con 0x7efc400cee60 2023-10-16T14:27:00.983 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.971+0000 7efc36ffd640 1 -- 172.21.15.59:0/1762917363 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3000b820 con 0x7efc400cee60 2023-10-16T14:27:00.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.971+0000 7efc36ffd640 1 -- 172.21.15.59:0/1762917363 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3000bbb0 con 0x7efc400cee60 2023-10-16T14:27:00.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.971+0000 7efc47535640 1 -- 172.21.15.59:0/1762917363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc401f5b50 con 0x7efc400cee60 2023-10-16T14:27:00.984 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.971+0000 7efc47535640 1 -- 172.21.15.59:0/1762917363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc401f6110 con 0x7efc400cee60 2023-10-16T14:27:00.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.972+0000 7efc47535640 1 -- 172.21.15.59:0/1762917363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc401f30b0 con 0x7efc400cee60 2023-10-16T14:27:00.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.973+0000 7efc36ffd640 1 -- 172.21.15.59:0/1762917363 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efc3000bd10 con 0x7efc400cee60 2023-10-16T14:27:00.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.974+0000 7efc36ffd640 1 --2- 172.21.15.59:0/1762917363 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7efc2406ae70 0x7efc2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:00.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.974+0000 7efc36ffd640 1 -- 172.21.15.59:0/1762917363 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7efc30089ef0 con 0x7efc400cee60 2023-10-16T14:27:00.987 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.975+0000 7efc46533640 1 --2- 172.21.15.59:0/1762917363 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7efc2406ae70 0x7efc2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:00.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.976+0000 7efc46533640 1 --2- 172.21.15.59:0/1762917363 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7efc2406ae70 0x7efc2406d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efc3c036000 tx=0x7efc3c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:00.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:00.979+0000 7efc36ffd640 1 -- 172.21.15.59:0/1762917363 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efc401f30b0 con 0x7efc400cee60 2023-10-16T14:27:01.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.176+0000 7efc47535640 1 -- 172.21.15.59:0/1762917363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efc401f30b0 con 0x7efc400cee60 2023-10-16T14:27:01.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.178+0000 7efc36ffd640 1 -- 172.21.15.59:0/1762917363 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7efc401f30b0 con 0x7efc400cee60 2023-10-16T14:27:01.180 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-16T14:27:01.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.180+0000 7efc47535640 1 -- 172.21.15.59:0/1762917363 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7efc2406ae70 msgr2=0x7efc2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:01.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.180+0000 7efc47535640 1 --2- 172.21.15.59:0/1762917363 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7efc2406ae70 0x7efc2406d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efc3c036000 tx=0x7efc3c030000 comp rx=0 tx=0).stop 2023-10-16T14:27:01.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.180+0000 7efc47535640 1 -- 172.21.15.59:0/1762917363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc400cee60 msgr2=0x7efc40070f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:01.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.180+0000 7efc47535640 1 --2- 172.21.15.59:0/1762917363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc400cee60 0x7efc40070f90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efc3000d800 tx=0x7efc3000dcc0 comp rx=0 tx=0).stop 2023-10-16T14:27:01.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.180+0000 7efc47535640 1 -- 172.21.15.59:0/1762917363 shutdown_connections 2023-10-16T14:27:01.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.180+0000 7efc47535640 1 --2- 172.21.15.59:0/1762917363 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7efc2406ae70 0x7efc2406d330 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:01.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.180+0000 7efc47535640 1 --2- 172.21.15.59:0/1762917363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc40154d10 0x7efc400714d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:01.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.180+0000 7efc47535640 1 --2- 172.21.15.59:0/1762917363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc400cee60 0x7efc40070f90 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:01.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.180+0000 7efc47535640 1 --2- 172.21.15.59:0/1762917363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc4006d360 0x7efc40071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:01.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.180+0000 7efc47535640 1 -- 172.21.15.59:0/1762917363 >> 172.21.15.59:0/1762917363 conn(0x7efc4006a200 msgr2=0x7efc400ca3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:01.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.181+0000 7efc47535640 1 -- 172.21.15.59:0/1762917363 shutdown_connections 2023-10-16T14:27:01.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.181+0000 7efc47535640 1 -- 172.21.15.59:0/1762917363 wait complete. 2023-10-16T14:27:01.203 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T14:27:01.420 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.418+0000 7f17dd1c9640 1 Processor -- start 2023-10-16T14:27:01.421 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.418+0000 7f17dd1c9640 1 -- start start 2023-10-16T14:27:01.422 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.420+0000 7f17dd1c9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17d815cbc0 0x7f17d80afda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:01.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.420+0000 7f17dd1c9640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17d80af960 0x7f17d80cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:01.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.420+0000 7f17dd1c9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d80aedc0 con 0x7f17d80b02e0 2023-10-16T14:27:01.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.420+0000 7f17dd1c9640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d80d16c0 con 0x7f17d80af960 2023-10-16T14:27:01.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.420+0000 7f17dd1c9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d80cfe70 con 0x7f17d815cbc0 2023-10-16T14:27:01.423 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.420+0000 7f17d759e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17d80af960 0x7f17d80cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:01.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.420+0000 7f17d759e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17d80af960 0x7f17d80cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34734/0 (socket says 172.21.15.59:34734) 2023-10-16T14:27:01.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.420+0000 7f17d759e640 1 -- 172.21.15.59:0/3978020475 learned_addr learned my addr 172.21.15.59:0/3978020475 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:01.424 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.420+0000 7f17d6d9d640 1 --2- 172.21.15.59:0/3978020475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17d815cbc0 0x7f17d80afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:01.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.421+0000 7f17d759e640 1 -- 172.21.15.59:0/3978020475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17d815cbc0 msgr2=0x7f17d80afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:01.425 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.421+0000 7f17d759e640 1 --2- 172.21.15.59:0/3978020475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17d815cbc0 0x7f17d80afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:01.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.421+0000 7f17d759e640 1 -- 172.21.15.59:0/3978020475 >> v1:172.21.15.151:6789/0 conn(0x7f17d80b02e0 legacy=0x7f17d80af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:01.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.421+0000 7f17d759e640 1 -- 172.21.15.59:0/3978020475 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d80ae490 con 0x7f17d80af960 2023-10-16T14:27:01.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.422+0000 7f17d759e640 1 --2- 172.21.15.59:0/3978020475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d80af960 0x7f17d80cce90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f17d0009e50 tx=0x7f17d002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95efdc63951f049a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:01.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.423+0000 7f17d659c640 1 -- 172.21.15.59:0/3978020475 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d002cb00 con 0x7f17d80af960 2023-10-16T14:27:01.426 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.423+0000 7f17d659c640 1 -- 172.21.15.59:0/3978020475 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d002cc60 con 0x7f17d80af960 2023-10-16T14:27:01.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.423+0000 7f17d659c640 1 -- 172.21.15.59:0/3978020475 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d00343f0 con 0x7f17d80af960 2023-10-16T14:27:01.427 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.424+0000 7f17dd1c9640 1 -- 172.21.15.59:0/3978020475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d80af960 msgr2=0x7f17d80cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:01.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.424+0000 7f17dd1c9640 1 --2- 172.21.15.59:0/3978020475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d80af960 0x7f17d80cce90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f17d0009e50 tx=0x7f17d002bf60 comp rx=0 tx=0).stop 2023-10-16T14:27:01.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.424+0000 7f17dd1c9640 1 -- 172.21.15.59:0/3978020475 shutdown_connections 2023-10-16T14:27:01.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.424+0000 7f17dd1c9640 1 --2- 172.21.15.59:0/3978020475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d80af960 0x7f17d80cce90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:01.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.424+0000 7f17dd1c9640 1 --2- 172.21.15.59:0/3978020475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17d815cbc0 0x7f17d80afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:01.428 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.424+0000 7f17dd1c9640 1 -- 172.21.15.59:0/3978020475 >> 172.21.15.59:0/3978020475 conn(0x7f17d80d0820 msgr2=0x7f17d80d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:01.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.424+0000 7f17dd1c9640 1 -- 172.21.15.59:0/3978020475 shutdown_connections 2023-10-16T14:27:01.429 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.424+0000 7f17dd1c9640 1 -- 172.21.15.59:0/3978020475 wait complete. 2023-10-16T14:27:01.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.426+0000 7f17dd1c9640 1 Processor -- start 2023-10-16T14:27:01.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.426+0000 7f17dd1c9640 1 -- start start 2023-10-16T14:27:01.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.427+0000 7f17dd1c9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17d80af960 0x7f17d81e6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:01.431 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.427+0000 7f17dd1c9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17d80b02e0 0x7f17d8153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:01.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.427+0000 7f17dd1c9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d815cbc0 0x7f17d80b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:01.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.427+0000 7f17dd1c9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d8158970 con 0x7f17d815cbc0 2023-10-16T14:27:01.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.427+0000 7f17dd1c9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d81e65b0 con 0x7f17d80af960 2023-10-16T14:27:01.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.427+0000 7f17dd1c9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d81e59a0 con 0x7f17d80b02e0 2023-10-16T14:27:01.432 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.427+0000 7f17d759e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d815cbc0 0x7f17d80b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:01.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.427+0000 7f17d759e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d815cbc0 0x7f17d80b0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34742/0 (socket says 172.21.15.59:34742) 2023-10-16T14:27:01.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.427+0000 7f17d759e640 1 -- 172.21.15.59:0/3625796004 learned_addr learned my addr 172.21.15.59:0/3625796004 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:01.433 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.427+0000 7f17d6d9d640 1 --2- 172.21.15.59:0/3625796004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17d80af960 0x7f17d81e6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:01.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.427+0000 7f17cffff640 1 --2- 172.21.15.59:0/3625796004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17d80b02e0 0x7f17d8153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:01.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.428+0000 7f17d759e640 1 -- 172.21.15.59:0/3625796004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17d80b02e0 msgr2=0x7f17d8153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:01.434 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.428+0000 7f17d759e640 1 --2- 172.21.15.59:0/3625796004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17d80b02e0 0x7f17d8153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:01.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.428+0000 7f17d759e640 1 -- 172.21.15.59:0/3625796004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17d80af960 msgr2=0x7f17d81e6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:01.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.428+0000 7f17d759e640 1 --2- 172.21.15.59:0/3625796004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17d80af960 0x7f17d81e6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:01.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.428+0000 7f17d759e640 1 -- 172.21.15.59:0/3625796004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d0009b30 con 0x7f17d815cbc0 2023-10-16T14:27:01.435 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.428+0000 7f17d759e640 1 --2- 172.21.15.59:0/3625796004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d815cbc0 0x7f17d80b0ff0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f17d0009e50 tx=0x7f17d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:01.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.428+0000 7f17cf7fe640 1 -- 172.21.15.59:0/3625796004 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d0009510 con 0x7f17d815cbc0 2023-10-16T14:27:01.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.428+0000 7f17cf7fe640 1 -- 172.21.15.59:0/3625796004 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d003e450 con 0x7f17d815cbc0 2023-10-16T14:27:01.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.428+0000 7f17cf7fe640 1 -- 172.21.15.59:0/3625796004 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d003e800 con 0x7f17d815cbc0 2023-10-16T14:27:01.436 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.428+0000 7f17dd1c9640 1 -- 172.21.15.59:0/3625796004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d81e5c80 con 0x7f17d815cbc0 2023-10-16T14:27:01.437 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.429+0000 7f17dd1c9640 1 -- 172.21.15.59:0/3625796004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d81e6240 con 0x7f17d815cbc0 2023-10-16T14:27:01.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.430+0000 7f17dd1c9640 1 -- 172.21.15.59:0/3625796004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d81e6760 con 0x7f17d815cbc0 2023-10-16T14:27:01.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.432+0000 7f17cf7fe640 1 -- 172.21.15.59:0/3625796004 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f17d003e960 con 0x7f17d815cbc0 2023-10-16T14:27:01.438 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.433+0000 7f17cf7fe640 1 --2- 172.21.15.59:0/3625796004 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f17b806ae70 0x7f17b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:01.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.433+0000 7f17cf7fe640 1 -- 172.21.15.59:0/3625796004 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f17d00ac760 con 0x7f17d815cbc0 2023-10-16T14:27:01.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.434+0000 7f17d6d9d640 1 --2- 172.21.15.59:0/3625796004 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f17b806ae70 0x7f17b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:01.439 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.435+0000 7f17d6d9d640 1 --2- 172.21.15.59:0/3625796004 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f17b806ae70 0x7f17b806d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f17c8006fd0 tx=0x7f17c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:01.440 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.438+0000 7f17cf7fe640 1 -- 172.21.15.59:0/3625796004 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f17d81e6760 con 0x7f17d815cbc0 2023-10-16T14:27:01.537 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:27:01.546 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:27:01.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.635+0000 7f17dd1c9640 1 -- 172.21.15.59:0/3625796004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f17d81e6720 con 0x7f17d815cbc0 2023-10-16T14:27:01.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.636+0000 7f17cf7fe640 1 -- 172.21.15.59:0/3625796004 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f17d0077560 con 0x7f17d815cbc0 2023-10-16T14:27:01.639 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:27:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.638+0000 7f17dd1c9640 1 -- 172.21.15.59:0/3625796004 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f17b806ae70 msgr2=0x7f17b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.638+0000 7f17dd1c9640 1 --2- 172.21.15.59:0/3625796004 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f17b806ae70 0x7f17b806d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f17c8006fd0 tx=0x7f17c8008040 comp rx=0 tx=0).stop 2023-10-16T14:27:01.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.638+0000 7f17dd1c9640 1 -- 172.21.15.59:0/3625796004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d815cbc0 msgr2=0x7f17d80b0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.638+0000 7f17dd1c9640 1 --2- 172.21.15.59:0/3625796004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d815cbc0 0x7f17d80b0ff0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f17d0009e50 tx=0x7f17d0004a40 comp rx=0 tx=0).stop 2023-10-16T14:27:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.638+0000 7f17dd1c9640 1 -- 172.21.15.59:0/3625796004 shutdown_connections 2023-10-16T14:27:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.638+0000 7f17dd1c9640 1 --2- 172.21.15.59:0/3625796004 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f17b806ae70 0x7f17b806d330 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:01.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.638+0000 7f17dd1c9640 1 --2- 172.21.15.59:0/3625796004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d815cbc0 0x7f17d80b0ff0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:01.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.638+0000 7f17dd1c9640 1 --2- 172.21.15.59:0/3625796004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17d80b02e0 0x7f17d8153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:01.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.638+0000 7f17dd1c9640 1 --2- 172.21.15.59:0/3625796004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17d80af960 0x7f17d81e6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:01.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.638+0000 7f17dd1c9640 1 -- 172.21.15.59:0/3625796004 >> 172.21.15.59:0/3625796004 conn(0x7f17d80d0820 msgr2=0x7f17d80af250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:01.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.639+0000 7f17dd1c9640 1 -- 172.21.15.59:0/3625796004 shutdown_connections 2023-10-16T14:27:01.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.639+0000 7f17dd1c9640 1 -- 172.21.15.59:0/3625796004 wait complete. 2023-10-16T14:27:01.659 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T14:27:01.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.858+0000 7f35e1aaf640 1 Processor -- start 2023-10-16T14:27:01.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.858+0000 7f35e1aaf640 1 -- start start 2023-10-16T14:27:01.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.859+0000 7f35e1aaf640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f35dc0b83b0 0x7f35dc0cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:01.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.859+0000 7f35e1aaf640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35dc0cdbc0 0x7f35dc0d1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:01.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.860+0000 7f35e1aaf640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35dc161520 con 0x7f35dc15c9f0 2023-10-16T14:27:01.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.860+0000 7f35e1aaf640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35dc0ce030 con 0x7f35dc0b83b0 2023-10-16T14:27:01.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.860+0000 7f35e1aaf640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc160f60 con 0x7f35dc0cdbc0 2023-10-16T14:27:01.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.860+0000 7f35d3fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f35dc0b83b0 0x7f35dc0cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:01.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.860+0000 7f35d3fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f35dc0b83b0 0x7f35dc0cd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34746/0 (socket says 172.21.15.59:34746) 2023-10-16T14:27:01.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.860+0000 7f35d3fff640 1 -- 172.21.15.59:0/63349631 learned_addr learned my addr 172.21.15.59:0/63349631 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:01.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.860+0000 7f35dbfff640 1 --2- 172.21.15.59:0/63349631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35dc0cdbc0 0x7f35dc0d1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:01.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.860+0000 7f35d3fff640 1 -- 172.21.15.59:0/63349631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35dc0cdbc0 msgr2=0x7f35dc0d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:01.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.860+0000 7f35d3fff640 1 --2- 172.21.15.59:0/63349631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35dc0cdbc0 0x7f35dc0d1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:01.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.860+0000 7f35d3fff640 1 -- 172.21.15.59:0/63349631 >> v1:172.21.15.151:6789/0 conn(0x7f35dc15c9f0 legacy=0x7f35dc160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:01.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.860+0000 7f35d3fff640 1 -- 172.21.15.59:0/63349631 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35dc161240 con 0x7f35dc0b83b0 2023-10-16T14:27:01.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.861+0000 7f35d3fff640 1 --2- 172.21.15.59:0/63349631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35dc0b83b0 0x7f35dc0cd680 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f35dc161710 tx=0x7f35c402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5f8a1b154d847a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:01.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.862+0000 7f35daffd640 1 -- 172.21.15.59:0/63349631 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4031640 con 0x7f35dc0b83b0 2023-10-16T14:27:01.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.862+0000 7f35daffd640 1 -- 172.21.15.59:0/63349631 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c40317a0 con 0x7f35dc0b83b0 2023-10-16T14:27:01.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.862+0000 7f35daffd640 1 -- 172.21.15.59:0/63349631 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4031b30 con 0x7f35dc0b83b0 2023-10-16T14:27:01.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.863+0000 7f35e1aaf640 1 -- 172.21.15.59:0/63349631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35dc0b83b0 msgr2=0x7f35dc0cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:01.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.863+0000 7f35e1aaf640 1 --2- 172.21.15.59:0/63349631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35dc0b83b0 0x7f35dc0cd680 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f35dc161710 tx=0x7f35c402b8f0 comp rx=0 tx=0).stop 2023-10-16T14:27:01.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.863+0000 7f35e1aaf640 1 -- 172.21.15.59:0/63349631 shutdown_connections 2023-10-16T14:27:01.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.863+0000 7f35e1aaf640 1 --2- 172.21.15.59:0/63349631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35dc0cdbc0 0x7f35dc0d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:01.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.863+0000 7f35e1aaf640 1 --2- 172.21.15.59:0/63349631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35dc0b83b0 0x7f35dc0cd680 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:01.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.863+0000 7f35e1aaf640 1 -- 172.21.15.59:0/63349631 >> 172.21.15.59:0/63349631 conn(0x7f35dc071510 msgr2=0x7f35dc071920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:01.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.863+0000 7f35e1aaf640 1 -- 172.21.15.59:0/63349631 shutdown_connections 2023-10-16T14:27:01.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.863+0000 7f35e1aaf640 1 -- 172.21.15.59:0/63349631 wait complete. 2023-10-16T14:27:01.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.866+0000 7f35e1aaf640 1 Processor -- start 2023-10-16T14:27:01.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.866+0000 7f35e1aaf640 1 -- start start 2023-10-16T14:27:01.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.867+0000 7f35e1aaf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35dc0b83b0 0x7f35dc0b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:01.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.867+0000 7f35e1aaf640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35dc0cdbc0 0x7f35dc14fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:01.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.867+0000 7f35e1aaf640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35dc15c9f0 0x7f35dc1f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:01.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.867+0000 7f35e1aaf640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc0c93d0 con 0x7f35dc0b83b0 2023-10-16T14:27:01.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.867+0000 7f35e1aaf640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc0b5220 con 0x7f35dc15c9f0 2023-10-16T14:27:01.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.867+0000 7f35e1aaf640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc0c8aa0 con 0x7f35dc0cdbc0 2023-10-16T14:27:01.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.868+0000 7f35db7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35dc0b83b0 0x7f35dc0b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:01.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.868+0000 7f35db7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35dc0b83b0 0x7f35dc0b49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34760/0 (socket says 172.21.15.59:34760) 2023-10-16T14:27:01.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.868+0000 7f35db7fe640 1 -- 172.21.15.59:0/3836776425 learned_addr learned my addr 172.21.15.59:0/3836776425 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:01.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.868+0000 7f35dbfff640 1 --2- 172.21.15.59:0/3836776425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35dc15c9f0 0x7f35dc1f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:01.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.868+0000 7f35d3fff640 1 --2- 172.21.15.59:0/3836776425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35dc0cdbc0 0x7f35dc14fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:01.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.868+0000 7f35db7fe640 1 -- 172.21.15.59:0/3836776425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35dc0cdbc0 msgr2=0x7f35dc14fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:01.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.868+0000 7f35db7fe640 1 --2- 172.21.15.59:0/3836776425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35dc0cdbc0 0x7f35dc14fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:01.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.868+0000 7f35db7fe640 1 -- 172.21.15.59:0/3836776425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35dc15c9f0 msgr2=0x7f35dc1f5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:01.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.868+0000 7f35db7fe640 1 --2- 172.21.15.59:0/3836776425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35dc15c9f0 0x7f35dc1f5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:01.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.868+0000 7f35db7fe640 1 -- 172.21.15.59:0/3836776425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c40094d0 con 0x7f35dc0b83b0 2023-10-16T14:27:01.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.868+0000 7f35d3fff640 1 --2- 172.21.15.59:0/3836776425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35dc0cdbc0 0x7f35dc14fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:01.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.868+0000 7f35dbfff640 1 --2- 172.21.15.59:0/3836776425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35dc15c9f0 0x7f35dc1f5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:01.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.869+0000 7f35db7fe640 1 --2- 172.21.15.59:0/3836776425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35dc0b83b0 0x7f35dc0b49f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00b3f0 tx=0x7f35cc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:01.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.869+0000 7f35d8ff9640 1 -- 172.21.15.59:0/3836776425 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc011830 con 0x7f35dc0b83b0 2023-10-16T14:27:01.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.869+0000 7f35d8ff9640 1 -- 172.21.15.59:0/3836776425 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc011990 con 0x7f35dc0b83b0 2023-10-16T14:27:01.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.869+0000 7f35d8ff9640 1 -- 172.21.15.59:0/3836776425 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc011d40 con 0x7f35dc0b83b0 2023-10-16T14:27:01.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.869+0000 7f35e1aaf640 1 -- 172.21.15.59:0/3836776425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35dc0c8d80 con 0x7f35dc0b83b0 2023-10-16T14:27:01.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.869+0000 7f35e1aaf640 1 -- 172.21.15.59:0/3836776425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35dc0b4f30 con 0x7f35dc0b83b0 2023-10-16T14:27:01.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.870+0000 7f35e1aaf640 1 -- 172.21.15.59:0/3836776425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35dc073ef0 con 0x7f35dc0b83b0 2023-10-16T14:27:01.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.871+0000 7f35d8ff9640 1 -- 172.21.15.59:0/3836776425 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f35cc01a400 con 0x7f35dc0b83b0 2023-10-16T14:27:01.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.872+0000 7f35d8ff9640 1 --2- 172.21.15.59:0/3836776425 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f35bc06ae70 0x7f35bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:01.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.873+0000 7f35d8ff9640 1 -- 172.21.15.59:0/3836776425 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f35cc089830 con 0x7f35dc0b83b0 2023-10-16T14:27:01.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.873+0000 7f35d3fff640 1 --2- 172.21.15.59:0/3836776425 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f35bc06ae70 0x7f35bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:01.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.874+0000 7f35d3fff640 1 --2- 172.21.15.59:0/3836776425 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f35bc06ae70 0x7f35bc06d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f35c4036000 tx=0x7f35c403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:01.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:01.876+0000 7f35d8ff9640 1 -- 172.21.15.59:0/3836776425 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f35cc0545a0 con 0x7f35dc0b83b0 2023-10-16T14:27:02.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.082+0000 7f35e1aaf640 1 -- 172.21.15.59:0/3836776425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f35dc0d0680 con 0x7f35dc0b83b0 2023-10-16T14:27:02.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.083+0000 7f35d8ff9640 1 -- 172.21.15.59:0/3836776425 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f35cc057bc0 con 0x7f35dc0b83b0 2023-10-16T14:27:02.086 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2023-10-16T14:27:02.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.086+0000 7f35e1aaf640 1 -- 172.21.15.59:0/3836776425 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f35bc06ae70 msgr2=0x7f35bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:02.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.086+0000 7f35e1aaf640 1 --2- 172.21.15.59:0/3836776425 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f35bc06ae70 0x7f35bc06d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f35c4036000 tx=0x7f35c403c040 comp rx=0 tx=0).stop 2023-10-16T14:27:02.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.086+0000 7f35e1aaf640 1 -- 172.21.15.59:0/3836776425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35dc0b83b0 msgr2=0x7f35dc0b49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:02.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.086+0000 7f35e1aaf640 1 --2- 172.21.15.59:0/3836776425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35dc0b83b0 0x7f35dc0b49f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00b3f0 tx=0x7f35cc00b8b0 comp rx=0 tx=0).stop 2023-10-16T14:27:02.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.086+0000 7f35e1aaf640 1 -- 172.21.15.59:0/3836776425 shutdown_connections 2023-10-16T14:27:02.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.087+0000 7f35e1aaf640 1 --2- 172.21.15.59:0/3836776425 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f35bc06ae70 0x7f35bc06d330 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:02.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.087+0000 7f35e1aaf640 1 --2- 172.21.15.59:0/3836776425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35dc15c9f0 0x7f35dc1f5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:02.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.087+0000 7f35e1aaf640 1 --2- 172.21.15.59:0/3836776425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35dc0cdbc0 0x7f35dc14fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:02.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.087+0000 7f35e1aaf640 1 --2- 172.21.15.59:0/3836776425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35dc0b83b0 0x7f35dc0b49f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:02.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.087+0000 7f35e1aaf640 1 -- 172.21.15.59:0/3836776425 >> 172.21.15.59:0/3836776425 conn(0x7f35dc071510 msgr2=0x7f35dc15a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:02.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.087+0000 7f35e1aaf640 1 -- 172.21.15.59:0/3836776425 shutdown_connections 2023-10-16T14:27:02.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.087+0000 7f35e1aaf640 1 -- 172.21.15.59:0/3836776425 wait complete. 2023-10-16T14:27:02.108 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi151.front.sepia.ceph.com... 2023-10-16T14:27:02.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:02.109 DEBUG:teuthology.orchestra.run.smithi151:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-16T14:27:02.209 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T14:27:02.210 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-16T14:27:02.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:02.211 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-16T14:27:02.264 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:27:02.265 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T14:27:02.321 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:27:02.321 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T14:27:02.372 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:27:02.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.571+0000 7f6be47f5640 1 Processor -- start 2023-10-16T14:27:02.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.571+0000 7f6be47f5640 1 -- start start 2023-10-16T14:27:02.574 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.572+0000 7f6be47f5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6bdc0ce420 0x7f6bdc0b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:02.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.572+0000 7f6be47f5640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6bdc0ad1e0 0x7f6bdc06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:02.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.572+0000 7f6be47f5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bdc0ad690 con 0x7f6bdc0cec20 2023-10-16T14:27:02.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.572+0000 7f6be47f5640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bdc15aea0 con 0x7f6bdc0ad1e0 2023-10-16T14:27:02.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.572+0000 7f6be47f5640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bdc06def0 con 0x7f6bdc0ce420 2023-10-16T14:27:02.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.573+0000 7f6be2d92640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6bdc0ad1e0 0x7f6bdc06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:02.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.573+0000 7f6be2d92640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6bdc0ad1e0 0x7f6bdc06ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55158/0 (socket says 172.21.15.59:55158) 2023-10-16T14:27:02.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.573+0000 7f6be2d92640 1 -- 172.21.15.59:0/416609295 learned_addr learned my addr 172.21.15.59:0/416609295 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:02.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.573+0000 7f6be1d90640 1 --2- 172.21.15.59:0/416609295 >> v2:172.21.15.151:3300/0 conn(0x7f6bdc0ce420 0x7f6bdc0b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:02.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.573+0000 7f6be2d92640 1 -- 172.21.15.59:0/416609295 >> v2:172.21.15.151:3300/0 conn(0x7f6bdc0ce420 msgr2=0x7f6bdc0b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:02.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.573+0000 7f6be2d92640 1 --2- 172.21.15.59:0/416609295 >> v2:172.21.15.151:3300/0 conn(0x7f6bdc0ce420 0x7f6bdc0b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:02.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.573+0000 7f6be2d92640 1 -- 172.21.15.59:0/416609295 >> v1:172.21.15.151:6789/0 conn(0x7f6bdc0cec20 legacy=0x7f6bdc0cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:02.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.573+0000 7f6be2d92640 1 -- 172.21.15.59:0/416609295 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc06e1d0 con 0x7f6bdc0ad1e0 2023-10-16T14:27:02.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.574+0000 7f6be2d92640 1 --2- 172.21.15.59:0/416609295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bdc0ad1e0 0x7f6bdc06ef90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc067910 tx=0x7f6bd402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650c61d68ba6bb66 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:02.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.575+0000 7f6be158f640 1 -- 172.21.15.59:0/416609295 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd402ca80 con 0x7f6bdc0ad1e0 2023-10-16T14:27:02.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.575+0000 7f6be158f640 1 -- 172.21.15.59:0/416609295 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd402cbe0 con 0x7f6bdc0ad1e0 2023-10-16T14:27:02.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.575+0000 7f6be158f640 1 -- 172.21.15.59:0/416609295 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd40343f0 con 0x7f6bdc0ad1e0 2023-10-16T14:27:02.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.575+0000 7f6be47f5640 1 -- 172.21.15.59:0/416609295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bdc0ad1e0 msgr2=0x7f6bdc06ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:02.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.575+0000 7f6be47f5640 1 --2- 172.21.15.59:0/416609295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bdc0ad1e0 0x7f6bdc06ef90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc067910 tx=0x7f6bd402bee0 comp rx=0 tx=0).stop 2023-10-16T14:27:02.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.575+0000 7f6be47f5640 1 -- 172.21.15.59:0/416609295 shutdown_connections 2023-10-16T14:27:02.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.575+0000 7f6be47f5640 1 --2- 172.21.15.59:0/416609295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bdc0ad1e0 0x7f6bdc06ef90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:02.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.575+0000 7f6be47f5640 1 --2- 172.21.15.59:0/416609295 >> v2:172.21.15.151:3300/0 conn(0x7f6bdc0ce420 0x7f6bdc0b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:02.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.575+0000 7f6be47f5640 1 -- 172.21.15.59:0/416609295 >> 172.21.15.59:0/416609295 conn(0x7f6bdc0d06d0 msgr2=0x7f6bdc0d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:02.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.575+0000 7f6be47f5640 1 -- 172.21.15.59:0/416609295 shutdown_connections 2023-10-16T14:27:02.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.575+0000 7f6be47f5640 1 -- 172.21.15.59:0/416609295 wait complete. 2023-10-16T14:27:02.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.577+0000 7f6be47f5640 1 Processor -- start 2023-10-16T14:27:02.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.577+0000 7f6be47f5640 1 -- start start 2023-10-16T14:27:02.583 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.578+0000 7f6be47f5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bdc0ad1e0 0x7f6bdc154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:02.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.578+0000 7f6be47f5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bdc0ce420 0x7f6bdc0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:02.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.578+0000 7f6be47f5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bdc0cec20 0x7f6bdc15d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:02.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.578+0000 7f6be47f5640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc06aef0 con 0x7f6bdc0cec20 2023-10-16T14:27:02.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.578+0000 7f6be47f5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc0b5b60 con 0x7f6bdc0ad1e0 2023-10-16T14:27:02.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.578+0000 7f6be47f5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc0b5e40 con 0x7f6bdc0ce420 2023-10-16T14:27:02.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.579+0000 7f6be2d92640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bdc0cec20 0x7f6bdc15d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:02.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.579+0000 7f6be2d92640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bdc0cec20 0x7f6bdc15d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55162/0 (socket says 172.21.15.59:55162) 2023-10-16T14:27:02.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.579+0000 7f6be2d92640 1 -- 172.21.15.59:0/2194443595 learned_addr learned my addr 172.21.15.59:0/2194443595 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:02.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.579+0000 7f6be2d92640 1 -- 172.21.15.59:0/2194443595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bdc0ce420 msgr2=0x7f6bdc0c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:02.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.579+0000 7f6be2591640 1 --2- 172.21.15.59:0/2194443595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bdc0ad1e0 0x7f6bdc154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:02.585 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.579+0000 7f6be2d92640 1 --2- 172.21.15.59:0/2194443595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bdc0ce420 0x7f6bdc0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:02.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.579+0000 7f6be2d92640 1 -- 172.21.15.59:0/2194443595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bdc0ad1e0 msgr2=0x7f6bdc154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:02.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.579+0000 7f6be2d92640 1 --2- 172.21.15.59:0/2194443595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bdc0ad1e0 0x7f6bdc154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:02.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.579+0000 7f6be2d92640 1 -- 172.21.15.59:0/2194443595 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd4009b30 con 0x7f6bdc0cec20 2023-10-16T14:27:02.586 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.579+0000 7f6be2591640 1 --2- 172.21.15.59:0/2194443595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bdc0ad1e0 0x7f6bdc154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:02.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.580+0000 7f6be2d92640 1 --2- 172.21.15.59:0/2194443595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bdc0cec20 0x7f6bdc15d1b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4036040 tx=0x7f6bd4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:02.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.580+0000 7f6bd2ffd640 1 -- 172.21.15.59:0/2194443595 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4009510 con 0x7f6bdc0cec20 2023-10-16T14:27:02.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.580+0000 7f6bd2ffd640 1 -- 172.21.15.59:0/2194443595 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd403e450 con 0x7f6bdc0cec20 2023-10-16T14:27:02.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.580+0000 7f6bd2ffd640 1 -- 172.21.15.59:0/2194443595 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd403e800 con 0x7f6bdc0cec20 2023-10-16T14:27:02.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.580+0000 7f6be47f5640 1 -- 172.21.15.59:0/2194443595 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bdc0b6120 con 0x7f6bdc0cec20 2023-10-16T14:27:02.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.580+0000 7f6be47f5640 1 -- 172.21.15.59:0/2194443595 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bdc0b57f0 con 0x7f6bdc0cec20 2023-10-16T14:27:02.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.581+0000 7f6be47f5640 1 -- 172.21.15.59:0/2194443595 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bdc06b0a0 con 0x7f6bdc0cec20 2023-10-16T14:27:02.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.582+0000 7f6bd2ffd640 1 -- 172.21.15.59:0/2194443595 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6bd402cd50 con 0x7f6bdc0cec20 2023-10-16T14:27:02.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.583+0000 7f6bd2ffd640 1 --2- 172.21.15.59:0/2194443595 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6bc006ae70 0x7f6bc006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:02.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.583+0000 7f6bd2ffd640 1 -- 172.21.15.59:0/2194443595 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f6bd40ac450 con 0x7f6bdc0cec20 2023-10-16T14:27:02.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.584+0000 7f6be2591640 1 --2- 172.21.15.59:0/2194443595 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6bc006ae70 0x7f6bc006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:02.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.584+0000 7f6be2591640 1 --2- 172.21.15.59:0/2194443595 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6bc006ae70 0x7f6bc006d330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8000fb0 tx=0x7f6bd8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:02.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.591+0000 7f6bd2ffd640 1 -- 172.21.15.59:0/2194443595 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6bdc06b0a0 con 0x7f6bdc0cec20 2023-10-16T14:27:02.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.784+0000 7f6be47f5640 1 -- 172.21.15.59:0/2194443595 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bdc067180 con 0x7f6bdc0cec20 2023-10-16T14:27:02.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.788+0000 7f6bd2ffd640 1 -- 172.21.15.59:0/2194443595 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18445 (secure 0 0 0) 0x7f6bd4077130 con 0x7f6bdc0cec20 2023-10-16T14:27:02.791 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:02.791 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:26:29.634854+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:27:02.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.790+0000 7f6be47f5640 1 -- 172.21.15.59:0/2194443595 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6bc006ae70 msgr2=0x7f6bc006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:02.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.790+0000 7f6be47f5640 1 --2- 172.21.15.59:0/2194443595 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6bc006ae70 0x7f6bc006d330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8000fb0 tx=0x7f6bd8009040 comp rx=0 tx=0).stop 2023-10-16T14:27:02.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.790+0000 7f6be47f5640 1 -- 172.21.15.59:0/2194443595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bdc0cec20 msgr2=0x7f6bdc15d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:02.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.790+0000 7f6be47f5640 1 --2- 172.21.15.59:0/2194443595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bdc0cec20 0x7f6bdc15d1b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4036040 tx=0x7f6bd4004a40 comp rx=0 tx=0).stop 2023-10-16T14:27:02.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.790+0000 7f6be47f5640 1 -- 172.21.15.59:0/2194443595 shutdown_connections 2023-10-16T14:27:02.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.790+0000 7f6be47f5640 1 --2- 172.21.15.59:0/2194443595 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6bc006ae70 0x7f6bc006d330 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:02.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.790+0000 7f6be47f5640 1 --2- 172.21.15.59:0/2194443595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bdc0cec20 0x7f6bdc15d1b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:02.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.790+0000 7f6be47f5640 1 --2- 172.21.15.59:0/2194443595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bdc0ce420 0x7f6bdc0c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.790+0000 7f6be47f5640 1 --2- 172.21.15.59:0/2194443595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bdc0ad1e0 0x7f6bdc154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.790+0000 7f6be47f5640 1 -- 172.21.15.59:0/2194443595 >> 172.21.15.59:0/2194443595 conn(0x7f6bdc0d06d0 msgr2=0x7f6bdc159eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.791+0000 7f6be47f5640 1 -- 172.21.15.59:0/2194443595 shutdown_connections 2023-10-16T14:27:02.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:02.791+0000 7f6be47f5640 1 -- 172.21.15.59:0/2194443595 wait complete. 2023-10-16T14:27:02.813 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T14:25:46.371818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T14:25:47.145341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T14:25:50.758038+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T14:27:02.814 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:27:03.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.039+0000 7f020ffff640 1 Processor -- start 2023-10-16T14:27:03.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.039+0000 7f020ffff640 1 -- start start 2023-10-16T14:27:03.044 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.041+0000 7f020ffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02100d2760 0x7f02100d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.041+0000 7f020ffff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02100cf180 0x7f02100cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.041+0000 7f020ffff640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02100d30e0 con 0x7f021015cae0 2023-10-16T14:27:03.045 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.041+0000 7f020ffff640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02100cfed0 con 0x7f02100cf180 2023-10-16T14:27:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.041+0000 7f020ffff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02100cd660 con 0x7f02100d2760 2023-10-16T14:27:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.041+0000 7f020effd640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f021015cae0 0x7f02100ce140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47816/0 (socket says 172.21.15.59:47816) 2023-10-16T14:27:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.041+0000 7f020effd640 1 -- 172.21.15.59:0/837565753 learned_addr learned my addr 172.21.15.59:0/837565753 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:03.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.041+0000 7f020f7fe640 1 --2- 172.21.15.59:0/837565753 >> v2:172.21.15.59:3300/0 conn(0x7f02100cf180 0x7f02100cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.041+0000 7f020e7fc640 1 --2- 172.21.15.59:0/837565753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02100d2760 0x7f02100d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:03.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.042+0000 7f020dffb640 1 -- 172.21.15.59:0/837565753 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506684381 0 0) 0x7f02100d30e0 con 0x7f021015cae0 2023-10-16T14:27:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.042+0000 7f020dffb640 1 -- 172.21.15.59:0/837565753 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01fc003520 con 0x7f021015cae0 2023-10-16T14:27:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.042+0000 7f020f7fe640 1 -- 172.21.15.59:0/837565753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02100d2760 msgr2=0x7f02100d2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.042+0000 7f020f7fe640 1 --2- 172.21.15.59:0/837565753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02100d2760 0x7f02100d2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.042+0000 7f020f7fe640 1 -- 172.21.15.59:0/837565753 >> v1:172.21.15.59:6789/0 conn(0x7f021015cae0 legacy=0x7f02100ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.042+0000 7f020f7fe640 1 -- 172.21.15.59:0/837565753 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02100cd940 con 0x7f02100cf180 2023-10-16T14:27:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.043+0000 7f020f7fe640 1 --2- 172.21.15.59:0/837565753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02100cf180 0x7f02100cf610 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f02080097a0 tx=0x7f020802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4fb395edf278af server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.043+0000 7f020dffb640 1 -- 172.21.15.59:0/837565753 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020802d040 con 0x7f02100cf180 2023-10-16T14:27:03.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.043+0000 7f020dffb640 1 -- 172.21.15.59:0/837565753 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0208031810 con 0x7f02100cf180 2023-10-16T14:27:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.043+0000 7f020dffb640 1 -- 172.21.15.59:0/837565753 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208031ba0 con 0x7f02100cf180 2023-10-16T14:27:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.044+0000 7f020ffff640 1 -- 172.21.15.59:0/837565753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02100cf180 msgr2=0x7f02100cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.044+0000 7f020ffff640 1 --2- 172.21.15.59:0/837565753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02100cf180 0x7f02100cf610 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f02080097a0 tx=0x7f020802b8b0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.044+0000 7f020ffff640 1 -- 172.21.15.59:0/837565753 shutdown_connections 2023-10-16T14:27:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.044+0000 7f020ffff640 1 --2- 172.21.15.59:0/837565753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02100cf180 0x7f02100cf610 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.044+0000 7f020ffff640 1 --2- 172.21.15.59:0/837565753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02100d2760 0x7f02100d2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.044+0000 7f020ffff640 1 -- 172.21.15.59:0/837565753 >> 172.21.15.59:0/837565753 conn(0x7f021009bb50 msgr2=0x7f0210089f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:03.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.044+0000 7f020ffff640 1 -- 172.21.15.59:0/837565753 shutdown_connections 2023-10-16T14:27:03.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.044+0000 7f020ffff640 1 -- 172.21.15.59:0/837565753 wait complete. 2023-10-16T14:27:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.046+0000 7f020ffff640 1 Processor -- start 2023-10-16T14:27:03.055 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.046+0000 7f020ffff640 1 -- start start 2023-10-16T14:27:03.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.047+0000 7f020ffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02100cf180 0x7f0210155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.047+0000 7f020ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02100d2760 0x7f02101f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.047+0000 7f020ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f021015cae0 0x7f02100b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.047+0000 7f020ffff640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02101594d0 con 0x7f02100d2760 2023-10-16T14:27:03.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.047+0000 7f020ffff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02101f6250 con 0x7f021015cae0 2023-10-16T14:27:03.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.047+0000 7f020ffff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02101606d0 con 0x7f02100cf180 2023-10-16T14:27:03.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.047+0000 7f020e7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02100d2760 0x7f02101f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:03.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.047+0000 7f020e7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02100d2760 0x7f02101f5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55188/0 (socket says 172.21.15.59:55188) 2023-10-16T14:27:03.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.047+0000 7f020e7fc640 1 -- 172.21.15.59:0/2884998419 learned_addr learned my addr 172.21.15.59:0/2884998419 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:03.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.047+0000 7f020e7fc640 1 -- 172.21.15.59:0/2884998419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02100cf180 msgr2=0x7f0210155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:03.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.047+0000 7f020effd640 1 --2- 172.21.15.59:0/2884998419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02100cf180 0x7f0210155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:03.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.047+0000 7f020e7fc640 1 --2- 172.21.15.59:0/2884998419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02100cf180 0x7f0210155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.047+0000 7f020e7fc640 1 -- 172.21.15.59:0/2884998419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f021015cae0 msgr2=0x7f02100b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:03.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.047+0000 7f020e7fc640 1 --2- 172.21.15.59:0/2884998419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f021015cae0 0x7f02100b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.047+0000 7f020e7fc640 1 -- 172.21.15.59:0/2884998419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0208009400 con 0x7f02100d2760 2023-10-16T14:27:03.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.048+0000 7f020e7fc640 1 --2- 172.21.15.59:0/2884998419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02100d2760 0x7f02101f5d10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f01f800d800 tx=0x7f01f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:03.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.048+0000 7f02077fe640 1 -- 172.21.15.59:0/2884998419 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f800b6c0 con 0x7f02100d2760 2023-10-16T14:27:03.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.048+0000 7f02077fe640 1 -- 172.21.15.59:0/2884998419 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f800b820 con 0x7f02100d2760 2023-10-16T14:27:03.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.048+0000 7f02077fe640 1 -- 172.21.15.59:0/2884998419 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f800bbb0 con 0x7f02100d2760 2023-10-16T14:27:03.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.048+0000 7f020ffff640 1 -- 172.21.15.59:0/2884998419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02101609b0 con 0x7f02100d2760 2023-10-16T14:27:03.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.048+0000 7f020ffff640 1 -- 172.21.15.59:0/2884998419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0210160f70 con 0x7f02100d2760 2023-10-16T14:27:03.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.049+0000 7f020ffff640 1 -- 172.21.15.59:0/2884998419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021004e9b0 con 0x7f02100d2760 2023-10-16T14:27:03.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.050+0000 7f02077fe640 1 -- 172.21.15.59:0/2884998419 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f01f800bd10 con 0x7f02100d2760 2023-10-16T14:27:03.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.051+0000 7f02077fe640 1 --2- 172.21.15.59:0/2884998419 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f01f006ae70 0x7f01f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.051+0000 7f02077fe640 1 -- 172.21.15.59:0/2884998419 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f01f8089f80 con 0x7f02100d2760 2023-10-16T14:27:03.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.052+0000 7f020effd640 1 --2- 172.21.15.59:0/2884998419 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f01f006ae70 0x7f01f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:03.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.053+0000 7f020effd640 1 --2- 172.21.15.59:0/2884998419 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f01f006ae70 0x7f01f006d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0200007fd0 tx=0x7f0200009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:03.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.056+0000 7f02077fe640 1 -- 172.21.15.59:0/2884998419 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f01f8054c60 con 0x7f02100d2760 2023-10-16T14:27:03.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.242+0000 7f020ffff640 1 -- 172.21.15.59:0/2884998419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f02100c9610 con 0x7f02100d2760 2023-10-16T14:27:03.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.244+0000 7f02077fe640 1 -- 172.21.15.59:0/2884998419 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f01f8058280 con 0x7f02100d2760 2023-10-16T14:27:03.247 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:27:03.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.246+0000 7f020ffff640 1 -- 172.21.15.59:0/2884998419 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f01f006ae70 msgr2=0x7f01f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:03.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.246+0000 7f020ffff640 1 --2- 172.21.15.59:0/2884998419 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f01f006ae70 0x7f01f006d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0200007fd0 tx=0x7f0200009040 comp rx=0 tx=0).stop 2023-10-16T14:27:03.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.246+0000 7f020ffff640 1 -- 172.21.15.59:0/2884998419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02100d2760 msgr2=0x7f02101f5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:03.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.246+0000 7f020ffff640 1 --2- 172.21.15.59:0/2884998419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02100d2760 0x7f02101f5d10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f01f800d800 tx=0x7f01f800dcc0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.246+0000 7f020ffff640 1 -- 172.21.15.59:0/2884998419 shutdown_connections 2023-10-16T14:27:03.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.246+0000 7f020ffff640 1 --2- 172.21.15.59:0/2884998419 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f01f006ae70 0x7f01f006d330 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.246+0000 7f020ffff640 1 --2- 172.21.15.59:0/2884998419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f021015cae0 0x7f02100b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.246+0000 7f020ffff640 1 --2- 172.21.15.59:0/2884998419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02100d2760 0x7f02101f5d10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.246+0000 7f020ffff640 1 --2- 172.21.15.59:0/2884998419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02100cf180 0x7f0210155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.246+0000 7f020ffff640 1 -- 172.21.15.59:0/2884998419 >> 172.21.15.59:0/2884998419 conn(0x7f021009bb50 msgr2=0x7f0210089f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:03.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.246+0000 7f020ffff640 1 -- 172.21.15.59:0/2884998419 shutdown_connections 2023-10-16T14:27:03.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.246+0000 7f020ffff640 1 -- 172.21.15.59:0/2884998419 wait complete. 2023-10-16T14:27:03.267 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T14:27:03.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.482+0000 7fdbb084e640 1 Processor -- start 2023-10-16T14:27:03.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.482+0000 7fdbb084e640 1 -- start start 2023-10-16T14:27:03.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.484+0000 7fdbb084e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbac0b2ee0 0x7fdbac06d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.484+0000 7fdbb084e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbac1550f0 con 0x7fdbac154d10 2023-10-16T14:27:03.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.484+0000 7fdbb084e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbac06db50 con 0x7fdbac0cf030 2023-10-16T14:27:03.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.484+0000 7fdbb084e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac0b13f0 con 0x7fdbac0b2ee0 2023-10-16T14:27:03.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.484+0000 7fdbaad9d640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdbac154d10 0x7fdbac0ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47824/0 (socket says 172.21.15.59:47824) 2023-10-16T14:27:03.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.484+0000 7fdbaad9d640 1 -- 172.21.15.59:0/1773594655 learned_addr learned my addr 172.21.15.59:0/1773594655 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:03.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.484+0000 7fdbab59e640 1 --2- 172.21.15.59:0/1773594655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbac0b2ee0 0x7fdbac06d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:03.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.484+0000 7fdbaa59c640 1 -- 172.21.15.59:0/1773594655 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038287994 0 0) 0x7fdbac1550f0 con 0x7fdbac154d10 2023-10-16T14:27:03.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.485+0000 7fdbaa59c640 1 -- 172.21.15.59:0/1773594655 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb98003520 con 0x7fdbac154d10 2023-10-16T14:27:03.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.485+0000 7fdbaa59c640 1 -- 172.21.15.59:0/1773594655 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3896281607 0 0) 0x7fdbac06db50 con 0x7fdbac0cf030 2023-10-16T14:27:03.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.485+0000 7fdbaa59c640 1 -- 172.21.15.59:0/1773594655 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbac1550f0 con 0x7fdbac0cf030 2023-10-16T14:27:03.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.485+0000 7fdbaa59c640 1 -- 172.21.15.59:0/1773594655 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2875988201 0 0) 0x7fdb98003520 con 0x7fdbac154d10 2023-10-16T14:27:03.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.485+0000 7fdbaa59c640 1 -- 172.21.15.59:0/1773594655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbac0b2ee0 msgr2=0x7fdbac06d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:03.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.485+0000 7fdbaa59c640 1 --2- 172.21.15.59:0/1773594655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbac0b2ee0 0x7fdbac06d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.485+0000 7fdbaa59c640 1 -- 172.21.15.59:0/1773594655 >> v1:172.21.15.151:6789/0 conn(0x7fdbac0cf030 legacy=0x7fdbac06ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:03.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.485+0000 7fdbaa59c640 1 -- 172.21.15.59:0/1773594655 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac0b16d0 con 0x7fdbac154d10 2023-10-16T14:27:03.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.485+0000 7fdbaa59c640 1 -- 172.21.15.59:0/1773594655 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7fdb9c0019f0 con 0x7fdbac154d10 2023-10-16T14:27:03.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.485+0000 7fdbaa59c640 1 -- 172.21.15.59:0/1773594655 >> v1:172.21.15.59:6789/0 conn(0x7fdbac154d10 legacy=0x7fdbac0ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:03.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.485+0000 7fdbaa59c640 1 --2- 172.21.15.59:0/1773594655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb98003ba0 0x7fdb98003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.485+0000 7fdbaa59c640 1 --2- 172.21.15.59:0/1773594655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbac0b2ee0 0x7fdb980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.485+0000 7fdbaa59c640 1 --2- 172.21.15.59:0/1773594655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb98004d00 0x7fdb98005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.485+0000 7fdbaa59c640 1 -- 172.21.15.59:0/1773594655 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac0b13f0 con 0x7fdb98003ba0 2023-10-16T14:27:03.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.485+0000 7fdbaa59c640 1 -- 172.21.15.59:0/1773594655 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9800ba60 con 0x7fdb98004d00 2023-10-16T14:27:03.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.485+0000 7fdbaa59c640 1 -- 172.21.15.59:0/1773594655 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9800bc20 con 0x7fdbac0b2ee0 2023-10-16T14:27:03.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.485+0000 7fdbaad9d640 1 --2- 172.21.15.59:0/1773594655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb98003ba0 0x7fdb98003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:03.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.486+0000 7fdbab59e640 1 --2- 172.21.15.59:0/1773594655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb98004d00 0x7fdb98005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:03.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.486+0000 7fdba259c640 1 --2- 172.21.15.59:0/1773594655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbac0b2ee0 0x7fdb980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.486+0000 7fdbaad9d640 1 -- 172.21.15.59:0/1773594655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbac0b2ee0 msgr2=0x7fdb980047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.486+0000 7fdbaad9d640 1 --2- 172.21.15.59:0/1773594655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbac0b2ee0 0x7fdb980047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.486+0000 7fdbaad9d640 1 -- 172.21.15.59:0/1773594655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb98004d00 msgr2=0x7fdb98005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.486+0000 7fdbaad9d640 1 --2- 172.21.15.59:0/1773594655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb98004d00 0x7fdb98005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.486+0000 7fdbaad9d640 1 -- 172.21.15.59:0/1773594655 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb98003520 con 0x7fdb98003ba0 2023-10-16T14:27:03.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.486+0000 7fdba259c640 1 --2- 172.21.15.59:0/1773594655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbac0b2ee0 0x7fdb980047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:03.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.487+0000 7fdbaad9d640 1 --2- 172.21.15.59:0/1773594655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb98003ba0 0x7fdb98003fa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c002230 tx=0x7fdb980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec880f91ff4ffaf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:03.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.487+0000 7fdbaa59c640 1 -- 172.21.15.59:0/1773594655 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c034630 con 0x7fdb98003ba0 2023-10-16T14:27:03.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.487+0000 7fdbaa59c640 1 -- 172.21.15.59:0/1773594655 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c02f070 con 0x7fdb98003ba0 2023-10-16T14:27:03.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.487+0000 7fdbaa59c640 1 -- 172.21.15.59:0/1773594655 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c0349f0 con 0x7fdb98003ba0 2023-10-16T14:27:03.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.488+0000 7fdbb084e640 1 -- 172.21.15.59:0/1773594655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb98003ba0 msgr2=0x7fdb98003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:03.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.488+0000 7fdbb084e640 1 --2- 172.21.15.59:0/1773594655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb98003ba0 0x7fdb98003fa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c002230 tx=0x7fdb980057f0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.488+0000 7fdbab59e640 1 -- 172.21.15.59:0/1773594655 reap_dead start 2023-10-16T14:27:03.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.488+0000 7fdbb084e640 1 -- 172.21.15.59:0/1773594655 shutdown_connections 2023-10-16T14:27:03.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.488+0000 7fdbb084e640 1 -- 172.21.15.59:0/1773594655 >> 172.21.15.59:0/1773594655 conn(0x7fdbac06a200 msgr2=0x7fdbac06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:03.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.488+0000 7fdbb084e640 1 -- 172.21.15.59:0/1773594655 shutdown_connections 2023-10-16T14:27:03.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.488+0000 7fdbb084e640 1 -- 172.21.15.59:0/1773594655 wait complete. 2023-10-16T14:27:03.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.490+0000 7fdbb084e640 1 Processor -- start 2023-10-16T14:27:03.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.490+0000 7fdbb084e640 1 -- start start 2023-10-16T14:27:03.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.491+0000 7fdbb084e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb98003ba0 0x7fdbac154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.500 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.491+0000 7fdbb084e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbac0cc7e0 0x7fdbac159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.491+0000 7fdbb084e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbac0ccc40 0x7fdbac1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.491+0000 7fdbb084e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac1548c0 con 0x7fdb98003ba0 2023-10-16T14:27:03.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.491+0000 7fdbb084e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac0cd150 con 0x7fdbac0ccc40 2023-10-16T14:27:03.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.491+0000 7fdbb084e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac0cd430 con 0x7fdbac0cc7e0 2023-10-16T14:27:03.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.491+0000 7fdbaad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb98003ba0 0x7fdbac154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:03.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.491+0000 7fdbaad9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb98003ba0 0x7fdbac154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55198/0 (socket says 172.21.15.59:55198) 2023-10-16T14:27:03.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.491+0000 7fdbaad9d640 1 -- 172.21.15.59:0/3055880526 learned_addr learned my addr 172.21.15.59:0/3055880526 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:03.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.492+0000 7fdbab59e640 1 --2- 172.21.15.59:0/3055880526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbac0ccc40 0x7fdbac1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:03.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.492+0000 7fdba259c640 1 --2- 172.21.15.59:0/3055880526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbac0cc7e0 0x7fdbac159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:03.502 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.492+0000 7fdbaad9d640 1 -- 172.21.15.59:0/3055880526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbac0cc7e0 msgr2=0x7fdbac159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:03.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.492+0000 7fdbaad9d640 1 --2- 172.21.15.59:0/3055880526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbac0cc7e0 0x7fdbac159390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.492+0000 7fdbaad9d640 1 -- 172.21.15.59:0/3055880526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbac0ccc40 msgr2=0x7fdbac1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:03.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.492+0000 7fdbaad9d640 1 --2- 172.21.15.59:0/3055880526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbac0ccc40 0x7fdbac1598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.492+0000 7fdbaad9d640 1 -- 172.21.15.59:0/3055880526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac0cd710 con 0x7fdb98003ba0 2023-10-16T14:27:03.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.492+0000 7fdbab59e640 1 --2- 172.21.15.59:0/3055880526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbac0ccc40 0x7fdbac1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:03.503 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.492+0000 7fdbaad9d640 1 --2- 172.21.15.59:0/3055880526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb98003ba0 0x7fdbac154380 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c002230 tx=0x7fdb9c001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:03.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.492+0000 7fdba3fff640 1 -- 172.21.15.59:0/3055880526 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c034700 con 0x7fdb98003ba0 2023-10-16T14:27:03.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.493+0000 7fdba3fff640 1 -- 172.21.15.59:0/3055880526 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c034860 con 0x7fdb98003ba0 2023-10-16T14:27:03.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.493+0000 7fdba3fff640 1 -- 172.21.15.59:0/3055880526 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c034bd0 con 0x7fdb98003ba0 2023-10-16T14:27:03.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.493+0000 7fdbb084e640 1 -- 172.21.15.59:0/3055880526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbac0cd9f0 con 0x7fdb98003ba0 2023-10-16T14:27:03.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.493+0000 7fdbb084e640 1 -- 172.21.15.59:0/3055880526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac1f59b0 con 0x7fdb98003ba0 2023-10-16T14:27:03.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.494+0000 7fdbb084e640 1 -- 172.21.15.59:0/3055880526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbac04e9b0 con 0x7fdb98003ba0 2023-10-16T14:27:03.505 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.495+0000 7fdba3fff640 1 -- 172.21.15.59:0/3055880526 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdb9c031030 con 0x7fdb98003ba0 2023-10-16T14:27:03.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.496+0000 7fdba3fff640 1 --2- 172.21.15.59:0/3055880526 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fdb8c06ae70 0x7fdb8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.496+0000 7fdba3fff640 1 -- 172.21.15.59:0/3055880526 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fdb9c0abf40 con 0x7fdb98003ba0 2023-10-16T14:27:03.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.496+0000 7fdba259c640 1 --2- 172.21.15.59:0/3055880526 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fdb8c06ae70 0x7fdb8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:03.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.497+0000 7fdba259c640 1 --2- 172.21.15.59:0/3055880526 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fdb8c06ae70 0x7fdb8c06d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0cc180 tx=0x7fdb94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:03.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.500+0000 7fdba3fff640 1 -- 172.21.15.59:0/3055880526 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdb9c076c20 con 0x7fdb98003ba0 2023-10-16T14:27:03.695 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.692+0000 7fdbb084e640 1 -- 172.21.15.59:0/3055880526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdbac0c8e50 con 0x7fdb98003ba0 2023-10-16T14:27:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.693+0000 7fdba3fff640 1 -- 172.21.15.59:0/3055880526 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdb9c043020 con 0x7fdb98003ba0 2023-10-16T14:27:03.696 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:27:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.695+0000 7fdbb084e640 1 -- 172.21.15.59:0/3055880526 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fdb8c06ae70 msgr2=0x7fdb8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.695+0000 7fdbb084e640 1 --2- 172.21.15.59:0/3055880526 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fdb8c06ae70 0x7fdb8c06d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0cc180 tx=0x7fdb94009040 comp rx=0 tx=0).stop 2023-10-16T14:27:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.695+0000 7fdbb084e640 1 -- 172.21.15.59:0/3055880526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb98003ba0 msgr2=0x7fdbac154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.695+0000 7fdbb084e640 1 --2- 172.21.15.59:0/3055880526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb98003ba0 0x7fdbac154380 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c002230 tx=0x7fdb9c001d00 comp rx=0 tx=0).stop 2023-10-16T14:27:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.696+0000 7fdbb084e640 1 -- 172.21.15.59:0/3055880526 shutdown_connections 2023-10-16T14:27:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.696+0000 7fdbb084e640 1 --2- 172.21.15.59:0/3055880526 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fdb8c06ae70 0x7fdb8c06d330 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.696+0000 7fdbb084e640 1 --2- 172.21.15.59:0/3055880526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbac0ccc40 0x7fdbac1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.696+0000 7fdbb084e640 1 --2- 172.21.15.59:0/3055880526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbac0cc7e0 0x7fdbac159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.696+0000 7fdbb084e640 1 --2- 172.21.15.59:0/3055880526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb98003ba0 0x7fdbac154380 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.696+0000 7fdbb084e640 1 -- 172.21.15.59:0/3055880526 >> 172.21.15.59:0/3055880526 conn(0x7fdbac06a200 msgr2=0x7fdbac0ce8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:03.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.696+0000 7fdbb084e640 1 -- 172.21.15.59:0/3055880526 shutdown_connections 2023-10-16T14:27:03.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.696+0000 7fdbb084e640 1 -- 172.21.15.59:0/3055880526 wait complete. 2023-10-16T14:27:03.718 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T14:27:03.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.935+0000 7ff542bd7640 1 Processor -- start 2023-10-16T14:27:03.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.935+0000 7ff542bd7640 1 -- start start 2023-10-16T14:27:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.937+0000 7ff542bd7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c0b2ee0 0x7ff53c06d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.937+0000 7ff542bd7640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53c1550f0 con 0x7ff53c154d10 2023-10-16T14:27:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.937+0000 7ff542bd7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53c06db50 con 0x7ff53c0cf030 2023-10-16T14:27:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.937+0000 7ff542bd7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0b13f0 con 0x7ff53c0b2ee0 2023-10-16T14:27:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.937+0000 7ff541bd5640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff53c154d10 0x7ff53c0ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47832/0 (socket says 172.21.15.59:47832) 2023-10-16T14:27:03.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.937+0000 7ff541bd5640 1 -- 172.21.15.59:0/2028822642 learned_addr learned my addr 172.21.15.59:0/2028822642 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.937+0000 7ff5423d6640 1 --2- 172.21.15.59:0/2028822642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c0b2ee0 0x7ff53c06d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.937+0000 7ff540bd3640 1 -- 172.21.15.59:0/2028822642 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357205867 0 0) 0x7ff53c1550f0 con 0x7ff53c154d10 2023-10-16T14:27:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.938+0000 7ff540bd3640 1 -- 172.21.15.59:0/2028822642 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff528003520 con 0x7ff53c154d10 2023-10-16T14:27:03.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.938+0000 7ff540bd3640 1 -- 172.21.15.59:0/2028822642 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3050786355 0 0) 0x7ff528003520 con 0x7ff53c154d10 2023-10-16T14:27:03.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.938+0000 7ff540bd3640 1 -- 172.21.15.59:0/2028822642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c0b2ee0 msgr2=0x7ff53c06d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:03.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.938+0000 7ff540bd3640 1 --2- 172.21.15.59:0/2028822642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c0b2ee0 0x7ff53c06d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.938+0000 7ff540bd3640 1 -- 172.21.15.59:0/2028822642 >> v1:172.21.15.151:6789/0 conn(0x7ff53c0cf030 legacy=0x7ff53c06ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:03.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.938+0000 7ff540bd3640 1 -- 172.21.15.59:0/2028822642 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c0b16d0 con 0x7ff53c154d10 2023-10-16T14:27:03.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.938+0000 7ff540bd3640 1 -- 172.21.15.59:0/2028822642 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7ff538001670 con 0x7ff53c154d10 2023-10-16T14:27:03.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.938+0000 7ff540bd3640 1 -- 172.21.15.59:0/2028822642 >> v1:172.21.15.59:6789/0 conn(0x7ff53c154d10 legacy=0x7ff53c0ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:03.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.938+0000 7ff540bd3640 1 --2- 172.21.15.59:0/2028822642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff528003a10 0x7ff528003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.938+0000 7ff540bd3640 1 --2- 172.21.15.59:0/2028822642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c0b2ee0 0x7ff5280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.938+0000 7ff540bd3640 1 --2- 172.21.15.59:0/2028822642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff528004d70 0x7ff5280051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.938+0000 7ff540bd3640 1 -- 172.21.15.59:0/2028822642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0b13f0 con 0x7ff528003a10 2023-10-16T14:27:03.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.938+0000 7ff540bd3640 1 -- 172.21.15.59:0/2028822642 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52800ffa0 con 0x7ff528004d70 2023-10-16T14:27:03.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.938+0000 7ff540bd3640 1 -- 172.21.15.59:0/2028822642 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff528010160 con 0x7ff53c0b2ee0 2023-10-16T14:27:03.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.938+0000 7ff541bd5640 1 --2- 172.21.15.59:0/2028822642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff528003a10 0x7ff528003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:03.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.939+0000 7ff541bd5640 1 -- 172.21.15.59:0/2028822642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c0b2ee0 msgr2=0x7ff5280047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:03.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.939+0000 7ff541bd5640 1 --2- 172.21.15.59:0/2028822642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c0b2ee0 0x7ff5280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.939+0000 7ff541bd5640 1 -- 172.21.15.59:0/2028822642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff528004d70 msgr2=0x7ff5280051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:03.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.939+0000 7ff541bd5640 1 --2- 172.21.15.59:0/2028822642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff528004d70 0x7ff5280051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.939+0000 7ff541bd5640 1 -- 172.21.15.59:0/2028822642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff528003520 con 0x7ff528003a10 2023-10-16T14:27:03.947 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.940+0000 7ff541bd5640 1 --2- 172.21.15.59:0/2028822642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff528003a10 0x7ff528003e30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff538001eb0 tx=0x7ff5280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180780f9c92b9091 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:03.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.940+0000 7ff540bd3640 1 -- 172.21.15.59:0/2028822642 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff538005ad0 con 0x7ff528003a10 2023-10-16T14:27:03.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.940+0000 7ff540bd3640 1 -- 172.21.15.59:0/2028822642 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff538005c30 con 0x7ff528003a10 2023-10-16T14:27:03.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.940+0000 7ff540bd3640 1 -- 172.21.15.59:0/2028822642 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff538007070 con 0x7ff528003a10 2023-10-16T14:27:03.952 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.941+0000 7ff542bd7640 1 -- 172.21.15.59:0/2028822642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff528003a10 msgr2=0x7ff528003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:03.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.941+0000 7ff542bd7640 1 --2- 172.21.15.59:0/2028822642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff528003a10 0x7ff528003e30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff538001eb0 tx=0x7ff5280057f0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.941+0000 7ff5423d6640 1 -- 172.21.15.59:0/2028822642 reap_dead start 2023-10-16T14:27:03.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.941+0000 7ff542bd7640 1 -- 172.21.15.59:0/2028822642 shutdown_connections 2023-10-16T14:27:03.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.941+0000 7ff542bd7640 1 -- 172.21.15.59:0/2028822642 >> 172.21.15.59:0/2028822642 conn(0x7ff53c06a200 msgr2=0x7ff53c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:03.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.941+0000 7ff542bd7640 1 -- 172.21.15.59:0/2028822642 shutdown_connections 2023-10-16T14:27:03.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.941+0000 7ff542bd7640 1 -- 172.21.15.59:0/2028822642 wait complete. 2023-10-16T14:27:03.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.943+0000 7ff542bd7640 1 Processor -- start 2023-10-16T14:27:03.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.943+0000 7ff542bd7640 1 -- start start 2023-10-16T14:27:03.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.943+0000 7ff542bd7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff528003a10 0x7ff53c0976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.944+0000 7ff542bd7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c097c20 0x7ff53c159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.944+0000 7ff542bd7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff53c159850 0x7ff53c1509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.944+0000 7ff542bd7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c15a070 con 0x7ff528003a10 2023-10-16T14:27:03.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.944+0000 7ff542bd7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c15a350 con 0x7ff53c159850 2023-10-16T14:27:03.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.944+0000 7ff542bd7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c15a630 con 0x7ff53c097c20 2023-10-16T14:27:03.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.944+0000 7ff541bd5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff528003a10 0x7ff53c0976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:03.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.944+0000 7ff541bd5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff528003a10 0x7ff53c0976e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55228/0 (socket says 172.21.15.59:55228) 2023-10-16T14:27:03.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.944+0000 7ff541bd5640 1 -- 172.21.15.59:0/3760047842 learned_addr learned my addr 172.21.15.59:0/3760047842 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:03.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.944+0000 7ff541bd5640 1 -- 172.21.15.59:0/3760047842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c097c20 msgr2=0x7ff53c159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:03.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.944+0000 7ff5423d6640 1 --2- 172.21.15.59:0/3760047842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff53c159850 0x7ff53c1509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:03.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.944+0000 7ff5413d4640 1 --2- 172.21.15.59:0/3760047842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c097c20 0x7ff53c159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:03.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.944+0000 7ff541bd5640 1 --2- 172.21.15.59:0/3760047842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c097c20 0x7ff53c159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.944+0000 7ff541bd5640 1 -- 172.21.15.59:0/3760047842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff53c159850 msgr2=0x7ff53c1509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:03.958 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.944+0000 7ff541bd5640 1 --2- 172.21.15.59:0/3760047842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff53c159850 0x7ff53c1509f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:03.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.944+0000 7ff541bd5640 1 -- 172.21.15.59:0/3760047842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c1501f0 con 0x7ff528003a10 2023-10-16T14:27:03.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.945+0000 7ff541bd5640 1 --2- 172.21.15.59:0/3760047842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff528003a10 0x7ff53c0976e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff538001eb0 tx=0x7ff538001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:03.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.945+0000 7ff5327fc640 1 -- 172.21.15.59:0/3760047842 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53803c040 con 0x7ff528003a10 2023-10-16T14:27:03.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.945+0000 7ff5327fc640 1 -- 172.21.15.59:0/3760047842 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff538007500 con 0x7ff528003a10 2023-10-16T14:27:03.959 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.945+0000 7ff5327fc640 1 -- 172.21.15.59:0/3760047842 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53802c700 con 0x7ff528003a10 2023-10-16T14:27:03.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.945+0000 7ff542bd7640 1 -- 172.21.15.59:0/3760047842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53c1504d0 con 0x7ff528003a10 2023-10-16T14:27:03.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.945+0000 7ff542bd7640 1 -- 172.21.15.59:0/3760047842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53c150f30 con 0x7ff528003a10 2023-10-16T14:27:03.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.946+0000 7ff542bd7640 1 -- 172.21.15.59:0/3760047842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53c04e9b0 con 0x7ff528003a10 2023-10-16T14:27:03.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.947+0000 7ff5327fc640 1 -- 172.21.15.59:0/3760047842 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff538032070 con 0x7ff528003a10 2023-10-16T14:27:03.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.948+0000 7ff5327fc640 1 --2- 172.21.15.59:0/3760047842 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff52006ae70 0x7ff52006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:03.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.948+0000 7ff5327fc640 1 -- 172.21.15.59:0/3760047842 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff5380aae70 con 0x7ff528003a10 2023-10-16T14:27:03.961 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.948+0000 7ff5413d4640 1 --2- 172.21.15.59:0/3760047842 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff52006ae70 0x7ff52006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:03.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.950+0000 7ff5413d4640 1 --2- 172.21.15.59:0/3760047842 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff52006ae70 0x7ff52006d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff53c098020 tx=0x7ff52c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:03.963 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:03.952+0000 7ff5327fc640 1 -- 172.21.15.59:0/3760047842 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff538075be0 con 0x7ff528003a10 2023-10-16T14:27:04.152 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.149+0000 7ff542bd7640 1 -- 172.21.15.59:0/3760047842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff53c0c8e50 con 0x7ff528003a10 2023-10-16T14:27:04.153 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.149+0000 7ff5327fc640 1 -- 172.21.15.59:0/3760047842 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff538046020 con 0x7ff528003a10 2023-10-16T14:27:04.153 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-16T14:27:04.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.152+0000 7ff542bd7640 1 -- 172.21.15.59:0/3760047842 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff52006ae70 msgr2=0x7ff52006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:04.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.152+0000 7ff542bd7640 1 --2- 172.21.15.59:0/3760047842 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff52006ae70 0x7ff52006d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff53c098020 tx=0x7ff52c009040 comp rx=0 tx=0).stop 2023-10-16T14:27:04.156 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.152+0000 7ff542bd7640 1 -- 172.21.15.59:0/3760047842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff528003a10 msgr2=0x7ff53c0976e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:04.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.152+0000 7ff542bd7640 1 --2- 172.21.15.59:0/3760047842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff528003a10 0x7ff53c0976e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff538001eb0 tx=0x7ff538001930 comp rx=0 tx=0).stop 2023-10-16T14:27:04.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.152+0000 7ff542bd7640 1 -- 172.21.15.59:0/3760047842 shutdown_connections 2023-10-16T14:27:04.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.152+0000 7ff542bd7640 1 --2- 172.21.15.59:0/3760047842 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff52006ae70 0x7ff52006d330 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.152+0000 7ff542bd7640 1 --2- 172.21.15.59:0/3760047842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff53c159850 0x7ff53c1509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.157 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.152+0000 7ff542bd7640 1 --2- 172.21.15.59:0/3760047842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff53c097c20 0x7ff53c159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.152+0000 7ff542bd7640 1 --2- 172.21.15.59:0/3760047842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff528003a10 0x7ff53c0976e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.152+0000 7ff542bd7640 1 -- 172.21.15.59:0/3760047842 >> 172.21.15.59:0/3760047842 conn(0x7ff53c06a200 msgr2=0x7ff53c0cc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:04.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.153+0000 7ff542bd7640 1 -- 172.21.15.59:0/3760047842 shutdown_connections 2023-10-16T14:27:04.158 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.153+0000 7ff542bd7640 1 -- 172.21.15.59:0/3760047842 wait complete. 2023-10-16T14:27:04.175 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T14:27:04.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.396+0000 7fe4f7fff640 1 Processor -- start 2023-10-16T14:27:04.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.397+0000 7fe4f7fff640 1 -- start start 2023-10-16T14:27:04.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.398+0000 7fe4f7fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4f80cf030 0x7fe4f806ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:04.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.398+0000 7fe4f7fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4f806d360 0x7fe4f80ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:04.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.398+0000 7fe4f7fff640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f81550f0 con 0x7fe4f8154d10 2023-10-16T14:27:04.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.398+0000 7fe4f7fff640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f806db50 con 0x7fe4f806d360 2023-10-16T14:27:04.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.398+0000 7fe4f7fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f80b13f0 con 0x7fe4f80cf030 2023-10-16T14:27:04.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.399+0000 7fe4f6ffd640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe4f8154d10 0x7fe4f80ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47846/0 (socket says 172.21.15.59:47846) 2023-10-16T14:27:04.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.399+0000 7fe4f6ffd640 1 -- 172.21.15.59:0/2318143640 learned_addr learned my addr 172.21.15.59:0/2318143640 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:04.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.399+0000 7fe4f77fe640 1 --2- 172.21.15.59:0/2318143640 >> v2:172.21.15.59:3300/0 conn(0x7fe4f806d360 0x7fe4f80ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:04.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.399+0000 7fe4f67fc640 1 -- 172.21.15.59:0/2318143640 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2238609165 0 0) 0x7fe4f81550f0 con 0x7fe4f8154d10 2023-10-16T14:27:04.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.399+0000 7fe4f67fc640 1 -- 172.21.15.59:0/2318143640 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4e4003520 con 0x7fe4f8154d10 2023-10-16T14:27:04.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.399+0000 7fe4f77fe640 1 -- 172.21.15.59:0/2318143640 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4f80cf030 msgr2=0x7fe4f806ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:04.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.399+0000 7fe4f77fe640 1 --2- 172.21.15.59:0/2318143640 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4f80cf030 0x7fe4f806ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.399+0000 7fe4f77fe640 1 -- 172.21.15.59:0/2318143640 >> v1:172.21.15.59:6789/0 conn(0x7fe4f8154d10 legacy=0x7fe4f80ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:04.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.399+0000 7fe4f77fe640 1 -- 172.21.15.59:0/2318143640 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f80b16d0 con 0x7fe4f806d360 2023-10-16T14:27:04.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.401+0000 7fe4f77fe640 1 --2- 172.21.15.59:0/2318143640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f806d360 0x7fe4f80ac1d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00097a0 tx=0x7fe4f002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6a1a766c36fba3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:04.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.401+0000 7fe4f67fc640 1 -- 172.21.15.59:0/2318143640 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f002d040 con 0x7fe4f806d360 2023-10-16T14:27:04.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.401+0000 7fe4f67fc640 1 -- 172.21.15.59:0/2318143640 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f0031810 con 0x7fe4f806d360 2023-10-16T14:27:04.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.401+0000 7fe4f67fc640 1 -- 172.21.15.59:0/2318143640 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0031b80 con 0x7fe4f806d360 2023-10-16T14:27:04.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.402+0000 7fe4f7fff640 1 -- 172.21.15.59:0/2318143640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f806d360 msgr2=0x7fe4f80ac1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:04.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.402+0000 7fe4f7fff640 1 --2- 172.21.15.59:0/2318143640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f806d360 0x7fe4f80ac1d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00097a0 tx=0x7fe4f002b8b0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.402+0000 7fe4f7fff640 1 -- 172.21.15.59:0/2318143640 shutdown_connections 2023-10-16T14:27:04.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.402+0000 7fe4f7fff640 1 --2- 172.21.15.59:0/2318143640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f806d360 0x7fe4f80ac1d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.402+0000 7fe4f7fff640 1 --2- 172.21.15.59:0/2318143640 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4f80cf030 0x7fe4f806ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.402+0000 7fe4f7fff640 1 -- 172.21.15.59:0/2318143640 >> 172.21.15.59:0/2318143640 conn(0x7fe4f806a200 msgr2=0x7fe4f806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:04.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.402+0000 7fe4f7fff640 1 -- 172.21.15.59:0/2318143640 shutdown_connections 2023-10-16T14:27:04.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.402+0000 7fe4f7fff640 1 -- 172.21.15.59:0/2318143640 wait complete. 2023-10-16T14:27:04.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.404+0000 7fe4f7fff640 1 Processor -- start 2023-10-16T14:27:04.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.404+0000 7fe4f7fff640 1 -- start start 2023-10-16T14:27:04.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.405+0000 7fe4f7fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4f806d360 0x7fe4f8156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:04.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.405+0000 7fe4f7fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4f80cf030 0x7fe4f8154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:04.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.405+0000 7fe4f7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f8154d10 0x7fe4f815e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:04.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.405+0000 7fe4f7fff640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f80c3a80 con 0x7fe4f8154d10 2023-10-16T14:27:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.405+0000 7fe4f7fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f8154690 con 0x7fe4f80cf030 2023-10-16T14:27:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.405+0000 7fe4f7fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f815e680 con 0x7fe4f806d360 2023-10-16T14:27:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.405+0000 7fe4f77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f8154d10 0x7fe4f815e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.405+0000 7fe4f77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f8154d10 0x7fe4f815e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55252/0 (socket says 172.21.15.59:55252) 2023-10-16T14:27:04.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.405+0000 7fe4f77fe640 1 -- 172.21.15.59:0/1470829967 learned_addr learned my addr 172.21.15.59:0/1470829967 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.406+0000 7fe4f6ffd640 1 --2- 172.21.15.59:0/1470829967 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4f806d360 0x7fe4f8156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.406+0000 7fe4f77fe640 1 -- 172.21.15.59:0/1470829967 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4f806d360 msgr2=0x7fe4f8156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.406+0000 7fe4ee7fc640 1 --2- 172.21.15.59:0/1470829967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4f80cf030 0x7fe4f8154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:04.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.406+0000 7fe4f77fe640 1 --2- 172.21.15.59:0/1470829967 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4f806d360 0x7fe4f8156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.406+0000 7fe4f77fe640 1 -- 172.21.15.59:0/1470829967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4f80cf030 msgr2=0x7fe4f8154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:04.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.406+0000 7fe4f77fe640 1 --2- 172.21.15.59:0/1470829967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4f80cf030 0x7fe4f8154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.406+0000 7fe4f77fe640 1 -- 172.21.15.59:0/1470829967 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f0009400 con 0x7fe4f8154d10 2023-10-16T14:27:04.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.406+0000 7fe4ee7fc640 1 --2- 172.21.15.59:0/1470829967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4f80cf030 0x7fe4f8154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:04.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.406+0000 7fe4f77fe640 1 --2- 172.21.15.59:0/1470829967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f8154d10 0x7fe4f815e140 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe4f002b8f0 tx=0x7fe4f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:04.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.406+0000 7fe4f4ff9640 1 -- 172.21.15.59:0/1470829967 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0006e10 con 0x7fe4f8154d10 2023-10-16T14:27:04.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.407+0000 7fe4f4ff9640 1 -- 172.21.15.59:0/1470829967 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f003ad60 con 0x7fe4f8154d10 2023-10-16T14:27:04.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.407+0000 7fe4f4ff9640 1 -- 172.21.15.59:0/1470829967 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0044630 con 0x7fe4f8154d10 2023-10-16T14:27:04.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.407+0000 7fe4f7fff640 1 -- 172.21.15.59:0/1470829967 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f815e950 con 0x7fe4f8154d10 2023-10-16T14:27:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.407+0000 7fe4f7fff640 1 -- 172.21.15.59:0/1470829967 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f80c3430 con 0x7fe4f8154d10 2023-10-16T14:27:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.408+0000 7fe4f7fff640 1 -- 172.21.15.59:0/1470829967 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f804e9b0 con 0x7fe4f8154d10 2023-10-16T14:27:04.417 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.409+0000 7fe4f4ff9640 1 -- 172.21.15.59:0/1470829967 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe4f0044790 con 0x7fe4f8154d10 2023-10-16T14:27:04.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.410+0000 7fe4f4ff9640 1 --2- 172.21.15.59:0/1470829967 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe4d806ae70 0x7fe4d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:04.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.410+0000 7fe4f4ff9640 1 -- 172.21.15.59:0/1470829967 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fe4f00abc20 con 0x7fe4f8154d10 2023-10-16T14:27:04.418 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.411+0000 7fe4f6ffd640 1 --2- 172.21.15.59:0/1470829967 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe4d806ae70 0x7fe4d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:04.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.412+0000 7fe4f6ffd640 1 --2- 172.21.15.59:0/1470829967 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe4d806ae70 0x7fe4d806d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80cb090 tx=0x7fe4e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:04.419 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.415+0000 7fe4f4ff9640 1 -- 172.21.15.59:0/1470829967 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe4f00769a0 con 0x7fe4f8154d10 2023-10-16T14:27:04.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.608+0000 7fe4f7fff640 1 -- 172.21.15.59:0/1470829967 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe4f80c3bc0 con 0x7fe4f8154d10 2023-10-16T14:27:04.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.609+0000 7fe4f4ff9640 1 -- 172.21.15.59:0/1470829967 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe4f00350a0 con 0x7fe4f8154d10 2023-10-16T14:27:04.613 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:27:04.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.612+0000 7fe4f7fff640 1 -- 172.21.15.59:0/1470829967 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe4d806ae70 msgr2=0x7fe4d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:04.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.612+0000 7fe4f7fff640 1 --2- 172.21.15.59:0/1470829967 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe4d806ae70 0x7fe4d806d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80cb090 tx=0x7fe4e8009040 comp rx=0 tx=0).stop 2023-10-16T14:27:04.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.612+0000 7fe4f7fff640 1 -- 172.21.15.59:0/1470829967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f8154d10 msgr2=0x7fe4f815e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:04.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.612+0000 7fe4f7fff640 1 --2- 172.21.15.59:0/1470829967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f8154d10 0x7fe4f815e140 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe4f002b8f0 tx=0x7fe4f00046c0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.612+0000 7fe4f7fff640 1 -- 172.21.15.59:0/1470829967 shutdown_connections 2023-10-16T14:27:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.612+0000 7fe4f7fff640 1 --2- 172.21.15.59:0/1470829967 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe4d806ae70 0x7fe4d806d330 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.612+0000 7fe4f7fff640 1 --2- 172.21.15.59:0/1470829967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4f8154d10 0x7fe4f815e140 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.612+0000 7fe4f7fff640 1 --2- 172.21.15.59:0/1470829967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4f80cf030 0x7fe4f8154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.612+0000 7fe4f7fff640 1 --2- 172.21.15.59:0/1470829967 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4f806d360 0x7fe4f8156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.612+0000 7fe4f7fff640 1 -- 172.21.15.59:0/1470829967 >> 172.21.15.59:0/1470829967 conn(0x7fe4f806a200 msgr2=0x7fe4f80af790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.613+0000 7fe4f7fff640 1 -- 172.21.15.59:0/1470829967 shutdown_connections 2023-10-16T14:27:04.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.613+0000 7fe4f7fff640 1 -- 172.21.15.59:0/1470829967 wait complete. 2023-10-16T14:27:04.636 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T14:27:04.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.853+0000 7f5dff59e640 1 Processor -- start 2023-10-16T14:27:04.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.853+0000 7f5dff59e640 1 -- start start 2023-10-16T14:27:04.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.855+0000 7f5dff59e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5e000ce600 0x7f5e000cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:04.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.855+0000 7f5dff59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e000ab180 0x7f5e000ab610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:04.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.855+0000 7f5dff59e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e000cefa0 con 0x7f5e000b2dd0 2023-10-16T14:27:04.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.855+0000 7f5dff59e640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0015e2b0 con 0x7f5e000ce600 2023-10-16T14:27:04.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.855+0000 7f5dff59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0015f0d0 con 0x7f5e000ab180 2023-10-16T14:27:04.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.855+0000 7f5dfe59c640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5e000b2dd0 0x7f5e0006d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47858/0 (socket says 172.21.15.59:47858) 2023-10-16T14:27:04.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.855+0000 7f5dfe59c640 1 -- 172.21.15.59:0/320431925 learned_addr learned my addr 172.21.15.59:0/320431925 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:04.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.855+0000 7f5df5d9b640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5e000ce600 0x7f5e000cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:04.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.855+0000 7f5dfed9d640 1 --2- 172.21.15.59:0/320431925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e000ab180 0x7f5e000ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:04.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.856+0000 7f5dfdd9b640 1 -- 172.21.15.59:0/320431925 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646705330 0 0) 0x7f5e000cefa0 con 0x7f5e000b2dd0 2023-10-16T14:27:04.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.856+0000 7f5df5d9b640 1 -- 172.21.15.59:0/320431925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e000ab180 msgr2=0x7f5e000ab610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:04.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.856+0000 7f5df5d9b640 1 --2- 172.21.15.59:0/320431925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e000ab180 0x7f5e000ab610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.856+0000 7f5df5d9b640 1 -- 172.21.15.59:0/320431925 >> v1:172.21.15.59:6789/0 conn(0x7f5e000b2dd0 legacy=0x7f5e0006d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:04.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.856+0000 7f5df5d9b640 1 -- 172.21.15.59:0/320431925 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0015ab50 con 0x7f5e000ce600 2023-10-16T14:27:04.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.857+0000 7f5df5d9b640 1 --2- 172.21.15.59:0/320431925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e000ce600 0x7f5e000cea60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5de80097a0 tx=0x7f5de802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8668ed068bd57d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:04.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.857+0000 7f5dfdd9b640 1 -- 172.21.15.59:0/320431925 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de802d040 con 0x7f5e000ce600 2023-10-16T14:27:04.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.857+0000 7f5dfdd9b640 1 -- 172.21.15.59:0/320431925 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de8031810 con 0x7f5e000ce600 2023-10-16T14:27:04.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.857+0000 7f5dfdd9b640 1 -- 172.21.15.59:0/320431925 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de8031ba0 con 0x7f5e000ce600 2023-10-16T14:27:04.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.858+0000 7f5dff59e640 1 -- 172.21.15.59:0/320431925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e000ce600 msgr2=0x7f5e000cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:04.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.858+0000 7f5dff59e640 1 --2- 172.21.15.59:0/320431925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e000ce600 0x7f5e000cea60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5de80097a0 tx=0x7f5de802b8b0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.858+0000 7f5dff59e640 1 -- 172.21.15.59:0/320431925 shutdown_connections 2023-10-16T14:27:04.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.858+0000 7f5dff59e640 1 --2- 172.21.15.59:0/320431925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e000ab180 0x7f5e000ab610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.858+0000 7f5dff59e640 1 --2- 172.21.15.59:0/320431925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e000ce600 0x7f5e000cea60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.858+0000 7f5dff59e640 1 -- 172.21.15.59:0/320431925 >> 172.21.15.59:0/320431925 conn(0x7f5e00069fc0 msgr2=0x7f5e0006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:04.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.858+0000 7f5dff59e640 1 -- 172.21.15.59:0/320431925 shutdown_connections 2023-10-16T14:27:04.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.858+0000 7f5dff59e640 1 -- 172.21.15.59:0/320431925 wait complete. 2023-10-16T14:27:04.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.860+0000 7f5dff59e640 1 Processor -- start 2023-10-16T14:27:04.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.860+0000 7f5dff59e640 1 -- start start 2023-10-16T14:27:04.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.861+0000 7f5dff59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e000ab180 0x7f5e00155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:04.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.861+0000 7f5dff59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e000b2dd0 0x7f5e001579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:04.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.861+0000 7f5dff59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e000ce600 0x7f5e001f1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:04.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.861+0000 7f5dff59e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e00157ee0 con 0x7f5e000ab180 2023-10-16T14:27:04.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.861+0000 7f5dff59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e001f0230 con 0x7f5e000ce600 2023-10-16T14:27:04.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.861+0000 7f5dff59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e00156200 con 0x7f5e000b2dd0 2023-10-16T14:27:04.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.862+0000 7f5dfe59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e000ab180 0x7f5e00155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:04.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.862+0000 7f5dfe59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e000ab180 0x7f5e00155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55276/0 (socket says 172.21.15.59:55276) 2023-10-16T14:27:04.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.862+0000 7f5dfe59c640 1 -- 172.21.15.59:0/901919691 learned_addr learned my addr 172.21.15.59:0/901919691 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:04.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.862+0000 7f5df5d9b640 1 --2- 172.21.15.59:0/901919691 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e000b2dd0 0x7f5e001579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:04.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.862+0000 7f5dfed9d640 1 --2- 172.21.15.59:0/901919691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e000ce600 0x7f5e001f1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:04.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.862+0000 7f5dfe59c640 1 -- 172.21.15.59:0/901919691 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e000b2dd0 msgr2=0x7f5e001579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:04.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.862+0000 7f5dfe59c640 1 --2- 172.21.15.59:0/901919691 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e000b2dd0 0x7f5e001579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.862+0000 7f5dfe59c640 1 -- 172.21.15.59:0/901919691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e000ce600 msgr2=0x7f5e001f1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:04.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.862+0000 7f5dfe59c640 1 --2- 172.21.15.59:0/901919691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e000ce600 0x7f5e001f1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:04.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.862+0000 7f5dfe59c640 1 -- 172.21.15.59:0/901919691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de8009400 con 0x7f5e000ab180 2023-10-16T14:27:04.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.862+0000 7f5dfe59c640 1 --2- 172.21.15.59:0/901919691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e000ab180 0x7f5e00155c20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5df000c4d0 tx=0x7f5df000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:04.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.863+0000 7f5df77fe640 1 -- 172.21.15.59:0/901919691 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0007480 con 0x7f5e000ab180 2023-10-16T14:27:04.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.863+0000 7f5df77fe640 1 -- 172.21.15.59:0/901919691 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df00075e0 con 0x7f5e000ab180 2023-10-16T14:27:04.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.863+0000 7f5df77fe640 1 -- 172.21.15.59:0/901919691 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df00059a0 con 0x7f5e000ab180 2023-10-16T14:27:04.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.863+0000 7f5dff59e640 1 -- 172.21.15.59:0/901919691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e001564e0 con 0x7f5e000ab180 2023-10-16T14:27:04.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.863+0000 7f5dff59e640 1 -- 172.21.15.59:0/901919691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e00156aa0 con 0x7f5e000ab180 2023-10-16T14:27:04.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.864+0000 7f5dff59e640 1 -- 172.21.15.59:0/901919691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0004e9b0 con 0x7f5e000ab180 2023-10-16T14:27:04.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.865+0000 7f5df77fe640 1 -- 172.21.15.59:0/901919691 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5df0005b00 con 0x7f5e000ab180 2023-10-16T14:27:04.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.866+0000 7f5df77fe640 1 --2- 172.21.15.59:0/901919691 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f5de006ae70 0x7f5de006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:04.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.866+0000 7f5df77fe640 1 -- 172.21.15.59:0/901919691 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f5df0089570 con 0x7f5e000ab180 2023-10-16T14:27:04.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.867+0000 7f5df5d9b640 1 --2- 172.21.15.59:0/901919691 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f5de006ae70 0x7f5de006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:04.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.868+0000 7f5df5d9b640 1 --2- 172.21.15.59:0/901919691 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f5de006ae70 0x7f5de006d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5de8036000 tx=0x7f5de8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:04.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:04.870+0000 7f5df77fe640 1 -- 172.21.15.59:0/901919691 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5df0054250 con 0x7f5e000ab180 2023-10-16T14:27:05.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.077+0000 7f5dff59e640 1 -- 172.21.15.59:0/901919691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5e0015c470 con 0x7f5e000ab180 2023-10-16T14:27:05.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.078+0000 7f5df77fe640 1 -- 172.21.15.59:0/901919691 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5df0005db0 con 0x7f5e000ab180 2023-10-16T14:27:05.081 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2023-10-16T14:27:05.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.080+0000 7f5dff59e640 1 -- 172.21.15.59:0/901919691 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f5de006ae70 msgr2=0x7f5de006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:05.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.080+0000 7f5dff59e640 1 --2- 172.21.15.59:0/901919691 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f5de006ae70 0x7f5de006d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5de8036000 tx=0x7f5de8008030 comp rx=0 tx=0).stop 2023-10-16T14:27:05.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.080+0000 7f5dff59e640 1 -- 172.21.15.59:0/901919691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e000ab180 msgr2=0x7f5e00155c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:05.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.080+0000 7f5dff59e640 1 --2- 172.21.15.59:0/901919691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e000ab180 0x7f5e00155c20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5df000c4d0 tx=0x7f5df000c990 comp rx=0 tx=0).stop 2023-10-16T14:27:05.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.080+0000 7f5dff59e640 1 -- 172.21.15.59:0/901919691 shutdown_connections 2023-10-16T14:27:05.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.080+0000 7f5dff59e640 1 --2- 172.21.15.59:0/901919691 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f5de006ae70 0x7f5de006d330 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.080+0000 7f5dff59e640 1 --2- 172.21.15.59:0/901919691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e000ce600 0x7f5e001f1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.080+0000 7f5dff59e640 1 --2- 172.21.15.59:0/901919691 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e000b2dd0 0x7f5e001579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.080+0000 7f5dff59e640 1 --2- 172.21.15.59:0/901919691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e000ab180 0x7f5e00155c20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.080+0000 7f5dff59e640 1 -- 172.21.15.59:0/901919691 >> 172.21.15.59:0/901919691 conn(0x7f5e00069fc0 msgr2=0x7f5e000b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:05.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.081+0000 7f5dff59e640 1 -- 172.21.15.59:0/901919691 shutdown_connections 2023-10-16T14:27:05.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.081+0000 7f5dff59e640 1 -- 172.21.15.59:0/901919691 wait complete. 2023-10-16T14:27:05.104 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:27:05.105 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T14:27:05.161 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:27:05.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.386+0000 7f0ba1867640 1 Processor -- start 2023-10-16T14:27:05.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.386+0000 7f0ba1867640 1 -- start start 2023-10-16T14:27:05.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.387+0000 7f0ba1867640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b9c0ce4f0 0x7f0b9c1611c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:05.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.387+0000 7f0ba1867640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9c0cd730 con 0x7f0b9c15cac0 2023-10-16T14:27:05.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.387+0000 7f0ba1867640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9c0cda10 con 0x7f0b9c0d1530 2023-10-16T14:27:05.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.387+0000 7f0ba1867640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c0cdcf0 con 0x7f0b9c0ce4f0 2023-10-16T14:27:05.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.387+0000 7f0ba0865640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0b9c15cac0 0x7f0b9c0d0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47874/0 (socket says 172.21.15.59:47874) 2023-10-16T14:27:05.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.387+0000 7f0ba0865640 1 -- 172.21.15.59:0/1464996720 learned_addr learned my addr 172.21.15.59:0/1464996720 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:05.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.388+0000 7f0b9b7fe640 1 -- 172.21.15.59:0/1464996720 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279133216 0 0) 0x7f0b9c0cd730 con 0x7f0b9c15cac0 2023-10-16T14:27:05.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.388+0000 7f0b9b7fe640 1 -- 172.21.15.59:0/1464996720 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b84003520 con 0x7f0b9c15cac0 2023-10-16T14:27:05.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.388+0000 7f0ba1066640 1 --2- 172.21.15.59:0/1464996720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b9c0ce4f0 0x7f0b9c1611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:05.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.388+0000 7f0b9b7fe640 1 -- 172.21.15.59:0/1464996720 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1076725040 0 0) 0x7f0b84003520 con 0x7f0b9c15cac0 2023-10-16T14:27:05.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.388+0000 7f0b9b7fe640 1 -- 172.21.15.59:0/1464996720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b9c0ce4f0 msgr2=0x7f0b9c1611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:05.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.388+0000 7f0b9b7fe640 1 --2- 172.21.15.59:0/1464996720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b9c0ce4f0 0x7f0b9c1611c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.388+0000 7f0b9b7fe640 1 -- 172.21.15.59:0/1464996720 >> v1:172.21.15.151:6789/0 conn(0x7f0b9c0d1530 legacy=0x7f0b9c06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:05.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.388+0000 7f0b9b7fe640 1 -- 172.21.15.59:0/1464996720 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c0cdfd0 con 0x7f0b9c15cac0 2023-10-16T14:27:05.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.388+0000 7f0b9b7fe640 1 -- 172.21.15.59:0/1464996720 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f0b8c001a10 con 0x7f0b9c15cac0 2023-10-16T14:27:05.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.388+0000 7f0b9b7fe640 1 -- 172.21.15.59:0/1464996720 >> v1:172.21.15.59:6789/0 conn(0x7f0b9c15cac0 legacy=0x7f0b9c0d0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:05.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.388+0000 7f0b9b7fe640 1 --2- 172.21.15.59:0/1464996720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b840039a0 0x7f0b84003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:05.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.388+0000 7f0b9b7fe640 1 --2- 172.21.15.59:0/1464996720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b9c0ce4f0 0x7f0b840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:05.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.388+0000 7f0b9b7fe640 1 --2- 172.21.15.59:0/1464996720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b84004d00 0x7f0b84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:05.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.388+0000 7f0b9b7fe640 1 -- 172.21.15.59:0/1464996720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c0cdcf0 con 0x7f0b84004d00 2023-10-16T14:27:05.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.389+0000 7f0b9b7fe640 1 -- 172.21.15.59:0/1464996720 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8400bba0 con 0x7f0b840039a0 2023-10-16T14:27:05.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.389+0000 7f0b9b7fe640 1 -- 172.21.15.59:0/1464996720 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8400bd30 con 0x7f0b9c0ce4f0 2023-10-16T14:27:05.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.389+0000 7f0ba1066640 1 --2- 172.21.15.59:0/1464996720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b84004d00 0x7f0b84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:05.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.389+0000 7f0ba0865640 1 --2- 172.21.15.59:0/1464996720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b840039a0 0x7f0b84003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:05.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.389+0000 7f0b9bfff640 1 --2- 172.21.15.59:0/1464996720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b9c0ce4f0 0x7f0b840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:05.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.389+0000 7f0ba1066640 1 -- 172.21.15.59:0/1464996720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b9c0ce4f0 msgr2=0x7f0b840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:05.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.389+0000 7f0ba1066640 1 --2- 172.21.15.59:0/1464996720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b9c0ce4f0 0x7f0b840047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.389+0000 7f0ba1066640 1 -- 172.21.15.59:0/1464996720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b840039a0 msgr2=0x7f0b84003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:05.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.389+0000 7f0ba1066640 1 --2- 172.21.15.59:0/1464996720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b840039a0 0x7f0b84003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.389+0000 7f0ba1066640 1 -- 172.21.15.59:0/1464996720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b84003520 con 0x7f0b84004d00 2023-10-16T14:27:05.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.389+0000 7f0b9bfff640 1 --2- 172.21.15.59:0/1464996720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b9c0ce4f0 0x7f0b840047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:05.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.389+0000 7f0ba0865640 1 --2- 172.21.15.59:0/1464996720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b840039a0 0x7f0b84003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:27:05.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.390+0000 7f0ba1066640 1 --2- 172.21.15.59:0/1464996720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b84004d00 0x7f0b84005180 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400ba60 tx=0x7f0b840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec237312666726 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:05.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.391+0000 7f0b9b7fe640 1 -- 172.21.15.59:0/1464996720 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b94032630 con 0x7f0b84004d00 2023-10-16T14:27:05.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.391+0000 7f0b9b7fe640 1 -- 172.21.15.59:0/1464996720 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b94032790 con 0x7f0b84004d00 2023-10-16T14:27:05.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.391+0000 7f0b9b7fe640 1 -- 172.21.15.59:0/1464996720 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b94032b20 con 0x7f0b84004d00 2023-10-16T14:27:05.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.391+0000 7f0ba1867640 1 -- 172.21.15.59:0/1464996720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b84004d00 msgr2=0x7f0b84005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:05.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.391+0000 7f0ba1867640 1 --2- 172.21.15.59:0/1464996720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b84004d00 0x7f0b84005180 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400ba60 tx=0x7f0b840057f0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.391+0000 7f0ba1066640 1 -- 172.21.15.59:0/1464996720 reap_dead start 2023-10-16T14:27:05.403 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.391+0000 7f0ba1867640 1 -- 172.21.15.59:0/1464996720 shutdown_connections 2023-10-16T14:27:05.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.391+0000 7f0ba1867640 1 -- 172.21.15.59:0/1464996720 >> 172.21.15.59:0/1464996720 conn(0x7f0b9c089f70 msgr2=0x7f0b9c0d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:05.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.391+0000 7f0ba1867640 1 -- 172.21.15.59:0/1464996720 shutdown_connections 2023-10-16T14:27:05.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.391+0000 7f0ba1867640 1 -- 172.21.15.59:0/1464996720 wait complete. 2023-10-16T14:27:05.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.393+0000 7f0ba1867640 1 Processor -- start 2023-10-16T14:27:05.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.393+0000 7f0ba1867640 1 -- start start 2023-10-16T14:27:05.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.394+0000 7f0ba1867640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b84004d00 0x7f0b9c0b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:05.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.394+0000 7f0ba1867640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b9c0b1c20 0x7f0b9c0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:05.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.394+0000 7f0ba1867640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b9c0cc020 0x7f0b9c0b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:05.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.394+0000 7f0ba1867640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c0b8350 con 0x7f0b9c0cc020 2023-10-16T14:27:05.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.394+0000 7f0ba1867640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c0cc4a0 con 0x7f0b9c0b1c20 2023-10-16T14:27:05.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.394+0000 7f0ba1867640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c06cc80 con 0x7f0b84004d00 2023-10-16T14:27:05.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.395+0000 7f0ba1066640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b9c0cc020 0x7f0b9c0b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:05.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.395+0000 7f0ba1066640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b9c0cc020 0x7f0b9c0b4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55294/0 (socket says 172.21.15.59:55294) 2023-10-16T14:27:05.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.395+0000 7f0ba1066640 1 -- 172.21.15.59:0/2258706924 learned_addr learned my addr 172.21.15.59:0/2258706924 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:05.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.395+0000 7f0ba0865640 1 --2- 172.21.15.59:0/2258706924 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b84004d00 0x7f0b9c0b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:05.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.395+0000 7f0b9bfff640 1 --2- 172.21.15.59:0/2258706924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b9c0b1c20 0x7f0b9c0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:05.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.395+0000 7f0ba1066640 1 -- 172.21.15.59:0/2258706924 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b84004d00 msgr2=0x7f0b9c0b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:05.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.395+0000 7f0ba1066640 1 --2- 172.21.15.59:0/2258706924 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b84004d00 0x7f0b9c0b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.395+0000 7f0ba1066640 1 -- 172.21.15.59:0/2258706924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b9c0b1c20 msgr2=0x7f0b9c0cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:05.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.395+0000 7f0ba1066640 1 --2- 172.21.15.59:0/2258706924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b9c0b1c20 0x7f0b9c0cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.395+0000 7f0ba1066640 1 -- 172.21.15.59:0/2258706924 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c0b59a0 con 0x7f0b9c0cc020 2023-10-16T14:27:05.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.395+0000 7f0ba1066640 1 --2- 172.21.15.59:0/2258706924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b9c0cc020 0x7f0b9c0b4670 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400ba60 tx=0x7f0b94004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:05.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.396+0000 7f0b997fa640 1 -- 172.21.15.59:0/2258706924 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b94004020 con 0x7f0b9c0cc020 2023-10-16T14:27:05.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.396+0000 7f0b997fa640 1 -- 172.21.15.59:0/2258706924 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b94004180 con 0x7f0b9c0cc020 2023-10-16T14:27:05.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.396+0000 7f0b997fa640 1 -- 172.21.15.59:0/2258706924 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b940044f0 con 0x7f0b9c0cc020 2023-10-16T14:27:05.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.396+0000 7f0ba1867640 1 -- 172.21.15.59:0/2258706924 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9c0b22a0 con 0x7f0b9c0cc020 2023-10-16T14:27:05.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.396+0000 7f0ba1867640 1 -- 172.21.15.59:0/2258706924 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9c0b7d90 con 0x7f0b9c0cc020 2023-10-16T14:27:05.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.397+0000 7f0ba1867640 1 -- 172.21.15.59:0/2258706924 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b9c04e9b0 con 0x7f0b9c0cc020 2023-10-16T14:27:05.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.398+0000 7f0b997fa640 1 -- 172.21.15.59:0/2258706924 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0b9403b630 con 0x7f0b9c0cc020 2023-10-16T14:27:05.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.399+0000 7f0b997fa640 1 --2- 172.21.15.59:0/2258706924 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0b8806aea0 0x7f0b8806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:05.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.399+0000 7f0b997fa640 1 -- 172.21.15.59:0/2258706924 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f0b94000e40 con 0x7f0b9c0cc020 2023-10-16T14:27:05.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.400+0000 7f0ba0865640 1 --2- 172.21.15.59:0/2258706924 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0b8806aea0 0x7f0b8806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:05.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.401+0000 7f0ba0865640 1 --2- 172.21.15.59:0/2258706924 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0b8806aea0 0x7f0b8806d360 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0d33b0 tx=0x7f0b8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:05.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.404+0000 7f0b997fa640 1 -- 172.21.15.59:0/2258706924 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b94076680 con 0x7f0b9c0cc020 2023-10-16T14:27:05.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.598+0000 7f0ba1867640 1 -- 172.21.15.59:0/2258706924 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b9c0d0c00 con 0x7f0b9c0cc020 2023-10-16T14:27:05.605 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.602+0000 7f0b997fa640 1 -- 172.21.15.59:0/2258706924 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18445 (secure 0 0 0) 0x7f0b94079ca0 con 0x7f0b9c0cc020 2023-10-16T14:27:05.607 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:05.607 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:26:29.634854+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:27:05.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.605+0000 7f0ba1867640 1 -- 172.21.15.59:0/2258706924 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0b8806aea0 msgr2=0x7f0b8806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:05.610 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.605+0000 7f0ba1867640 1 --2- 172.21.15.59:0/2258706924 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0b8806aea0 0x7f0b8806d360 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0d33b0 tx=0x7f0b8c009040 comp rx=0 tx=0).stop 2023-10-16T14:27:05.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.605+0000 7f0ba1867640 1 -- 172.21.15.59:0/2258706924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b9c0cc020 msgr2=0x7f0b9c0b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:05.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.605+0000 7f0ba1867640 1 --2- 172.21.15.59:0/2258706924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b9c0cc020 0x7f0b9c0b4670 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400ba60 tx=0x7f0b94004730 comp rx=0 tx=0).stop 2023-10-16T14:27:05.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.605+0000 7f0ba1867640 1 -- 172.21.15.59:0/2258706924 shutdown_connections 2023-10-16T14:27:05.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.605+0000 7f0ba1867640 1 --2- 172.21.15.59:0/2258706924 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0b8806aea0 0x7f0b8806d360 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.605+0000 7f0ba1867640 1 --2- 172.21.15.59:0/2258706924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b9c0cc020 0x7f0b9c0b4670 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.605+0000 7f0ba1867640 1 --2- 172.21.15.59:0/2258706924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b9c0b1c20 0x7f0b9c0cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.605+0000 7f0ba1867640 1 --2- 172.21.15.59:0/2258706924 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b84004d00 0x7f0b9c0b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.605+0000 7f0ba1867640 1 -- 172.21.15.59:0/2258706924 >> 172.21.15.59:0/2258706924 conn(0x7f0b9c089f70 msgr2=0x7f0b9c15a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:05.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.605+0000 7f0ba1867640 1 -- 172.21.15.59:0/2258706924 shutdown_connections 2023-10-16T14:27:05.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.605+0000 7f0ba1867640 1 -- 172.21.15.59:0/2258706924 wait complete. 2023-10-16T14:27:05.632 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T14:25:46.371818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T14:25:47.145341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T14:25:50.758038+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T14:27:05.633 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:27:05.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.865+0000 7ffaef54c640 1 Processor -- start 2023-10-16T14:27:05.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.866+0000 7ffaef54c640 1 -- start start 2023-10-16T14:27:05.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.867+0000 7ffaef54c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ffae815a830 0x7ffae80cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:05.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.867+0000 7ffaef54c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffae8070a30 0x7ffae80c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:05.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.867+0000 7ffaef54c640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffae80cf040 con 0x7ffae80ca550 2023-10-16T14:27:05.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.868+0000 7ffaef54c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae80ca9e0 con 0x7ffae815a830 2023-10-16T14:27:05.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.868+0000 7ffaef54c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae80ce430 con 0x7ffae8070a30 2023-10-16T14:27:05.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.868+0000 7ffaecae7640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffae80ca550 0x7ffae8070320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47886/0 (socket says 172.21.15.59:47886) 2023-10-16T14:27:05.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.868+0000 7ffaecae7640 1 -- 172.21.15.59:0/1360173305 learned_addr learned my addr 172.21.15.59:0/1360173305 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:05.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.868+0000 7ffaed2e8640 1 --2- 172.21.15.59:0/1360173305 >> v2:172.21.15.151:3300/0 conn(0x7ffae815a830 0x7ffae80cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:05.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.868+0000 7ffaedae9640 1 --2- 172.21.15.59:0/1360173305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffae8070a30 0x7ffae80c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:05.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.868+0000 7ffae7fff640 1 -- 172.21.15.59:0/1360173305 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228598818 0 0) 0x7ffae80cf040 con 0x7ffae80ca550 2023-10-16T14:27:05.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.868+0000 7ffae7fff640 1 -- 172.21.15.59:0/1360173305 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffad0003520 con 0x7ffae80ca550 2023-10-16T14:27:05.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.869+0000 7ffae7fff640 1 -- 172.21.15.59:0/1360173305 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 728949630 0 0) 0x7ffad0003520 con 0x7ffae80ca550 2023-10-16T14:27:05.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.869+0000 7ffae7fff640 1 -- 172.21.15.59:0/1360173305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffae8070a30 msgr2=0x7ffae80c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:05.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.869+0000 7ffae7fff640 1 --2- 172.21.15.59:0/1360173305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffae8070a30 0x7ffae80c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.869+0000 7ffae7fff640 1 -- 172.21.15.59:0/1360173305 >> v2:172.21.15.151:3300/0 conn(0x7ffae815a830 msgr2=0x7ffae80cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:05.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.869+0000 7ffae7fff640 1 --2- 172.21.15.59:0/1360173305 >> v2:172.21.15.151:3300/0 conn(0x7ffae815a830 0x7ffae80cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.869+0000 7ffae7fff640 1 -- 172.21.15.59:0/1360173305 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae80ce710 con 0x7ffae80ca550 2023-10-16T14:27:05.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.869+0000 7ffae7fff640 1 -- 172.21.15.59:0/1360173305 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7ffadc001670 con 0x7ffae80ca550 2023-10-16T14:27:05.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.869+0000 7ffae7fff640 1 -- 172.21.15.59:0/1360173305 >> v1:172.21.15.59:6789/0 conn(0x7ffae80ca550 legacy=0x7ffae8070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:05.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.869+0000 7ffae7fff640 1 --2- 172.21.15.59:0/1360173305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffad0003970 0x7ffad0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:05.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.869+0000 7ffae7fff640 1 --2- 172.21.15.59:0/1360173305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffad00047c0 0x7ffad0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:05.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.869+0000 7ffae7fff640 1 --2- 172.21.15.59:0/1360173305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffae8070a30 0x7ffad0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:05.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.869+0000 7ffae7fff640 1 -- 172.21.15.59:0/1360173305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae80ca9e0 con 0x7ffad00047c0 2023-10-16T14:27:05.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.869+0000 7ffae7fff640 1 -- 172.21.15.59:0/1360173305 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae80ce430 con 0x7ffad0003970 2023-10-16T14:27:05.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.869+0000 7ffae7fff640 1 -- 172.21.15.59:0/1360173305 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad000ba30 con 0x7ffae8070a30 2023-10-16T14:27:05.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.869+0000 7ffaecae7640 1 --2- 172.21.15.59:0/1360173305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffad00047c0 0x7ffad0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:05.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.870+0000 7ffaedae9640 1 --2- 172.21.15.59:0/1360173305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffae8070a30 0x7ffad0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:05.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.870+0000 7ffaecae7640 1 -- 172.21.15.59:0/1360173305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffae8070a30 msgr2=0x7ffad0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:05.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.870+0000 7ffaed2e8640 1 --2- 172.21.15.59:0/1360173305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffad0003970 0x7ffad0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:05.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.870+0000 7ffaecae7640 1 --2- 172.21.15.59:0/1360173305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffae8070a30 0x7ffad0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.870+0000 7ffaecae7640 1 -- 172.21.15.59:0/1360173305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffad0003970 msgr2=0x7ffad0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:05.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.870+0000 7ffaecae7640 1 --2- 172.21.15.59:0/1360173305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffad0003970 0x7ffad0003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.870+0000 7ffaecae7640 1 -- 172.21.15.59:0/1360173305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad0003520 con 0x7ffad00047c0 2023-10-16T14:27:05.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.871+0000 7ffaecae7640 1 --2- 172.21.15.59:0/1360173305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffad00047c0 0x7ffad0004c40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00c110 tx=0x7ffad00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8ba4a2019dcfe4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:05.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.871+0000 7ffae7fff640 1 -- 172.21.15.59:0/1360173305 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc005ad0 con 0x7ffad00047c0 2023-10-16T14:27:05.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.871+0000 7ffae7fff640 1 -- 172.21.15.59:0/1360173305 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffadc005c50 con 0x7ffad00047c0 2023-10-16T14:27:05.885 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.871+0000 7ffae7fff640 1 -- 172.21.15.59:0/1360173305 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc007070 con 0x7ffad00047c0 2023-10-16T14:27:05.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.872+0000 7ffaef54c640 1 -- 172.21.15.59:0/1360173305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffad00047c0 msgr2=0x7ffad0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:05.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.872+0000 7ffaef54c640 1 --2- 172.21.15.59:0/1360173305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffad00047c0 0x7ffad0004c40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffadc00c110 tx=0x7ffad00057f0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.872+0000 7ffaedae9640 1 -- 172.21.15.59:0/1360173305 reap_dead start 2023-10-16T14:27:05.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.872+0000 7ffaef54c640 1 -- 172.21.15.59:0/1360173305 shutdown_connections 2023-10-16T14:27:05.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.872+0000 7ffaef54c640 1 -- 172.21.15.59:0/1360173305 >> 172.21.15.59:0/1360173305 conn(0x7ffae80b0030 msgr2=0x7ffae80b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:05.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.872+0000 7ffaef54c640 1 -- 172.21.15.59:0/1360173305 shutdown_connections 2023-10-16T14:27:05.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.872+0000 7ffaef54c640 1 -- 172.21.15.59:0/1360173305 wait complete. 2023-10-16T14:27:05.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.874+0000 7ffaef54c640 1 Processor -- start 2023-10-16T14:27:05.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.874+0000 7ffaef54c640 1 -- start start 2023-10-16T14:27:05.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.875+0000 7ffaef54c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffad00047c0 0x7ffae80c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:05.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.875+0000 7ffaef54c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffae81f1af0 0x7ffae80a7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:05.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.875+0000 7ffaef54c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffae80a7990 0x7ffae814ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:05.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.875+0000 7ffaef54c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae80a7e10 con 0x7ffad00047c0 2023-10-16T14:27:05.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.875+0000 7ffaef54c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae80c8780 con 0x7ffae81f1af0 2023-10-16T14:27:05.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.875+0000 7ffaef54c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae80c7b70 con 0x7ffae80a7990 2023-10-16T14:27:05.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.875+0000 7ffaed2e8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffad00047c0 0x7ffae80c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:05.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.875+0000 7ffaed2e8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffad00047c0 0x7ffae80c55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55310/0 (socket says 172.21.15.59:55310) 2023-10-16T14:27:05.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.875+0000 7ffaed2e8640 1 -- 172.21.15.59:0/1738506078 learned_addr learned my addr 172.21.15.59:0/1738506078 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:05.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.875+0000 7ffaed2e8640 1 -- 172.21.15.59:0/1738506078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffae80a7990 msgr2=0x7ffae814ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:05.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.875+0000 7ffaed2e8640 1 --2- 172.21.15.59:0/1738506078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffae80a7990 0x7ffae814ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.875+0000 7ffaed2e8640 1 -- 172.21.15.59:0/1738506078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffae81f1af0 msgr2=0x7ffae80a7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:05.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.875+0000 7ffaed2e8640 1 --2- 172.21.15.59:0/1738506078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffae81f1af0 0x7ffae80a7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:05.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.875+0000 7ffaed2e8640 1 -- 172.21.15.59:0/1738506078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae80c7e50 con 0x7ffad00047c0 2023-10-16T14:27:05.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.876+0000 7ffaed2e8640 1 --2- 172.21.15.59:0/1738506078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffad00047c0 0x7ffae80c55d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ffad800f450 tx=0x7ffad800f910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:05.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.876+0000 7ffae5ffb640 1 -- 172.21.15.59:0/1738506078 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad8009ea0 con 0x7ffad00047c0 2023-10-16T14:27:05.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.876+0000 7ffae5ffb640 1 -- 172.21.15.59:0/1738506078 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad8014800 con 0x7ffad00047c0 2023-10-16T14:27:05.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.876+0000 7ffae5ffb640 1 -- 172.21.15.59:0/1738506078 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad8014bb0 con 0x7ffad00047c0 2023-10-16T14:27:05.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.876+0000 7ffaef54c640 1 -- 172.21.15.59:0/1738506078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae80c8130 con 0x7ffad00047c0 2023-10-16T14:27:05.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.876+0000 7ffaef54c640 1 -- 172.21.15.59:0/1738506078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae81f1f70 con 0x7ffad00047c0 2023-10-16T14:27:05.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.877+0000 7ffaef54c640 1 -- 172.21.15.59:0/1738506078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae81f2100 con 0x7ffad00047c0 2023-10-16T14:27:05.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.878+0000 7ffae5ffb640 1 -- 172.21.15.59:0/1738506078 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffad8014d10 con 0x7ffad00047c0 2023-10-16T14:27:05.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.879+0000 7ffae5ffb640 1 --2- 172.21.15.59:0/1738506078 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ffad406ae70 0x7ffad406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:05.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.880+0000 7ffae5ffb640 1 -- 172.21.15.59:0/1738506078 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ffad808aa10 con 0x7ffad00047c0 2023-10-16T14:27:05.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.880+0000 7ffaecae7640 1 --2- 172.21.15.59:0/1738506078 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ffad406ae70 0x7ffad406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:05.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.881+0000 7ffaecae7640 1 --2- 172.21.15.59:0/1738506078 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ffad406ae70 0x7ffad406d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ffadc034000 tx=0x7ffadc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:05.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:05.884+0000 7ffae5ffb640 1 -- 172.21.15.59:0/1738506078 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffae81f2100 con 0x7ffad00047c0 2023-10-16T14:27:06.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.078+0000 7ffaef54c640 1 -- 172.21.15.59:0/1738506078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffae81f2100 con 0x7ffad00047c0 2023-10-16T14:27:06.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.079+0000 7ffae5ffb640 1 -- 172.21.15.59:0/1738506078 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffae81f2100 con 0x7ffad00047c0 2023-10-16T14:27:06.083 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:27:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.081+0000 7ffaef54c640 1 -- 172.21.15.59:0/1738506078 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ffad406ae70 msgr2=0x7ffad406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.081+0000 7ffaef54c640 1 --2- 172.21.15.59:0/1738506078 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ffad406ae70 0x7ffad406d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ffadc034000 tx=0x7ffadc02e000 comp rx=0 tx=0).stop 2023-10-16T14:27:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.082+0000 7ffaef54c640 1 -- 172.21.15.59:0/1738506078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffad00047c0 msgr2=0x7ffae80c55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.082+0000 7ffaef54c640 1 --2- 172.21.15.59:0/1738506078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffad00047c0 0x7ffae80c55d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ffad800f450 tx=0x7ffad800f910 comp rx=0 tx=0).stop 2023-10-16T14:27:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.082+0000 7ffaef54c640 1 -- 172.21.15.59:0/1738506078 shutdown_connections 2023-10-16T14:27:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.082+0000 7ffaef54c640 1 --2- 172.21.15.59:0/1738506078 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ffad406ae70 0x7ffad406d330 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.082+0000 7ffaef54c640 1 --2- 172.21.15.59:0/1738506078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffae80a7990 0x7ffae814ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.082+0000 7ffaef54c640 1 --2- 172.21.15.59:0/1738506078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffae81f1af0 0x7ffae80a7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.082+0000 7ffaef54c640 1 --2- 172.21.15.59:0/1738506078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffad00047c0 0x7ffae80c55d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.082+0000 7ffaef54c640 1 -- 172.21.15.59:0/1738506078 >> 172.21.15.59:0/1738506078 conn(0x7ffae80b0030 msgr2=0x7ffae80b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:06.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.082+0000 7ffaef54c640 1 -- 172.21.15.59:0/1738506078 shutdown_connections 2023-10-16T14:27:06.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.082+0000 7ffaef54c640 1 -- 172.21.15.59:0/1738506078 wait complete. 2023-10-16T14:27:06.106 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T14:27:06.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.333+0000 7ff5e98d7640 1 Processor -- start 2023-10-16T14:27:06.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.333+0000 7ff5e98d7640 1 -- start start 2023-10-16T14:27:06.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.335+0000 7ff5e98d7640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff5e40cf030 0x7ff5e406ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:06.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.335+0000 7ff5e98d7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff5e406d360 0x7ff5e40ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:06.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.335+0000 7ff5e98d7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e41550f0 con 0x7ff5e4154d10 2023-10-16T14:27:06.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.335+0000 7ff5e98d7640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e406db50 con 0x7ff5e40cf030 2023-10-16T14:27:06.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.335+0000 7ff5e98d7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e40b13f0 con 0x7ff5e406d360 2023-10-16T14:27:06.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.335+0000 7ff5e3fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff5e40cf030 0x7ff5e406ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:06.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.335+0000 7ff5e3fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff5e40cf030 0x7ff5e406ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55326/0 (socket says 172.21.15.59:55326) 2023-10-16T14:27:06.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.335+0000 7ff5e3fff640 1 -- 172.21.15.59:0/3405280466 learned_addr learned my addr 172.21.15.59:0/3405280466 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:06.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.336+0000 7ff5e3fff640 1 -- 172.21.15.59:0/3405280466 >> v2:172.21.15.151:3300/0 conn(0x7ff5e406d360 msgr2=0x7ff5e40ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:06.341 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.336+0000 7ff5e90d6640 1 --2- 172.21.15.59:0/3405280466 >> v2:172.21.15.151:3300/0 conn(0x7ff5e406d360 0x7ff5e40ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:06.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.336+0000 7ff5e3fff640 1 --2- 172.21.15.59:0/3405280466 >> v2:172.21.15.151:3300/0 conn(0x7ff5e406d360 0x7ff5e40ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.336+0000 7ff5e3fff640 1 -- 172.21.15.59:0/3405280466 >> v1:172.21.15.151:6789/0 conn(0x7ff5e4154d10 legacy=0x7ff5e40ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:06.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.336+0000 7ff5e3fff640 1 -- 172.21.15.59:0/3405280466 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e40b16d0 con 0x7ff5e40cf030 2023-10-16T14:27:06.342 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.336+0000 7ff5e90d6640 1 --2- 172.21.15.59:0/3405280466 >> v2:172.21.15.151:3300/0 conn(0x7ff5e406d360 0x7ff5e40ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:06.343 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.337+0000 7ff5e3fff640 1 --2- 172.21.15.59:0/3405280466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e40cf030 0x7ff5e406ce20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff5e406c090 tx=0x7ff5d002b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486d3e4a56753047 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:06.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.338+0000 7ff5e37fe640 1 -- 172.21.15.59:0/3405280466 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0030870 con 0x7ff5e40cf030 2023-10-16T14:27:06.344 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.338+0000 7ff5e37fe640 1 -- 172.21.15.59:0/3405280466 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d00309d0 con 0x7ff5e40cf030 2023-10-16T14:27:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.338+0000 7ff5e37fe640 1 -- 172.21.15.59:0/3405280466 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0030d60 con 0x7ff5e40cf030 2023-10-16T14:27:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.338+0000 7ff5e98d7640 1 -- 172.21.15.59:0/3405280466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e40cf030 msgr2=0x7ff5e406ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.338+0000 7ff5e98d7640 1 --2- 172.21.15.59:0/3405280466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e40cf030 0x7ff5e406ce20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff5e406c090 tx=0x7ff5d002b9b0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.338+0000 7ff5e98d7640 1 -- 172.21.15.59:0/3405280466 shutdown_connections 2023-10-16T14:27:06.345 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.338+0000 7ff5e98d7640 1 --2- 172.21.15.59:0/3405280466 >> v2:172.21.15.151:3300/0 conn(0x7ff5e406d360 0x7ff5e40ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.338+0000 7ff5e98d7640 1 --2- 172.21.15.59:0/3405280466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e40cf030 0x7ff5e406ce20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.339+0000 7ff5e98d7640 1 -- 172.21.15.59:0/3405280466 >> 172.21.15.59:0/3405280466 conn(0x7ff5e406a200 msgr2=0x7ff5e406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:06.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.339+0000 7ff5e98d7640 1 -- 172.21.15.59:0/3405280466 shutdown_connections 2023-10-16T14:27:06.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.339+0000 7ff5e98d7640 1 -- 172.21.15.59:0/3405280466 wait complete. 2023-10-16T14:27:06.346 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.341+0000 7ff5e98d7640 1 Processor -- start 2023-10-16T14:27:06.347 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.341+0000 7ff5e98d7640 1 -- start start 2023-10-16T14:27:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.342+0000 7ff5e98d7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e406d360 0x7ff5e40c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.342+0000 7ff5e98d7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5e4154d10 0x7ff5e4071b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.342+0000 7ff5e98d7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e4152fd0 0x7ff5e40cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:06.349 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.342+0000 7ff5e98d7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e41f6440 con 0x7ff5e406d360 2023-10-16T14:27:06.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.342+0000 7ff5e98d7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e4152e40 con 0x7ff5e4154d10 2023-10-16T14:27:06.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.342+0000 7ff5e98d7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e41f5830 con 0x7ff5e4152fd0 2023-10-16T14:27:06.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.342+0000 7ff5e88d5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e406d360 0x7ff5e40c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:06.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.342+0000 7ff5e88d5640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e406d360 0x7ff5e40c41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55340/0 (socket says 172.21.15.59:55340) 2023-10-16T14:27:06.350 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.342+0000 7ff5e88d5640 1 -- 172.21.15.59:0/3503706148 learned_addr learned my addr 172.21.15.59:0/3503706148 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.343+0000 7ff5e3fff640 1 --2- 172.21.15.59:0/3503706148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5e4154d10 0x7ff5e4071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.343+0000 7ff5e90d6640 1 --2- 172.21.15.59:0/3503706148 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e4152fd0 0x7ff5e40cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.343+0000 7ff5e88d5640 1 -- 172.21.15.59:0/3503706148 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e4152fd0 msgr2=0x7ff5e40cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:06.351 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.343+0000 7ff5e88d5640 1 --2- 172.21.15.59:0/3503706148 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e4152fd0 0x7ff5e40cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.343+0000 7ff5e88d5640 1 -- 172.21.15.59:0/3503706148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5e4154d10 msgr2=0x7ff5e4071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:06.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.343+0000 7ff5e88d5640 1 --2- 172.21.15.59:0/3503706148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5e4154d10 0x7ff5e4071b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.343+0000 7ff5e88d5640 1 -- 172.21.15.59:0/3503706148 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d00094d0 con 0x7ff5e406d360 2023-10-16T14:27:06.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.343+0000 7ff5e90d6640 1 --2- 172.21.15.59:0/3503706148 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e4152fd0 0x7ff5e40cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:06.352 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.343+0000 7ff5e3fff640 1 --2- 172.21.15.59:0/3503706148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5e4154d10 0x7ff5e4071b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:06.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.343+0000 7ff5e88d5640 1 --2- 172.21.15.59:0/3503706148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e406d360 0x7ff5e40c41a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800c450 tx=0x7ff5d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:06.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.344+0000 7ff5e17fa640 1 -- 172.21.15.59:0/3503706148 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80052d0 con 0x7ff5e406d360 2023-10-16T14:27:06.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.344+0000 7ff5e17fa640 1 -- 172.21.15.59:0/3503706148 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d8005430 con 0x7ff5e406d360 2023-10-16T14:27:06.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.344+0000 7ff5e17fa640 1 -- 172.21.15.59:0/3503706148 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8012870 con 0x7ff5e406d360 2023-10-16T14:27:06.353 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.344+0000 7ff5e98d7640 1 -- 172.21.15.59:0/3503706148 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e41f5b10 con 0x7ff5e406d360 2023-10-16T14:27:06.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.344+0000 7ff5e98d7640 1 -- 172.21.15.59:0/3503706148 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e41f60d0 con 0x7ff5e406d360 2023-10-16T14:27:06.354 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.345+0000 7ff5e98d7640 1 -- 172.21.15.59:0/3503706148 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e41f6260 con 0x7ff5e406d360 2023-10-16T14:27:06.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.346+0000 7ff5e17fa640 1 -- 172.21.15.59:0/3503706148 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff5d80129d0 con 0x7ff5e406d360 2023-10-16T14:27:06.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.347+0000 7ff5e17fa640 1 --2- 172.21.15.59:0/3503706148 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff5c806ae70 0x7ff5c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:06.355 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.347+0000 7ff5e17fa640 1 -- 172.21.15.59:0/3503706148 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff5d8089490 con 0x7ff5e406d360 2023-10-16T14:27:06.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.348+0000 7ff5e3fff640 1 --2- 172.21.15.59:0/3503706148 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff5c806ae70 0x7ff5c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:06.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.349+0000 7ff5e3fff640 1 --2- 172.21.15.59:0/3503706148 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff5c806ae70 0x7ff5c806d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0036000 tx=0x7ff5d003b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:06.356 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.351+0000 7ff5e17fa640 1 -- 172.21.15.59:0/3503706148 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff5d8054200 con 0x7ff5e406d360 2023-10-16T14:27:06.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.546+0000 7ff5e98d7640 1 -- 172.21.15.59:0/3503706148 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff5e404e9b0 con 0x7ff5e406d360 2023-10-16T14:27:06.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.547+0000 7ff5e17fa640 1 -- 172.21.15.59:0/3503706148 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff5d8057820 con 0x7ff5e406d360 2023-10-16T14:27:06.550 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:27:06.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.549+0000 7ff5e98d7640 1 -- 172.21.15.59:0/3503706148 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff5c806ae70 msgr2=0x7ff5c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:06.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.549+0000 7ff5e98d7640 1 --2- 172.21.15.59:0/3503706148 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff5c806ae70 0x7ff5c806d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0036000 tx=0x7ff5d003b040 comp rx=0 tx=0).stop 2023-10-16T14:27:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.549+0000 7ff5e98d7640 1 -- 172.21.15.59:0/3503706148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e406d360 msgr2=0x7ff5e40c41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.549+0000 7ff5e98d7640 1 --2- 172.21.15.59:0/3503706148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e406d360 0x7ff5e40c41a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800c450 tx=0x7ff5d800c910 comp rx=0 tx=0).stop 2023-10-16T14:27:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.550+0000 7ff5e98d7640 1 -- 172.21.15.59:0/3503706148 shutdown_connections 2023-10-16T14:27:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.550+0000 7ff5e98d7640 1 --2- 172.21.15.59:0/3503706148 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff5c806ae70 0x7ff5c806d330 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.550+0000 7ff5e98d7640 1 --2- 172.21.15.59:0/3503706148 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e4152fd0 0x7ff5e40cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.550+0000 7ff5e98d7640 1 --2- 172.21.15.59:0/3503706148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5e4154d10 0x7ff5e4071b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.550+0000 7ff5e98d7640 1 --2- 172.21.15.59:0/3503706148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5e406d360 0x7ff5e40c41a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.550+0000 7ff5e98d7640 1 -- 172.21.15.59:0/3503706148 >> 172.21.15.59:0/3503706148 conn(0x7ff5e406a200 msgr2=0x7ff5e40cb430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:06.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.550+0000 7ff5e98d7640 1 -- 172.21.15.59:0/3503706148 shutdown_connections 2023-10-16T14:27:06.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.550+0000 7ff5e98d7640 1 -- 172.21.15.59:0/3503706148 wait complete. 2023-10-16T14:27:06.573 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T14:27:06.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.786+0000 7ff01b2aa640 1 Processor -- start 2023-10-16T14:27:06.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.786+0000 7ff01b2aa640 1 -- start start 2023-10-16T14:27:06.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.788+0000 7ff01b2aa640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0140cf030 0x7ff01406ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:06.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.788+0000 7ff01b2aa640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff01406d360 0x7ff0140ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:06.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.788+0000 7ff01b2aa640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0141550f0 con 0x7ff014154d10 2023-10-16T14:27:06.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.788+0000 7ff01b2aa640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01406db50 con 0x7ff01406d360 2023-10-16T14:27:06.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.788+0000 7ff01b2aa640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0140b13f0 con 0x7ff0140cf030 2023-10-16T14:27:06.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.788+0000 7ff01a2a8640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff014154d10 0x7ff0140ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47894/0 (socket says 172.21.15.59:47894) 2023-10-16T14:27:06.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.788+0000 7ff01a2a8640 1 -- 172.21.15.59:0/2233483444 learned_addr learned my addr 172.21.15.59:0/2233483444 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:06.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.789+0000 7ff0192a6640 1 -- 172.21.15.59:0/2233483444 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129869548 0 0) 0x7ff0141550f0 con 0x7ff014154d10 2023-10-16T14:27:06.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.789+0000 7ff0192a6640 1 -- 172.21.15.59:0/2233483444 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff000003520 con 0x7ff014154d10 2023-10-16T14:27:06.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.789+0000 7ff01aaa9640 1 --2- 172.21.15.59:0/2233483444 >> v2:172.21.15.151:3300/0 conn(0x7ff01406d360 0x7ff0140ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:06.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.789+0000 7ff019aa7640 1 --2- 172.21.15.59:0/2233483444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0140cf030 0x7ff01406ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:06.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.789+0000 7ff0192a6640 1 -- 172.21.15.59:0/2233483444 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3123802400 0 0) 0x7ff000003520 con 0x7ff014154d10 2023-10-16T14:27:06.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.789+0000 7ff0192a6640 1 -- 172.21.15.59:0/2233483444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0140cf030 msgr2=0x7ff01406ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:06.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.789+0000 7ff0192a6640 1 --2- 172.21.15.59:0/2233483444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0140cf030 0x7ff01406ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.789+0000 7ff0192a6640 1 -- 172.21.15.59:0/2233483444 >> v2:172.21.15.151:3300/0 conn(0x7ff01406d360 msgr2=0x7ff0140ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:06.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.789+0000 7ff0192a6640 1 --2- 172.21.15.59:0/2233483444 >> v2:172.21.15.151:3300/0 conn(0x7ff01406d360 0x7ff0140ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.789+0000 7ff0192a6640 1 -- 172.21.15.59:0/2233483444 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0140b16d0 con 0x7ff014154d10 2023-10-16T14:27:06.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.789+0000 7ff0192a6640 1 -- 172.21.15.59:0/2233483444 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7ff010001670 con 0x7ff014154d10 2023-10-16T14:27:06.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.789+0000 7ff0192a6640 1 -- 172.21.15.59:0/2233483444 >> v1:172.21.15.59:6789/0 conn(0x7ff014154d10 legacy=0x7ff0140ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:06.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.789+0000 7ff0192a6640 1 --2- 172.21.15.59:0/2233483444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0000039e0 0x7ff000003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:06.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.789+0000 7ff0192a6640 1 --2- 172.21.15.59:0/2233483444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0140cf030 0x7ff0000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:06.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.789+0000 7ff0192a6640 1 --2- 172.21.15.59:0/2233483444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff000004d00 0x7ff000005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:06.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.789+0000 7ff0192a6640 1 -- 172.21.15.59:0/2233483444 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01406db50 con 0x7ff000004d00 2023-10-16T14:27:06.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.789+0000 7ff0192a6640 1 -- 172.21.15.59:0/2233483444 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0140b13f0 con 0x7ff0000039e0 2023-10-16T14:27:06.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.789+0000 7ff0192a6640 1 -- 172.21.15.59:0/2233483444 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00000bb60 con 0x7ff0140cf030 2023-10-16T14:27:06.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.790+0000 7ff01aaa9640 1 --2- 172.21.15.59:0/2233483444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff000004d00 0x7ff000005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:06.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.790+0000 7ff01a2a8640 1 --2- 172.21.15.59:0/2233483444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0000039e0 0x7ff000003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:06.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.790+0000 7ff019aa7640 1 --2- 172.21.15.59:0/2233483444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0140cf030 0x7ff0000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:06.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.790+0000 7ff01aaa9640 1 -- 172.21.15.59:0/2233483444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0140cf030 msgr2=0x7ff0000047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:06.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.790+0000 7ff01aaa9640 1 --2- 172.21.15.59:0/2233483444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0140cf030 0x7ff0000047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.790+0000 7ff01aaa9640 1 -- 172.21.15.59:0/2233483444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0000039e0 msgr2=0x7ff000003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:06.799 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.790+0000 7ff01aaa9640 1 --2- 172.21.15.59:0/2233483444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0000039e0 0x7ff000003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.790+0000 7ff01aaa9640 1 -- 172.21.15.59:0/2233483444 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff000003520 con 0x7ff000004d00 2023-10-16T14:27:06.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.790+0000 7ff019aa7640 1 --2- 172.21.15.59:0/2233483444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0140cf030 0x7ff0000047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:06.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.790+0000 7ff01a2a8640 1 --2- 172.21.15.59:0/2233483444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0000039e0 0x7ff000003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:06.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.791+0000 7ff01aaa9640 1 --2- 172.21.15.59:0/2233483444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff000004d00 0x7ff000005180 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff00c007360 tx=0x7ff0000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e05ec88f5c557f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:06.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.791+0000 7ff0192a6640 1 -- 172.21.15.59:0/2233483444 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c02ccf0 con 0x7ff000004d00 2023-10-16T14:27:06.800 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.792+0000 7ff0192a6640 1 -- 172.21.15.59:0/2233483444 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00c02ce50 con 0x7ff000004d00 2023-10-16T14:27:06.801 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.792+0000 7ff0192a6640 1 -- 172.21.15.59:0/2233483444 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c034660 con 0x7ff000004d00 2023-10-16T14:27:06.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.792+0000 7ff01b2aa640 1 -- 172.21.15.59:0/2233483444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff000004d00 msgr2=0x7ff000005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:06.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.792+0000 7ff01b2aa640 1 --2- 172.21.15.59:0/2233483444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff000004d00 0x7ff000005180 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff00c007360 tx=0x7ff0000057f0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.792+0000 7ff01aaa9640 1 -- 172.21.15.59:0/2233483444 reap_dead start 2023-10-16T14:27:06.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.792+0000 7ff01b2aa640 1 -- 172.21.15.59:0/2233483444 shutdown_connections 2023-10-16T14:27:06.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.792+0000 7ff01b2aa640 1 -- 172.21.15.59:0/2233483444 >> 172.21.15.59:0/2233483444 conn(0x7ff01406a200 msgr2=0x7ff01406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:06.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.792+0000 7ff01b2aa640 1 -- 172.21.15.59:0/2233483444 shutdown_connections 2023-10-16T14:27:06.804 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.792+0000 7ff01b2aa640 1 -- 172.21.15.59:0/2233483444 wait complete. 2023-10-16T14:27:06.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.794+0000 7ff01b2aa640 1 Processor -- start 2023-10-16T14:27:06.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.794+0000 7ff01b2aa640 1 -- start start 2023-10-16T14:27:06.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.795+0000 7ff01b2aa640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0141f1a20 0x7ff014159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:06.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.795+0000 7ff01b2aa640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0141f2e40 0x7ff01415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:06.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.795+0000 7ff01b2aa640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff01415d280 0x7ff01415d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:06.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.795+0000 7ff01b2aa640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01415dc40 con 0x7ff0141f2e40 2023-10-16T14:27:06.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.795+0000 7ff01b2aa640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01415c520 con 0x7ff0141f1a20 2023-10-16T14:27:06.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.795+0000 7ff01b2aa640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01415a110 con 0x7ff01415d280 2023-10-16T14:27:06.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.796+0000 7ff019aa7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0141f2e40 0x7ff01415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:06.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.796+0000 7ff019aa7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0141f2e40 0x7ff01415c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55356/0 (socket says 172.21.15.59:55356) 2023-10-16T14:27:06.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.796+0000 7ff019aa7640 1 -- 172.21.15.59:0/3880408547 learned_addr learned my addr 172.21.15.59:0/3880408547 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:06.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.796+0000 7ff01a2a8640 1 --2- 172.21.15.59:0/3880408547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0141f1a20 0x7ff014159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:06.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.796+0000 7ff01aaa9640 1 --2- 172.21.15.59:0/3880408547 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff01415d280 0x7ff01415d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:06.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.796+0000 7ff019aa7640 1 -- 172.21.15.59:0/3880408547 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff01415d280 msgr2=0x7ff01415d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:06.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.796+0000 7ff019aa7640 1 --2- 172.21.15.59:0/3880408547 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff01415d280 0x7ff01415d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.807 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.796+0000 7ff019aa7640 1 -- 172.21.15.59:0/3880408547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0141f1a20 msgr2=0x7ff014159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:06.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.796+0000 7ff019aa7640 1 --2- 172.21.15.59:0/3880408547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0141f1a20 0x7ff014159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:06.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.796+0000 7ff019aa7640 1 -- 172.21.15.59:0/3880408547 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01415bed0 con 0x7ff0141f2e40 2023-10-16T14:27:06.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.796+0000 7ff01a2a8640 1 --2- 172.21.15.59:0/3880408547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0141f1a20 0x7ff014159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:27:06.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.797+0000 7ff019aa7640 1 --2- 172.21.15.59:0/3880408547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0141f2e40 0x7ff01415c9b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff00400e7e0 tx=0x7ff00400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:06.808 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.797+0000 7ff00affd640 1 -- 172.21.15.59:0/3880408547 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00400c670 con 0x7ff0141f2e40 2023-10-16T14:27:06.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.797+0000 7ff00affd640 1 -- 172.21.15.59:0/3880408547 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00400c7d0 con 0x7ff0141f2e40 2023-10-16T14:27:06.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.797+0000 7ff00affd640 1 -- 172.21.15.59:0/3880408547 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00400cb40 con 0x7ff0141f2e40 2023-10-16T14:27:06.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.797+0000 7ff01b2aa640 1 -- 172.21.15.59:0/3880408547 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01415c1b0 con 0x7ff0141f2e40 2023-10-16T14:27:06.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.797+0000 7ff01b2aa640 1 -- 172.21.15.59:0/3880408547 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01415cef0 con 0x7ff0141f2e40 2023-10-16T14:27:06.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.798+0000 7ff01b2aa640 1 -- 172.21.15.59:0/3880408547 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01415bd30 con 0x7ff0141f2e40 2023-10-16T14:27:06.809 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.799+0000 7ff00affd640 1 -- 172.21.15.59:0/3880408547 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff00400cca0 con 0x7ff0141f2e40 2023-10-16T14:27:06.810 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.801+0000 7ff00affd640 1 --2- 172.21.15.59:0/3880408547 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7feff806ae70 0x7feff806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:06.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.801+0000 7ff00affd640 1 -- 172.21.15.59:0/3880408547 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff0040896a0 con 0x7ff0141f2e40 2023-10-16T14:27:06.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.801+0000 7ff01a2a8640 1 --2- 172.21.15.59:0/3880408547 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7feff806ae70 0x7feff806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:06.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.803+0000 7ff01a2a8640 1 --2- 172.21.15.59:0/3880408547 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7feff806ae70 0x7feff806d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff010001eb0 tx=0x7ff010009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:06.811 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.805+0000 7ff00affd640 1 -- 172.21.15.59:0/3880408547 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff01415bd30 con 0x7ff0141f2e40 2023-10-16T14:27:06.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.995+0000 7ff01b2aa640 1 -- 172.21.15.59:0/3880408547 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff01415bd30 con 0x7ff0141f2e40 2023-10-16T14:27:07.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.996+0000 7ff00affd640 1 -- 172.21.15.59:0/3880408547 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff01415bd30 con 0x7ff0141f2e40 2023-10-16T14:27:07.001 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-16T14:27:07.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.999+0000 7ff01b2aa640 1 -- 172.21.15.59:0/3880408547 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7feff806ae70 msgr2=0x7feff806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:07.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.999+0000 7ff01b2aa640 1 --2- 172.21.15.59:0/3880408547 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7feff806ae70 0x7feff806d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff010001eb0 tx=0x7ff010009040 comp rx=0 tx=0).stop 2023-10-16T14:27:07.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.999+0000 7ff01b2aa640 1 -- 172.21.15.59:0/3880408547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0141f2e40 msgr2=0x7ff01415c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:07.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.999+0000 7ff01b2aa640 1 --2- 172.21.15.59:0/3880408547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0141f2e40 0x7ff01415c9b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff00400e7e0 tx=0x7ff00400eca0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.999+0000 7ff01b2aa640 1 -- 172.21.15.59:0/3880408547 shutdown_connections 2023-10-16T14:27:07.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.999+0000 7ff01b2aa640 1 --2- 172.21.15.59:0/3880408547 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7feff806ae70 0x7feff806d330 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.999+0000 7ff01b2aa640 1 --2- 172.21.15.59:0/3880408547 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff01415d280 0x7ff01415d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.999+0000 7ff01b2aa640 1 --2- 172.21.15.59:0/3880408547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0141f2e40 0x7ff01415c9b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.999+0000 7ff01b2aa640 1 --2- 172.21.15.59:0/3880408547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0141f1a20 0x7ff014159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.999+0000 7ff01b2aa640 1 -- 172.21.15.59:0/3880408547 >> 172.21.15.59:0/3880408547 conn(0x7ff01406a200 msgr2=0x7ff0140ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:07.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.999+0000 7ff01b2aa640 1 -- 172.21.15.59:0/3880408547 shutdown_connections 2023-10-16T14:27:07.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:06.999+0000 7ff01b2aa640 1 -- 172.21.15.59:0/3880408547 wait complete. 2023-10-16T14:27:07.021 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T14:27:07.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.246+0000 7f6689275640 1 Processor -- start 2023-10-16T14:27:07.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.247+0000 7f6689275640 1 -- start start 2023-10-16T14:27:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.248+0000 7f6689275640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f66840cdf50 0x7f66840ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.248+0000 7f6689275640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66840cee60 0x7f6684070040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.248+0000 7f6689275640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66840cf2b0 con 0x7f668415c8e0 2023-10-16T14:27:07.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.248+0000 7f6689275640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668406df90 con 0x7f66840cdf50 2023-10-16T14:27:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.248+0000 7f6689275640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66840cdac0 con 0x7f66840cee60 2023-10-16T14:27:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.248+0000 7f66837fe640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f66840cdf50 0x7f66840ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.248+0000 7f6683fff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f668415c8e0 0x7f668406d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47908/0 (socket says 172.21.15.59:47908) 2023-10-16T14:27:07.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.248+0000 7f6683fff640 1 -- 172.21.15.59:0/1428799342 learned_addr learned my addr 172.21.15.59:0/1428799342 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:07.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.249+0000 7f66837fe640 1 -- 172.21.15.59:0/1428799342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66840cee60 msgr2=0x7f6684070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:07.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.249+0000 7f66837fe640 1 --2- 172.21.15.59:0/1428799342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66840cee60 0x7f6684070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.249+0000 7f66837fe640 1 -- 172.21.15.59:0/1428799342 >> v1:172.21.15.59:6789/0 conn(0x7f668415c8e0 legacy=0x7f668406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:07.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.249+0000 7f66837fe640 1 -- 172.21.15.59:0/1428799342 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66840cd1f0 con 0x7f66840cdf50 2023-10-16T14:27:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.250+0000 7f66837fe640 1 --2- 172.21.15.59:0/1428799342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66840cdf50 0x7f66840ce920 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f66780097a0 tx=0x7f667802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8066bbffb012f74 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.250+0000 7f6682ffd640 1 -- 172.21.15.59:0/1428799342 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667802d040 con 0x7f66840cdf50 2023-10-16T14:27:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.250+0000 7f6682ffd640 1 -- 172.21.15.59:0/1428799342 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6678031810 con 0x7f66840cdf50 2023-10-16T14:27:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.250+0000 7f6682ffd640 1 -- 172.21.15.59:0/1428799342 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678031ba0 con 0x7f66840cdf50 2023-10-16T14:27:07.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.251+0000 7f6689275640 1 -- 172.21.15.59:0/1428799342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66840cdf50 msgr2=0x7f66840ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.251+0000 7f6689275640 1 --2- 172.21.15.59:0/1428799342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66840cdf50 0x7f66840ce920 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f66780097a0 tx=0x7f667802b8b0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.251+0000 7f6689275640 1 -- 172.21.15.59:0/1428799342 shutdown_connections 2023-10-16T14:27:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.251+0000 7f6689275640 1 --2- 172.21.15.59:0/1428799342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66840cee60 0x7f6684070040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.251+0000 7f6689275640 1 --2- 172.21.15.59:0/1428799342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66840cdf50 0x7f66840ce920 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.251+0000 7f6689275640 1 -- 172.21.15.59:0/1428799342 >> 172.21.15.59:0/1428799342 conn(0x7f668406a200 msgr2=0x7f668406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:07.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.251+0000 7f6689275640 1 -- 172.21.15.59:0/1428799342 shutdown_connections 2023-10-16T14:27:07.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.251+0000 7f6689275640 1 -- 172.21.15.59:0/1428799342 wait complete. 2023-10-16T14:27:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.253+0000 7f6689275640 1 Processor -- start 2023-10-16T14:27:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.253+0000 7f6689275640 1 -- start start 2023-10-16T14:27:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.255+0000 7f6689275640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66840cdf50 0x7f6684154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.255+0000 7f6689275640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66840cee60 0x7f66840cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:07.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.255+0000 7f6689275640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f668415c8e0 0x7f668415ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:07.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.255+0000 7f6689275640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66840ca5b0 con 0x7f66840cdf50 2023-10-16T14:27:07.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.255+0000 7f6689275640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66840cb110 con 0x7f66840cee60 2023-10-16T14:27:07.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.255+0000 7f6689275640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66840c8410 con 0x7f668415c8e0 2023-10-16T14:27:07.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.255+0000 7f6683fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66840cdf50 0x7f6684154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:07.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.255+0000 7f6683fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66840cdf50 0x7f6684154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55362/0 (socket says 172.21.15.59:55362) 2023-10-16T14:27:07.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.255+0000 7f6683fff640 1 -- 172.21.15.59:0/3929640904 learned_addr learned my addr 172.21.15.59:0/3929640904 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:07.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.255+0000 7f6688a74640 1 --2- 172.21.15.59:0/3929640904 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f668415c8e0 0x7f668415ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:07.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.255+0000 7f66837fe640 1 --2- 172.21.15.59:0/3929640904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66840cee60 0x7f66840cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:07.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.255+0000 7f6683fff640 1 -- 172.21.15.59:0/3929640904 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f668415c8e0 msgr2=0x7f668415ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:07.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.255+0000 7f6683fff640 1 --2- 172.21.15.59:0/3929640904 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f668415c8e0 0x7f668415ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.255+0000 7f6683fff640 1 -- 172.21.15.59:0/3929640904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66840cee60 msgr2=0x7f66840cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:07.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.255+0000 7f6683fff640 1 --2- 172.21.15.59:0/3929640904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66840cee60 0x7f66840cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.255+0000 7f6683fff640 1 -- 172.21.15.59:0/3929640904 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6678009400 con 0x7f66840cdf50 2023-10-16T14:27:07.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.256+0000 7f6683fff640 1 --2- 172.21.15.59:0/3929640904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66840cdf50 0x7f6684154380 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f667400c480 tx=0x7f667400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:07.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.256+0000 7f6680ff9640 1 -- 172.21.15.59:0/3929640904 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674005ce0 con 0x7f66840cdf50 2023-10-16T14:27:07.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.256+0000 7f6680ff9640 1 -- 172.21.15.59:0/3929640904 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6674005e40 con 0x7f66840cdf50 2023-10-16T14:27:07.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.256+0000 7f6680ff9640 1 -- 172.21.15.59:0/3929640904 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66740072f0 con 0x7f66840cdf50 2023-10-16T14:27:07.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.256+0000 7f6689275640 1 -- 172.21.15.59:0/3929640904 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66840ca7e0 con 0x7f66840cdf50 2023-10-16T14:27:07.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.256+0000 7f6689275640 1 -- 172.21.15.59:0/3929640904 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66840cada0 con 0x7f66840cdf50 2023-10-16T14:27:07.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.257+0000 7f6689275640 1 -- 172.21.15.59:0/3929640904 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668404e9b0 con 0x7f66840cdf50 2023-10-16T14:27:07.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.258+0000 7f6680ff9640 1 -- 172.21.15.59:0/3929640904 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6674007450 con 0x7f66840cdf50 2023-10-16T14:27:07.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.259+0000 7f6680ff9640 1 --2- 172.21.15.59:0/3929640904 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f667006aea0 0x7f667006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:07.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.260+0000 7f6680ff9640 1 -- 172.21.15.59:0/3929640904 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f6674088c90 con 0x7f66840cdf50 2023-10-16T14:27:07.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.260+0000 7f66837fe640 1 --2- 172.21.15.59:0/3929640904 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f667006aea0 0x7f667006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:07.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.261+0000 7f66837fe640 1 --2- 172.21.15.59:0/3929640904 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f667006aea0 0x7f667006d360 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6678036000 tx=0x7f667803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:07.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.264+0000 7f6680ff9640 1 -- 172.21.15.59:0/3929640904 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6674053ab0 con 0x7f66840cdf50 2023-10-16T14:27:07.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.453+0000 7f6689275640 1 -- 172.21.15.59:0/3929640904 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f66840cf2b0 con 0x7f66840cdf50 2023-10-16T14:27:07.458 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.454+0000 7f6680ff9640 1 -- 172.21.15.59:0/3929640904 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f66840cf2b0 con 0x7f66840cdf50 2023-10-16T14:27:07.458 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:27:07.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.457+0000 7f6689275640 1 -- 172.21.15.59:0/3929640904 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f667006aea0 msgr2=0x7f667006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:07.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.457+0000 7f6689275640 1 --2- 172.21.15.59:0/3929640904 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f667006aea0 0x7f667006d360 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6678036000 tx=0x7f667803c040 comp rx=0 tx=0).stop 2023-10-16T14:27:07.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.457+0000 7f6689275640 1 -- 172.21.15.59:0/3929640904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66840cdf50 msgr2=0x7f6684154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:07.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.457+0000 7f6689275640 1 --2- 172.21.15.59:0/3929640904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66840cdf50 0x7f6684154380 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f667400c480 tx=0x7f667400c940 comp rx=0 tx=0).stop 2023-10-16T14:27:07.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.457+0000 7f6689275640 1 -- 172.21.15.59:0/3929640904 shutdown_connections 2023-10-16T14:27:07.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.457+0000 7f6689275640 1 --2- 172.21.15.59:0/3929640904 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f667006aea0 0x7f667006d360 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.457+0000 7f6689275640 1 --2- 172.21.15.59:0/3929640904 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f668415c8e0 0x7f668415ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.457+0000 7f6689275640 1 --2- 172.21.15.59:0/3929640904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66840cee60 0x7f66840cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.457+0000 7f6689275640 1 --2- 172.21.15.59:0/3929640904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66840cdf50 0x7f6684154380 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.457+0000 7f6689275640 1 -- 172.21.15.59:0/3929640904 >> 172.21.15.59:0/3929640904 conn(0x7f668406a200 msgr2=0x7f66840af680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:07.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.458+0000 7f6689275640 1 -- 172.21.15.59:0/3929640904 shutdown_connections 2023-10-16T14:27:07.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.458+0000 7f6689275640 1 -- 172.21.15.59:0/3929640904 wait complete. 2023-10-16T14:27:07.478 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T14:27:07.705 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.702+0000 7f22d6c21640 1 Processor -- start 2023-10-16T14:27:07.706 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.702+0000 7f22d6c21640 1 -- start start 2023-10-16T14:27:07.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.703+0000 7f22d6c21640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22d015cc20 0x7f22d00c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:07.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.703+0000 7f22d6c21640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f22d0161310 0x7f22d00ab860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:07.707 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.703+0000 7f22d6c21640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d00c9c70 con 0x7f22d00b01b0 2023-10-16T14:27:07.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.703+0000 7f22d6c21640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22d00cca90 con 0x7f22d0161310 2023-10-16T14:27:07.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.703+0000 7f22d6c21640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d015d000 con 0x7f22d015cc20 2023-10-16T14:27:07.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.704+0000 7f22cffff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f22d0161310 0x7f22d00ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:07.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.704+0000 7f22d51be640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f22d00b01b0 0x7f22d00ccf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47914/0 (socket says 172.21.15.59:47914) 2023-10-16T14:27:07.708 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.704+0000 7f22d51be640 1 -- 172.21.15.59:0/1747871732 learned_addr learned my addr 172.21.15.59:0/1747871732 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:07.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.704+0000 7f22d49bd640 1 --2- 172.21.15.59:0/1747871732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22d015cc20 0x7f22d00c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:07.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.704+0000 7f22cffff640 1 -- 172.21.15.59:0/1747871732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22d015cc20 msgr2=0x7f22d00c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:07.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.704+0000 7f22cffff640 1 --2- 172.21.15.59:0/1747871732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22d015cc20 0x7f22d00c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.704+0000 7f22cffff640 1 -- 172.21.15.59:0/1747871732 >> v1:172.21.15.59:6789/0 conn(0x7f22d00b01b0 legacy=0x7f22d00ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:07.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.704+0000 7f22cffff640 1 -- 172.21.15.59:0/1747871732 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d00cc760 con 0x7f22d0161310 2023-10-16T14:27:07.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.704+0000 7f22cf7fe640 1 -- 172.21.15.59:0/1747871732 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835942245 0 0) 0x7f22d00c9c70 con 0x7f22d00b01b0 2023-10-16T14:27:07.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.706+0000 7f22cffff640 1 --2- 172.21.15.59:0/1747871732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22d0161310 0x7f22d00ab860 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f22c40097a0 tx=0x7f22c402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c22e304fc42938d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:07.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.706+0000 7f22cf7fe640 1 -- 172.21.15.59:0/1747871732 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c4031830 con 0x7f22d0161310 2023-10-16T14:27:07.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.706+0000 7f22cf7fe640 1 -- 172.21.15.59:0/1747871732 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c4031990 con 0x7f22d0161310 2023-10-16T14:27:07.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.706+0000 7f22cf7fe640 1 -- 172.21.15.59:0/1747871732 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c4031d20 con 0x7f22d0161310 2023-10-16T14:27:07.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.706+0000 7f22d6c21640 1 -- 172.21.15.59:0/1747871732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22d0161310 msgr2=0x7f22d00ab860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:07.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.706+0000 7f22d6c21640 1 --2- 172.21.15.59:0/1747871732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22d0161310 0x7f22d00ab860 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f22c40097a0 tx=0x7f22c402b8d0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.707+0000 7f22d6c21640 1 -- 172.21.15.59:0/1747871732 shutdown_connections 2023-10-16T14:27:07.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.707+0000 7f22d6c21640 1 --2- 172.21.15.59:0/1747871732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22d0161310 0x7f22d00ab860 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.707+0000 7f22d6c21640 1 --2- 172.21.15.59:0/1747871732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22d015cc20 0x7f22d00c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.707+0000 7f22d6c21640 1 -- 172.21.15.59:0/1747871732 >> 172.21.15.59:0/1747871732 conn(0x7f22d00cb1b0 msgr2=0x7f22d00cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:07.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.707+0000 7f22d6c21640 1 -- 172.21.15.59:0/1747871732 shutdown_connections 2023-10-16T14:27:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.707+0000 7f22d6c21640 1 -- 172.21.15.59:0/1747871732 wait complete. 2023-10-16T14:27:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.708+0000 7f22d6c21640 1 Processor -- start 2023-10-16T14:27:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.709+0000 7f22d6c21640 1 -- start start 2023-10-16T14:27:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.709+0000 7f22d6c21640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22d00b01b0 0x7f22d00b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:07.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.709+0000 7f22d6c21640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22d015cc20 0x7f22d0157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:07.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.709+0000 7f22d6c21640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22d0161310 0x7f22d0158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:07.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.709+0000 7f22d6c21640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d0143560 con 0x7f22d00b01b0 2023-10-16T14:27:07.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.709+0000 7f22d6c21640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d0158c60 con 0x7f22d015cc20 2023-10-16T14:27:07.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.709+0000 7f22d6c21640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d0158f40 con 0x7f22d0161310 2023-10-16T14:27:07.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.710+0000 7f22d49bd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22d00b01b0 0x7f22d00b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:07.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.710+0000 7f22d49bd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22d00b01b0 0x7f22d00b15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55378/0 (socket says 172.21.15.59:55378) 2023-10-16T14:27:07.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.710+0000 7f22d49bd640 1 -- 172.21.15.59:0/1411750490 learned_addr learned my addr 172.21.15.59:0/1411750490 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:07.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.710+0000 7f22d51be640 1 --2- 172.21.15.59:0/1411750490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22d0161310 0x7f22d0158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:07.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.710+0000 7f22d49bd640 1 -- 172.21.15.59:0/1411750490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22d0161310 msgr2=0x7f22d0158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.710+0000 7f22d49bd640 1 --2- 172.21.15.59:0/1411750490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22d0161310 0x7f22d0158430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.710+0000 7f22d49bd640 1 -- 172.21.15.59:0/1411750490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22d015cc20 msgr2=0x7f22d0157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.710+0000 7f22cffff640 1 --2- 172.21.15.59:0/1411750490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22d015cc20 0x7f22d0157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.710+0000 7f22d49bd640 1 --2- 172.21.15.59:0/1411750490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22d015cc20 0x7f22d0157ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.710+0000 7f22d49bd640 1 -- 172.21.15.59:0/1411750490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c4009400 con 0x7f22d00b01b0 2023-10-16T14:27:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.711+0000 7f22d49bd640 1 --2- 172.21.15.59:0/1411750490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22d00b01b0 0x7f22d00b15c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f22c0007ef0 tx=0x7f22c000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.711+0000 7f22cd7fa640 1 -- 172.21.15.59:0/1411750490 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c0014620 con 0x7f22d00b01b0 2023-10-16T14:27:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.711+0000 7f22cd7fa640 1 -- 172.21.15.59:0/1411750490 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c0014780 con 0x7f22d00b01b0 2023-10-16T14:27:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.711+0000 7f22cd7fa640 1 -- 172.21.15.59:0/1411750490 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c0014b30 con 0x7f22d00b01b0 2023-10-16T14:27:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.711+0000 7f22d6c21640 1 -- 172.21.15.59:0/1411750490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d0159220 con 0x7f22d00b01b0 2023-10-16T14:27:07.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.711+0000 7f22d6c21640 1 -- 172.21.15.59:0/1411750490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d0158970 con 0x7f22d00b01b0 2023-10-16T14:27:07.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.712+0000 7f22d6c21640 1 -- 172.21.15.59:0/1411750490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d0073ef0 con 0x7f22d00b01b0 2023-10-16T14:27:07.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.713+0000 7f22cd7fa640 1 -- 172.21.15.59:0/1411750490 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f22c0014c90 con 0x7f22d00b01b0 2023-10-16T14:27:07.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.714+0000 7f22cd7fa640 1 --2- 172.21.15.59:0/1411750490 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f22bc06ae70 0x7f22bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:07.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.714+0000 7f22cd7fa640 1 -- 172.21.15.59:0/1411750490 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f22c008a470 con 0x7f22d00b01b0 2023-10-16T14:27:07.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.715+0000 7f22cffff640 1 --2- 172.21.15.59:0/1411750490 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f22bc06ae70 0x7f22bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:07.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.716+0000 7f22cffff640 1 --2- 172.21.15.59:0/1411750490 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f22bc06ae70 0x7f22bc06d330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f22c4036000 tx=0x7f22c403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:07.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.719+0000 7f22cd7fa640 1 -- 172.21.15.59:0/1411750490 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f22c00550c0 con 0x7f22d00b01b0 2023-10-16T14:27:07.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.922+0000 7f22d6c21640 1 -- 172.21.15.59:0/1411750490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f22d00b46b0 con 0x7f22d00b01b0 2023-10-16T14:27:07.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.923+0000 7f22cd7fa640 1 -- 172.21.15.59:0/1411750490 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f22c00586e0 con 0x7f22d00b01b0 2023-10-16T14:27:07.927 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2023-10-16T14:27:07.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.926+0000 7f22d6c21640 1 -- 172.21.15.59:0/1411750490 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f22bc06ae70 msgr2=0x7f22bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:07.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.926+0000 7f22d6c21640 1 --2- 172.21.15.59:0/1411750490 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f22bc06ae70 0x7f22bc06d330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f22c4036000 tx=0x7f22c403c040 comp rx=0 tx=0).stop 2023-10-16T14:27:07.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.926+0000 7f22d6c21640 1 -- 172.21.15.59:0/1411750490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22d00b01b0 msgr2=0x7f22d00b15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:07.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.926+0000 7f22d6c21640 1 --2- 172.21.15.59:0/1411750490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22d00b01b0 0x7f22d00b15c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f22c0007ef0 tx=0x7f22c000e4b0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.926+0000 7f22d6c21640 1 -- 172.21.15.59:0/1411750490 shutdown_connections 2023-10-16T14:27:07.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.926+0000 7f22d6c21640 1 --2- 172.21.15.59:0/1411750490 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f22bc06ae70 0x7f22bc06d330 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.926+0000 7f22d6c21640 1 --2- 172.21.15.59:0/1411750490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22d0161310 0x7f22d0158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.926+0000 7f22d6c21640 1 --2- 172.21.15.59:0/1411750490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22d015cc20 0x7f22d0157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.926+0000 7f22d6c21640 1 --2- 172.21.15.59:0/1411750490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22d00b01b0 0x7f22d00b15c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:07.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.926+0000 7f22d6c21640 1 -- 172.21.15.59:0/1411750490 >> 172.21.15.59:0/1411750490 conn(0x7f22d00cb1b0 msgr2=0x7f22d00ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:07.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.926+0000 7f22d6c21640 1 -- 172.21.15.59:0/1411750490 shutdown_connections 2023-10-16T14:27:07.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:07.926+0000 7f22d6c21640 1 -- 172.21.15.59:0/1411750490 wait complete. 2023-10-16T14:27:07.947 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi059.front.sepia.ceph.com... 2023-10-16T14:27:07.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:07.948 DEBUG:teuthology.orchestra.run.smithi059:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-10-16T14:27:08.048 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T14:27:08.048 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-16T14:27:08.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:08.049 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-16T14:27:08.104 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:27:08.105 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T14:27:08.166 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:27:08.167 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T14:27:08.217 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:27:08.452 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.449+0000 7fa6d359e640 1 Processor -- start 2023-10-16T14:27:08.453 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.449+0000 7fa6d359e640 1 -- start start 2023-10-16T14:27:08.454 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.451+0000 7fa6d359e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa6d40cb250 0x7fa6d40c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:08.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.451+0000 7fa6d359e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d415acb0 con 0x7fa6d415a8d0 2023-10-16T14:27:08.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.451+0000 7fa6d359e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d40c1c60 con 0x7fa6d40ca660 2023-10-16T14:27:08.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.451+0000 7fa6d359e640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d415e350 con 0x7fa6d40cb250 2023-10-16T14:27:08.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.451+0000 7fa6d1d9b640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa6d40cb250 0x7fa6d40c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:08.455 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.451+0000 7fa6d259c640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa6d415a8d0 0x7fa6d40cab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47920/0 (socket says 172.21.15.59:47920) 2023-10-16T14:27:08.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.451+0000 7fa6d259c640 1 -- 172.21.15.59:0/652823966 learned_addr learned my addr 172.21.15.59:0/652823966 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:08.456 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.452+0000 7fa6d159a640 1 -- 172.21.15.59:0/652823966 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756707430 0 0) 0x7fa6c4001290 con 0x7fa6d415a8d0 2023-10-16T14:27:08.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.452+0000 7fa6d159a640 1 -- 172.21.15.59:0/652823966 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6bc003520 con 0x7fa6d415a8d0 2023-10-16T14:27:08.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.452+0000 7fa6d1d9b640 1 -- 172.21.15.59:0/652823966 >> v1:172.21.15.151:6789/0 conn(0x7fa6d40ca660 legacy=0x7fa6d40c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:08.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.452+0000 7fa6d1d9b640 1 -- 172.21.15.59:0/652823966 >> v1:172.21.15.59:6789/0 conn(0x7fa6d415a8d0 legacy=0x7fa6d40cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:08.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.452+0000 7fa6d1d9b640 1 -- 172.21.15.59:0/652823966 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d415e630 con 0x7fa6d40cb250 2023-10-16T14:27:08.457 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.453+0000 7fa6d1d9b640 1 --2- 172.21.15.59:0/652823966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d40cb250 0x7fa6d40c8e10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40c1df0 tx=0x7fa6c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7c41673165ff03 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:08.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.453+0000 7fa6d159a640 1 -- 172.21.15.59:0/652823966 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8031830 con 0x7fa6d40cb250 2023-10-16T14:27:08.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.454+0000 7fa6d159a640 1 -- 172.21.15.59:0/652823966 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c8031990 con 0x7fa6d40cb250 2023-10-16T14:27:08.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.454+0000 7fa6d159a640 1 -- 172.21.15.59:0/652823966 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8031d00 con 0x7fa6d40cb250 2023-10-16T14:27:08.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.454+0000 7fa6d359e640 1 -- 172.21.15.59:0/652823966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d40cb250 msgr2=0x7fa6d40c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:08.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.454+0000 7fa6d359e640 1 --2- 172.21.15.59:0/652823966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d40cb250 0x7fa6d40c8e10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40c1df0 tx=0x7fa6c802b8d0 comp rx=0 tx=0).stop 2023-10-16T14:27:08.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.454+0000 7fa6d359e640 1 -- 172.21.15.59:0/652823966 shutdown_connections 2023-10-16T14:27:08.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.454+0000 7fa6d359e640 1 --2- 172.21.15.59:0/652823966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d40cb250 0x7fa6d40c8e10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:08.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.454+0000 7fa6d359e640 1 -- 172.21.15.59:0/652823966 >> 172.21.15.59:0/652823966 conn(0x7fa6d406a470 msgr2=0x7fa6d40afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:08.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.454+0000 7fa6d359e640 1 -- 172.21.15.59:0/652823966 shutdown_connections 2023-10-16T14:27:08.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.454+0000 7fa6d359e640 1 -- 172.21.15.59:0/652823966 wait complete. 2023-10-16T14:27:08.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.456+0000 7fa6d359e640 1 Processor -- start 2023-10-16T14:27:08.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.456+0000 7fa6d359e640 1 -- start start 2023-10-16T14:27:08.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.457+0000 7fa6d359e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d40ca660 0x7fa6d4155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:08.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.457+0000 7fa6d359e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6d40cb250 0x7fa6d4154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:08.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.457+0000 7fa6d359e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6d415a8d0 0x7fa6d40b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:08.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.457+0000 7fa6d359e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40b17e0 con 0x7fa6d40ca660 2023-10-16T14:27:08.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.457+0000 7fa6d359e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40b1ac0 con 0x7fa6d40cb250 2023-10-16T14:27:08.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.457+0000 7fa6d359e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d40b1da0 con 0x7fa6d415a8d0 2023-10-16T14:27:08.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.457+0000 7fa6d259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d40ca660 0x7fa6d4155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:08.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.457+0000 7fa6d259c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d40ca660 0x7fa6d4155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55398/0 (socket says 172.21.15.59:55398) 2023-10-16T14:27:08.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.458+0000 7fa6d259c640 1 -- 172.21.15.59:0/737016891 learned_addr learned my addr 172.21.15.59:0/737016891 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:08.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.458+0000 7fa6d1d9b640 1 --2- 172.21.15.59:0/737016891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6d40cb250 0x7fa6d4154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:08.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.458+0000 7fa6d259c640 1 -- 172.21.15.59:0/737016891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6d415a8d0 msgr2=0x7fa6d40b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:08.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.458+0000 7fa6d259c640 1 --2- 172.21.15.59:0/737016891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6d415a8d0 0x7fa6d40b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:08.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.458+0000 7fa6d259c640 1 -- 172.21.15.59:0/737016891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6d40cb250 msgr2=0x7fa6d4154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:08.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.458+0000 7fa6d259c640 1 --2- 172.21.15.59:0/737016891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6d40cb250 0x7fa6d4154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:08.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.458+0000 7fa6d259c640 1 -- 172.21.15.59:0/737016891 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c8009400 con 0x7fa6d40ca660 2023-10-16T14:27:08.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.458+0000 7fa6d259c640 1 --2- 172.21.15.59:0/737016891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d40ca660 0x7fa6d4155600 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400c390 tx=0x7fa6c400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:08.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.459+0000 7fa6c2ffd640 1 -- 172.21.15.59:0/737016891 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c40074e0 con 0x7fa6d40ca660 2023-10-16T14:27:08.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.459+0000 7fa6c2ffd640 1 -- 172.21.15.59:0/737016891 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c4007640 con 0x7fa6d40ca660 2023-10-16T14:27:08.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.459+0000 7fa6d359e640 1 -- 172.21.15.59:0/737016891 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d40b2080 con 0x7fa6d40ca660 2023-10-16T14:27:08.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.459+0000 7fa6c2ffd640 1 -- 172.21.15.59:0/737016891 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c40059c0 con 0x7fa6d40ca660 2023-10-16T14:27:08.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.459+0000 7fa6d359e640 1 -- 172.21.15.59:0/737016891 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d4155390 con 0x7fa6d40ca660 2023-10-16T14:27:08.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.460+0000 7fa6d359e640 1 -- 172.21.15.59:0/737016891 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d40b25a0 con 0x7fa6d40ca660 2023-10-16T14:27:08.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.461+0000 7fa6c2ffd640 1 -- 172.21.15.59:0/737016891 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa6c4005b20 con 0x7fa6d40ca660 2023-10-16T14:27:08.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.463+0000 7fa6c2ffd640 1 --2- 172.21.15.59:0/737016891 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa6b406ae70 0x7fa6b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:08.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.463+0000 7fa6c2ffd640 1 -- 172.21.15.59:0/737016891 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fa6c4088e30 con 0x7fa6d40ca660 2023-10-16T14:27:08.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.463+0000 7fa6d1d9b640 1 --2- 172.21.15.59:0/737016891 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa6b406ae70 0x7fa6b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:08.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.464+0000 7fa6d1d9b640 1 --2- 172.21.15.59:0/737016891 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa6b406ae70 0x7fa6b406d330 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8036000 tx=0x7fa6c8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:08.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.468+0000 7fa6c2ffd640 1 -- 172.21.15.59:0/737016891 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa6c4053b10 con 0x7fa6d40ca660 2023-10-16T14:27:08.664 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.661+0000 7fa6d359e640 1 -- 172.21.15.59:0/737016891 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6d404e9b0 con 0x7fa6d40ca660 2023-10-16T14:27:08.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.663+0000 7fa6c2ffd640 1 -- 172.21.15.59:0/737016891 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18445 (secure 0 0 0) 0x7fa6c4017020 con 0x7fa6d40ca660 2023-10-16T14:27:08.667 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:08.667 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:26:29.634854+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:27:08.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.665+0000 7fa6d359e640 1 -- 172.21.15.59:0/737016891 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa6b406ae70 msgr2=0x7fa6b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:08.669 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.665+0000 7fa6d359e640 1 --2- 172.21.15.59:0/737016891 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa6b406ae70 0x7fa6b406d330 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8036000 tx=0x7fa6c8008030 comp rx=0 tx=0).stop 2023-10-16T14:27:08.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.665+0000 7fa6d359e640 1 -- 172.21.15.59:0/737016891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d40ca660 msgr2=0x7fa6d4155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:08.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.665+0000 7fa6d359e640 1 --2- 172.21.15.59:0/737016891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d40ca660 0x7fa6d4155600 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400c390 tx=0x7fa6c400c850 comp rx=0 tx=0).stop 2023-10-16T14:27:08.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.666+0000 7fa6d359e640 1 -- 172.21.15.59:0/737016891 shutdown_connections 2023-10-16T14:27:08.670 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.666+0000 7fa6d359e640 1 --2- 172.21.15.59:0/737016891 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fa6b406ae70 0x7fa6b406d330 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:08.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.666+0000 7fa6d359e640 1 --2- 172.21.15.59:0/737016891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6d415a8d0 0x7fa6d40b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:08.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.666+0000 7fa6d359e640 1 --2- 172.21.15.59:0/737016891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6d40cb250 0x7fa6d4154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:08.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.666+0000 7fa6d359e640 1 --2- 172.21.15.59:0/737016891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6d40ca660 0x7fa6d4155600 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:08.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.666+0000 7fa6d359e640 1 -- 172.21.15.59:0/737016891 >> 172.21.15.59:0/737016891 conn(0x7fa6d406a470 msgr2=0x7fa6d40abcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:08.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.666+0000 7fa6d359e640 1 -- 172.21.15.59:0/737016891 shutdown_connections 2023-10-16T14:27:08.672 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.666+0000 7fa6d359e640 1 -- 172.21.15.59:0/737016891 wait complete. 2023-10-16T14:27:08.690 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T14:25:46.371818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T14:25:47.145341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T14:25:50.758038+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T14:27:08.691 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:27:08.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.920+0000 7f412249e640 1 Processor -- start 2023-10-16T14:27:08.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.920+0000 7f412249e640 1 -- start start 2023-10-16T14:27:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.921+0000 7f412249e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f411c0c9a50 0x7f411c0c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.921+0000 7f412249e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f411c0ce7b0 0x7f411c0cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:08.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.922+0000 7f412249e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f411c0af670 con 0x7f411c15cb00 2023-10-16T14:27:08.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.922+0000 7f412249e640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411c15cee0 con 0x7f411c0ce7b0 2023-10-16T14:27:08.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.922+0000 7f412249e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411c0ca420 con 0x7f411c0c9a50 2023-10-16T14:27:08.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.922+0000 7f412149c640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f411c15cb00 0x7f411c0afb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47924/0 (socket says 172.21.15.59:47924) 2023-10-16T14:27:08.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.922+0000 7f412149c640 1 -- 172.21.15.59:0/411366145 learned_addr learned my addr 172.21.15.59:0/411366145 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:08.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.922+0000 7f4121c9d640 1 --2- 172.21.15.59:0/411366145 >> v2:172.21.15.59:3300/0 conn(0x7f411c0ce7b0 0x7f411c0cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.922+0000 7f4120c9b640 1 --2- 172.21.15.59:0/411366145 >> v2:172.21.15.151:3300/0 conn(0x7f411c0c9a50 0x7f411c0c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:08.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.922+0000 7f4113fff640 1 -- 172.21.15.59:0/411366145 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953867139 0 0) 0x7f411c0af670 con 0x7f411c15cb00 2023-10-16T14:27:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.922+0000 7f4113fff640 1 -- 172.21.15.59:0/411366145 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4108003520 con 0x7f411c15cb00 2023-10-16T14:27:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.923+0000 7f4121c9d640 1 -- 172.21.15.59:0/411366145 >> v2:172.21.15.151:3300/0 conn(0x7f411c0c9a50 msgr2=0x7f411c0c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.923+0000 7f4121c9d640 1 --2- 172.21.15.59:0/411366145 >> v2:172.21.15.151:3300/0 conn(0x7f411c0c9a50 0x7f411c0c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.923+0000 7f4121c9d640 1 -- 172.21.15.59:0/411366145 >> v1:172.21.15.59:6789/0 conn(0x7f411c15cb00 legacy=0x7f411c0afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:08.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.923+0000 7f4121c9d640 1 -- 172.21.15.59:0/411366145 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c0aeaa0 con 0x7f411c0ce7b0 2023-10-16T14:27:08.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.924+0000 7f4121c9d640 1 --2- 172.21.15.59:0/411366145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c0ce7b0 0x7f411c0cec40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f411c0b54b0 tx=0x7f411402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d093d3ebf03610f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:08.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.924+0000 7f4113fff640 1 -- 172.21.15.59:0/411366145 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411402cc70 con 0x7f411c0ce7b0 2023-10-16T14:27:08.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.924+0000 7f4113fff640 1 -- 172.21.15.59:0/411366145 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411402cdd0 con 0x7f411c0ce7b0 2023-10-16T14:27:08.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.924+0000 7f4113fff640 1 -- 172.21.15.59:0/411366145 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4114034660 con 0x7f411c0ce7b0 2023-10-16T14:27:08.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.925+0000 7f412249e640 1 -- 172.21.15.59:0/411366145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c0ce7b0 msgr2=0x7f411c0cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:08.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.925+0000 7f412249e640 1 --2- 172.21.15.59:0/411366145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c0ce7b0 0x7f411c0cec40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f411c0b54b0 tx=0x7f411402bec0 comp rx=0 tx=0).stop 2023-10-16T14:27:08.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.925+0000 7f412249e640 1 -- 172.21.15.59:0/411366145 shutdown_connections 2023-10-16T14:27:08.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.925+0000 7f412249e640 1 --2- 172.21.15.59:0/411366145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c0ce7b0 0x7f411c0cec40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:08.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.925+0000 7f412249e640 1 --2- 172.21.15.59:0/411366145 >> v2:172.21.15.151:3300/0 conn(0x7f411c0c9a50 0x7f411c0c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:08.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.925+0000 7f412249e640 1 -- 172.21.15.59:0/411366145 >> 172.21.15.59:0/411366145 conn(0x7f411c0989e0 msgr2=0x7f411c0cf400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.925+0000 7f412249e640 1 -- 172.21.15.59:0/411366145 shutdown_connections 2023-10-16T14:27:08.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.925+0000 7f412249e640 1 -- 172.21.15.59:0/411366145 wait complete. 2023-10-16T14:27:08.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.927+0000 7f412249e640 1 Processor -- start 2023-10-16T14:27:08.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.927+0000 7f412249e640 1 -- start start 2023-10-16T14:27:08.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.928+0000 7f412249e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c0c9a50 0x7f411c1f1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:08.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.928+0000 7f412249e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f411c0ce7b0 0x7f411c15f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:08.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.928+0000 7f412249e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f411c15cb00 0x7f411c0c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:08.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.928+0000 7f412249e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c0c7cf0 con 0x7f411c0c9a50 2023-10-16T14:27:08.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.928+0000 7f412249e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c14e360 con 0x7f411c0ce7b0 2023-10-16T14:27:08.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.928+0000 7f412249e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411c0c7450 con 0x7f411c15cb00 2023-10-16T14:27:08.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.928+0000 7f412149c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c0c9a50 0x7f411c1f1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:08.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.928+0000 7f412149c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c0c9a50 0x7f411c1f1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55416/0 (socket says 172.21.15.59:55416) 2023-10-16T14:27:08.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.928+0000 7f412149c640 1 -- 172.21.15.59:0/2193961880 learned_addr learned my addr 172.21.15.59:0/2193961880 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:08.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.928+0000 7f4120c9b640 1 --2- 172.21.15.59:0/2193961880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f411c0ce7b0 0x7f411c15f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:08.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.928+0000 7f4121c9d640 1 --2- 172.21.15.59:0/2193961880 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f411c15cb00 0x7f411c0c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:08.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.929+0000 7f412149c640 1 -- 172.21.15.59:0/2193961880 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f411c15cb00 msgr2=0x7f411c0c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:08.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.929+0000 7f412149c640 1 --2- 172.21.15.59:0/2193961880 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f411c15cb00 0x7f411c0c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:08.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.929+0000 7f412149c640 1 -- 172.21.15.59:0/2193961880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f411c0ce7b0 msgr2=0x7f411c15f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:08.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.929+0000 7f412149c640 1 --2- 172.21.15.59:0/2193961880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f411c0ce7b0 0x7f411c15f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:08.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.929+0000 7f412149c640 1 -- 172.21.15.59:0/2193961880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4114009a70 con 0x7f411c0c9a50 2023-10-16T14:27:08.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.929+0000 7f412149c640 1 --2- 172.21.15.59:0/2193961880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c0c9a50 0x7f411c1f1840 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f411800c4d0 tx=0x7f411800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:08.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.929+0000 7f4111ffb640 1 -- 172.21.15.59:0/2193961880 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4118007480 con 0x7f411c0c9a50 2023-10-16T14:27:08.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.929+0000 7f4111ffb640 1 -- 172.21.15.59:0/2193961880 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41180075e0 con 0x7f411c0c9a50 2023-10-16T14:27:08.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.929+0000 7f4111ffb640 1 -- 172.21.15.59:0/2193961880 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41180059a0 con 0x7f411c0c9a50 2023-10-16T14:27:08.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.929+0000 7f412249e640 1 -- 172.21.15.59:0/2193961880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411c0c7730 con 0x7f411c0c9a50 2023-10-16T14:27:08.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.929+0000 7f412249e640 1 -- 172.21.15.59:0/2193961880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411c15d190 con 0x7f411c0c9a50 2023-10-16T14:27:08.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.931+0000 7f412249e640 1 -- 172.21.15.59:0/2193961880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411c067440 con 0x7f411c0c9a50 2023-10-16T14:27:08.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.931+0000 7f4111ffb640 1 -- 172.21.15.59:0/2193961880 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4118005b00 con 0x7f411c0c9a50 2023-10-16T14:27:08.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.933+0000 7f4111ffb640 1 --2- 172.21.15.59:0/2193961880 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f410006ae70 0x7f410006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:08.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.933+0000 7f4111ffb640 1 -- 172.21.15.59:0/2193961880 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f4118088c60 con 0x7f411c0c9a50 2023-10-16T14:27:08.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.934+0000 7f4120c9b640 1 --2- 172.21.15.59:0/2193961880 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f410006ae70 0x7f410006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:08.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.935+0000 7f4120c9b640 1 --2- 172.21.15.59:0/2193961880 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f410006ae70 0x7f410006d330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f411c0c8080 tx=0x7f410c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:08.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:08.937+0000 7f4111ffb640 1 -- 172.21.15.59:0/2193961880 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4118053b20 con 0x7f411c0c9a50 2023-10-16T14:27:09.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.128+0000 7f412249e640 1 -- 172.21.15.59:0/2193961880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f411c15d350 con 0x7f411c0c9a50 2023-10-16T14:27:09.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.129+0000 7f4111ffb640 1 -- 172.21.15.59:0/2193961880 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4118017070 con 0x7f411c0c9a50 2023-10-16T14:27:09.133 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:27:09.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.132+0000 7f412249e640 1 -- 172.21.15.59:0/2193961880 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f410006ae70 msgr2=0x7f410006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:09.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.132+0000 7f412249e640 1 --2- 172.21.15.59:0/2193961880 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f410006ae70 0x7f410006d330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f411c0c8080 tx=0x7f410c008040 comp rx=0 tx=0).stop 2023-10-16T14:27:09.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.132+0000 7f412249e640 1 -- 172.21.15.59:0/2193961880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c0c9a50 msgr2=0x7f411c1f1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:09.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.132+0000 7f412249e640 1 --2- 172.21.15.59:0/2193961880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c0c9a50 0x7f411c1f1840 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f411800c4d0 tx=0x7f411800c990 comp rx=0 tx=0).stop 2023-10-16T14:27:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.132+0000 7f412249e640 1 -- 172.21.15.59:0/2193961880 shutdown_connections 2023-10-16T14:27:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.132+0000 7f412249e640 1 --2- 172.21.15.59:0/2193961880 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f410006ae70 0x7f410006d330 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.132+0000 7f412249e640 1 --2- 172.21.15.59:0/2193961880 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f411c15cb00 0x7f411c0c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.132+0000 7f412249e640 1 --2- 172.21.15.59:0/2193961880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f411c0ce7b0 0x7f411c15f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.132+0000 7f412249e640 1 --2- 172.21.15.59:0/2193961880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411c0c9a50 0x7f411c1f1840 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:09.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.132+0000 7f412249e640 1 -- 172.21.15.59:0/2193961880 >> 172.21.15.59:0/2193961880 conn(0x7f411c0989e0 msgr2=0x7f411c0cc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:09.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.132+0000 7f412249e640 1 -- 172.21.15.59:0/2193961880 shutdown_connections 2023-10-16T14:27:09.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.132+0000 7f412249e640 1 -- 172.21.15.59:0/2193961880 wait complete. 2023-10-16T14:27:09.154 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T14:27:09.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.375+0000 7feaa759e640 1 Processor -- start 2023-10-16T14:27:09.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.375+0000 7feaa759e640 1 -- start start 2023-10-16T14:27:09.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.376+0000 7feaa759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaa815c940 0x7feaa80d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:09.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.376+0000 7feaa759e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feaa80d0d80 0x7feaa80d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:09.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.376+0000 7feaa759e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa80ce810 con 0x7feaa8160520 2023-10-16T14:27:09.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.376+0000 7feaa759e640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa80d1740 con 0x7feaa80d0d80 2023-10-16T14:27:09.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.376+0000 7feaa759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa80b5b40 con 0x7feaa815c940 2023-10-16T14:27:09.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.377+0000 7feaa6d9d640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7feaa8160520 0x7feaa81609b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47932/0 (socket says 172.21.15.59:47932) 2023-10-16T14:27:09.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.377+0000 7feaa5d9b640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feaa80d0d80 0x7feaa80d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:09.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.377+0000 7feaa6d9d640 1 -- 172.21.15.59:0/1787304063 learned_addr learned my addr 172.21.15.59:0/1787304063 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:09.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.377+0000 7feaa659c640 1 --2- 172.21.15.59:0/1787304063 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaa815c940 0x7feaa80d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:09.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.377+0000 7feaa559a640 1 -- 172.21.15.59:0/1787304063 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2804291676 0 0) 0x7feaa80ce810 con 0x7feaa8160520 2023-10-16T14:27:09.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.377+0000 7feaa559a640 1 -- 172.21.15.59:0/1787304063 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea94003520 con 0x7feaa8160520 2023-10-16T14:27:09.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.377+0000 7feaa5d9b640 1 -- 172.21.15.59:0/1787304063 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaa815c940 msgr2=0x7feaa80d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:09.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.377+0000 7feaa5d9b640 1 --2- 172.21.15.59:0/1787304063 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaa815c940 0x7feaa80d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:09.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.377+0000 7feaa5d9b640 1 -- 172.21.15.59:0/1787304063 >> v1:172.21.15.59:6789/0 conn(0x7feaa8160520 legacy=0x7feaa81609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:09.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.378+0000 7feaa5d9b640 1 -- 172.21.15.59:0/1787304063 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa80ce250 con 0x7feaa80d0d80 2023-10-16T14:27:09.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.379+0000 7feaa5d9b640 1 --2- 172.21.15.59:0/1787304063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa80d0d80 0x7feaa80d1200 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fea90009d90 tx=0x7fea9002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53aee412af44c148 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:09.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.379+0000 7feaa559a640 1 -- 172.21.15.59:0/1787304063 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9002cbd0 con 0x7feaa80d0d80 2023-10-16T14:27:09.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.379+0000 7feaa559a640 1 -- 172.21.15.59:0/1787304063 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9002cd30 con 0x7feaa80d0d80 2023-10-16T14:27:09.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.379+0000 7feaa559a640 1 -- 172.21.15.59:0/1787304063 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9002cea0 con 0x7feaa80d0d80 2023-10-16T14:27:09.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.380+0000 7feaa759e640 1 -- 172.21.15.59:0/1787304063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa80d0d80 msgr2=0x7feaa80d1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:09.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.380+0000 7feaa759e640 1 --2- 172.21.15.59:0/1787304063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa80d0d80 0x7feaa80d1200 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fea90009d90 tx=0x7fea9002be20 comp rx=0 tx=0).stop 2023-10-16T14:27:09.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.380+0000 7feaa759e640 1 -- 172.21.15.59:0/1787304063 shutdown_connections 2023-10-16T14:27:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.380+0000 7feaa759e640 1 --2- 172.21.15.59:0/1787304063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa80d0d80 0x7feaa80d1200 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.380+0000 7feaa759e640 1 --2- 172.21.15.59:0/1787304063 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaa815c940 0x7feaa80d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.380+0000 7feaa759e640 1 -- 172.21.15.59:0/1787304063 >> 172.21.15.59:0/1787304063 conn(0x7feaa809bb30 msgr2=0x7feaa80d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.380+0000 7feaa759e640 1 -- 172.21.15.59:0/1787304063 shutdown_connections 2023-10-16T14:27:09.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.380+0000 7feaa759e640 1 -- 172.21.15.59:0/1787304063 wait complete. 2023-10-16T14:27:09.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.381+0000 7feaa759e640 1 Processor -- start 2023-10-16T14:27:09.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.382+0000 7feaa759e640 1 -- start start 2023-10-16T14:27:09.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.383+0000 7feaa759e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa80d0d80 0x7feaa81e58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:09.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.383+0000 7feaa759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaa815c940 0x7feaa815f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:09.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.383+0000 7feaa759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feaa8160520 0x7feaa81f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:09.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.383+0000 7feaa759e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa81f5bc0 con 0x7feaa80d0d80 2023-10-16T14:27:09.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.383+0000 7feaa759e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa81f5ea0 con 0x7feaa8160520 2023-10-16T14:27:09.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.383+0000 7feaa759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa81f6180 con 0x7feaa815c940 2023-10-16T14:27:09.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.383+0000 7feaa659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa80d0d80 0x7feaa81e58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:09.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.383+0000 7feaa659c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa80d0d80 0x7feaa81e58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55424/0 (socket says 172.21.15.59:55424) 2023-10-16T14:27:09.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.383+0000 7feaa659c640 1 -- 172.21.15.59:0/3876492438 learned_addr learned my addr 172.21.15.59:0/3876492438 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:09.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.383+0000 7feaa5d9b640 1 --2- 172.21.15.59:0/3876492438 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaa815c940 0x7feaa815f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:09.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.383+0000 7feaa6d9d640 1 --2- 172.21.15.59:0/3876492438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feaa8160520 0x7feaa81f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:09.392 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.383+0000 7feaa659c640 1 -- 172.21.15.59:0/3876492438 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaa815c940 msgr2=0x7feaa815f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:09.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.383+0000 7feaa659c640 1 --2- 172.21.15.59:0/3876492438 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaa815c940 0x7feaa815f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:09.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.383+0000 7feaa659c640 1 -- 172.21.15.59:0/3876492438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feaa8160520 msgr2=0x7feaa81f4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:09.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.383+0000 7feaa659c640 1 --2- 172.21.15.59:0/3876492438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feaa8160520 0x7feaa81f4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:09.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.383+0000 7feaa659c640 1 -- 172.21.15.59:0/3876492438 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea90009a70 con 0x7feaa80d0d80 2023-10-16T14:27:09.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.383+0000 7feaa5d9b640 1 --2- 172.21.15.59:0/3876492438 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaa815c940 0x7feaa815f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:09.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.384+0000 7feaa659c640 1 --2- 172.21.15.59:0/3876492438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa80d0d80 0x7feaa81e58b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fea9800d5f0 tx=0x7fea9800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:09.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.384+0000 7fea9effd640 1 -- 172.21.15.59:0/3876492438 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea980125f0 con 0x7feaa80d0d80 2023-10-16T14:27:09.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.384+0000 7fea9effd640 1 -- 172.21.15.59:0/3876492438 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea98012750 con 0x7feaa80d0d80 2023-10-16T14:27:09.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.384+0000 7feaa759e640 1 -- 172.21.15.59:0/3876492438 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa81f6460 con 0x7feaa80d0d80 2023-10-16T14:27:09.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.384+0000 7fea9effd640 1 -- 172.21.15.59:0/3876492438 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98012b00 con 0x7feaa80d0d80 2023-10-16T14:27:09.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.384+0000 7feaa759e640 1 -- 172.21.15.59:0/3876492438 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa81e5df0 con 0x7feaa80d0d80 2023-10-16T14:27:09.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.385+0000 7feaa759e640 1 -- 172.21.15.59:0/3876492438 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa81e5fe0 con 0x7feaa80d0d80 2023-10-16T14:27:09.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.386+0000 7fea9effd640 1 -- 172.21.15.59:0/3876492438 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fea98012c60 con 0x7feaa80d0d80 2023-10-16T14:27:09.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.387+0000 7fea9effd640 1 --2- 172.21.15.59:0/3876492438 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fea8806ae70 0x7fea8806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:09.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.387+0000 7fea9effd640 1 -- 172.21.15.59:0/3876492438 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fea98089e40 con 0x7feaa80d0d80 2023-10-16T14:27:09.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.388+0000 7feaa5d9b640 1 --2- 172.21.15.59:0/3876492438 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fea8806ae70 0x7fea8806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.389+0000 7feaa5d9b640 1 --2- 172.21.15.59:0/3876492438 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fea8806ae70 0x7fea8806d330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fea90036000 tx=0x7fea90030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.392+0000 7fea9effd640 1 -- 172.21.15.59:0/3876492438 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fea98054bb0 con 0x7feaa80d0d80 2023-10-16T14:27:09.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.586+0000 7feaa759e640 1 -- 172.21.15.59:0/3876492438 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feaa804e9b0 con 0x7feaa80d0d80 2023-10-16T14:27:09.591 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.587+0000 7fea9effd640 1 -- 172.21.15.59:0/3876492438 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fea980581d0 con 0x7feaa80d0d80 2023-10-16T14:27:09.591 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:27:09.593 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.590+0000 7feaa759e640 1 -- 172.21.15.59:0/3876492438 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fea8806ae70 msgr2=0x7fea8806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:09.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.590+0000 7feaa759e640 1 --2- 172.21.15.59:0/3876492438 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fea8806ae70 0x7fea8806d330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fea90036000 tx=0x7fea90030000 comp rx=0 tx=0).stop 2023-10-16T14:27:09.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.590+0000 7feaa759e640 1 -- 172.21.15.59:0/3876492438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa80d0d80 msgr2=0x7feaa81e58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:09.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.590+0000 7feaa759e640 1 --2- 172.21.15.59:0/3876492438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa80d0d80 0x7feaa81e58b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fea9800d5f0 tx=0x7fea9800dab0 comp rx=0 tx=0).stop 2023-10-16T14:27:09.594 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.590+0000 7feaa759e640 1 -- 172.21.15.59:0/3876492438 shutdown_connections 2023-10-16T14:27:09.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.590+0000 7feaa759e640 1 --2- 172.21.15.59:0/3876492438 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fea8806ae70 0x7fea8806d330 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:09.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.590+0000 7feaa759e640 1 --2- 172.21.15.59:0/3876492438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feaa8160520 0x7feaa81f4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:09.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.590+0000 7feaa759e640 1 --2- 172.21.15.59:0/3876492438 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaa815c940 0x7feaa815f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:09.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.590+0000 7feaa759e640 1 --2- 172.21.15.59:0/3876492438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaa80d0d80 0x7feaa81e58b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:09.595 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.590+0000 7feaa759e640 1 -- 172.21.15.59:0/3876492438 >> 172.21.15.59:0/3876492438 conn(0x7feaa809bb30 msgr2=0x7feaa80cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:09.596 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.590+0000 7feaa759e640 1 -- 172.21.15.59:0/3876492438 shutdown_connections 2023-10-16T14:27:09.597 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.591+0000 7feaa759e640 1 -- 172.21.15.59:0/3876492438 wait complete. 2023-10-16T14:27:09.614 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T14:27:09.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.837+0000 7fb62b59e640 1 Processor -- start 2023-10-16T14:27:09.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.837+0000 7fb62b59e640 1 -- start start 2023-10-16T14:27:09.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.839+0000 7fb62b59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb62c0ca3a0 0x7fb62c0ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:09.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.839+0000 7fb62b59e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb62c0ccae0 0x7fb62c0ceef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.839+0000 7fb62b59e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb62c159ca0 con 0x7fb62c0ad940 2023-10-16T14:27:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.839+0000 7fb62b59e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62c0b34c0 con 0x7fb62c0ccae0 2023-10-16T14:27:09.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.839+0000 7fb62b59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c0b2fd0 con 0x7fb62c0ca3a0 2023-10-16T14:27:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.840+0000 7fb621d9b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb62c0ca3a0 0x7fb62c0ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.840+0000 7fb62a59c640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fb62c0ad940 0x7fb62c06c6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.59:47374/0 (socket says 172.21.15.59:47374) 2023-10-16T14:27:09.844 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.840+0000 7fb62a59c640 1 -- 172.21.15.59:0/2367728793 learned_addr learned my addr 172.21.15.59:0/2367728793 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.840+0000 7fb62ad9d640 1 --2- 172.21.15.59:0/2367728793 >> v2:172.21.15.151:3300/0 conn(0x7fb62c0ccae0 0x7fb62c0ceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.841+0000 7fb621d9b640 1 -- 172.21.15.59:0/2367728793 >> v2:172.21.15.151:3300/0 conn(0x7fb62c0ccae0 msgr2=0x7fb62c0ceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.841+0000 7fb621d9b640 1 --2- 172.21.15.59:0/2367728793 >> v2:172.21.15.151:3300/0 conn(0x7fb62c0ccae0 0x7fb62c0ceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.841+0000 7fb621d9b640 1 -- 172.21.15.59:0/2367728793 >> v1:172.21.15.151:6789/0 conn(0x7fb62c0ad940 legacy=0x7fb62c06c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:09.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.841+0000 7fb621d9b640 1 -- 172.21.15.59:0/2367728793 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c0cac20 con 0x7fb62c0ca3a0 2023-10-16T14:27:09.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.842+0000 7fb621d9b640 1 --2- 172.21.15.59:0/2367728793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb62c0ca3a0 0x7fb62c0ce9b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb6140097a0 tx=0x7fb61402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ae08feb2e8f79cc server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.847+0000 7fb629d9b640 1 -- 172.21.15.59:0/2367728793 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61402d040 con 0x7fb62c0ca3a0 2023-10-16T14:27:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.847+0000 7fb629d9b640 1 -- 172.21.15.59:0/2367728793 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb614031810 con 0x7fb62c0ca3a0 2023-10-16T14:27:09.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.847+0000 7fb629d9b640 1 -- 172.21.15.59:0/2367728793 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb614031ba0 con 0x7fb62c0ca3a0 2023-10-16T14:27:09.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.848+0000 7fb62b59e640 1 -- 172.21.15.59:0/2367728793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb62c0ca3a0 msgr2=0x7fb62c0ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:09.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.848+0000 7fb62b59e640 1 --2- 172.21.15.59:0/2367728793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb62c0ca3a0 0x7fb62c0ce9b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb6140097a0 tx=0x7fb61402b8b0 comp rx=0 tx=0).stop 2023-10-16T14:27:09.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.848+0000 7fb62b59e640 1 -- 172.21.15.59:0/2367728793 shutdown_connections 2023-10-16T14:27:09.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.848+0000 7fb62b59e640 1 --2- 172.21.15.59:0/2367728793 >> v2:172.21.15.151:3300/0 conn(0x7fb62c0ccae0 0x7fb62c0ceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:09.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.848+0000 7fb62b59e640 1 --2- 172.21.15.59:0/2367728793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb62c0ca3a0 0x7fb62c0ce9b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:09.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.848+0000 7fb62b59e640 1 -- 172.21.15.59:0/2367728793 >> 172.21.15.59:0/2367728793 conn(0x7fb62c06a200 msgr2=0x7fb62c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.848+0000 7fb62b59e640 1 -- 172.21.15.59:0/2367728793 shutdown_connections 2023-10-16T14:27:09.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.848+0000 7fb62b59e640 1 -- 172.21.15.59:0/2367728793 wait complete. 2023-10-16T14:27:09.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.850+0000 7fb62b59e640 1 Processor -- start 2023-10-16T14:27:09.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.850+0000 7fb62b59e640 1 -- start start 2023-10-16T14:27:09.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.852+0000 7fb62b59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb62c0ad940 0x7fb62c15c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:09.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.852+0000 7fb62b59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb62c0ca3a0 0x7fb62c15c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:09.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.852+0000 7fb62b59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb62c0ccae0 0x7fb62c154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:09.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.852+0000 7fb62b59e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c0b08d0 con 0x7fb62c0ad940 2023-10-16T14:27:09.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.852+0000 7fb62b59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c070780 con 0x7fb62c0ccae0 2023-10-16T14:27:09.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.852+0000 7fb62b59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c070a60 con 0x7fb62c0ca3a0 2023-10-16T14:27:09.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.852+0000 7fb62a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb62c0ad940 0x7fb62c15c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:09.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.852+0000 7fb62a59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb62c0ad940 0x7fb62c15c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55434/0 (socket says 172.21.15.59:55434) 2023-10-16T14:27:09.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.852+0000 7fb62a59c640 1 -- 172.21.15.59:0/415674654 learned_addr learned my addr 172.21.15.59:0/415674654 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:09.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.852+0000 7fb62ad9d640 1 --2- 172.21.15.59:0/415674654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb62c0ccae0 0x7fb62c154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:09.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.853+0000 7fb621d9b640 1 --2- 172.21.15.59:0/415674654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb62c0ca3a0 0x7fb62c15c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:09.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.853+0000 7fb62a59c640 1 -- 172.21.15.59:0/415674654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb62c0ca3a0 msgr2=0x7fb62c15c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:09.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.853+0000 7fb62a59c640 1 --2- 172.21.15.59:0/415674654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb62c0ca3a0 0x7fb62c15c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:09.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.853+0000 7fb62a59c640 1 -- 172.21.15.59:0/415674654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb62c0ccae0 msgr2=0x7fb62c154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:09.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.853+0000 7fb62a59c640 1 --2- 172.21.15.59:0/415674654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb62c0ccae0 0x7fb62c154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:09.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.853+0000 7fb62a59c640 1 -- 172.21.15.59:0/415674654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb614009400 con 0x7fb62c0ad940 2023-10-16T14:27:09.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.853+0000 7fb62a59c640 1 --2- 172.21.15.59:0/415674654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb62c0ad940 0x7fb62c15c000 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00c480 tx=0x7fb61c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:09.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.853+0000 7fb6237fe640 1 -- 172.21.15.59:0/415674654 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c005ce0 con 0x7fb62c0ad940 2023-10-16T14:27:09.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.853+0000 7fb6237fe640 1 -- 172.21.15.59:0/415674654 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61c005e40 con 0x7fb62c0ad940 2023-10-16T14:27:09.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.853+0000 7fb6237fe640 1 -- 172.21.15.59:0/415674654 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c0072f0 con 0x7fb62c0ad940 2023-10-16T14:27:09.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.853+0000 7fb62b59e640 1 -- 172.21.15.59:0/415674654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62c0afdf0 con 0x7fb62c0ad940 2023-10-16T14:27:09.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.854+0000 7fb62b59e640 1 -- 172.21.15.59:0/415674654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62c0b03b0 con 0x7fb62c0ad940 2023-10-16T14:27:09.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.855+0000 7fb62b59e640 1 -- 172.21.15.59:0/415674654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62c0b05a0 con 0x7fb62c0ad940 2023-10-16T14:27:09.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.856+0000 7fb6237fe640 1 -- 172.21.15.59:0/415674654 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb61c007450 con 0x7fb62c0ad940 2023-10-16T14:27:09.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.857+0000 7fb6237fe640 1 --2- 172.21.15.59:0/415674654 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb60c06aea0 0x7fb60c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:09.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.857+0000 7fb6237fe640 1 -- 172.21.15.59:0/415674654 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fb61c088d70 con 0x7fb62c0ad940 2023-10-16T14:27:09.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.857+0000 7fb621d9b640 1 --2- 172.21.15.59:0/415674654 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb60c06aea0 0x7fb60c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:09.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.859+0000 7fb621d9b640 1 --2- 172.21.15.59:0/415674654 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb60c06aea0 0x7fb60c06d360 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb614036000 tx=0x7fb61403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:09.863+0000 7fb6237fe640 1 -- 172.21.15.59:0/415674654 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb61c0576c0 con 0x7fb62c0ad940 2023-10-16T14:27:10.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.059+0000 7fb62b59e640 1 -- 172.21.15.59:0/415674654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb62c04e9b0 con 0x7fb62c0ad940 2023-10-16T14:27:10.064 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.060+0000 7fb6237fe640 1 -- 172.21.15.59:0/415674654 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb61c017020 con 0x7fb62c0ad940 2023-10-16T14:27:10.064 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-16T14:27:10.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.063+0000 7fb62b59e640 1 -- 172.21.15.59:0/415674654 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb60c06aea0 msgr2=0x7fb60c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:10.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.063+0000 7fb62b59e640 1 --2- 172.21.15.59:0/415674654 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb60c06aea0 0x7fb60c06d360 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb614036000 tx=0x7fb61403c040 comp rx=0 tx=0).stop 2023-10-16T14:27:10.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.063+0000 7fb62b59e640 1 -- 172.21.15.59:0/415674654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb62c0ad940 msgr2=0x7fb62c15c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:10.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.063+0000 7fb62b59e640 1 --2- 172.21.15.59:0/415674654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb62c0ad940 0x7fb62c15c000 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00c480 tx=0x7fb61c00c940 comp rx=0 tx=0).stop 2023-10-16T14:27:10.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.063+0000 7fb62b59e640 1 -- 172.21.15.59:0/415674654 shutdown_connections 2023-10-16T14:27:10.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.064+0000 7fb62b59e640 1 --2- 172.21.15.59:0/415674654 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb60c06aea0 0x7fb60c06d360 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.064+0000 7fb62b59e640 1 --2- 172.21.15.59:0/415674654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb62c0ccae0 0x7fb62c154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.064+0000 7fb62b59e640 1 --2- 172.21.15.59:0/415674654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb62c0ca3a0 0x7fb62c15c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.064+0000 7fb62b59e640 1 --2- 172.21.15.59:0/415674654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb62c0ad940 0x7fb62c15c000 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.064+0000 7fb62b59e640 1 -- 172.21.15.59:0/415674654 >> 172.21.15.59:0/415674654 conn(0x7fb62c06a200 msgr2=0x7fb62c0c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.064+0000 7fb62b59e640 1 -- 172.21.15.59:0/415674654 shutdown_connections 2023-10-16T14:27:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.064+0000 7fb62b59e640 1 -- 172.21.15.59:0/415674654 wait complete. 2023-10-16T14:27:10.086 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T14:27:10.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.315+0000 7f194a4bb640 1 Processor -- start 2023-10-16T14:27:10.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.315+0000 7f194a4bb640 1 -- start start 2023-10-16T14:27:10.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.316+0000 7f194a4bb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19440cf030 0x7f194406ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:10.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.316+0000 7f194a4bb640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f194406d360 0x7f19440ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:10.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.316+0000 7f194a4bb640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19441550f0 con 0x7f1944154d10 2023-10-16T14:27:10.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.316+0000 7f194a4bb640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194406db50 con 0x7f194406d360 2023-10-16T14:27:10.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.316+0000 7f194a4bb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19440b13f0 con 0x7f19440cf030 2023-10-16T14:27:10.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.316+0000 7f19494b9640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1944154d10 0x7f19440ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47934/0 (socket says 172.21.15.59:47934) 2023-10-16T14:27:10.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.316+0000 7f19494b9640 1 -- 172.21.15.59:0/45500368 learned_addr learned my addr 172.21.15.59:0/45500368 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:10.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.316+0000 7f1949cba640 1 --2- 172.21.15.59:0/45500368 >> v2:172.21.15.59:3300/0 conn(0x7f194406d360 0x7f19440ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:10.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.317+0000 7f1948cb8640 1 --2- 172.21.15.59:0/45500368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19440cf030 0x7f194406ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:10.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.317+0000 7f193bfff640 1 -- 172.21.15.59:0/45500368 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152468366 0 0) 0x7f19441550f0 con 0x7f1944154d10 2023-10-16T14:27:10.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.317+0000 7f193bfff640 1 -- 172.21.15.59:0/45500368 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1930003520 con 0x7f1944154d10 2023-10-16T14:27:10.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.317+0000 7f1949cba640 1 -- 172.21.15.59:0/45500368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19440cf030 msgr2=0x7f194406ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:10.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.317+0000 7f1949cba640 1 --2- 172.21.15.59:0/45500368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19440cf030 0x7f194406ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.317+0000 7f1949cba640 1 -- 172.21.15.59:0/45500368 >> v1:172.21.15.59:6789/0 conn(0x7f1944154d10 legacy=0x7f19440ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:10.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.317+0000 7f1949cba640 1 -- 172.21.15.59:0/45500368 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19440b16d0 con 0x7f194406d360 2023-10-16T14:27:10.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.318+0000 7f1949cba640 1 --2- 172.21.15.59:0/45500368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f194406d360 0x7f19440ac1d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f193c0097a0 tx=0x7f193c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d275c3b619341cfa server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:10.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.319+0000 7f193bfff640 1 -- 172.21.15.59:0/45500368 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c02d040 con 0x7f194406d360 2023-10-16T14:27:10.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.319+0000 7f193bfff640 1 -- 172.21.15.59:0/45500368 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c031810 con 0x7f194406d360 2023-10-16T14:27:10.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.319+0000 7f193bfff640 1 -- 172.21.15.59:0/45500368 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c031b80 con 0x7f194406d360 2023-10-16T14:27:10.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.319+0000 7f194a4bb640 1 -- 172.21.15.59:0/45500368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f194406d360 msgr2=0x7f19440ac1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:10.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.319+0000 7f194a4bb640 1 --2- 172.21.15.59:0/45500368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f194406d360 0x7f19440ac1d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f193c0097a0 tx=0x7f193c02b8b0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.319+0000 7f194a4bb640 1 -- 172.21.15.59:0/45500368 shutdown_connections 2023-10-16T14:27:10.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.319+0000 7f194a4bb640 1 --2- 172.21.15.59:0/45500368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f194406d360 0x7f19440ac1d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.319+0000 7f194a4bb640 1 --2- 172.21.15.59:0/45500368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19440cf030 0x7f194406ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.319+0000 7f194a4bb640 1 -- 172.21.15.59:0/45500368 >> 172.21.15.59:0/45500368 conn(0x7f194406a200 msgr2=0x7f194406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:10.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.320+0000 7f194a4bb640 1 -- 172.21.15.59:0/45500368 shutdown_connections 2023-10-16T14:27:10.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.320+0000 7f194a4bb640 1 -- 172.21.15.59:0/45500368 wait complete. 2023-10-16T14:27:10.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.321+0000 7f194a4bb640 1 Processor -- start 2023-10-16T14:27:10.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.321+0000 7f194a4bb640 1 -- start start 2023-10-16T14:27:10.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.322+0000 7f194a4bb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f194406d360 0x7f19440c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:10.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.322+0000 7f194a4bb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19440cf030 0x7f1944154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:10.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.322+0000 7f194a4bb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1944154d10 0x7f19441550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:10.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.322+0000 7f194a4bb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19440c5c50 con 0x7f1944154d10 2023-10-16T14:27:10.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.322+0000 7f194a4bb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1944154850 con 0x7f194406d360 2023-10-16T14:27:10.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.322+0000 7f194a4bb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1944158c80 con 0x7f19440cf030 2023-10-16T14:27:10.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.323+0000 7f1949cba640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1944154d10 0x7f19441550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:10.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.323+0000 7f1949cba640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1944154d10 0x7f19441550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55444/0 (socket says 172.21.15.59:55444) 2023-10-16T14:27:10.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.323+0000 7f1949cba640 1 -- 172.21.15.59:0/1383318925 learned_addr learned my addr 172.21.15.59:0/1383318925 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:10.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.323+0000 7f1948cb8640 1 --2- 172.21.15.59:0/1383318925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19440cf030 0x7f1944154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:10.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.323+0000 7f19494b9640 1 --2- 172.21.15.59:0/1383318925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f194406d360 0x7f19440c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:10.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.323+0000 7f1949cba640 1 -- 172.21.15.59:0/1383318925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19440cf030 msgr2=0x7f1944154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:10.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.323+0000 7f1949cba640 1 --2- 172.21.15.59:0/1383318925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19440cf030 0x7f1944154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.323+0000 7f1949cba640 1 -- 172.21.15.59:0/1383318925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f194406d360 msgr2=0x7f19440c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:10.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.323+0000 7f1949cba640 1 --2- 172.21.15.59:0/1383318925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f194406d360 0x7f19440c5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.323+0000 7f1949cba640 1 -- 172.21.15.59:0/1383318925 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c009400 con 0x7f1944154d10 2023-10-16T14:27:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.323+0000 7f1948cb8640 1 --2- 172.21.15.59:0/1383318925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19440cf030 0x7f1944154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.324+0000 7f1949cba640 1 --2- 172.21.15.59:0/1383318925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1944154d10 0x7f19441550f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f193c02bec0 tx=0x7f193c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.324+0000 7f1939ffb640 1 -- 172.21.15.59:0/1383318925 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c003820 con 0x7f1944154d10 2023-10-16T14:27:10.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.324+0000 7f1939ffb640 1 -- 172.21.15.59:0/1383318925 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c03f070 con 0x7f1944154d10 2023-10-16T14:27:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.324+0000 7f1939ffb640 1 -- 172.21.15.59:0/1383318925 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c003ba0 con 0x7f1944154d10 2023-10-16T14:27:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.324+0000 7f194a4bb640 1 -- 172.21.15.59:0/1383318925 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1944156020 con 0x7f1944154d10 2023-10-16T14:27:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.324+0000 7f194a4bb640 1 -- 172.21.15.59:0/1383318925 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1944155d40 con 0x7f1944154d10 2023-10-16T14:27:10.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.325+0000 7f194a4bb640 1 -- 172.21.15.59:0/1383318925 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194404e9b0 con 0x7f1944154d10 2023-10-16T14:27:10.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.326+0000 7f1939ffb640 1 -- 172.21.15.59:0/1383318925 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f193c003d00 con 0x7f1944154d10 2023-10-16T14:27:10.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.328+0000 7f1939ffb640 1 --2- 172.21.15.59:0/1383318925 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f192806aec0 0x7f192806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:10.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.328+0000 7f1939ffb640 1 -- 172.21.15.59:0/1383318925 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f193c041070 con 0x7f1944154d10 2023-10-16T14:27:10.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.328+0000 7f19494b9640 1 --2- 172.21.15.59:0/1383318925 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f192806aec0 0x7f192806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:10.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.330+0000 7f19494b9640 1 --2- 172.21.15.59:0/1383318925 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f192806aec0 0x7f192806d380 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f19400011e0 tx=0x7f1940009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:10.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.332+0000 7f1939ffb640 1 -- 172.21.15.59:0/1383318925 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f193c076960 con 0x7f1944154d10 2023-10-16T14:27:10.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.524+0000 7f194a4bb640 1 -- 172.21.15.59:0/1383318925 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1944158dc0 con 0x7f1944154d10 2023-10-16T14:27:10.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.526+0000 7f1939ffb640 1 -- 172.21.15.59:0/1383318925 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f193c079f80 con 0x7f1944154d10 2023-10-16T14:27:10.529 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:27:10.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.528+0000 7f194a4bb640 1 -- 172.21.15.59:0/1383318925 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f192806aec0 msgr2=0x7f192806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:10.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.528+0000 7f194a4bb640 1 --2- 172.21.15.59:0/1383318925 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f192806aec0 0x7f192806d380 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f19400011e0 tx=0x7f1940009040 comp rx=0 tx=0).stop 2023-10-16T14:27:10.532 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.528+0000 7f194a4bb640 1 -- 172.21.15.59:0/1383318925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1944154d10 msgr2=0x7f19441550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:10.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.528+0000 7f194a4bb640 1 --2- 172.21.15.59:0/1383318925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1944154d10 0x7f19441550f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f193c02bec0 tx=0x7f193c0046c0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.528+0000 7f194a4bb640 1 -- 172.21.15.59:0/1383318925 shutdown_connections 2023-10-16T14:27:10.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.528+0000 7f194a4bb640 1 --2- 172.21.15.59:0/1383318925 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f192806aec0 0x7f192806d380 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.533 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.528+0000 7f194a4bb640 1 --2- 172.21.15.59:0/1383318925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1944154d10 0x7f19441550f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.528+0000 7f194a4bb640 1 --2- 172.21.15.59:0/1383318925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f19440cf030 0x7f1944154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.528+0000 7f194a4bb640 1 --2- 172.21.15.59:0/1383318925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f194406d360 0x7f19440c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.528+0000 7f194a4bb640 1 -- 172.21.15.59:0/1383318925 >> 172.21.15.59:0/1383318925 conn(0x7f194406a200 msgr2=0x7f194406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:10.534 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.528+0000 7f194a4bb640 1 -- 172.21.15.59:0/1383318925 shutdown_connections 2023-10-16T14:27:10.535 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.528+0000 7f194a4bb640 1 -- 172.21.15.59:0/1383318925 wait complete. 2023-10-16T14:27:10.550 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T14:27:10.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.774+0000 7f1438d6a640 1 Processor -- start 2023-10-16T14:27:10.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.775+0000 7f1438d6a640 1 -- start start 2023-10-16T14:27:10.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.776+0000 7f1438d6a640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1434157040 0x7f143406d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:10.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.776+0000 7f1438d6a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14340cd950 0x7f14340cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:10.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.776+0000 7f1438d6a640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143406d4c0 con 0x7f14340ce600 2023-10-16T14:27:10.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.776+0000 7f1438d6a640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14340cdde0 con 0x7f1434157040 2023-10-16T14:27:10.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.776+0000 7f1438d6a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14340cefc0 con 0x7f14340cd950 2023-10-16T14:27:10.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.777+0000 7f142bfff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f14340ce600 0x7f14340cd240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47942/0 (socket says 172.21.15.59:47942) 2023-10-16T14:27:10.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.777+0000 7f142bfff640 1 -- 172.21.15.59:0/3250107011 learned_addr learned my addr 172.21.15.59:0/3250107011 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:10.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.777+0000 7f14337fe640 1 --2- 172.21.15.59:0/3250107011 >> v2:172.21.15.59:3300/0 conn(0x7f1434157040 0x7f143406d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:10.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.777+0000 7f1433fff640 1 --2- 172.21.15.59:0/3250107011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14340cd950 0x7f14340cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:10.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.777+0000 7f1432ffd640 1 -- 172.21.15.59:0/3250107011 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276278719 0 0) 0x7f143406d4c0 con 0x7f14340ce600 2023-10-16T14:27:10.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.777+0000 7f1432ffd640 1 -- 172.21.15.59:0/3250107011 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1420003520 con 0x7f14340ce600 2023-10-16T14:27:10.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.777+0000 7f14337fe640 1 -- 172.21.15.59:0/3250107011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14340cd950 msgr2=0x7f14340cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:10.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.777+0000 7f14337fe640 1 --2- 172.21.15.59:0/3250107011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14340cd950 0x7f14340cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.777+0000 7f14337fe640 1 -- 172.21.15.59:0/3250107011 >> v1:172.21.15.59:6789/0 conn(0x7f14340ce600 legacy=0x7f14340cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:10.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.777+0000 7f14337fe640 1 -- 172.21.15.59:0/3250107011 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143406de90 con 0x7f1434157040 2023-10-16T14:27:10.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.779+0000 7f14337fe640 1 --2- 172.21.15.59:0/3250107011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1434157040 0x7f143406d950 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1424009790 tx=0x7f142402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c113ccaf717a0e1f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:10.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.779+0000 7f1432ffd640 1 -- 172.21.15.59:0/3250107011 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424031800 con 0x7f1434157040 2023-10-16T14:27:10.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.779+0000 7f1432ffd640 1 -- 172.21.15.59:0/3250107011 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1424031960 con 0x7f1434157040 2023-10-16T14:27:10.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.779+0000 7f1432ffd640 1 -- 172.21.15.59:0/3250107011 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424031cd0 con 0x7f1434157040 2023-10-16T14:27:10.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.780+0000 7f1438d6a640 1 -- 172.21.15.59:0/3250107011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1434157040 msgr2=0x7f143406d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:10.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.780+0000 7f1438d6a640 1 --2- 172.21.15.59:0/3250107011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1434157040 0x7f143406d950 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1424009790 tx=0x7f142402b8a0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.780+0000 7f1438d6a640 1 -- 172.21.15.59:0/3250107011 shutdown_connections 2023-10-16T14:27:10.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.780+0000 7f1438d6a640 1 --2- 172.21.15.59:0/3250107011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14340cd950 0x7f14340cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.780+0000 7f1438d6a640 1 --2- 172.21.15.59:0/3250107011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1434157040 0x7f143406d950 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.780+0000 7f1438d6a640 1 -- 172.21.15.59:0/3250107011 >> 172.21.15.59:0/3250107011 conn(0x7f1434069fc0 msgr2=0x7f143406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:10.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.780+0000 7f1438d6a640 1 -- 172.21.15.59:0/3250107011 shutdown_connections 2023-10-16T14:27:10.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.780+0000 7f1438d6a640 1 -- 172.21.15.59:0/3250107011 wait complete. 2023-10-16T14:27:10.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.781+0000 7f1438d6a640 1 Processor -- start 2023-10-16T14:27:10.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.782+0000 7f1438d6a640 1 -- start start 2023-10-16T14:27:10.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.783+0000 7f1438d6a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14340cd950 0x7f14341f2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:10.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.783+0000 7f1438d6a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14340ce600 0x7f14340cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:10.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.783+0000 7f1438d6a640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1434157040 0x7f14340ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:10.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.783+0000 7f1438d6a640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14340c6c20 con 0x7f1434157040 2023-10-16T14:27:10.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.783+0000 7f1438d6a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14340ac900 con 0x7f14340ce600 2023-10-16T14:27:10.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.783+0000 7f1438d6a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14341f2720 con 0x7f14340cd950 2023-10-16T14:27:10.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.783+0000 7f1433fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1434157040 0x7f14340ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:10.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.783+0000 7f1433fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1434157040 0x7f14340ab9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55458/0 (socket says 172.21.15.59:55458) 2023-10-16T14:27:10.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.783+0000 7f1433fff640 1 -- 172.21.15.59:0/1988041904 learned_addr learned my addr 172.21.15.59:0/1988041904 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:10.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.783+0000 7f14337fe640 1 --2- 172.21.15.59:0/1988041904 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14340cd950 0x7f14341f2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:10.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.783+0000 7f142bfff640 1 --2- 172.21.15.59:0/1988041904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14340ce600 0x7f14340cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:10.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.783+0000 7f1433fff640 1 -- 172.21.15.59:0/1988041904 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14340cd950 msgr2=0x7f14341f2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:10.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.783+0000 7f1433fff640 1 --2- 172.21.15.59:0/1988041904 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14340cd950 0x7f14341f2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.783+0000 7f1433fff640 1 -- 172.21.15.59:0/1988041904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14340ce600 msgr2=0x7f14340cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:10.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.783+0000 7f1433fff640 1 --2- 172.21.15.59:0/1988041904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14340ce600 0x7f14340cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:10.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.783+0000 7f1433fff640 1 -- 172.21.15.59:0/1988041904 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14240093a0 con 0x7f1434157040 2023-10-16T14:27:10.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.783+0000 7f142bfff640 1 --2- 172.21.15.59:0/1988041904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14340ce600 0x7f14340cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:10.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.784+0000 7f1433fff640 1 --2- 172.21.15.59:0/1988041904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1434157040 0x7f14340ab9e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f142c007d90 tx=0x7f142c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:10.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.784+0000 7f1430ff9640 1 -- 172.21.15.59:0/1988041904 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c014420 con 0x7f1434157040 2023-10-16T14:27:10.795 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.784+0000 7f1430ff9640 1 -- 172.21.15.59:0/1988041904 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c0145a0 con 0x7f1434157040 2023-10-16T14:27:10.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.784+0000 7f1430ff9640 1 -- 172.21.15.59:0/1988041904 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c014950 con 0x7f1434157040 2023-10-16T14:27:10.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.784+0000 7f1438d6a640 1 -- 172.21.15.59:0/1988041904 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14341f2a00 con 0x7f1434157040 2023-10-16T14:27:10.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.784+0000 7f1438d6a640 1 -- 172.21.15.59:0/1988041904 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14341f2fc0 con 0x7f1434157040 2023-10-16T14:27:10.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.785+0000 7f1438d6a640 1 -- 172.21.15.59:0/1988041904 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14340c6dd0 con 0x7f1434157040 2023-10-16T14:27:10.796 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.786+0000 7f1430ff9640 1 -- 172.21.15.59:0/1988041904 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f142c014ab0 con 0x7f1434157040 2023-10-16T14:27:10.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.787+0000 7f1430ff9640 1 --2- 172.21.15.59:0/1988041904 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f141406ae70 0x7f141406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:10.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.787+0000 7f1430ff9640 1 -- 172.21.15.59:0/1988041904 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f142c08a310 con 0x7f1434157040 2023-10-16T14:27:10.797 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.788+0000 7f14337fe640 1 --2- 172.21.15.59:0/1988041904 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f141406ae70 0x7f141406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:10.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.789+0000 7f14337fe640 1 --2- 172.21.15.59:0/1988041904 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f141406ae70 0x7f141406d330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1424036000 tx=0x7f142403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:10.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.791+0000 7f1430ff9640 1 -- 172.21.15.59:0/1988041904 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f14340c6dd0 con 0x7f1434157040 2023-10-16T14:27:11.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.997+0000 7f1438d6a640 1 -- 172.21.15.59:0/1988041904 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f14340c6dd0 con 0x7f1434157040 2023-10-16T14:27:11.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:10.998+0000 7f1430ff9640 1 -- 172.21.15.59:0/1988041904 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f14340c6dd0 con 0x7f1434157040 2023-10-16T14:27:11.002 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2023-10-16T14:27:11.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.000+0000 7f1438d6a640 1 -- 172.21.15.59:0/1988041904 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f141406ae70 msgr2=0x7f141406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:11.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.000+0000 7f1438d6a640 1 --2- 172.21.15.59:0/1988041904 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f141406ae70 0x7f141406d330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1424036000 tx=0x7f142403c040 comp rx=0 tx=0).stop 2023-10-16T14:27:11.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.000+0000 7f1438d6a640 1 -- 172.21.15.59:0/1988041904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1434157040 msgr2=0x7f14340ab9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:11.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.000+0000 7f1438d6a640 1 --2- 172.21.15.59:0/1988041904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1434157040 0x7f14340ab9e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f142c007d90 tx=0x7f142c00e4b0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.001+0000 7f1438d6a640 1 -- 172.21.15.59:0/1988041904 shutdown_connections 2023-10-16T14:27:11.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.001+0000 7f1438d6a640 1 --2- 172.21.15.59:0/1988041904 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f141406ae70 0x7f141406d330 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.001+0000 7f1438d6a640 1 --2- 172.21.15.59:0/1988041904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1434157040 0x7f14340ab9e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.001+0000 7f1438d6a640 1 --2- 172.21.15.59:0/1988041904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14340ce600 0x7f14340cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.001+0000 7f1438d6a640 1 --2- 172.21.15.59:0/1988041904 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14340cd950 0x7f14341f2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.001+0000 7f1438d6a640 1 -- 172.21.15.59:0/1988041904 >> 172.21.15.59:0/1988041904 conn(0x7f1434069fc0 msgr2=0x7f143415f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:11.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.001+0000 7f1438d6a640 1 -- 172.21.15.59:0/1988041904 shutdown_connections 2023-10-16T14:27:11.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.001+0000 7f1438d6a640 1 -- 172.21.15.59:0/1988041904 wait complete. 2023-10-16T14:27:11.022 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T14:27:11.022 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T14:27:11.086 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:27:11.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.309+0000 7f0d3d711640 1 Processor -- start 2023-10-16T14:27:11.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.309+0000 7f0d3d711640 1 -- start start 2023-10-16T14:27:11.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.310+0000 7f0d3d711640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d3815c9d0 0x7f0d380cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:11.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.310+0000 7f0d3d711640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0d380d16a0 0x7f0d380cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:11.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.310+0000 7f0d3d711640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d380b2f90 con 0x7f0d380ce4d0 2023-10-16T14:27:11.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.310+0000 7f0d3d711640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d380d0320 con 0x7f0d380d16a0 2023-10-16T14:27:11.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.310+0000 7f0d3d711640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d380d0600 con 0x7f0d3815c9d0 2023-10-16T14:27:11.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.311+0000 7f0d3cf10640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0d380ce4d0 0x7f0d38160530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47952/0 (socket says 172.21.15.59:47952) 2023-10-16T14:27:11.315 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.311+0000 7f0d3cf10640 1 -- 172.21.15.59:0/1720598765 learned_addr learned my addr 172.21.15.59:0/1720598765 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:11.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.311+0000 7f0d377fe640 1 --2- 172.21.15.59:0/1720598765 >> v2:172.21.15.151:3300/0 conn(0x7f0d380d16a0 0x7f0d380cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:11.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.311+0000 7f0d36ffd640 1 -- 172.21.15.59:0/1720598765 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625212381 0 0) 0x7f0d380b2f90 con 0x7f0d380ce4d0 2023-10-16T14:27:11.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.311+0000 7f0d36ffd640 1 -- 172.21.15.59:0/1720598765 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d24003520 con 0x7f0d380ce4d0 2023-10-16T14:27:11.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.311+0000 7f0d37fff640 1 --2- 172.21.15.59:0/1720598765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d3815c9d0 0x7f0d380cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:11.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.312+0000 7f0d36ffd640 1 -- 172.21.15.59:0/1720598765 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1821957154 0 0) 0x7f0d24003520 con 0x7f0d380ce4d0 2023-10-16T14:27:11.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.312+0000 7f0d36ffd640 1 -- 172.21.15.59:0/1720598765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d3815c9d0 msgr2=0x7f0d380cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:11.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.312+0000 7f0d36ffd640 1 --2- 172.21.15.59:0/1720598765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d3815c9d0 0x7f0d380cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.312+0000 7f0d36ffd640 1 -- 172.21.15.59:0/1720598765 >> v2:172.21.15.151:3300/0 conn(0x7f0d380d16a0 msgr2=0x7f0d380cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:11.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.312+0000 7f0d36ffd640 1 --2- 172.21.15.59:0/1720598765 >> v2:172.21.15.151:3300/0 conn(0x7f0d380d16a0 0x7f0d380cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.312+0000 7f0d36ffd640 1 -- 172.21.15.59:0/1720598765 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d380d08e0 con 0x7f0d380ce4d0 2023-10-16T14:27:11.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.312+0000 7f0d36ffd640 1 -- 172.21.15.59:0/1720598765 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f0d300019f0 con 0x7f0d380ce4d0 2023-10-16T14:27:11.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.312+0000 7f0d37fff640 1 --2- 172.21.15.59:0/1720598765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d3815c9d0 0x7f0d380cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:27:11.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.312+0000 7f0d36ffd640 1 -- 172.21.15.59:0/1720598765 >> v1:172.21.15.59:6789/0 conn(0x7f0d380ce4d0 legacy=0x7f0d38160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:11.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.312+0000 7f0d36ffd640 1 --2- 172.21.15.59:0/1720598765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d24003970 0x7f0d24003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:11.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.312+0000 7f0d36ffd640 1 --2- 172.21.15.59:0/1720598765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d240047c0 0x7f0d24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:11.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.312+0000 7f0d36ffd640 1 --2- 172.21.15.59:0/1720598765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d3815c9d0 0x7f0d24005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:11.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.312+0000 7f0d36ffd640 1 -- 172.21.15.59:0/1720598765 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d380d0320 con 0x7f0d240047c0 2023-10-16T14:27:11.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.312+0000 7f0d36ffd640 1 -- 172.21.15.59:0/1720598765 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d380d0600 con 0x7f0d24003970 2023-10-16T14:27:11.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.312+0000 7f0d36ffd640 1 -- 172.21.15.59:0/1720598765 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2400b980 con 0x7f0d3815c9d0 2023-10-16T14:27:11.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.312+0000 7f0d377fe640 1 --2- 172.21.15.59:0/1720598765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d240047c0 0x7f0d24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:11.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.313+0000 7f0d37fff640 1 --2- 172.21.15.59:0/1720598765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d24003970 0x7f0d24003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:11.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.313+0000 7f0d3cf10640 1 --2- 172.21.15.59:0/1720598765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d3815c9d0 0x7f0d24005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:11.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.313+0000 7f0d377fe640 1 -- 172.21.15.59:0/1720598765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d3815c9d0 msgr2=0x7f0d24005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:11.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.313+0000 7f0d377fe640 1 --2- 172.21.15.59:0/1720598765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d3815c9d0 0x7f0d24005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.313+0000 7f0d377fe640 1 -- 172.21.15.59:0/1720598765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d24003970 msgr2=0x7f0d24003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:11.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.313+0000 7f0d377fe640 1 --2- 172.21.15.59:0/1720598765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d24003970 0x7f0d24003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.313+0000 7f0d377fe640 1 -- 172.21.15.59:0/1720598765 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d24003520 con 0x7f0d240047c0 2023-10-16T14:27:11.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.313+0000 7f0d37fff640 1 --2- 172.21.15.59:0/1720598765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d24003970 0x7f0d24003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:11.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.314+0000 7f0d377fe640 1 --2- 172.21.15.59:0/1720598765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d240047c0 0x7f0d24004c40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009af0 tx=0x7f0d240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4c581ddd2996e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:11.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.314+0000 7f0d36ffd640 1 -- 172.21.15.59:0/1720598765 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2002c710 con 0x7f0d240047c0 2023-10-16T14:27:11.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.314+0000 7f0d36ffd640 1 -- 172.21.15.59:0/1720598765 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2002c870 con 0x7f0d240047c0 2023-10-16T14:27:11.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.314+0000 7f0d36ffd640 1 -- 172.21.15.59:0/1720598765 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2002cc00 con 0x7f0d240047c0 2023-10-16T14:27:11.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.315+0000 7f0d3d711640 1 -- 172.21.15.59:0/1720598765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d240047c0 msgr2=0x7f0d24004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:11.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.315+0000 7f0d3d711640 1 --2- 172.21.15.59:0/1720598765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d240047c0 0x7f0d24004c40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009af0 tx=0x7f0d240057f0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.315+0000 7f0d3cf10640 1 -- 172.21.15.59:0/1720598765 reap_dead start 2023-10-16T14:27:11.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.315+0000 7f0d3d711640 1 -- 172.21.15.59:0/1720598765 shutdown_connections 2023-10-16T14:27:11.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.315+0000 7f0d3d711640 1 -- 172.21.15.59:0/1720598765 >> 172.21.15.59:0/1720598765 conn(0x7f0d3809bad0 msgr2=0x7f0d380d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:11.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.315+0000 7f0d3d711640 1 -- 172.21.15.59:0/1720598765 shutdown_connections 2023-10-16T14:27:11.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.315+0000 7f0d3d711640 1 -- 172.21.15.59:0/1720598765 wait complete. 2023-10-16T14:27:11.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.317+0000 7f0d3d711640 1 Processor -- start 2023-10-16T14:27:11.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.317+0000 7f0d3d711640 1 -- start start 2023-10-16T14:27:11.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.318+0000 7f0d3d711640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d240047c0 0x7f0d38149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:11.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.318+0000 7f0d3d711640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d380cb9b0 0x7f0d380cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:11.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.318+0000 7f0d3d711640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d38149ec0 0x7f0d3814a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:11.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.318+0000 7f0d3d711640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3814a880 con 0x7f0d38149ec0 2023-10-16T14:27:11.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.318+0000 7f0d3d711640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d38149c50 con 0x7f0d380cb9b0 2023-10-16T14:27:11.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.318+0000 7f0d3d711640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d380cb520 con 0x7f0d240047c0 2023-10-16T14:27:11.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.319+0000 7f0d3cf10640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d38149ec0 0x7f0d3814a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:11.331 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.319+0000 7f0d3cf10640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d38149ec0 0x7f0d3814a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55468/0 (socket says 172.21.15.59:55468) 2023-10-16T14:27:11.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.319+0000 7f0d3cf10640 1 -- 172.21.15.59:0/4095174018 learned_addr learned my addr 172.21.15.59:0/4095174018 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:11.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.319+0000 7f0d377fe640 1 --2- 172.21.15.59:0/4095174018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d380cb9b0 0x7f0d380cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:11.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.319+0000 7f0d37fff640 1 --2- 172.21.15.59:0/4095174018 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d240047c0 0x7f0d38149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:11.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.319+0000 7f0d3cf10640 1 -- 172.21.15.59:0/4095174018 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d240047c0 msgr2=0x7f0d38149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:11.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.319+0000 7f0d3cf10640 1 --2- 172.21.15.59:0/4095174018 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d240047c0 0x7f0d38149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.319+0000 7f0d3cf10640 1 -- 172.21.15.59:0/4095174018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d380cb9b0 msgr2=0x7f0d380cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:11.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.319+0000 7f0d3cf10640 1 --2- 172.21.15.59:0/4095174018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d380cb9b0 0x7f0d380cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.319+0000 7f0d3cf10640 1 -- 172.21.15.59:0/4095174018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d380ca910 con 0x7f0d38149ec0 2023-10-16T14:27:11.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.319+0000 7f0d377fe640 1 --2- 172.21.15.59:0/4095174018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d380cb9b0 0x7f0d380cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:11.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.319+0000 7f0d37fff640 1 --2- 172.21.15.59:0/4095174018 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d240047c0 0x7f0d38149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:11.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.319+0000 7f0d3cf10640 1 --2- 172.21.15.59:0/4095174018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d38149ec0 0x7f0d3814a340 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0d380d26b0 tx=0x7f0d3000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:11.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.320+0000 7f0d34ff9640 1 -- 172.21.15.59:0/4095174018 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30004d60 con 0x7f0d38149ec0 2023-10-16T14:27:11.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.320+0000 7f0d34ff9640 1 -- 172.21.15.59:0/4095174018 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3000bb20 con 0x7f0d38149ec0 2023-10-16T14:27:11.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.320+0000 7f0d34ff9640 1 -- 172.21.15.59:0/4095174018 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3000bed0 con 0x7f0d38149ec0 2023-10-16T14:27:11.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.320+0000 7f0d3d711640 1 -- 172.21.15.59:0/4095174018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d380cabf0 con 0x7f0d38149ec0 2023-10-16T14:27:11.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.320+0000 7f0d3d711640 1 -- 172.21.15.59:0/4095174018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d380cb1b0 con 0x7f0d38149ec0 2023-10-16T14:27:11.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.321+0000 7f0d3d711640 1 -- 172.21.15.59:0/4095174018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3804e9b0 con 0x7f0d38149ec0 2023-10-16T14:27:11.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.322+0000 7f0d34ff9640 1 -- 172.21.15.59:0/4095174018 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0d30007070 con 0x7f0d38149ec0 2023-10-16T14:27:11.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.323+0000 7f0d34ff9640 1 --2- 172.21.15.59:0/4095174018 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0d1806aea0 0x7f0d1806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:11.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.323+0000 7f0d34ff9640 1 -- 172.21.15.59:0/4095174018 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f0d30089d10 con 0x7f0d38149ec0 2023-10-16T14:27:11.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.324+0000 7f0d37fff640 1 --2- 172.21.15.59:0/4095174018 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0d1806aea0 0x7f0d1806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:11.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.325+0000 7f0d37fff640 1 --2- 172.21.15.59:0/4095174018 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0d1806aea0 0x7f0d1806d360 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0d28006fd0 tx=0x7f0d28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:11.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.327+0000 7f0d34ff9640 1 -- 172.21.15.59:0/4095174018 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0d30054960 con 0x7f0d38149ec0 2023-10-16T14:27:11.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.519+0000 7f0d3d711640 1 -- 172.21.15.59:0/4095174018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d380cb660 con 0x7f0d38149ec0 2023-10-16T14:27:11.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.521+0000 7f0d34ff9640 1 -- 172.21.15.59:0/4095174018 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18445 (secure 0 0 0) 0x7f0d30057f80 con 0x7f0d38149ec0 2023-10-16T14:27:11.525 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:11.525 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:26:29.634854+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:27:11.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.523+0000 7f0d3d711640 1 -- 172.21.15.59:0/4095174018 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0d1806aea0 msgr2=0x7f0d1806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:11.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.523+0000 7f0d3d711640 1 --2- 172.21.15.59:0/4095174018 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0d1806aea0 0x7f0d1806d360 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0d28006fd0 tx=0x7f0d28008040 comp rx=0 tx=0).stop 2023-10-16T14:27:11.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.523+0000 7f0d3d711640 1 -- 172.21.15.59:0/4095174018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d38149ec0 msgr2=0x7f0d3814a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:11.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.523+0000 7f0d3d711640 1 --2- 172.21.15.59:0/4095174018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d38149ec0 0x7f0d3814a340 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0d380d26b0 tx=0x7f0d3000b4a0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.523+0000 7f0d3d711640 1 -- 172.21.15.59:0/4095174018 shutdown_connections 2023-10-16T14:27:11.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.523+0000 7f0d3d711640 1 --2- 172.21.15.59:0/4095174018 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0d1806aea0 0x7f0d1806d360 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.523+0000 7f0d3d711640 1 --2- 172.21.15.59:0/4095174018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d38149ec0 0x7f0d3814a340 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.523+0000 7f0d3d711640 1 --2- 172.21.15.59:0/4095174018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d380cb9b0 0x7f0d380cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.523+0000 7f0d3d711640 1 --2- 172.21.15.59:0/4095174018 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d240047c0 0x7f0d38149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.523+0000 7f0d3d711640 1 -- 172.21.15.59:0/4095174018 >> 172.21.15.59:0/4095174018 conn(0x7f0d3809bad0 msgr2=0x7f0d380b2360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:11.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.523+0000 7f0d3d711640 1 -- 172.21.15.59:0/4095174018 shutdown_connections 2023-10-16T14:27:11.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.524+0000 7f0d3d711640 1 -- 172.21.15.59:0/4095174018 wait complete. 2023-10-16T14:27:11.544 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T14:25:46.371818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T14:25:47.145341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T14:25:50.758038+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T14:27:11.545 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:27:11.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.771+0000 7fea9753c640 1 Processor -- start 2023-10-16T14:27:11.775 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.772+0000 7fea9753c640 1 -- start start 2023-10-16T14:27:11.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.773+0000 7fea9753c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea900b1a30 0x7fea900cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:11.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.773+0000 7fea9753c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fea9006b570 0x7fea9006ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:11.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.773+0000 7fea9753c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9006bf40 con 0x7fea900d0cd0 2023-10-16T14:27:11.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.773+0000 7fea9753c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea900cfc20 con 0x7fea9006b570 2023-10-16T14:27:11.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.773+0000 7fea9753c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea900cd4a0 con 0x7fea900b1a30 2023-10-16T14:27:11.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.774+0000 7fea96d3b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fea9006b570 0x7fea9006ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:11.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.774+0000 7fea96d3b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fea9006b570 0x7fea9006ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.59:51888/0 (socket says 172.21.15.59:51888) 2023-10-16T14:27:11.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.774+0000 7fea96d3b640 1 -- 172.21.15.59:0/3451643099 learned_addr learned my addr 172.21.15.59:0/3451643099 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:11.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.774+0000 7fea9653a640 1 --2- 172.21.15.59:0/3451643099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea900b1a30 0x7fea900cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:11.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.775+0000 7fea96d3b640 1 -- 172.21.15.59:0/3451643099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea900b1a30 msgr2=0x7fea900cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:11.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.775+0000 7fea96d3b640 1 --2- 172.21.15.59:0/3451643099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea900b1a30 0x7fea900cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.775+0000 7fea96d3b640 1 -- 172.21.15.59:0/3451643099 >> v1:172.21.15.151:6789/0 conn(0x7fea900d0cd0 legacy=0x7fea900d10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:11.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.775+0000 7fea96d3b640 1 -- 172.21.15.59:0/3451643099 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea900cd780 con 0x7fea9006b570 2023-10-16T14:27:11.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.776+0000 7fea96d3b640 1 --2- 172.21.15.59:0/3451643099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea9006b570 0x7fea9006ba00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fea88009e50 tx=0x7fea8802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=480246797ab9dc15 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:11.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.777+0000 7fea95538640 1 -- 172.21.15.59:0/3451643099 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8802cb00 con 0x7fea9006b570 2023-10-16T14:27:11.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.777+0000 7fea95538640 1 -- 172.21.15.59:0/3451643099 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8802cc60 con 0x7fea9006b570 2023-10-16T14:27:11.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.777+0000 7fea95538640 1 -- 172.21.15.59:0/3451643099 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea880343f0 con 0x7fea9006b570 2023-10-16T14:27:11.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.777+0000 7fea9753c640 1 -- 172.21.15.59:0/3451643099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea9006b570 msgr2=0x7fea9006ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:11.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.777+0000 7fea9753c640 1 --2- 172.21.15.59:0/3451643099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea9006b570 0x7fea9006ba00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fea88009e50 tx=0x7fea8802bf60 comp rx=0 tx=0).stop 2023-10-16T14:27:11.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.777+0000 7fea9753c640 1 -- 172.21.15.59:0/3451643099 shutdown_connections 2023-10-16T14:27:11.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.777+0000 7fea9753c640 1 --2- 172.21.15.59:0/3451643099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea9006b570 0x7fea9006ba00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.777+0000 7fea9753c640 1 --2- 172.21.15.59:0/3451643099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea900b1a30 0x7fea900cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.777+0000 7fea9753c640 1 -- 172.21.15.59:0/3451643099 >> 172.21.15.59:0/3451643099 conn(0x7fea9008c140 msgr2=0x7fea9009ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:11.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.778+0000 7fea9753c640 1 -- 172.21.15.59:0/3451643099 shutdown_connections 2023-10-16T14:27:11.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.778+0000 7fea9753c640 1 -- 172.21.15.59:0/3451643099 wait complete. 2023-10-16T14:27:11.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.780+0000 7fea9753c640 1 Processor -- start 2023-10-16T14:27:11.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.780+0000 7fea9753c640 1 -- start start 2023-10-16T14:27:11.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.781+0000 7fea9753c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea9006b570 0x7fea901569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:11.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.781+0000 7fea9753c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea900b1a30 0x7fea900ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:11.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.781+0000 7fea9753c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea900d0cd0 0x7fea900cab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:11.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.781+0000 7fea9753c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea900b7050 con 0x7fea900d0cd0 2023-10-16T14:27:11.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.781+0000 7fea9753c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea900b72a0 con 0x7fea900b1a30 2023-10-16T14:27:11.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.781+0000 7fea9753c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea900b7580 con 0x7fea9006b570 2023-10-16T14:27:11.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.781+0000 7fea96d3b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea900d0cd0 0x7fea900cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:11.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.781+0000 7fea96d3b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea900d0cd0 0x7fea900cab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55476/0 (socket says 172.21.15.59:55476) 2023-10-16T14:27:11.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.781+0000 7fea96d3b640 1 -- 172.21.15.59:0/3506670545 learned_addr learned my addr 172.21.15.59:0/3506670545 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:11.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.782+0000 7fea9653a640 1 --2- 172.21.15.59:0/3506670545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea9006b570 0x7fea901569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:11.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.782+0000 7fea95d39640 1 --2- 172.21.15.59:0/3506670545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea900b1a30 0x7fea900ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:11.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.782+0000 7fea96d3b640 1 -- 172.21.15.59:0/3506670545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea9006b570 msgr2=0x7fea901569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:11.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.782+0000 7fea96d3b640 1 --2- 172.21.15.59:0/3506670545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea9006b570 0x7fea901569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.782+0000 7fea96d3b640 1 -- 172.21.15.59:0/3506670545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea900b1a30 msgr2=0x7fea900ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:11.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.782+0000 7fea96d3b640 1 --2- 172.21.15.59:0/3506670545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea900b1a30 0x7fea900ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.782+0000 7fea96d3b640 1 -- 172.21.15.59:0/3506670545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea88009b30 con 0x7fea900d0cd0 2023-10-16T14:27:11.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.782+0000 7fea95d39640 1 --2- 172.21.15.59:0/3506670545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea900b1a30 0x7fea900ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:27:11.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.782+0000 7fea96d3b640 1 --2- 172.21.15.59:0/3506670545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea900d0cd0 0x7fea900cab20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fea88009e50 tx=0x7fea88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:11.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.783+0000 7fea82ffd640 1 -- 172.21.15.59:0/3506670545 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea88009510 con 0x7fea900d0cd0 2023-10-16T14:27:11.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.783+0000 7fea82ffd640 1 -- 172.21.15.59:0/3506670545 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8803e450 con 0x7fea900d0cd0 2023-10-16T14:27:11.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.783+0000 7fea82ffd640 1 -- 172.21.15.59:0/3506670545 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8803e800 con 0x7fea900d0cd0 2023-10-16T14:27:11.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.783+0000 7fea9753c640 1 -- 172.21.15.59:0/3506670545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea900b7860 con 0x7fea900d0cd0 2023-10-16T14:27:11.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.783+0000 7fea9753c640 1 -- 172.21.15.59:0/3506670545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea900b7e20 con 0x7fea900d0cd0 2023-10-16T14:27:11.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.784+0000 7fea9753c640 1 -- 172.21.15.59:0/3506670545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9004e9b0 con 0x7fea900d0cd0 2023-10-16T14:27:11.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.785+0000 7fea82ffd640 1 -- 172.21.15.59:0/3506670545 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fea8803e960 con 0x7fea900d0cd0 2023-10-16T14:27:11.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.786+0000 7fea82ffd640 1 --2- 172.21.15.59:0/3506670545 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fea7406aea0 0x7fea7406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:11.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.786+0000 7fea82ffd640 1 -- 172.21.15.59:0/3506670545 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fea880ac5e0 con 0x7fea900d0cd0 2023-10-16T14:27:11.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.787+0000 7fea9653a640 1 --2- 172.21.15.59:0/3506670545 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fea7406aea0 0x7fea7406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:11.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.788+0000 7fea9653a640 1 --2- 172.21.15.59:0/3506670545 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fea7406aea0 0x7fea7406d360 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009ad0 tx=0x7fea8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:11.794 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.791+0000 7fea82ffd640 1 -- 172.21.15.59:0/3506670545 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fea880772e0 con 0x7fea900d0cd0 2023-10-16T14:27:11.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.985+0000 7fea9753c640 1 -- 172.21.15.59:0/3506670545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fea900d3120 con 0x7fea900d0cd0 2023-10-16T14:27:11.989 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.986+0000 7fea82ffd640 1 -- 172.21.15.59:0/3506670545 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea8807a900 con 0x7fea900d0cd0 2023-10-16T14:27:11.989 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:27:11.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.988+0000 7fea9753c640 1 -- 172.21.15.59:0/3506670545 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fea7406aea0 msgr2=0x7fea7406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:11.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.988+0000 7fea9753c640 1 --2- 172.21.15.59:0/3506670545 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fea7406aea0 0x7fea7406d360 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009ad0 tx=0x7fea8c008040 comp rx=0 tx=0).stop 2023-10-16T14:27:11.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.989+0000 7fea9753c640 1 -- 172.21.15.59:0/3506670545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea900d0cd0 msgr2=0x7fea900cab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:11.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.989+0000 7fea9753c640 1 --2- 172.21.15.59:0/3506670545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea900d0cd0 0x7fea900cab20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fea88009e50 tx=0x7fea88004a40 comp rx=0 tx=0).stop 2023-10-16T14:27:11.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.989+0000 7fea9753c640 1 -- 172.21.15.59:0/3506670545 shutdown_connections 2023-10-16T14:27:11.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.989+0000 7fea9753c640 1 --2- 172.21.15.59:0/3506670545 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fea7406aea0 0x7fea7406d360 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.989+0000 7fea9753c640 1 --2- 172.21.15.59:0/3506670545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea900d0cd0 0x7fea900cab20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.989+0000 7fea9753c640 1 --2- 172.21.15.59:0/3506670545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea900b1a30 0x7fea900ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.989+0000 7fea9753c640 1 --2- 172.21.15.59:0/3506670545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea9006b570 0x7fea901569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:11.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.989+0000 7fea9753c640 1 -- 172.21.15.59:0/3506670545 >> 172.21.15.59:0/3506670545 conn(0x7fea9008c140 msgr2=0x7fea90072770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:11.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.989+0000 7fea9753c640 1 -- 172.21.15.59:0/3506670545 shutdown_connections 2023-10-16T14:27:11.995 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:11.989+0000 7fea9753c640 1 -- 172.21.15.59:0/3506670545 wait complete. 2023-10-16T14:27:12.013 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T14:27:12.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.246+0000 7f6ecec75640 1 Processor -- start 2023-10-16T14:27:12.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.246+0000 7f6ecec75640 1 -- start start 2023-10-16T14:27:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.247+0000 7f6ecec75640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ec80ca820 0x7f6ec8071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.247+0000 7f6ecec75640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ec80c8ea0 0x7f6ec80c9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.247+0000 7f6ecec75640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec8072480 con 0x7f6ec8159890 2023-10-16T14:27:12.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.247+0000 7f6ecec75640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec80cd0c0 con 0x7f6ec80c8ea0 2023-10-16T14:27:12.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.247+0000 7f6ecec75640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80cc540 con 0x7f6ec80ca820 2023-10-16T14:27:12.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.248+0000 7f6ecd212640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ec80c8ea0 0x7f6ec80c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:12.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.248+0000 7f6ecd212640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ec80c8ea0 0x7f6ec80c9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34670/0 (socket says 172.21.15.59:34670) 2023-10-16T14:27:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.248+0000 7f6ecd212640 1 -- 172.21.15.59:0/3293097093 learned_addr learned my addr 172.21.15.59:0/3293097093 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.248+0000 7f6ec7fff640 1 --2- 172.21.15.59:0/3293097093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ec80ca820 0x7f6ec8071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.248+0000 7f6ecd212640 1 -- 172.21.15.59:0/3293097093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ec80ca820 msgr2=0x7f6ec8071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.248+0000 7f6ecd212640 1 --2- 172.21.15.59:0/3293097093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ec80ca820 0x7f6ec8071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.248+0000 7f6ecd212640 1 -- 172.21.15.59:0/3293097093 >> v1:172.21.15.151:6789/0 conn(0x7f6ec8159890 legacy=0x7f6ec80ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.248+0000 7f6ecd212640 1 -- 172.21.15.59:0/3293097093 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec80cc820 con 0x7f6ec80c8ea0 2023-10-16T14:27:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.250+0000 7f6ecd212640 1 --2- 172.21.15.59:0/3293097093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ec80c8ea0 0x7f6ec80c9330 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009870 tx=0x7f6ec002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48dac24580a709eb server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.250+0000 7f6ec77fe640 1 -- 172.21.15.59:0/3293097093 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0031640 con 0x7f6ec80c8ea0 2023-10-16T14:27:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.250+0000 7f6ec77fe640 1 -- 172.21.15.59:0/3293097093 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec00317a0 con 0x7f6ec80c8ea0 2023-10-16T14:27:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.250+0000 7f6ec77fe640 1 -- 172.21.15.59:0/3293097093 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0031b30 con 0x7f6ec80c8ea0 2023-10-16T14:27:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.251+0000 7f6ecec75640 1 -- 172.21.15.59:0/3293097093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ec80c8ea0 msgr2=0x7f6ec80c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.251+0000 7f6ecec75640 1 --2- 172.21.15.59:0/3293097093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ec80c8ea0 0x7f6ec80c9330 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009870 tx=0x7f6ec002b8f0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.251+0000 7f6ecec75640 1 -- 172.21.15.59:0/3293097093 shutdown_connections 2023-10-16T14:27:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.251+0000 7f6ecec75640 1 --2- 172.21.15.59:0/3293097093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ec80c8ea0 0x7f6ec80c9330 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.251+0000 7f6ecec75640 1 --2- 172.21.15.59:0/3293097093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ec80ca820 0x7f6ec8071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.251+0000 7f6ecec75640 1 -- 172.21.15.59:0/3293097093 >> 172.21.15.59:0/3293097093 conn(0x7f6ec80b0030 msgr2=0x7f6ec80b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.251+0000 7f6ecec75640 1 -- 172.21.15.59:0/3293097093 shutdown_connections 2023-10-16T14:27:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.251+0000 7f6ecec75640 1 -- 172.21.15.59:0/3293097093 wait complete. 2023-10-16T14:27:12.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.253+0000 7f6ecec75640 1 Processor -- start 2023-10-16T14:27:12.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.253+0000 7f6ecec75640 1 -- start start 2023-10-16T14:27:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.254+0000 7f6ecec75640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ec80c8ea0 0x7f6ec80c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.254+0000 7f6ecec75640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ec80ca820 0x7f6ec8151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.254+0000 7f6ecec75640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ec8159890 0x7f6ec80af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.254+0000 7f6ecec75640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80c2ec0 con 0x7f6ec80ca820 2023-10-16T14:27:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.254+0000 7f6ecec75640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80c6620 con 0x7f6ec80c8ea0 2023-10-16T14:27:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.254+0000 7f6ecec75640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80c6900 con 0x7f6ec8159890 2023-10-16T14:27:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.254+0000 7f6ec7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ec80ca820 0x7f6ec8151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.254+0000 7f6ec7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ec80ca820 0x7f6ec8151230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34680/0 (socket says 172.21.15.59:34680) 2023-10-16T14:27:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.254+0000 7f6ec7fff640 1 -- 172.21.15.59:0/1902900603 learned_addr learned my addr 172.21.15.59:0/1902900603 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.254+0000 7f6ec7fff640 1 -- 172.21.15.59:0/1902900603 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ec8159890 msgr2=0x7f6ec80af120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.254+0000 7f6ecd212640 1 --2- 172.21.15.59:0/1902900603 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ec8159890 0x7f6ec80af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.255+0000 7f6ec7fff640 1 --2- 172.21.15.59:0/1902900603 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ec8159890 0x7f6ec80af120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.255+0000 7f6ecca11640 1 --2- 172.21.15.59:0/1902900603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ec80c8ea0 0x7f6ec80c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.255+0000 7f6ec7fff640 1 -- 172.21.15.59:0/1902900603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ec80c8ea0 msgr2=0x7f6ec80c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.255+0000 7f6ec7fff640 1 --2- 172.21.15.59:0/1902900603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ec80c8ea0 0x7f6ec80c2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.255+0000 7f6ec7fff640 1 -- 172.21.15.59:0/1902900603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec00094d0 con 0x7f6ec80ca820 2023-10-16T14:27:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.255+0000 7f6ec7fff640 1 --2- 172.21.15.59:0/1902900603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ec80ca820 0x7f6ec8151230 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6eb000d5f0 tx=0x7f6eb000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.255+0000 7f6ec57fa640 1 -- 172.21.15.59:0/1902900603 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00125f0 con 0x7f6ec80ca820 2023-10-16T14:27:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.255+0000 7f6ec57fa640 1 -- 172.21.15.59:0/1902900603 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb0012750 con 0x7f6ec80ca820 2023-10-16T14:27:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.255+0000 7f6ec57fa640 1 -- 172.21.15.59:0/1902900603 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb0012b00 con 0x7f6ec80ca820 2023-10-16T14:27:12.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.255+0000 7f6ecec75640 1 -- 172.21.15.59:0/1902900603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec80c6be0 con 0x7f6ec80ca820 2023-10-16T14:27:12.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.255+0000 7f6ecec75640 1 -- 172.21.15.59:0/1902900603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec80c71a0 con 0x7f6ec80ca820 2023-10-16T14:27:12.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.256+0000 7f6ecec75640 1 -- 172.21.15.59:0/1902900603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec8073ef0 con 0x7f6ec80ca820 2023-10-16T14:27:12.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.258+0000 7f6ec57fa640 1 -- 172.21.15.59:0/1902900603 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6eb0012c60 con 0x7f6ec80ca820 2023-10-16T14:27:12.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.258+0000 7f6ec57fa640 1 --2- 172.21.15.59:0/1902900603 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6ea806ae70 0x7f6ea806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:12.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.259+0000 7f6ec57fa640 1 -- 172.21.15.59:0/1902900603 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f6eb0089e50 con 0x7f6ec80ca820 2023-10-16T14:27:12.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.259+0000 7f6ecca11640 1 --2- 172.21.15.59:0/1902900603 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6ea806ae70 0x7f6ea806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:12.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.260+0000 7f6ecca11640 1 --2- 172.21.15.59:0/1902900603 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6ea806ae70 0x7f6ea806d330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8007fd0 tx=0x7f6eb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:12.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.263+0000 7f6ec57fa640 1 -- 172.21.15.59:0/1902900603 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6eb0054bb0 con 0x7f6ec80ca820 2023-10-16T14:27:12.459 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.456+0000 7f6ecec75640 1 -- 172.21.15.59:0/1902900603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6ec8159040 con 0x7f6ec80ca820 2023-10-16T14:27:12.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.457+0000 7f6ec57fa640 1 -- 172.21.15.59:0/1902900603 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6eb00581d0 con 0x7f6ec80ca820 2023-10-16T14:27:12.461 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:27:12.463 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.459+0000 7f6ecec75640 1 -- 172.21.15.59:0/1902900603 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6ea806ae70 msgr2=0x7f6ea806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:12.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.459+0000 7f6ecec75640 1 --2- 172.21.15.59:0/1902900603 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6ea806ae70 0x7f6ea806d330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8007fd0 tx=0x7f6eb8009040 comp rx=0 tx=0).stop 2023-10-16T14:27:12.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.459+0000 7f6ecec75640 1 -- 172.21.15.59:0/1902900603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ec80ca820 msgr2=0x7f6ec8151230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:12.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.459+0000 7f6ecec75640 1 --2- 172.21.15.59:0/1902900603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ec80ca820 0x7f6ec8151230 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6eb000d5f0 tx=0x7f6eb000dab0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.460+0000 7f6ecec75640 1 -- 172.21.15.59:0/1902900603 shutdown_connections 2023-10-16T14:27:12.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.460+0000 7f6ecec75640 1 --2- 172.21.15.59:0/1902900603 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6ea806ae70 0x7f6ea806d330 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.460+0000 7f6ecec75640 1 --2- 172.21.15.59:0/1902900603 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ec8159890 0x7f6ec80af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.460+0000 7f6ecec75640 1 --2- 172.21.15.59:0/1902900603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ec80ca820 0x7f6ec8151230 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.460+0000 7f6ecec75640 1 --2- 172.21.15.59:0/1902900603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ec80c8ea0 0x7f6ec80c2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.460+0000 7f6ecec75640 1 -- 172.21.15.59:0/1902900603 >> 172.21.15.59:0/1902900603 conn(0x7f6ec80b0030 msgr2=0x7f6ec80c9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:12.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.460+0000 7f6ecec75640 1 -- 172.21.15.59:0/1902900603 shutdown_connections 2023-10-16T14:27:12.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.460+0000 7f6ecec75640 1 -- 172.21.15.59:0/1902900603 wait complete. 2023-10-16T14:27:12.481 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T14:27:12.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.705+0000 7ff6f4aa9640 1 Processor -- start 2023-10-16T14:27:12.709 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.706+0000 7ff6f4aa9640 1 -- start start 2023-10-16T14:27:12.710 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.707+0000 7ff6f4aa9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6f015a830 0x7ff6f00cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:12.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.707+0000 7ff6f4aa9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff6f00ca550 0x7ff6f0070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:12.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.707+0000 7ff6f4aa9640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6f0070860 0x7ff6f015e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:12.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.707+0000 7ff6f4aa9640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f0070cf0 con 0x7ff6f0070860 2023-10-16T14:27:12.711 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.707+0000 7ff6f4aa9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f00cf040 con 0x7ff6f00ca550 2023-10-16T14:27:12.712 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.707+0000 7ff6f4aa9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f00ce430 con 0x7ff6f015a830 2023-10-16T14:27:12.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.708+0000 7ff6eed9d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6f0070860 0x7ff6f015e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:12.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.708+0000 7ff6eed9d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6f0070860 0x7ff6f015e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34688/0 (socket says 172.21.15.59:34688) 2023-10-16T14:27:12.713 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.708+0000 7ff6eed9d640 1 -- 172.21.15.59:0/1052895428 learned_addr learned my addr 172.21.15.59:0/1052895428 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:12.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.708+0000 7ff6e7fff640 1 --2- 172.21.15.59:0/1052895428 >> v2:172.21.15.151:3300/0 conn(0x7ff6f00ca550 0x7ff6f0070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:12.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.708+0000 7ff6ee59c640 1 --2- 172.21.15.59:0/1052895428 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6f015a830 0x7ff6f00cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:12.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.708+0000 7ff6eed9d640 1 -- 172.21.15.59:0/1052895428 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6f015a830 msgr2=0x7ff6f00cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:12.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.708+0000 7ff6eed9d640 1 --2- 172.21.15.59:0/1052895428 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6f015a830 0x7ff6f00cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.714 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.708+0000 7ff6eed9d640 1 -- 172.21.15.59:0/1052895428 >> v2:172.21.15.151:3300/0 conn(0x7ff6f00ca550 msgr2=0x7ff6f0070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:12.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.708+0000 7ff6eed9d640 1 --2- 172.21.15.59:0/1052895428 >> v2:172.21.15.151:3300/0 conn(0x7ff6f00ca550 0x7ff6f0070320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.708+0000 7ff6eed9d640 1 -- 172.21.15.59:0/1052895428 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f00ce710 con 0x7ff6f0070860 2023-10-16T14:27:12.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.709+0000 7ff6eed9d640 1 --2- 172.21.15.59:0/1052895428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6f0070860 0x7ff6f015e420 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00cf5d0 tx=0x7ff6e802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b032158e8f992ae server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:12.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.710+0000 7ff6edd9b640 1 -- 172.21.15.59:0/1052895428 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e802ca70 con 0x7ff6f0070860 2023-10-16T14:27:12.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.710+0000 7ff6edd9b640 1 -- 172.21.15.59:0/1052895428 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e802cbd0 con 0x7ff6f0070860 2023-10-16T14:27:12.715 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.710+0000 7ff6edd9b640 1 -- 172.21.15.59:0/1052895428 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e80343f0 con 0x7ff6f0070860 2023-10-16T14:27:12.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.710+0000 7ff6f4aa9640 1 -- 172.21.15.59:0/1052895428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6f0070860 msgr2=0x7ff6f015e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:12.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.710+0000 7ff6f4aa9640 1 --2- 172.21.15.59:0/1052895428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6f0070860 0x7ff6f015e420 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00cf5d0 tx=0x7ff6e802bed0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.710+0000 7ff6f4aa9640 1 -- 172.21.15.59:0/1052895428 shutdown_connections 2023-10-16T14:27:12.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.710+0000 7ff6f4aa9640 1 --2- 172.21.15.59:0/1052895428 >> v2:172.21.15.151:3300/0 conn(0x7ff6f00ca550 0x7ff6f0070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.710+0000 7ff6f4aa9640 1 --2- 172.21.15.59:0/1052895428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6f0070860 0x7ff6f015e420 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.710+0000 7ff6f4aa9640 1 --2- 172.21.15.59:0/1052895428 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6f015a830 0x7ff6f00cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.710+0000 7ff6f4aa9640 1 -- 172.21.15.59:0/1052895428 >> 172.21.15.59:0/1052895428 conn(0x7ff6f00b0030 msgr2=0x7ff6f00b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:12.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.710+0000 7ff6f4aa9640 1 -- 172.21.15.59:0/1052895428 shutdown_connections 2023-10-16T14:27:12.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.710+0000 7ff6f4aa9640 1 -- 172.21.15.59:0/1052895428 wait complete. 2023-10-16T14:27:12.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.712+0000 7ff6f4aa9640 1 Processor -- start 2023-10-16T14:27:12.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.712+0000 7ff6f4aa9640 1 -- start start 2023-10-16T14:27:12.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.713+0000 7ff6f4aa9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6f0070860 0x7ff6f01555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:12.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.713+0000 7ff6f4aa9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6f00ca550 0x7ff6f015e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:12.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.713+0000 7ff6f4aa9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6f015a830 0x7ff6f00cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:12.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.713+0000 7ff6f4aa9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f015d080 con 0x7ff6f00ca550 2023-10-16T14:27:12.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.713+0000 7ff6f4aa9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f00cd630 con 0x7ff6f015a830 2023-10-16T14:27:12.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.713+0000 7ff6f4aa9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f00ad540 con 0x7ff6f0070860 2023-10-16T14:27:12.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.714+0000 7ff6e7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6f00ca550 0x7ff6f015e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:12.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.714+0000 7ff6e7fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6f00ca550 0x7ff6f015e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34694/0 (socket says 172.21.15.59:34694) 2023-10-16T14:27:12.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.714+0000 7ff6e7fff640 1 -- 172.21.15.59:0/2912013793 learned_addr learned my addr 172.21.15.59:0/2912013793 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:12.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.714+0000 7ff6eed9d640 1 --2- 172.21.15.59:0/2912013793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6f015a830 0x7ff6f00cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:12.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.714+0000 7ff6ee59c640 1 --2- 172.21.15.59:0/2912013793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6f0070860 0x7ff6f01555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:12.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.714+0000 7ff6e7fff640 1 -- 172.21.15.59:0/2912013793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6f0070860 msgr2=0x7ff6f01555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:12.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.714+0000 7ff6e7fff640 1 --2- 172.21.15.59:0/2912013793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6f0070860 0x7ff6f01555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.714+0000 7ff6e7fff640 1 -- 172.21.15.59:0/2912013793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6f015a830 msgr2=0x7ff6f00cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:12.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.714+0000 7ff6e7fff640 1 --2- 172.21.15.59:0/2912013793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6f015a830 0x7ff6f00cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.714+0000 7ff6e7fff640 1 -- 172.21.15.59:0/2912013793 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e8009b30 con 0x7ff6f00ca550 2023-10-16T14:27:12.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.714+0000 7ff6e7fff640 1 --2- 172.21.15.59:0/2912013793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6f00ca550 0x7ff6f015e440 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800d830 tx=0x7ff6d800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:12.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.715+0000 7ff6e6ffd640 1 -- 172.21.15.59:0/2912013793 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d800b6c0 con 0x7ff6f00ca550 2023-10-16T14:27:12.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.715+0000 7ff6e6ffd640 1 -- 172.21.15.59:0/2912013793 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d800b820 con 0x7ff6f00ca550 2023-10-16T14:27:12.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.715+0000 7ff6e6ffd640 1 -- 172.21.15.59:0/2912013793 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d800bbb0 con 0x7ff6f00ca550 2023-10-16T14:27:12.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.715+0000 7ff6f4aa9640 1 -- 172.21.15.59:0/2912013793 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f015f2e0 con 0x7ff6f00ca550 2023-10-16T14:27:12.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.715+0000 7ff6f4aa9640 1 -- 172.21.15.59:0/2912013793 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f015f000 con 0x7ff6f00ca550 2023-10-16T14:27:12.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.716+0000 7ff6f4aa9640 1 -- 172.21.15.59:0/2912013793 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f00cd770 con 0x7ff6f00ca550 2023-10-16T14:27:12.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.717+0000 7ff6e6ffd640 1 -- 172.21.15.59:0/2912013793 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff6d801e460 con 0x7ff6f00ca550 2023-10-16T14:27:12.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.718+0000 7ff6e6ffd640 1 --2- 172.21.15.59:0/2912013793 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff6d006ae70 0x7ff6d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:12.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.719+0000 7ff6e6ffd640 1 -- 172.21.15.59:0/2912013793 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff6d808a030 con 0x7ff6f00ca550 2023-10-16T14:27:12.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.719+0000 7ff6ee59c640 1 --2- 172.21.15.59:0/2912013793 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff6d006ae70 0x7ff6d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:12.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.720+0000 7ff6ee59c640 1 --2- 172.21.15.59:0/2912013793 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff6d006ae70 0x7ff6d006d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0006fd0 tx=0x7ff6e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:12.727 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.723+0000 7ff6e6ffd640 1 -- 172.21.15.59:0/2912013793 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff6f00cd770 con 0x7ff6f00ca550 2023-10-16T14:27:12.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.926+0000 7ff6f4aa9640 1 -- 172.21.15.59:0/2912013793 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff6f00cd770 con 0x7ff6f00ca550 2023-10-16T14:27:12.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.927+0000 7ff6e6ffd640 1 -- 172.21.15.59:0/2912013793 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff6f00cd770 con 0x7ff6f00ca550 2023-10-16T14:27:12.930 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-16T14:27:12.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.929+0000 7ff6f4aa9640 1 -- 172.21.15.59:0/2912013793 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff6d006ae70 msgr2=0x7ff6d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:12.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.929+0000 7ff6f4aa9640 1 --2- 172.21.15.59:0/2912013793 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff6d006ae70 0x7ff6d006d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0006fd0 tx=0x7ff6e0008040 comp rx=0 tx=0).stop 2023-10-16T14:27:12.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.929+0000 7ff6f4aa9640 1 -- 172.21.15.59:0/2912013793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6f00ca550 msgr2=0x7ff6f015e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:12.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.929+0000 7ff6f4aa9640 1 --2- 172.21.15.59:0/2912013793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6f00ca550 0x7ff6f015e440 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800d830 tx=0x7ff6d800dcf0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.929+0000 7ff6f4aa9640 1 -- 172.21.15.59:0/2912013793 shutdown_connections 2023-10-16T14:27:12.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.929+0000 7ff6f4aa9640 1 --2- 172.21.15.59:0/2912013793 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff6d006ae70 0x7ff6d006d330 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.929+0000 7ff6f4aa9640 1 --2- 172.21.15.59:0/2912013793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6f015a830 0x7ff6f00cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.929+0000 7ff6f4aa9640 1 --2- 172.21.15.59:0/2912013793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6f00ca550 0x7ff6f015e440 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.929+0000 7ff6f4aa9640 1 --2- 172.21.15.59:0/2912013793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6f0070860 0x7ff6f01555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:12.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.929+0000 7ff6f4aa9640 1 -- 172.21.15.59:0/2912013793 >> 172.21.15.59:0/2912013793 conn(0x7ff6f00b0030 msgr2=0x7ff6f00b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:12.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.929+0000 7ff6f4aa9640 1 -- 172.21.15.59:0/2912013793 shutdown_connections 2023-10-16T14:27:12.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:12.930+0000 7ff6f4aa9640 1 -- 172.21.15.59:0/2912013793 wait complete. 2023-10-16T14:27:12.951 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T14:27:13.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.168+0000 7f4b8cffb640 1 Processor -- start 2023-10-16T14:27:13.172 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.168+0000 7f4b8cffb640 1 -- start start 2023-10-16T14:27:13.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.170+0000 7f4b8cffb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b880d1200 0x7f4b880b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:13.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.170+0000 7f4b8cffb640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b880ce810 con 0x7f4b880d0d80 2023-10-16T14:27:13.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.170+0000 7f4b8cffb640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b880b5b40 con 0x7f4b8815c940 2023-10-16T14:27:13.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.170+0000 7f4b8cffb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880d0b10 con 0x7f4b880d1200 2023-10-16T14:27:13.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.170+0000 7f4b7ffff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4b880d0d80 0x7f4b880b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34688/0 (socket says 172.21.15.59:34688) 2023-10-16T14:27:13.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.170+0000 7f4b7ffff640 1 -- 172.21.15.59:0/1801545139 learned_addr learned my addr 172.21.15.59:0/1801545139 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:13.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.171+0000 7f4b87fff640 1 --2- 172.21.15.59:0/1801545139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b880d1200 0x7f4b880b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:13.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.171+0000 7f4b86ffd640 1 -- 172.21.15.59:0/1801545139 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861890583 0 0) 0x7f4b880ce810 con 0x7f4b880d0d80 2023-10-16T14:27:13.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.171+0000 7f4b86ffd640 1 -- 172.21.15.59:0/1801545139 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b74003520 con 0x7f4b880d0d80 2023-10-16T14:27:13.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.171+0000 7f4b86ffd640 1 -- 172.21.15.59:0/1801545139 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3168430564 0 0) 0x7f4b74003520 con 0x7f4b880d0d80 2023-10-16T14:27:13.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.171+0000 7f4b86ffd640 1 -- 172.21.15.59:0/1801545139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b880d1200 msgr2=0x7f4b880b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:13.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.171+0000 7f4b86ffd640 1 --2- 172.21.15.59:0/1801545139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b880d1200 0x7f4b880b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.171+0000 7f4b86ffd640 1 -- 172.21.15.59:0/1801545139 >> v1:172.21.15.151:6789/0 conn(0x7f4b8815c940 legacy=0x7f4b880d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:13.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.171+0000 7f4b86ffd640 1 -- 172.21.15.59:0/1801545139 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b880d1690 con 0x7f4b880d0d80 2023-10-16T14:27:13.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.171+0000 7f4b86ffd640 1 -- 172.21.15.59:0/1801545139 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f4b70001670 con 0x7f4b880d0d80 2023-10-16T14:27:13.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.171+0000 7f4b86ffd640 1 -- 172.21.15.59:0/1801545139 >> v1:172.21.15.59:6789/0 conn(0x7f4b880d0d80 legacy=0x7f4b880b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:13.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.171+0000 7f4b86ffd640 1 --2- 172.21.15.59:0/1801545139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b880d1200 0x7f4b74003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:13.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.171+0000 7f4b86ffd640 1 --2- 172.21.15.59:0/1801545139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b74003f90 0x7f4b740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:13.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.171+0000 7f4b86ffd640 1 --2- 172.21.15.59:0/1801545139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b74004d00 0x7f4b74005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:13.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.171+0000 7f4b86ffd640 1 -- 172.21.15.59:0/1801545139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880d0b10 con 0x7f4b74004d00 2023-10-16T14:27:13.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.171+0000 7f4b86ffd640 1 -- 172.21.15.59:0/1801545139 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7400bb70 con 0x7f4b74003f90 2023-10-16T14:27:13.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.171+0000 7f4b86ffd640 1 -- 172.21.15.59:0/1801545139 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7400bd30 con 0x7f4b880d1200 2023-10-16T14:27:13.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.172+0000 7f4b87fff640 1 --2- 172.21.15.59:0/1801545139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b74004d00 0x7f4b74005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:13.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.172+0000 7f4b877fe640 1 --2- 172.21.15.59:0/1801545139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b880d1200 0x7f4b74003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:13.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.172+0000 7f4b7ffff640 1 --2- 172.21.15.59:0/1801545139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b74003f90 0x7f4b740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:13.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.172+0000 7f4b87fff640 1 -- 172.21.15.59:0/1801545139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b880d1200 msgr2=0x7f4b74003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:13.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.172+0000 7f4b87fff640 1 --2- 172.21.15.59:0/1801545139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b880d1200 0x7f4b74003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.172+0000 7f4b87fff640 1 -- 172.21.15.59:0/1801545139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b74003f90 msgr2=0x7f4b740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:13.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.172+0000 7f4b87fff640 1 --2- 172.21.15.59:0/1801545139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b74003f90 0x7f4b740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.172+0000 7f4b87fff640 1 -- 172.21.15.59:0/1801545139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b74003520 con 0x7f4b74004d00 2023-10-16T14:27:13.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.172+0000 7f4b877fe640 1 --2- 172.21.15.59:0/1801545139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b880d1200 0x7f4b74003a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:13.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.173+0000 7f4b87fff640 1 --2- 172.21.15.59:0/1801545139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b74004d00 0x7f4b74005180 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009fc0 tx=0x7f4b740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807b9a9e63dbdb01 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:13.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.173+0000 7f4b86ffd640 1 -- 172.21.15.59:0/1801545139 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8002cc20 con 0x7f4b74004d00 2023-10-16T14:27:13.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.173+0000 7f4b86ffd640 1 -- 172.21.15.59:0/1801545139 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8000f040 con 0x7f4b74004d00 2023-10-16T14:27:13.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.173+0000 7f4b86ffd640 1 -- 172.21.15.59:0/1801545139 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80034440 con 0x7f4b74004d00 2023-10-16T14:27:13.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.174+0000 7f4b8cffb640 1 -- 172.21.15.59:0/1801545139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b74004d00 msgr2=0x7f4b74005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:13.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.174+0000 7f4b8cffb640 1 --2- 172.21.15.59:0/1801545139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b74004d00 0x7f4b74005180 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009fc0 tx=0x7f4b740057f0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.174+0000 7f4b87fff640 1 -- 172.21.15.59:0/1801545139 reap_dead start 2023-10-16T14:27:13.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.174+0000 7f4b8cffb640 1 -- 172.21.15.59:0/1801545139 shutdown_connections 2023-10-16T14:27:13.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.174+0000 7f4b8cffb640 1 -- 172.21.15.59:0/1801545139 >> 172.21.15.59:0/1801545139 conn(0x7f4b8809bb30 msgr2=0x7f4b880d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:13.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.174+0000 7f4b8cffb640 1 -- 172.21.15.59:0/1801545139 shutdown_connections 2023-10-16T14:27:13.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.174+0000 7f4b8cffb640 1 -- 172.21.15.59:0/1801545139 wait complete. 2023-10-16T14:27:13.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.176+0000 7f4b8cffb640 1 Processor -- start 2023-10-16T14:27:13.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.176+0000 7f4b8cffb640 1 -- start start 2023-10-16T14:27:13.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.177+0000 7f4b8cffb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b74004d00 0x7f4b8815a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:13.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.177+0000 7f4b8cffb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b88151c00 0x7f4b88152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:13.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.177+0000 7f4b8cffb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b88155260 0x7f4b881556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:13.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.177+0000 7f4b8cffb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880c6f30 con 0x7f4b88151c00 2023-10-16T14:27:13.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.177+0000 7f4b8cffb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880c6390 con 0x7f4b74004d00 2023-10-16T14:27:13.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.177+0000 7f4b8cffb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b881525c0 con 0x7f4b88155260 2023-10-16T14:27:13.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.178+0000 7f4b7ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b88151c00 0x7f4b88152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:13.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.178+0000 7f4b7ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b88151c00 0x7f4b88152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34716/0 (socket says 172.21.15.59:34716) 2023-10-16T14:27:13.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.178+0000 7f4b7ffff640 1 -- 172.21.15.59:0/3633070489 learned_addr learned my addr 172.21.15.59:0/3633070489 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:13.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.178+0000 7f4b87fff640 1 --2- 172.21.15.59:0/3633070489 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b88155260 0x7f4b881556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:13.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.178+0000 7f4b877fe640 1 --2- 172.21.15.59:0/3633070489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b74004d00 0x7f4b8815a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:13.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.178+0000 7f4b7ffff640 1 -- 172.21.15.59:0/3633070489 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b88155260 msgr2=0x7f4b881556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:13.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.178+0000 7f4b7ffff640 1 --2- 172.21.15.59:0/3633070489 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b88155260 0x7f4b881556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.178+0000 7f4b7ffff640 1 -- 172.21.15.59:0/3633070489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b74004d00 msgr2=0x7f4b8815a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:13.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.178+0000 7f4b7ffff640 1 --2- 172.21.15.59:0/3633070489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b74004d00 0x7f4b8815a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.178+0000 7f4b7ffff640 1 -- 172.21.15.59:0/3633070489 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b880c6600 con 0x7f4b88151c00 2023-10-16T14:27:13.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.178+0000 7f4b877fe640 1 --2- 172.21.15.59:0/3633070489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b74004d00 0x7f4b8815a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:13.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.178+0000 7f4b7ffff640 1 --2- 172.21.15.59:0/3633070489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b88151c00 0x7f4b88152080 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000e830 tx=0x7f4b7000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:13.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.179+0000 7f4b84ff9640 1 -- 172.21.15.59:0/3633070489 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7000c8d0 con 0x7f4b88151c00 2023-10-16T14:27:13.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.179+0000 7f4b84ff9640 1 -- 172.21.15.59:0/3633070489 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7000ca30 con 0x7f4b88151c00 2023-10-16T14:27:13.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.179+0000 7f4b8cffb640 1 -- 172.21.15.59:0/3633070489 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b880c68e0 con 0x7f4b88151c00 2023-10-16T14:27:13.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.179+0000 7f4b84ff9640 1 -- 172.21.15.59:0/3633070489 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7000cde0 con 0x7f4b88151c00 2023-10-16T14:27:13.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.179+0000 7f4b8cffb640 1 -- 172.21.15.59:0/3633070489 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b88155c20 con 0x7f4b88151c00 2023-10-16T14:27:13.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.180+0000 7f4b8cffb640 1 -- 172.21.15.59:0/3633070489 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b880c70e0 con 0x7f4b88151c00 2023-10-16T14:27:13.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.181+0000 7f4b84ff9640 1 -- 172.21.15.59:0/3633070489 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4b7001d460 con 0x7f4b88151c00 2023-10-16T14:27:13.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.182+0000 7f4b84ff9640 1 --2- 172.21.15.59:0/3633070489 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4b6806ae70 0x7f4b6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:13.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.182+0000 7f4b84ff9640 1 -- 172.21.15.59:0/3633070489 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f4b70089a60 con 0x7f4b88151c00 2023-10-16T14:27:13.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.183+0000 7f4b877fe640 1 --2- 172.21.15.59:0/3633070489 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4b6806ae70 0x7f4b6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:13.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.184+0000 7f4b877fe640 1 --2- 172.21.15.59:0/3633070489 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4b6806ae70 0x7f4b6806d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4b780016f0 tx=0x7f4b78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:13.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.187+0000 7f4b84ff9640 1 -- 172.21.15.59:0/3633070489 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4b880c70e0 con 0x7f4b88151c00 2023-10-16T14:27:13.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.381+0000 7f4b8cffb640 1 -- 172.21.15.59:0/3633070489 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4b880c70e0 con 0x7f4b88151c00 2023-10-16T14:27:13.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.382+0000 7f4b84ff9640 1 -- 172.21.15.59:0/3633070489 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4b880c70e0 con 0x7f4b88151c00 2023-10-16T14:27:13.385 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:27:13.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.384+0000 7f4b8cffb640 1 -- 172.21.15.59:0/3633070489 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4b6806ae70 msgr2=0x7f4b6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:13.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.384+0000 7f4b8cffb640 1 --2- 172.21.15.59:0/3633070489 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4b6806ae70 0x7f4b6806d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4b780016f0 tx=0x7f4b78009040 comp rx=0 tx=0).stop 2023-10-16T14:27:13.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.384+0000 7f4b8cffb640 1 -- 172.21.15.59:0/3633070489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b88151c00 msgr2=0x7f4b88152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:13.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.384+0000 7f4b8cffb640 1 --2- 172.21.15.59:0/3633070489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b88151c00 0x7f4b88152080 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000e830 tx=0x7f4b7000ecf0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.385+0000 7f4b8cffb640 1 -- 172.21.15.59:0/3633070489 shutdown_connections 2023-10-16T14:27:13.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.385+0000 7f4b8cffb640 1 --2- 172.21.15.59:0/3633070489 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4b6806ae70 0x7f4b6806d330 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.385+0000 7f4b8cffb640 1 --2- 172.21.15.59:0/3633070489 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b88155260 0x7f4b881556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.385+0000 7f4b8cffb640 1 --2- 172.21.15.59:0/3633070489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b88151c00 0x7f4b88152080 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.385+0000 7f4b8cffb640 1 --2- 172.21.15.59:0/3633070489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b74004d00 0x7f4b8815a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.385+0000 7f4b8cffb640 1 -- 172.21.15.59:0/3633070489 >> 172.21.15.59:0/3633070489 conn(0x7f4b8809bb30 msgr2=0x7f4b8815bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:13.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.385+0000 7f4b8cffb640 1 -- 172.21.15.59:0/3633070489 shutdown_connections 2023-10-16T14:27:13.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.385+0000 7f4b8cffb640 1 -- 172.21.15.59:0/3633070489 wait complete. 2023-10-16T14:27:13.407 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-16T14:27:13.632 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.629+0000 7f90e2328640 1 Processor -- start 2023-10-16T14:27:13.633 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.629+0000 7f90e2328640 1 -- start start 2023-10-16T14:27:13.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.630+0000 7f90e2328640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f90dc0ad970 0x7f90dc0b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:13.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.630+0000 7f90e2328640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90dc0b2e90 0x7f90dc0ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:13.634 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.631+0000 7f90e2328640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90dc0c8a10 con 0x7f90dc0ceb40 2023-10-16T14:27:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.631+0000 7f90e2328640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90dc159b40 con 0x7f90dc0ad970 2023-10-16T14:27:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.631+0000 7f90e2328640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc0cefb0 con 0x7f90dc0b2e90 2023-10-16T14:27:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.631+0000 7f90e1b27640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f90dc0ceb40 0x7f90dc0b17e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34690/0 (socket says 172.21.15.59:34690) 2023-10-16T14:27:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.631+0000 7f90e1b27640 1 -- 172.21.15.59:0/2664424956 learned_addr learned my addr 172.21.15.59:0/2664424956 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:13.636 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.631+0000 7f90e1326640 1 --2- 172.21.15.59:0/2664424956 >> v2:172.21.15.151:3300/0 conn(0x7f90dc0ad970 0x7f90dc0b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:13.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.631+0000 7f90e0b25640 1 --2- 172.21.15.59:0/2664424956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90dc0b2e90 0x7f90dc0ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:13.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.632+0000 7f90d3fff640 1 -- 172.21.15.59:0/2664424956 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223519642 0 0) 0x7f90dc0c8a10 con 0x7f90dc0ceb40 2023-10-16T14:27:13.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.632+0000 7f90d3fff640 1 -- 172.21.15.59:0/2664424956 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90c8003520 con 0x7f90dc0ceb40 2023-10-16T14:27:13.637 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.632+0000 7f90d3fff640 1 -- 172.21.15.59:0/2664424956 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 133562244 0 0) 0x7f90c8003520 con 0x7f90dc0ceb40 2023-10-16T14:27:13.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.632+0000 7f90e1326640 1 -- 172.21.15.59:0/2664424956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90dc0b2e90 msgr2=0x7f90dc0ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:13.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.632+0000 7f90e1326640 1 --2- 172.21.15.59:0/2664424956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90dc0b2e90 0x7f90dc0ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.632+0000 7f90e1326640 1 -- 172.21.15.59:0/2664424956 >> v1:172.21.15.59:6789/0 conn(0x7f90dc0ceb40 legacy=0x7f90dc0b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:13.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.632+0000 7f90e1326640 1 -- 172.21.15.59:0/2664424956 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90dc15d1a0 con 0x7f90dc0ad970 2023-10-16T14:27:13.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.633+0000 7f90e1326640 1 --2- 172.21.15.59:0/2664424956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90dc0ad970 0x7f90dc0b1210 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f90d80097c0 tx=0x7f90d802b6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88fa3ca2a55f0685 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:13.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.634+0000 7f90d3fff640 1 -- 172.21.15.59:0/2664424956 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d40019f0 con 0x7f90dc0ad970 2023-10-16T14:27:13.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.634+0000 7f90d3fff640 1 -- 172.21.15.59:0/2664424956 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d802e050 con 0x7f90dc0ad970 2023-10-16T14:27:13.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.634+0000 7f90d3fff640 1 -- 172.21.15.59:0/2664424956 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d8030710 con 0x7f90dc0ad970 2023-10-16T14:27:13.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.634+0000 7f90e2328640 1 -- 172.21.15.59:0/2664424956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90dc0ad970 msgr2=0x7f90dc0b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:13.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.634+0000 7f90e2328640 1 --2- 172.21.15.59:0/2664424956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90dc0ad970 0x7f90dc0b1210 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f90d80097c0 tx=0x7f90d802b6d0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.635+0000 7f90e2328640 1 -- 172.21.15.59:0/2664424956 shutdown_connections 2023-10-16T14:27:13.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.635+0000 7f90e2328640 1 --2- 172.21.15.59:0/2664424956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90dc0b2e90 0x7f90dc0ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.635+0000 7f90e2328640 1 --2- 172.21.15.59:0/2664424956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90dc0ad970 0x7f90dc0b1210 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.635+0000 7f90e2328640 1 -- 172.21.15.59:0/2664424956 >> 172.21.15.59:0/2664424956 conn(0x7f90dc069fc0 msgr2=0x7f90dc06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:13.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.635+0000 7f90e2328640 1 -- 172.21.15.59:0/2664424956 shutdown_connections 2023-10-16T14:27:13.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.635+0000 7f90e2328640 1 -- 172.21.15.59:0/2664424956 wait complete. 2023-10-16T14:27:13.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.637+0000 7f90e2328640 1 Processor -- start 2023-10-16T14:27:13.642 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.637+0000 7f90e2328640 1 -- start start 2023-10-16T14:27:13.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.638+0000 7f90e2328640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90dc0ad970 0x7f90dc158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:13.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.638+0000 7f90e2328640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90dc0b2e90 0x7f90dc071900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:13.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.638+0000 7f90e2328640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90dc0ceb40 0x7f90dc0ac190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:13.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.638+0000 7f90e2328640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc0c3700 con 0x7f90dc0ceb40 2023-10-16T14:27:13.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.638+0000 7f90e2328640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc0ce8f0 con 0x7f90dc0ad970 2023-10-16T14:27:13.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.638+0000 7f90e2328640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc071e40 con 0x7f90dc0b2e90 2023-10-16T14:27:13.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.638+0000 7f90e1b27640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90dc0ceb40 0x7f90dc0ac190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:13.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.638+0000 7f90e1b27640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90dc0ceb40 0x7f90dc0ac190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34726/0 (socket says 172.21.15.59:34726) 2023-10-16T14:27:13.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.638+0000 7f90e1b27640 1 -- 172.21.15.59:0/1689670221 learned_addr learned my addr 172.21.15.59:0/1689670221 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:13.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.638+0000 7f90e1326640 1 --2- 172.21.15.59:0/1689670221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90dc0ad970 0x7f90dc158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:13.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.638+0000 7f90e0b25640 1 --2- 172.21.15.59:0/1689670221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90dc0b2e90 0x7f90dc071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:13.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.639+0000 7f90e1b27640 1 -- 172.21.15.59:0/1689670221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90dc0b2e90 msgr2=0x7f90dc071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:13.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.639+0000 7f90e1b27640 1 --2- 172.21.15.59:0/1689670221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90dc0b2e90 0x7f90dc071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.639+0000 7f90e1b27640 1 -- 172.21.15.59:0/1689670221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90dc0ad970 msgr2=0x7f90dc158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:13.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.639+0000 7f90e1b27640 1 --2- 172.21.15.59:0/1689670221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90dc0ad970 0x7f90dc158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.639+0000 7f90e1b27640 1 -- 172.21.15.59:0/1689670221 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d80093a0 con 0x7f90dc0ceb40 2023-10-16T14:27:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.639+0000 7f90e1b27640 1 --2- 172.21.15.59:0/1689670221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90dc0ceb40 0x7f90dc0ac190 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f90d400cc20 tx=0x7f90d400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.639+0000 7f90d1ffb640 1 -- 172.21.15.59:0/1689670221 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d400ce30 con 0x7f90dc0ceb40 2023-10-16T14:27:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.639+0000 7f90d1ffb640 1 -- 172.21.15.59:0/1689670221 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d4012400 con 0x7f90dc0ceb40 2023-10-16T14:27:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.639+0000 7f90e2328640 1 -- 172.21.15.59:0/1689670221 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90dc0c3910 con 0x7f90dc0ceb40 2023-10-16T14:27:13.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.639+0000 7f90d1ffb640 1 -- 172.21.15.59:0/1689670221 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d40127b0 con 0x7f90dc0ceb40 2023-10-16T14:27:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.639+0000 7f90e2328640 1 -- 172.21.15.59:0/1689670221 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90dc0c3ed0 con 0x7f90dc0ceb40 2023-10-16T14:27:13.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.641+0000 7f90e2328640 1 -- 172.21.15.59:0/1689670221 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90dc04e9b0 con 0x7f90dc0ceb40 2023-10-16T14:27:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.642+0000 7f90d1ffb640 1 -- 172.21.15.59:0/1689670221 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f90d4012910 con 0x7f90dc0ceb40 2023-10-16T14:27:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.642+0000 7f90d1ffb640 1 --2- 172.21.15.59:0/1689670221 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f90c006aea0 0x7f90c006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.643+0000 7f90d1ffb640 1 -- 172.21.15.59:0/1689670221 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f90d408a0c0 con 0x7f90dc0ceb40 2023-10-16T14:27:13.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.643+0000 7f90e1326640 1 --2- 172.21.15.59:0/1689670221 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f90c006aea0 0x7f90c006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:13.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.644+0000 7f90e1326640 1 --2- 172.21.15.59:0/1689670221 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f90c006aea0 0x7f90c006d360 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f90d8034000 tx=0x7f90d8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:13.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.647+0000 7f90d1ffb640 1 -- 172.21.15.59:0/1689670221 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f90d4054db0 con 0x7f90dc0ceb40 2023-10-16T14:27:13.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.853+0000 7f90e2328640 1 -- 172.21.15.59:0/1689670221 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f90dc06dc00 con 0x7f90dc0ceb40 2023-10-16T14:27:13.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.854+0000 7f90d1ffb640 1 -- 172.21.15.59:0/1689670221 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f90d40583d0 con 0x7f90dc0ceb40 2023-10-16T14:27:13.858 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2023-10-16T14:27:13.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.857+0000 7f90e2328640 1 -- 172.21.15.59:0/1689670221 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f90c006aea0 msgr2=0x7f90c006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.857+0000 7f90e2328640 1 --2- 172.21.15.59:0/1689670221 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f90c006aea0 0x7f90c006d360 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f90d8034000 tx=0x7f90d8008030 comp rx=0 tx=0).stop 2023-10-16T14:27:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.857+0000 7f90e2328640 1 -- 172.21.15.59:0/1689670221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90dc0ceb40 msgr2=0x7f90dc0ac190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.857+0000 7f90e2328640 1 --2- 172.21.15.59:0/1689670221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90dc0ceb40 0x7f90dc0ac190 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f90d400cc20 tx=0x7f90d400a430 comp rx=0 tx=0).stop 2023-10-16T14:27:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.857+0000 7f90e2328640 1 -- 172.21.15.59:0/1689670221 shutdown_connections 2023-10-16T14:27:13.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.857+0000 7f90e2328640 1 --2- 172.21.15.59:0/1689670221 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f90c006aea0 0x7f90c006d360 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.857+0000 7f90e2328640 1 --2- 172.21.15.59:0/1689670221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90dc0ceb40 0x7f90dc0ac190 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.857+0000 7f90e2328640 1 --2- 172.21.15.59:0/1689670221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f90dc0b2e90 0x7f90dc071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.857+0000 7f90e2328640 1 --2- 172.21.15.59:0/1689670221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90dc0ad970 0x7f90dc158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:13.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.857+0000 7f90e2328640 1 -- 172.21.15.59:0/1689670221 >> 172.21.15.59:0/1689670221 conn(0x7f90dc069fc0 msgr2=0x7f90dc0b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:13.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.857+0000 7f90e2328640 1 -- 172.21.15.59:0/1689670221 shutdown_connections 2023-10-16T14:27:13.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:13.857+0000 7f90e2328640 1 -- 172.21.15.59:0/1689670221 wait complete. 2023-10-16T14:27:13.879 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi151.front.sepia.ceph.com... 2023-10-16T14:27:13.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:13.880 DEBUG:teuthology.orchestra.run.smithi151:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-10-16T14:27:13.975 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T14:27:13.976 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-16T14:27:13.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:13.977 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-16T14:27:14.028 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-16T14:27:14.029 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T14:27:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.262+0000 7f9d74c40640 1 Processor -- start 2023-10-16T14:27:14.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.263+0000 7f9d74c40640 1 -- start start 2023-10-16T14:27:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.264+0000 7f9d74c40640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9d700b0010 0x7f9d700701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.264+0000 7f9d74c40640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d7015f040 0x7f9d7015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:14.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.264+0000 7f9d74c40640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d700707f0 con 0x7f9d7015ad00 2023-10-16T14:27:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.264+0000 7f9d74c40640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d70070ad0 con 0x7f9d700b0010 2023-10-16T14:27:14.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.264+0000 7f9d74c40640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7015b1d0 con 0x7f9d7015f040 2023-10-16T14:27:14.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.265+0000 7f9d6e59c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9d700b0010 0x7f9d700701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:14.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.265+0000 7f9d6ed9d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d7015f040 0x7f9d7015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.265+0000 7f9d6ed9d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d7015f040 0x7f9d7015b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.59:55322/0 (socket says 172.21.15.59:55322) 2023-10-16T14:27:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.265+0000 7f9d6ed9d640 1 -- 172.21.15.59:0/870658240 learned_addr learned my addr 172.21.15.59:0/870658240 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:14.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.266+0000 7f9d6ed9d640 1 -- 172.21.15.59:0/870658240 >> v2:172.21.15.151:3300/0 conn(0x7f9d700b0010 msgr2=0x7f9d700701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:14.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.266+0000 7f9d6ed9d640 1 --2- 172.21.15.59:0/870658240 >> v2:172.21.15.151:3300/0 conn(0x7f9d700b0010 0x7f9d700701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.266+0000 7f9d6ed9d640 1 -- 172.21.15.59:0/870658240 >> v1:172.21.15.151:6789/0 conn(0x7f9d7015ad00 legacy=0x7f9d700b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:14.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.266+0000 7f9d6ed9d640 1 -- 172.21.15.59:0/870658240 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7015b4b0 con 0x7f9d7015f040 2023-10-16T14:27:14.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.267+0000 7f9d6ed9d640 1 --2- 172.21.15.59:0/870658240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d7015f040 0x7f9d7015b9d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9d68009e50 tx=0x7f9d6802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4a5f032e1e4f25b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:14.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.268+0000 7f9d6dd9b640 1 -- 172.21.15.59:0/870658240 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6802cb00 con 0x7f9d7015f040 2023-10-16T14:27:14.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.268+0000 7f9d6dd9b640 1 -- 172.21.15.59:0/870658240 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6802cc60 con 0x7f9d7015f040 2023-10-16T14:27:14.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.268+0000 7f9d6dd9b640 1 -- 172.21.15.59:0/870658240 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d680343f0 con 0x7f9d7015f040 2023-10-16T14:27:14.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.269+0000 7f9d74c40640 1 -- 172.21.15.59:0/870658240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d7015f040 msgr2=0x7f9d7015b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:14.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.269+0000 7f9d74c40640 1 --2- 172.21.15.59:0/870658240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d7015f040 0x7f9d7015b9d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9d68009e50 tx=0x7f9d6802bf60 comp rx=0 tx=0).stop 2023-10-16T14:27:14.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.269+0000 7f9d74c40640 1 -- 172.21.15.59:0/870658240 shutdown_connections 2023-10-16T14:27:14.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.269+0000 7f9d74c40640 1 --2- 172.21.15.59:0/870658240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d7015f040 0x7f9d7015b9d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.269+0000 7f9d74c40640 1 --2- 172.21.15.59:0/870658240 >> v2:172.21.15.151:3300/0 conn(0x7f9d700b0010 0x7f9d700701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.269+0000 7f9d74c40640 1 -- 172.21.15.59:0/870658240 >> 172.21.15.59:0/870658240 conn(0x7f9d7006c1c0 msgr2=0x7f9d7006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:14.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.269+0000 7f9d74c40640 1 -- 172.21.15.59:0/870658240 shutdown_connections 2023-10-16T14:27:14.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.270+0000 7f9d74c40640 1 -- 172.21.15.59:0/870658240 wait complete. 2023-10-16T14:27:14.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.272+0000 7f9d74c40640 1 Processor -- start 2023-10-16T14:27:14.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.272+0000 7f9d74c40640 1 -- start start 2023-10-16T14:27:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.273+0000 7f9d74c40640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d700b0010 0x7f9d700c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.273+0000 7f9d74c40640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d7015ad00 0x7f9d700b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:14.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.273+0000 7f9d74c40640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d7015f040 0x7f9d701f12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:14.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.273+0000 7f9d74c40640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d700c4fd0 con 0x7f9d7015ad00 2023-10-16T14:27:14.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.273+0000 7f9d74c40640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d700b11b0 con 0x7f9d7015f040 2023-10-16T14:27:14.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.273+0000 7f9d74c40640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d700b1490 con 0x7f9d700b0010 2023-10-16T14:27:14.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.273+0000 7f9d65d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d7015ad00 0x7f9d700b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:14.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.273+0000 7f9d65d9b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d7015ad00 0x7f9d700b3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34732/0 (socket says 172.21.15.59:34732) 2023-10-16T14:27:14.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.273+0000 7f9d65d9b640 1 -- 172.21.15.59:0/909091319 learned_addr learned my addr 172.21.15.59:0/909091319 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:14.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.273+0000 7f9d6ed9d640 1 --2- 172.21.15.59:0/909091319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d7015f040 0x7f9d701f12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:14.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.274+0000 7f9d6e59c640 1 --2- 172.21.15.59:0/909091319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d700b0010 0x7f9d700c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:14.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.274+0000 7f9d65d9b640 1 -- 172.21.15.59:0/909091319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d700b0010 msgr2=0x7f9d700c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:14.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.274+0000 7f9d65d9b640 1 --2- 172.21.15.59:0/909091319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d700b0010 0x7f9d700c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.274+0000 7f9d65d9b640 1 -- 172.21.15.59:0/909091319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d7015f040 msgr2=0x7f9d701f12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:14.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.274+0000 7f9d65d9b640 1 --2- 172.21.15.59:0/909091319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d7015f040 0x7f9d701f12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.274+0000 7f9d65d9b640 1 -- 172.21.15.59:0/909091319 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d68009b30 con 0x7f9d7015ad00 2023-10-16T14:27:14.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.274+0000 7f9d65d9b640 1 --2- 172.21.15.59:0/909091319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d7015ad00 0x7f9d700b3b00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800c400 tx=0x7f9d5800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:14.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.274+0000 7f9d677fe640 1 -- 172.21.15.59:0/909091319 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d580052d0 con 0x7f9d7015ad00 2023-10-16T14:27:14.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.274+0000 7f9d677fe640 1 -- 172.21.15.59:0/909091319 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d58005430 con 0x7f9d7015ad00 2023-10-16T14:27:14.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.274+0000 7f9d677fe640 1 -- 172.21.15.59:0/909091319 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d58003830 con 0x7f9d7015ad00 2023-10-16T14:27:14.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.274+0000 7f9d74c40640 1 -- 172.21.15.59:0/909091319 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d700b1770 con 0x7f9d7015ad00 2023-10-16T14:27:14.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.275+0000 7f9d74c40640 1 -- 172.21.15.59:0/909091319 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d700c2660 con 0x7f9d7015ad00 2023-10-16T14:27:14.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.276+0000 7f9d74c40640 1 -- 172.21.15.59:0/909091319 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d700c21e0 con 0x7f9d7015ad00 2023-10-16T14:27:14.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.277+0000 7f9d677fe640 1 -- 172.21.15.59:0/909091319 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9d58003990 con 0x7f9d7015ad00 2023-10-16T14:27:14.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.278+0000 7f9d677fe640 1 --2- 172.21.15.59:0/909091319 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9d5006ae70 0x7f9d5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:14.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.278+0000 7f9d677fe640 1 -- 172.21.15.59:0/909091319 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f9d58088ee0 con 0x7f9d7015ad00 2023-10-16T14:27:14.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.278+0000 7f9d6e59c640 1 --2- 172.21.15.59:0/909091319 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9d5006ae70 0x7f9d5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:14.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.280+0000 7f9d6e59c640 1 --2- 172.21.15.59:0/909091319 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9d5006ae70 0x7f9d5006d330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9d60009ad0 tx=0x7f9d60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:14.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.282+0000 7f9d677fe640 1 -- 172.21.15.59:0/909091319 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9d700c21e0 con 0x7f9d7015ad00 2023-10-16T14:27:14.517 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.513+0000 7f9d74c40640 1 -- 172.21.15.59:0/909091319 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d700c21e0 con 0x7f9d7015ad00 2023-10-16T14:27:14.518 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.515+0000 7f9d677fe640 1 -- 172.21.15.59:0/909091319 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f9d700c21e0 con 0x7f9d7015ad00 2023-10-16T14:27:14.518 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:14.518 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3959035293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3959035293},{"type":"v1","addr":"172.21.15.59:6834","nonce":3959035293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1298271347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1298271347},{"type":"v1","addr":"172.21.15.151:6835","nonce":1298271347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/249904108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":249904108},{"type":"v1","addr":"172.21.15.59:6835","nonce":249904108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T14:25:48.130662+0000","modified":"2023-10-16T14:26:09.157993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6837/4004038733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4004038733},{"type":"v1","addr":"172.21.15.151:6837","nonce":4004038733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T14:27:14.519 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 9 2023-10-16T14:27:14.521 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.517+0000 7f9d74c40640 1 -- 172.21.15.59:0/909091319 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9d5006ae70 msgr2=0x7f9d5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.517+0000 7f9d74c40640 1 --2- 172.21.15.59:0/909091319 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9d5006ae70 0x7f9d5006d330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9d60009ad0 tx=0x7f9d60008040 comp rx=0 tx=0).stop 2023-10-16T14:27:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.518+0000 7f9d74c40640 1 -- 172.21.15.59:0/909091319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d7015ad00 msgr2=0x7f9d700b3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:14.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.518+0000 7f9d74c40640 1 --2- 172.21.15.59:0/909091319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d7015ad00 0x7f9d700b3b00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800c400 tx=0x7f9d5800c8c0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.518+0000 7f9d74c40640 1 -- 172.21.15.59:0/909091319 shutdown_connections 2023-10-16T14:27:14.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.518+0000 7f9d74c40640 1 --2- 172.21.15.59:0/909091319 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9d5006ae70 0x7f9d5006d330 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.518+0000 7f9d74c40640 1 --2- 172.21.15.59:0/909091319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d7015f040 0x7f9d701f12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.518+0000 7f9d74c40640 1 --2- 172.21.15.59:0/909091319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d7015ad00 0x7f9d700b3b00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.518+0000 7f9d74c40640 1 --2- 172.21.15.59:0/909091319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d700b0010 0x7f9d700c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.518+0000 7f9d74c40640 1 -- 172.21.15.59:0/909091319 >> 172.21.15.59:0/909091319 conn(0x7f9d7006c1c0 msgr2=0x7f9d7006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:14.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.518+0000 7f9d74c40640 1 -- 172.21.15.59:0/909091319 shutdown_connections 2023-10-16T14:27:14.524 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.518+0000 7f9d74c40640 1 -- 172.21.15.59:0/909091319 wait complete. 2023-10-16T14:27:14.542 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:27:14.770 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.767+0000 7f20b3fff640 1 Processor -- start 2023-10-16T14:27:14.771 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.767+0000 7f20b3fff640 1 -- start start 2023-10-16T14:27:14.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.769+0000 7f20b3fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f20b40ca660 0x7f20b40c9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:14.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.769+0000 7f20b3fff640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b415acb0 con 0x7f20b415a8d0 2023-10-16T14:27:14.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.769+0000 7f20b3fff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b40c1c60 con 0x7f20b40cb250 2023-10-16T14:27:14.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.769+0000 7f20b3fff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b415e350 con 0x7f20b40ca660 2023-10-16T14:27:14.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.769+0000 7f20b2ffd640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f20b415a8d0 0x7f20b40cab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34706/0 (socket says 172.21.15.59:34706) 2023-10-16T14:27:14.773 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.769+0000 7f20b2ffd640 1 -- 172.21.15.59:0/559939897 learned_addr learned my addr 172.21.15.59:0/559939897 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:14.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.769+0000 7f20b37fe640 1 --2- 172.21.15.59:0/559939897 >> v2:172.21.15.151:3300/0 conn(0x7f20b40ca660 0x7f20b40c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:14.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.770+0000 7f20b1ffb640 1 -- 172.21.15.59:0/559939897 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3961308352 0 0) 0x7f20a4001610 con 0x7f20b415a8d0 2023-10-16T14:27:14.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.770+0000 7f20b1ffb640 1 -- 172.21.15.59:0/559939897 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20a0003520 con 0x7f20b415a8d0 2023-10-16T14:27:14.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.770+0000 7f20b1ffb640 1 -- 172.21.15.59:0/559939897 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1150716547 0 0) 0x7f20a0003520 con 0x7f20b415a8d0 2023-10-16T14:27:14.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.770+0000 7f20b1ffb640 1 -- 172.21.15.59:0/559939897 >> v2:172.21.15.151:3300/0 conn(0x7f20b40ca660 msgr2=0x7f20b40c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:14.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.770+0000 7f20b1ffb640 1 --2- 172.21.15.59:0/559939897 >> v2:172.21.15.151:3300/0 conn(0x7f20b40ca660 0x7f20b40c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.770+0000 7f20b1ffb640 1 -- 172.21.15.59:0/559939897 >> v1:172.21.15.151:6789/0 conn(0x7f20b40cb250 legacy=0x7f20b40c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:14.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.770+0000 7f20b1ffb640 1 -- 172.21.15.59:0/559939897 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b415e630 con 0x7f20b415a8d0 2023-10-16T14:27:14.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.770+0000 7f20b1ffb640 1 -- 172.21.15.59:0/559939897 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f20a4001d00 con 0x7f20b415a8d0 2023-10-16T14:27:14.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.770+0000 7f20b1ffb640 1 -- 172.21.15.59:0/559939897 >> v1:172.21.15.59:6789/0 conn(0x7f20b415a8d0 legacy=0x7f20b40cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:14.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.770+0000 7f20b1ffb640 1 --2- 172.21.15.59:0/559939897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20a0003970 0x7f20a0003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:14.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.770+0000 7f20b1ffb640 1 --2- 172.21.15.59:0/559939897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20a00047c0 0x7f20a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:14.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.770+0000 7f20b1ffb640 1 --2- 172.21.15.59:0/559939897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20a0005180 0x7f20a000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:14.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.770+0000 7f20b1ffb640 1 -- 172.21.15.59:0/559939897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b415e350 con 0x7f20a0005180 2023-10-16T14:27:14.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.770+0000 7f20b1ffb640 1 -- 172.21.15.59:0/559939897 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a000c050 con 0x7f20a00047c0 2023-10-16T14:27:14.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.770+0000 7f20b1ffb640 1 -- 172.21.15.59:0/559939897 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a000c210 con 0x7f20a0003970 2023-10-16T14:27:14.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.771+0000 7f20b37fe640 1 --2- 172.21.15.59:0/559939897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20a0005180 0x7f20a000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:14.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.771+0000 7f20b2ffd640 1 --2- 172.21.15.59:0/559939897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20a0003970 0x7f20a0003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:14.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.771+0000 7f20b27fc640 1 --2- 172.21.15.59:0/559939897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20a00047c0 0x7f20a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:14.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.771+0000 7f20b37fe640 1 -- 172.21.15.59:0/559939897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20a0003970 msgr2=0x7f20a0003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:14.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.771+0000 7f20b37fe640 1 --2- 172.21.15.59:0/559939897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20a0003970 0x7f20a0003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.771+0000 7f20b37fe640 1 -- 172.21.15.59:0/559939897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20a00047c0 msgr2=0x7f20a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:14.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.771+0000 7f20b37fe640 1 --2- 172.21.15.59:0/559939897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20a00047c0 0x7f20a0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.771+0000 7f20b37fe640 1 -- 172.21.15.59:0/559939897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a0003520 con 0x7f20a0005180 2023-10-16T14:27:14.781 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.771+0000 7f20b2ffd640 1 --2- 172.21.15.59:0/559939897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20a0003970 0x7f20a0003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:14.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.771+0000 7f20b27fc640 1 --2- 172.21.15.59:0/559939897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20a00047c0 0x7f20a0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:14.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.772+0000 7f20b37fe640 1 -- 172.21.15.59:0/559939897 reap_dead start 2023-10-16T14:27:14.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.772+0000 7f20b37fe640 1 --2- 172.21.15.59:0/559939897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20a0005180 0x7f20a000b980 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f20ac009ac0 tx=0x7f20a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3beafe06922327e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:14.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.772+0000 7f20b1ffb640 1 -- 172.21.15.59:0/559939897 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac004030 con 0x7f20a0005180 2023-10-16T14:27:14.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.772+0000 7f20b1ffb640 1 -- 172.21.15.59:0/559939897 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ac004190 con 0x7f20a0005180 2023-10-16T14:27:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.772+0000 7f20b1ffb640 1 -- 172.21.15.59:0/559939897 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac02c710 con 0x7f20a0005180 2023-10-16T14:27:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.773+0000 7f20b3fff640 1 -- 172.21.15.59:0/559939897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20a0005180 msgr2=0x7f20a000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.773+0000 7f20b3fff640 1 --2- 172.21.15.59:0/559939897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20a0005180 0x7f20a000b980 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f20ac009ac0 tx=0x7f20a00057f0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.773+0000 7f20b3fff640 1 -- 172.21.15.59:0/559939897 shutdown_connections 2023-10-16T14:27:14.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.773+0000 7f20b3fff640 1 --2- 172.21.15.59:0/559939897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20a0005180 0x7f20a000b980 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.773+0000 7f20b3fff640 1 -- 172.21.15.59:0/559939897 >> 172.21.15.59:0/559939897 conn(0x7f20b406a470 msgr2=0x7f20b40afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:14.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.773+0000 7f20b3fff640 1 -- 172.21.15.59:0/559939897 shutdown_connections 2023-10-16T14:27:14.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.773+0000 7f20b3fff640 1 -- 172.21.15.59:0/559939897 wait complete. 2023-10-16T14:27:14.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.775+0000 7f20b3fff640 1 Processor -- start 2023-10-16T14:27:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.775+0000 7f20b3fff640 1 -- start start 2023-10-16T14:27:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.776+0000 7f20b3fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20a0005180 0x7f20b415b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.776+0000 7f20b3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20b41ef3f0 0x7f20b41ef850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.776+0000 7f20b3fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20b41f3810 0x7f20b41f3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.776+0000 7f20b3fff640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b40b0f90 con 0x7f20b41ef3f0 2023-10-16T14:27:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.776+0000 7f20b3fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b41591d0 con 0x7f20b41f3810 2023-10-16T14:27:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.776+0000 7f20b3fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b415be60 con 0x7f20a0005180 2023-10-16T14:27:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.776+0000 7f20b27fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20b41ef3f0 0x7f20b41ef850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.776+0000 7f20b27fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20b41ef3f0 0x7f20b41ef850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34750/0 (socket says 172.21.15.59:34750) 2023-10-16T14:27:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.776+0000 7f20b27fc640 1 -- 172.21.15.59:0/3803898078 learned_addr learned my addr 172.21.15.59:0/3803898078 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.777+0000 7f20b27fc640 1 -- 172.21.15.59:0/3803898078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20a0005180 msgr2=0x7f20b415b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.777+0000 7f20b27fc640 1 --2- 172.21.15.59:0/3803898078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20a0005180 0x7f20b415b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.777+0000 7f20b27fc640 1 -- 172.21.15.59:0/3803898078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20b41f3810 msgr2=0x7f20b41f3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.777+0000 7f20b27fc640 1 --2- 172.21.15.59:0/3803898078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20b41f3810 0x7f20b41f3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.777+0000 7f20b27fc640 1 -- 172.21.15.59:0/3803898078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b415c140 con 0x7f20b41ef3f0 2023-10-16T14:27:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.777+0000 7f20b27fc640 1 --2- 172.21.15.59:0/3803898078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20b41ef3f0 0x7f20b41ef850 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f209c00d560 tx=0x7f209c00da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.777+0000 7f20ab7fe640 1 -- 172.21.15.59:0/3803898078 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c005480 con 0x7f20b41ef3f0 2023-10-16T14:27:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.777+0000 7f20ab7fe640 1 -- 172.21.15.59:0/3803898078 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209c003610 con 0x7f20b41ef3f0 2023-10-16T14:27:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.777+0000 7f20ab7fe640 1 -- 172.21.15.59:0/3803898078 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c003980 con 0x7f20b41ef3f0 2023-10-16T14:27:14.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.777+0000 7f20b3fff640 1 -- 172.21.15.59:0/3803898078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b415c420 con 0x7f20b41ef3f0 2023-10-16T14:27:14.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.778+0000 7f20b3fff640 1 -- 172.21.15.59:0/3803898078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b41efd90 con 0x7f20b41ef3f0 2023-10-16T14:27:14.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.779+0000 7f20b3fff640 1 -- 172.21.15.59:0/3803898078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b404e9b0 con 0x7f20b41ef3f0 2023-10-16T14:27:14.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.780+0000 7f20ab7fe640 1 -- 172.21.15.59:0/3803898078 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f209c003ae0 con 0x7f20b41ef3f0 2023-10-16T14:27:14.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.781+0000 7f20ab7fe640 1 --2- 172.21.15.59:0/3803898078 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f209406ae70 0x7f209406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:14.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.781+0000 7f20ab7fe640 1 -- 172.21.15.59:0/3803898078 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f209c0898a0 con 0x7f20b41ef3f0 2023-10-16T14:27:14.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.781+0000 7f20b2ffd640 1 --2- 172.21.15.59:0/3803898078 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f209406ae70 0x7f209406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:14.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.783+0000 7f20b2ffd640 1 --2- 172.21.15.59:0/3803898078 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f209406ae70 0x7f209406d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f20a4001890 tx=0x7f20a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:14.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.785+0000 7f20ab7fe640 1 -- 172.21.15.59:0/3803898078 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f209c054580 con 0x7f20b41ef3f0 2023-10-16T14:27:14.985 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.981+0000 7f20b3fff640 1 -- 172.21.15.59:0/3803898078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20b40b1100 con 0x7f20b41ef3f0 2023-10-16T14:27:14.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.985+0000 7f20ab7fe640 1 -- 172.21.15.59:0/3803898078 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18445 (secure 0 0 0) 0x7f20b40b1100 con 0x7f20b41ef3f0 2023-10-16T14:27:14.989 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:14.989 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:26:29.634854+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:27:14.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.987+0000 7f20b3fff640 1 -- 172.21.15.59:0/3803898078 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f209406ae70 msgr2=0x7f209406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:14.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.987+0000 7f20b3fff640 1 --2- 172.21.15.59:0/3803898078 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f209406ae70 0x7f209406d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f20a4001890 tx=0x7f20a4009040 comp rx=0 tx=0).stop 2023-10-16T14:27:14.991 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.987+0000 7f20b3fff640 1 -- 172.21.15.59:0/3803898078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20b41ef3f0 msgr2=0x7f20b41ef850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:14.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.987+0000 7f20b3fff640 1 --2- 172.21.15.59:0/3803898078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20b41ef3f0 0x7f20b41ef850 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f209c00d560 tx=0x7f209c00da20 comp rx=0 tx=0).stop 2023-10-16T14:27:14.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.988+0000 7f20b3fff640 1 -- 172.21.15.59:0/3803898078 shutdown_connections 2023-10-16T14:27:14.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.988+0000 7f20b3fff640 1 --2- 172.21.15.59:0/3803898078 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f209406ae70 0x7f209406d330 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.988+0000 7f20b3fff640 1 --2- 172.21.15.59:0/3803898078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20b41f3810 0x7f20b41f3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.988+0000 7f20b3fff640 1 --2- 172.21.15.59:0/3803898078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20b41ef3f0 0x7f20b41ef850 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.988+0000 7f20b3fff640 1 --2- 172.21.15.59:0/3803898078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20a0005180 0x7f20b415b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.988+0000 7f20b3fff640 1 -- 172.21.15.59:0/3803898078 >> 172.21.15.59:0/3803898078 conn(0x7f20b406a470 msgr2=0x7f20b40cab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.988+0000 7f20b3fff640 1 -- 172.21.15.59:0/3803898078 shutdown_connections 2023-10-16T14:27:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:14.988+0000 7f20b3fff640 1 -- 172.21.15.59:0/3803898078 wait complete. 2023-10-16T14:27:15.011 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-16T14:25:46.371818+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-16T14:25:47.145341+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-16T14:25:50.758038+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-16T14:27:15.012 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:27:15.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.245+0000 7f41c3fff640 1 Processor -- start 2023-10-16T14:27:15.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.245+0000 7f41c3fff640 1 -- start start 2023-10-16T14:27:15.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.246+0000 7f41c3fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f41c415c9d0 0x7f41c406b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:15.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.246+0000 7f41c3fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41c40ce8a0 0x7f41c40caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:15.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.247+0000 7f41c3fff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c4161410 con 0x7f41c4160fb0 2023-10-16T14:27:15.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.247+0000 7f41c3fff640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c40cab30 con 0x7f41c415c9d0 2023-10-16T14:27:15.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.247+0000 7f41c3fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c406b7e0 con 0x7f41c40ce8a0 2023-10-16T14:27:15.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.247+0000 7f41c2ffd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f41c415c9d0 0x7f41c406b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:15.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.247+0000 7f41c2ffd640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f41c415c9d0 0x7f41c406b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34762/0 (socket says 172.21.15.59:34762) 2023-10-16T14:27:15.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.247+0000 7f41c2ffd640 1 -- 172.21.15.59:0/146441266 learned_addr learned my addr 172.21.15.59:0/146441266 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:15.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.247+0000 7f41c37fe640 1 --2- 172.21.15.59:0/146441266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41c40ce8a0 0x7f41c40caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:15.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.248+0000 7f41c2ffd640 1 -- 172.21.15.59:0/146441266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41c40ce8a0 msgr2=0x7f41c40caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:15.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.248+0000 7f41c2ffd640 1 --2- 172.21.15.59:0/146441266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41c40ce8a0 0x7f41c40caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:15.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.248+0000 7f41c2ffd640 1 -- 172.21.15.59:0/146441266 >> v1:172.21.15.151:6789/0 conn(0x7f41c4160fb0 legacy=0x7f41c40ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:15.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.248+0000 7f41c2ffd640 1 -- 172.21.15.59:0/146441266 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c406bac0 con 0x7f41c415c9d0 2023-10-16T14:27:15.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.249+0000 7f41c2ffd640 1 --2- 172.21.15.59:0/146441266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c415c9d0 0x7f41c406b100 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009870 tx=0x7f41b402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e7b065623ea1b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:15.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.250+0000 7f41c1ffb640 1 -- 172.21.15.59:0/146441266 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b4030840 con 0x7f41c415c9d0 2023-10-16T14:27:15.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.250+0000 7f41c1ffb640 1 -- 172.21.15.59:0/146441266 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b40309a0 con 0x7f41c415c9d0 2023-10-16T14:27:15.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.250+0000 7f41c1ffb640 1 -- 172.21.15.59:0/146441266 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b4030d30 con 0x7f41c415c9d0 2023-10-16T14:27:15.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.250+0000 7f41c3fff640 1 -- 172.21.15.59:0/146441266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c415c9d0 msgr2=0x7f41c406b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:15.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.250+0000 7f41c3fff640 1 --2- 172.21.15.59:0/146441266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c415c9d0 0x7f41c406b100 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009870 tx=0x7f41b402b980 comp rx=0 tx=0).stop 2023-10-16T14:27:15.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.250+0000 7f41c3fff640 1 -- 172.21.15.59:0/146441266 shutdown_connections 2023-10-16T14:27:15.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.250+0000 7f41c3fff640 1 --2- 172.21.15.59:0/146441266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41c40ce8a0 0x7f41c40caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:15.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.250+0000 7f41c3fff640 1 --2- 172.21.15.59:0/146441266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c415c9d0 0x7f41c406b100 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:15.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.250+0000 7f41c3fff640 1 -- 172.21.15.59:0/146441266 >> 172.21.15.59:0/146441266 conn(0x7f41c4069de0 msgr2=0x7f41c406a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:15.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.251+0000 7f41c3fff640 1 -- 172.21.15.59:0/146441266 shutdown_connections 2023-10-16T14:27:15.257 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.251+0000 7f41c3fff640 1 -- 172.21.15.59:0/146441266 wait complete. 2023-10-16T14:27:15.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.252+0000 7f41c3fff640 1 Processor -- start 2023-10-16T14:27:15.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.253+0000 7f41c3fff640 1 -- start start 2023-10-16T14:27:15.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.254+0000 7f41c3fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41c40ce8a0 0x7f41c4153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:15.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.254+0000 7f41c3fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41c415c9d0 0x7f41c41f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:15.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.254+0000 7f41c3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c4160fb0 0x7f41c40b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:15.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.254+0000 7f41c3fff640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c40b3090 con 0x7f41c4160fb0 2023-10-16T14:27:15.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.254+0000 7f41c3fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c40b3610 con 0x7f41c415c9d0 2023-10-16T14:27:15.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.254+0000 7f41c3fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c41f1ff0 con 0x7f41c40ce8a0 2023-10-16T14:27:15.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.254+0000 7f41c37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c4160fb0 0x7f41c40b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:15.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.254+0000 7f41c37fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c4160fb0 0x7f41c40b53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34768/0 (socket says 172.21.15.59:34768) 2023-10-16T14:27:15.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.254+0000 7f41c37fe640 1 -- 172.21.15.59:0/907366275 learned_addr learned my addr 172.21.15.59:0/907366275 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:15.262 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.254+0000 7f41c27fc640 1 --2- 172.21.15.59:0/907366275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41c415c9d0 0x7f41c41f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:15.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.254+0000 7f41c2ffd640 1 --2- 172.21.15.59:0/907366275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41c40ce8a0 0x7f41c4153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:15.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.255+0000 7f41c37fe640 1 -- 172.21.15.59:0/907366275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41c40ce8a0 msgr2=0x7f41c4153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:15.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.255+0000 7f41c37fe640 1 --2- 172.21.15.59:0/907366275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41c40ce8a0 0x7f41c4153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:15.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.255+0000 7f41c37fe640 1 -- 172.21.15.59:0/907366275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41c415c9d0 msgr2=0x7f41c41f56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:15.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.255+0000 7f41c37fe640 1 --2- 172.21.15.59:0/907366275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41c415c9d0 0x7f41c41f56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:15.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.255+0000 7f41c37fe640 1 -- 172.21.15.59:0/907366275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b40094d0 con 0x7f41c4160fb0 2023-10-16T14:27:15.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.255+0000 7f41c37fe640 1 --2- 172.21.15.59:0/907366275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c4160fb0 0x7f41c40b53c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f41bc007e60 tx=0x7f41bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:15.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.255+0000 7f41ab7fe640 1 -- 172.21.15.59:0/907366275 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc014620 con 0x7f41c4160fb0 2023-10-16T14:27:15.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.255+0000 7f41ab7fe640 1 -- 172.21.15.59:0/907366275 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc014780 con 0x7f41c4160fb0 2023-10-16T14:27:15.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.255+0000 7f41ab7fe640 1 -- 172.21.15.59:0/907366275 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc014b30 con 0x7f41c4160fb0 2023-10-16T14:27:15.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.255+0000 7f41c3fff640 1 -- 172.21.15.59:0/907366275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c41f6160 con 0x7f41c4160fb0 2023-10-16T14:27:15.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.255+0000 7f41c3fff640 1 -- 172.21.15.59:0/907366275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c40b32a0 con 0x7f41c4160fb0 2023-10-16T14:27:15.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.256+0000 7f41c3fff640 1 -- 172.21.15.59:0/907366275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c40b37c0 con 0x7f41c4160fb0 2023-10-16T14:27:15.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.257+0000 7f41ab7fe640 1 -- 172.21.15.59:0/907366275 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f41bc014c90 con 0x7f41c4160fb0 2023-10-16T14:27:15.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.258+0000 7f41ab7fe640 1 --2- 172.21.15.59:0/907366275 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f41b006ae70 0x7f41b006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:15.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.259+0000 7f41ab7fe640 1 -- 172.21.15.59:0/907366275 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f41bc08a360 con 0x7f41c4160fb0 2023-10-16T14:27:15.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.259+0000 7f41c2ffd640 1 --2- 172.21.15.59:0/907366275 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f41b006ae70 0x7f41b006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:15.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.260+0000 7f41c2ffd640 1 --2- 172.21.15.59:0/907366275 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f41b006ae70 0x7f41b006d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f41b4036000 tx=0x7f41b4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:15.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.263+0000 7f41ab7fe640 1 -- 172.21.15.59:0/907366275 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f41c40b37c0 con 0x7f41c4160fb0 2023-10-16T14:27:15.460 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.457+0000 7f41c3fff640 1 -- 172.21.15.59:0/907366275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f41c40b37c0 con 0x7f41c4160fb0 2023-10-16T14:27:15.461 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.458+0000 7f41ab7fe640 1 -- 172.21.15.59:0/907366275 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f41c40b37c0 con 0x7f41c4160fb0 2023-10-16T14:27:15.461 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:27:15.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.460+0000 7f41c3fff640 1 -- 172.21.15.59:0/907366275 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f41b006ae70 msgr2=0x7f41b006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:15.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.460+0000 7f41c3fff640 1 --2- 172.21.15.59:0/907366275 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f41b006ae70 0x7f41b006d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f41b4036000 tx=0x7f41b4008030 comp rx=0 tx=0).stop 2023-10-16T14:27:15.464 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.460+0000 7f41c3fff640 1 -- 172.21.15.59:0/907366275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c4160fb0 msgr2=0x7f41c40b53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:15.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.460+0000 7f41c3fff640 1 --2- 172.21.15.59:0/907366275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c4160fb0 0x7f41c40b53c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f41bc007e60 tx=0x7f41bc00e4b0 comp rx=0 tx=0).stop 2023-10-16T14:27:15.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.461+0000 7f41c3fff640 1 -- 172.21.15.59:0/907366275 shutdown_connections 2023-10-16T14:27:15.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.461+0000 7f41c3fff640 1 --2- 172.21.15.59:0/907366275 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f41b006ae70 0x7f41b006d330 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:15.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.461+0000 7f41c3fff640 1 --2- 172.21.15.59:0/907366275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c4160fb0 0x7f41c40b53c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:15.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.461+0000 7f41c3fff640 1 --2- 172.21.15.59:0/907366275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41c415c9d0 0x7f41c41f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:15.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.461+0000 7f41c3fff640 1 --2- 172.21.15.59:0/907366275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41c40ce8a0 0x7f41c4153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:15.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.461+0000 7f41c3fff640 1 -- 172.21.15.59:0/907366275 >> 172.21.15.59:0/907366275 conn(0x7f41c4069de0 msgr2=0x7f41c40d0470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:15.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.461+0000 7f41c3fff640 1 -- 172.21.15.59:0/907366275 shutdown_connections 2023-10-16T14:27:15.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.461+0000 7f41c3fff640 1 -- 172.21.15.59:0/907366275 wait complete. 2023-10-16T14:27:15.482 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-16T14:27:15.717 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.714+0000 7ff8a25e7640 1 Processor -- start 2023-10-16T14:27:15.718 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.714+0000 7ff8a25e7640 1 -- start start 2023-10-16T14:27:15.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.715+0000 7ff8a25e7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff89c15cbc0 0x7ff89c0afda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:15.719 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.716+0000 7ff8a25e7640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff89c0af960 0x7ff89c0cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:15.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.716+0000 7ff8a25e7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89c0aedc0 con 0x7ff89c0b02e0 2023-10-16T14:27:15.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.716+0000 7ff8a25e7640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89c0d16c0 con 0x7ff89c0af960 2023-10-16T14:27:15.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.716+0000 7ff8a25e7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89c0cfe70 con 0x7ff89c15cbc0 2023-10-16T14:27:15.720 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.716+0000 7ff8a0b84640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff89c0af960 0x7ff89c0cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:15.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.716+0000 7ff8a0b84640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff89c0af960 0x7ff89c0cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34772/0 (socket says 172.21.15.59:34772) 2023-10-16T14:27:15.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.716+0000 7ff8a0b84640 1 -- 172.21.15.59:0/1567872969 learned_addr learned my addr 172.21.15.59:0/1567872969 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:15.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.716+0000 7ff8a0b84640 1 -- 172.21.15.59:0/1567872969 >> v2:172.21.15.151:3300/0 conn(0x7ff89c15cbc0 msgr2=0x7ff89c0afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:15.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.716+0000 7ff8a0b84640 1 --2- 172.21.15.59:0/1567872969 >> v2:172.21.15.151:3300/0 conn(0x7ff89c15cbc0 0x7ff89c0afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:15.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.716+0000 7ff8a0b84640 1 -- 172.21.15.59:0/1567872969 >> v1:172.21.15.151:6789/0 conn(0x7ff89c0b02e0 legacy=0x7ff89c0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:15.723 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.716+0000 7ff8a0b84640 1 -- 172.21.15.59:0/1567872969 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89c0ae490 con 0x7ff89c0af960 2023-10-16T14:27:15.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.718+0000 7ff8a0b84640 1 --2- 172.21.15.59:0/1567872969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff89c0af960 0x7ff89c0cce90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff89c0b33a0 tx=0x7ff89402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672a3662ec0a13af server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:15.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.718+0000 7ff89affd640 1 -- 172.21.15.59:0/1567872969 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff894031870 con 0x7ff89c0af960 2023-10-16T14:27:15.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.718+0000 7ff89affd640 1 -- 172.21.15.59:0/1567872969 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8940319d0 con 0x7ff89c0af960 2023-10-16T14:27:15.724 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.718+0000 7ff89affd640 1 -- 172.21.15.59:0/1567872969 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff894031d60 con 0x7ff89c0af960 2023-10-16T14:27:15.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.719+0000 7ff8a25e7640 1 -- 172.21.15.59:0/1567872969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff89c0af960 msgr2=0x7ff89c0cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:15.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.719+0000 7ff8a25e7640 1 --2- 172.21.15.59:0/1567872969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff89c0af960 0x7ff89c0cce90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff89c0b33a0 tx=0x7ff89402b910 comp rx=0 tx=0).stop 2023-10-16T14:27:15.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.719+0000 7ff8a25e7640 1 -- 172.21.15.59:0/1567872969 shutdown_connections 2023-10-16T14:27:15.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.719+0000 7ff8a25e7640 1 --2- 172.21.15.59:0/1567872969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff89c0af960 0x7ff89c0cce90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:15.725 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.719+0000 7ff8a25e7640 1 --2- 172.21.15.59:0/1567872969 >> v2:172.21.15.151:3300/0 conn(0x7ff89c15cbc0 0x7ff89c0afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.719+0000 7ff8a25e7640 1 -- 172.21.15.59:0/1567872969 >> 172.21.15.59:0/1567872969 conn(0x7ff89c0d0820 msgr2=0x7ff89c0d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.719+0000 7ff8a25e7640 1 -- 172.21.15.59:0/1567872969 shutdown_connections 2023-10-16T14:27:15.726 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.719+0000 7ff8a25e7640 1 -- 172.21.15.59:0/1567872969 wait complete. 2023-10-16T14:27:15.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.721+0000 7ff8a25e7640 1 Processor -- start 2023-10-16T14:27:15.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.721+0000 7ff8a25e7640 1 -- start start 2023-10-16T14:27:15.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.722+0000 7ff8a25e7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff89c0af960 0x7ff89c0b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:15.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.722+0000 7ff8a25e7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff89c0b02e0 0x7ff89c159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:15.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.722+0000 7ff8a25e7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff89c15cbc0 0x7ff89c0c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:15.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.722+0000 7ff8a25e7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c0c8b90 con 0x7ff89c0af960 2023-10-16T14:27:15.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.722+0000 7ff8a25e7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c0b3960 con 0x7ff89c15cbc0 2023-10-16T14:27:15.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.722+0000 7ff8a25e7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c0b4780 con 0x7ff89c0b02e0 2023-10-16T14:27:15.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.722+0000 7ff89bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff89c0af960 0x7ff89c0b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:15.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.722+0000 7ff89bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff89c0af960 0x7ff89c0b3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34778/0 (socket says 172.21.15.59:34778) 2023-10-16T14:27:15.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.722+0000 7ff89bfff640 1 -- 172.21.15.59:0/170207743 learned_addr learned my addr 172.21.15.59:0/170207743 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:15.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.723+0000 7ff8a0b84640 1 --2- 172.21.15.59:0/170207743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff89c15cbc0 0x7ff89c0c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:15.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.723+0000 7ff89b7fe640 1 --2- 172.21.15.59:0/170207743 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff89c0b02e0 0x7ff89c159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:15.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.723+0000 7ff89bfff640 1 -- 172.21.15.59:0/170207743 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff89c0b02e0 msgr2=0x7ff89c159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:15.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.723+0000 7ff89bfff640 1 --2- 172.21.15.59:0/170207743 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff89c0b02e0 0x7ff89c159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:15.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.723+0000 7ff89bfff640 1 -- 172.21.15.59:0/170207743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff89c15cbc0 msgr2=0x7ff89c0c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:15.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.723+0000 7ff89bfff640 1 --2- 172.21.15.59:0/170207743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff89c15cbc0 0x7ff89c0c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:15.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.723+0000 7ff89bfff640 1 -- 172.21.15.59:0/170207743 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8940094d0 con 0x7ff89c0af960 2023-10-16T14:27:15.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.723+0000 7ff89bfff640 1 --2- 172.21.15.59:0/170207743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff89c0af960 0x7ff89c0b3420 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff88c00ba80 tx=0x7ff88c00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:15.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.723+0000 7ff898ff9640 1 -- 172.21.15.59:0/170207743 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c00cc00 con 0x7ff89c0af960 2023-10-16T14:27:15.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.724+0000 7ff898ff9640 1 -- 172.21.15.59:0/170207743 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88c00cd80 con 0x7ff89c0af960 2023-10-16T14:27:15.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.724+0000 7ff8a25e7640 1 -- 172.21.15.59:0/170207743 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89c0b3b70 con 0x7ff89c0af960 2023-10-16T14:27:15.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.724+0000 7ff898ff9640 1 -- 172.21.15.59:0/170207743 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c014680 con 0x7ff89c0af960 2023-10-16T14:27:15.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.724+0000 7ff8a25e7640 1 -- 172.21.15.59:0/170207743 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89c0b4130 con 0x7ff89c0af960 2023-10-16T14:27:15.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.725+0000 7ff8a25e7640 1 -- 172.21.15.59:0/170207743 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff89c073ef0 con 0x7ff89c0af960 2023-10-16T14:27:15.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.726+0000 7ff898ff9640 1 -- 172.21.15.59:0/170207743 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff88c01d3b0 con 0x7ff89c0af960 2023-10-16T14:27:15.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.727+0000 7ff898ff9640 1 --2- 172.21.15.59:0/170207743 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff87c06ae70 0x7ff87c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:15.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.728+0000 7ff898ff9640 1 -- 172.21.15.59:0/170207743 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff88c089a50 con 0x7ff89c0af960 2023-10-16T14:27:15.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.728+0000 7ff89b7fe640 1 --2- 172.21.15.59:0/170207743 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff87c06ae70 0x7ff87c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.729+0000 7ff89b7fe640 1 --2- 172.21.15.59:0/170207743 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff87c06ae70 0x7ff87c06d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff89c1f5540 tx=0x7ff884009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.732+0000 7ff898ff9640 1 -- 172.21.15.59:0/170207743 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff88c0546a0 con 0x7ff89c0af960 2023-10-16T14:27:15.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.925+0000 7ff8a25e7640 1 -- 172.21.15.59:0/170207743 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff89c06b930 con 0x7ff89c0af960 2023-10-16T14:27:15.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.926+0000 7ff898ff9640 1 -- 172.21.15.59:0/170207743 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff88c0190a0 con 0x7ff89c0af960 2023-10-16T14:27:15.929 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:27:15.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.928+0000 7ff8a25e7640 1 -- 172.21.15.59:0/170207743 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff87c06ae70 msgr2=0x7ff87c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:15.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.928+0000 7ff8a25e7640 1 --2- 172.21.15.59:0/170207743 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff87c06ae70 0x7ff87c06d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff89c1f5540 tx=0x7ff884009040 comp rx=0 tx=0).stop 2023-10-16T14:27:15.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.928+0000 7ff8a25e7640 1 -- 172.21.15.59:0/170207743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff89c0af960 msgr2=0x7ff89c0b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:15.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.928+0000 7ff8a25e7640 1 --2- 172.21.15.59:0/170207743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff89c0af960 0x7ff89c0b3420 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff88c00ba80 tx=0x7ff88c00bf40 comp rx=0 tx=0).stop 2023-10-16T14:27:15.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.928+0000 7ff8a25e7640 1 -- 172.21.15.59:0/170207743 shutdown_connections 2023-10-16T14:27:15.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.929+0000 7ff8a25e7640 1 --2- 172.21.15.59:0/170207743 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff87c06ae70 0x7ff87c06d330 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:15.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.929+0000 7ff8a25e7640 1 --2- 172.21.15.59:0/170207743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff89c15cbc0 0x7ff89c0c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:15.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.929+0000 7ff8a25e7640 1 --2- 172.21.15.59:0/170207743 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff89c0b02e0 0x7ff89c159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:15.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.929+0000 7ff8a25e7640 1 --2- 172.21.15.59:0/170207743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff89c0af960 0x7ff89c0b3420 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:15.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.929+0000 7ff8a25e7640 1 -- 172.21.15.59:0/170207743 >> 172.21.15.59:0/170207743 conn(0x7ff89c0d0820 msgr2=0x7ff89c0b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:15.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.929+0000 7ff8a25e7640 1 -- 172.21.15.59:0/170207743 shutdown_connections 2023-10-16T14:27:15.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:15.929+0000 7ff8a25e7640 1 -- 172.21.15.59:0/170207743 wait complete. 2023-10-16T14:27:15.950 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-16T14:27:16.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.177+0000 7fe5d3fff640 1 Processor -- start 2023-10-16T14:27:16.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.178+0000 7fe5d3fff640 1 -- start start 2023-10-16T14:27:16.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.179+0000 7fe5d3fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe5d4154d10 0x7fe5d40ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:16.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.179+0000 7fe5d3fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5d40cee60 0x7fe5d406ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:16.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.179+0000 7fe5d3fff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d41550f0 con 0x7fe5d406d360 2023-10-16T14:27:16.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.179+0000 7fe5d3fff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d40cf310 con 0x7fe5d4154d10 2023-10-16T14:27:16.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.179+0000 7fe5d3fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d406db50 con 0x7fe5d40cee60 2023-10-16T14:27:16.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.180+0000 7fe5d2ffd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe5d4154d10 0x7fe5d40ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:16.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.180+0000 7fe5d27fc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5d40cee60 0x7fe5d406ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:16.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.180+0000 7fe5d2ffd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe5d4154d10 0x7fe5d40ce920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.59:50294/0 (socket says 172.21.15.59:50294) 2023-10-16T14:27:16.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.180+0000 7fe5d2ffd640 1 -- 172.21.15.59:0/1835788945 learned_addr learned my addr 172.21.15.59:0/1835788945 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:16.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.181+0000 7fe5d27fc640 1 -- 172.21.15.59:0/1835788945 >> v2:172.21.15.151:3300/0 conn(0x7fe5d4154d10 msgr2=0x7fe5d40ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:16.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.181+0000 7fe5d27fc640 1 --2- 172.21.15.59:0/1835788945 >> v2:172.21.15.151:3300/0 conn(0x7fe5d4154d10 0x7fe5d40ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.181+0000 7fe5d27fc640 1 -- 172.21.15.59:0/1835788945 >> v1:172.21.15.151:6789/0 conn(0x7fe5d406d360 legacy=0x7fe5d40ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:16.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.181+0000 7fe5d27fc640 1 -- 172.21.15.59:0/1835788945 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d40b13f0 con 0x7fe5d40cee60 2023-10-16T14:27:16.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.182+0000 7fe5d27fc640 1 --2- 172.21.15.59:0/1835788945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5d40cee60 0x7fe5d406ce20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0097a0 tx=0x7fe5bc02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=747faeb8035268ee server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:16.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.183+0000 7fe5d1ffb640 1 -- 172.21.15.59:0/1835788945 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc02d040 con 0x7fe5d40cee60 2023-10-16T14:27:16.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.183+0000 7fe5d1ffb640 1 -- 172.21.15.59:0/1835788945 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5bc031810 con 0x7fe5d40cee60 2023-10-16T14:27:16.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.183+0000 7fe5d1ffb640 1 -- 172.21.15.59:0/1835788945 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc031ba0 con 0x7fe5d40cee60 2023-10-16T14:27:16.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.184+0000 7fe5d3fff640 1 -- 172.21.15.59:0/1835788945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5d40cee60 msgr2=0x7fe5d406ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:16.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.184+0000 7fe5d3fff640 1 --2- 172.21.15.59:0/1835788945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5d40cee60 0x7fe5d406ce20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc0097a0 tx=0x7fe5bc02b8b0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.184+0000 7fe5d3fff640 1 -- 172.21.15.59:0/1835788945 shutdown_connections 2023-10-16T14:27:16.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.184+0000 7fe5d3fff640 1 --2- 172.21.15.59:0/1835788945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5d40cee60 0x7fe5d406ce20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.184+0000 7fe5d3fff640 1 --2- 172.21.15.59:0/1835788945 >> v2:172.21.15.151:3300/0 conn(0x7fe5d4154d10 0x7fe5d40ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.184+0000 7fe5d3fff640 1 -- 172.21.15.59:0/1835788945 >> 172.21.15.59:0/1835788945 conn(0x7fe5d406a200 msgr2=0x7fe5d406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:16.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.184+0000 7fe5d3fff640 1 -- 172.21.15.59:0/1835788945 shutdown_connections 2023-10-16T14:27:16.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.184+0000 7fe5d3fff640 1 -- 172.21.15.59:0/1835788945 wait complete. 2023-10-16T14:27:16.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.186+0000 7fe5d3fff640 1 Processor -- start 2023-10-16T14:27:16.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.187+0000 7fe5d3fff640 1 -- start start 2023-10-16T14:27:16.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.188+0000 7fe5d3fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5d406d360 0x7fe5d40c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:16.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.188+0000 7fe5d3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d40cee60 0x7fe5d40c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.188+0000 7fe5d3fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5d4154d10 0x7fe5d40c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.188+0000 7fe5d3fff640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d4099840 con 0x7fe5d40cee60 2023-10-16T14:27:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.188+0000 7fe5d3fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d40c6ee0 con 0x7fe5d406d360 2023-10-16T14:27:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.188+0000 7fe5d3fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d40c7d80 con 0x7fe5d4154d10 2023-10-16T14:27:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.188+0000 7fe5d27fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d40cee60 0x7fe5d40c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:16.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.188+0000 7fe5d27fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d40cee60 0x7fe5d40c58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34794/0 (socket says 172.21.15.59:34794) 2023-10-16T14:27:16.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.188+0000 7fe5d27fc640 1 -- 172.21.15.59:0/3726256073 learned_addr learned my addr 172.21.15.59:0/3726256073 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:16.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.189+0000 7fe5d2ffd640 1 --2- 172.21.15.59:0/3726256073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5d406d360 0x7fe5d40c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:16.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.189+0000 7fe5d37fe640 1 --2- 172.21.15.59:0/3726256073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5d4154d10 0x7fe5d40c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:16.194 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.189+0000 7fe5d27fc640 1 -- 172.21.15.59:0/3726256073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5d4154d10 msgr2=0x7fe5d40c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.189+0000 7fe5d27fc640 1 --2- 172.21.15.59:0/3726256073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5d4154d10 0x7fe5d40c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.189+0000 7fe5d27fc640 1 -- 172.21.15.59:0/3726256073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5d406d360 msgr2=0x7fe5d40c4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.189+0000 7fe5d27fc640 1 --2- 172.21.15.59:0/3726256073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5d406d360 0x7fe5d40c4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.189+0000 7fe5d27fc640 1 -- 172.21.15.59:0/3726256073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc009400 con 0x7fe5d40cee60 2023-10-16T14:27:16.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.189+0000 7fe5d27fc640 1 --2- 172.21.15.59:0/3726256073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d40cee60 0x7fe5d40c58c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc02b8f0 tx=0x7fe5bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:16.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.190+0000 7fe5cbfff640 1 -- 172.21.15.59:0/3726256073 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc006e10 con 0x7fe5d40cee60 2023-10-16T14:27:16.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.190+0000 7fe5cbfff640 1 -- 172.21.15.59:0/3726256073 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5bc03ad60 con 0x7fe5d40cee60 2023-10-16T14:27:16.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.190+0000 7fe5d3fff640 1 -- 172.21.15.59:0/3726256073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d40c6640 con 0x7fe5d40cee60 2023-10-16T14:27:16.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.190+0000 7fe5cbfff640 1 -- 172.21.15.59:0/3726256073 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc044630 con 0x7fe5d40cee60 2023-10-16T14:27:16.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.190+0000 7fe5d3fff640 1 -- 172.21.15.59:0/3726256073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d40c6c00 con 0x7fe5d40cee60 2023-10-16T14:27:16.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.191+0000 7fe5d3fff640 1 -- 172.21.15.59:0/3726256073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d404e9b0 con 0x7fe5d40cee60 2023-10-16T14:27:16.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.192+0000 7fe5cbfff640 1 -- 172.21.15.59:0/3726256073 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe5bc04d450 con 0x7fe5d40cee60 2023-10-16T14:27:16.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.193+0000 7fe5cbfff640 1 --2- 172.21.15.59:0/3726256073 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe5b406ae70 0x7fe5b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:16.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.193+0000 7fe5cbfff640 1 -- 172.21.15.59:0/3726256073 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fe5bc0abc30 con 0x7fe5d40cee60 2023-10-16T14:27:16.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.194+0000 7fe5d2ffd640 1 --2- 172.21.15.59:0/3726256073 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe5b406ae70 0x7fe5b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:16.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.195+0000 7fe5d2ffd640 1 --2- 172.21.15.59:0/3726256073 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe5b406ae70 0x7fe5b406d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4009ce0 tx=0x7fe5c400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:16.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.197+0000 7fe5cbfff640 1 -- 172.21.15.59:0/3726256073 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe5bc0769a0 con 0x7fe5d40cee60 2023-10-16T14:27:16.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.391+0000 7fe5d3fff640 1 -- 172.21.15.59:0/3726256073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe5d40999d0 con 0x7fe5d40cee60 2023-10-16T14:27:16.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.393+0000 7fe5cbfff640 1 -- 172.21.15.59:0/3726256073 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe5bc079fc0 con 0x7fe5d40cee60 2023-10-16T14:27:16.396 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2023-10-16T14:27:16.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.395+0000 7fe5d3fff640 1 -- 172.21.15.59:0/3726256073 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe5b406ae70 msgr2=0x7fe5b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:16.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.395+0000 7fe5d3fff640 1 --2- 172.21.15.59:0/3726256073 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe5b406ae70 0x7fe5b406d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4009ce0 tx=0x7fe5c400b040 comp rx=0 tx=0).stop 2023-10-16T14:27:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.395+0000 7fe5d3fff640 1 -- 172.21.15.59:0/3726256073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d40cee60 msgr2=0x7fe5d40c58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.395+0000 7fe5d3fff640 1 --2- 172.21.15.59:0/3726256073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d40cee60 0x7fe5d40c58c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc02b8f0 tx=0x7fe5bc0046c0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.396+0000 7fe5d3fff640 1 -- 172.21.15.59:0/3726256073 shutdown_connections 2023-10-16T14:27:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.396+0000 7fe5d3fff640 1 --2- 172.21.15.59:0/3726256073 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe5b406ae70 0x7fe5b406d330 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.396+0000 7fe5d3fff640 1 --2- 172.21.15.59:0/3726256073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5d4154d10 0x7fe5d40c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.396+0000 7fe5d3fff640 1 --2- 172.21.15.59:0/3726256073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5d40cee60 0x7fe5d40c58c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.396+0000 7fe5d3fff640 1 --2- 172.21.15.59:0/3726256073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5d406d360 0x7fe5d40c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.396+0000 7fe5d3fff640 1 -- 172.21.15.59:0/3726256073 >> 172.21.15.59:0/3726256073 conn(0x7fe5d406a200 msgr2=0x7fe5d40b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:16.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.396+0000 7fe5d3fff640 1 -- 172.21.15.59:0/3726256073 shutdown_connections 2023-10-16T14:27:16.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.396+0000 7fe5d3fff640 1 -- 172.21.15.59:0/3726256073 wait complete. 2023-10-16T14:27:16.419 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-16T14:27:16.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.637+0000 7efd0f59e640 1 Processor -- start 2023-10-16T14:27:16.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.638+0000 7efd0f59e640 1 -- start start 2023-10-16T14:27:16.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.639+0000 7efd0f59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd1015c8e0 0x7efd100cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:16.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.639+0000 7efd0f59e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efd1006d230 0x7efd1006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:16.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.639+0000 7efd0f59e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd100cdac0 con 0x7efd100ce920 2023-10-16T14:27:16.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.639+0000 7efd0f59e640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd1006df90 con 0x7efd1006d230 2023-10-16T14:27:16.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.639+0000 7efd0f59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd100cd1f0 con 0x7efd1015c8e0 2023-10-16T14:27:16.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.639+0000 7efd0ed9d640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efd100ce920 0x7efd10070040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34710/0 (socket says 172.21.15.59:34710) 2023-10-16T14:27:16.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.639+0000 7efd0ed9d640 1 -- 172.21.15.59:0/338819833 learned_addr learned my addr 172.21.15.59:0/338819833 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:16.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.640+0000 7efd07fff640 1 --2- 172.21.15.59:0/338819833 >> v2:172.21.15.59:3300/0 conn(0x7efd1006d230 0x7efd1006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:16.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.640+0000 7efd0e59c640 1 --2- 172.21.15.59:0/338819833 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd1015c8e0 0x7efd100cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:16.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.640+0000 7efd0dd9b640 1 -- 172.21.15.59:0/338819833 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 766743993 0 0) 0x7efd100cdac0 con 0x7efd100ce920 2023-10-16T14:27:16.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.640+0000 7efd0dd9b640 1 -- 172.21.15.59:0/338819833 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcfc003520 con 0x7efd100ce920 2023-10-16T14:27:16.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.640+0000 7efd07fff640 1 -- 172.21.15.59:0/338819833 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd1015c8e0 msgr2=0x7efd100cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:16.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.640+0000 7efd07fff640 1 --2- 172.21.15.59:0/338819833 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd1015c8e0 0x7efd100cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.647 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.640+0000 7efd07fff640 1 -- 172.21.15.59:0/338819833 >> v1:172.21.15.59:6789/0 conn(0x7efd100ce920 legacy=0x7efd10070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:16.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.640+0000 7efd07fff640 1 -- 172.21.15.59:0/338819833 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1006dcb0 con 0x7efd1006d230 2023-10-16T14:27:16.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.642+0000 7efd07fff640 1 --2- 172.21.15.59:0/338819833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd1006d230 0x7efd1006d690 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7efcf80097a0 tx=0x7efcf802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb85c3384795016 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:16.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.642+0000 7efd0dd9b640 1 -- 172.21.15.59:0/338819833 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf802d040 con 0x7efd1006d230 2023-10-16T14:27:16.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.642+0000 7efd0dd9b640 1 -- 172.21.15.59:0/338819833 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf8031810 con 0x7efd1006d230 2023-10-16T14:27:16.648 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.642+0000 7efd0dd9b640 1 -- 172.21.15.59:0/338819833 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf8031b80 con 0x7efd1006d230 2023-10-16T14:27:16.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.643+0000 7efd0f59e640 1 -- 172.21.15.59:0/338819833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd1006d230 msgr2=0x7efd1006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:16.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.643+0000 7efd0f59e640 1 --2- 172.21.15.59:0/338819833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd1006d230 0x7efd1006d690 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7efcf80097a0 tx=0x7efcf802b8b0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.643+0000 7efd0f59e640 1 -- 172.21.15.59:0/338819833 shutdown_connections 2023-10-16T14:27:16.649 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.643+0000 7efd0f59e640 1 --2- 172.21.15.59:0/338819833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd1006d230 0x7efd1006d690 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.643+0000 7efd0f59e640 1 --2- 172.21.15.59:0/338819833 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd1015c8e0 0x7efd100cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.643+0000 7efd0f59e640 1 -- 172.21.15.59:0/338819833 >> 172.21.15.59:0/338819833 conn(0x7efd1006a200 msgr2=0x7efd1006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:16.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.643+0000 7efd0f59e640 1 -- 172.21.15.59:0/338819833 shutdown_connections 2023-10-16T14:27:16.650 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.643+0000 7efd0f59e640 1 -- 172.21.15.59:0/338819833 wait complete. 2023-10-16T14:27:16.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.645+0000 7efd0f59e640 1 Processor -- start 2023-10-16T14:27:16.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.645+0000 7efd0f59e640 1 -- start start 2023-10-16T14:27:16.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.646+0000 7efd0f59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd1006d230 0x7efd100c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:16.653 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.646+0000 7efd0f59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd100ce920 0x7efd1015bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:16.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.646+0000 7efd0f59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd1015c8e0 0x7efd10156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:16.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.646+0000 7efd0f59e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd100c9dc0 con 0x7efd100ce920 2023-10-16T14:27:16.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.646+0000 7efd0f59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1015c160 con 0x7efd1015c8e0 2023-10-16T14:27:16.654 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.646+0000 7efd0f59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd100ca250 con 0x7efd1006d230 2023-10-16T14:27:16.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.646+0000 7efd07fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd100ce920 0x7efd1015bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:16.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.646+0000 7efd07fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd100ce920 0x7efd1015bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34800/0 (socket says 172.21.15.59:34800) 2023-10-16T14:27:16.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.646+0000 7efd07fff640 1 -- 172.21.15.59:0/3224570916 learned_addr learned my addr 172.21.15.59:0/3224570916 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:16.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.646+0000 7efd0e59c640 1 --2- 172.21.15.59:0/3224570916 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd1006d230 0x7efd100c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:16.655 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.646+0000 7efd07fff640 1 -- 172.21.15.59:0/3224570916 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd1006d230 msgr2=0x7efd100c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:16.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.646+0000 7efd07fff640 1 --2- 172.21.15.59:0/3224570916 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd1006d230 0x7efd100c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.646+0000 7efd0ed9d640 1 --2- 172.21.15.59:0/3224570916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd1015c8e0 0x7efd10156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:16.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.646+0000 7efd07fff640 1 -- 172.21.15.59:0/3224570916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd1015c8e0 msgr2=0x7efd10156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:16.656 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.647+0000 7efd07fff640 1 --2- 172.21.15.59:0/3224570916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd1015c8e0 0x7efd10156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.647+0000 7efd07fff640 1 -- 172.21.15.59:0/3224570916 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf8009400 con 0x7efd100ce920 2023-10-16T14:27:16.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.647+0000 7efd0ed9d640 1 --2- 172.21.15.59:0/3224570916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd1015c8e0 0x7efd10156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:16.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.647+0000 7efd07fff640 1 --2- 172.21.15.59:0/3224570916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd100ce920 0x7efd1015bc20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7efcf8000c00 tx=0x7efcf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:16.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.647+0000 7efd06ffd640 1 -- 172.21.15.59:0/3224570916 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf803ad60 con 0x7efd100ce920 2023-10-16T14:27:16.657 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.647+0000 7efd06ffd640 1 -- 172.21.15.59:0/3224570916 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf8044400 con 0x7efd100ce920 2023-10-16T14:27:16.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.647+0000 7efd06ffd640 1 -- 172.21.15.59:0/3224570916 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf8044590 con 0x7efd100ce920 2023-10-16T14:27:16.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.647+0000 7efd0f59e640 1 -- 172.21.15.59:0/3224570916 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd100c91b0 con 0x7efd100ce920 2023-10-16T14:27:16.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.647+0000 7efd0f59e640 1 -- 172.21.15.59:0/3224570916 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd100c9770 con 0x7efd100ce920 2023-10-16T14:27:16.658 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.649+0000 7efd0f59e640 1 -- 172.21.15.59:0/3224570916 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd10161310 con 0x7efd100ce920 2023-10-16T14:27:16.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.650+0000 7efd06ffd640 1 -- 172.21.15.59:0/3224570916 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efcf804d440 con 0x7efd100ce920 2023-10-16T14:27:16.659 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.650+0000 7efd06ffd640 1 --2- 172.21.15.59:0/3224570916 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7efcf006aef0 0x7efcf006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:16.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.651+0000 7efd06ffd640 1 -- 172.21.15.59:0/3224570916 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7efcf80aba70 con 0x7efd100ce920 2023-10-16T14:27:16.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.651+0000 7efd0e59c640 1 --2- 172.21.15.59:0/3224570916 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7efcf006aef0 0x7efcf006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:16.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.652+0000 7efd0e59c640 1 --2- 172.21.15.59:0/3224570916 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7efcf006aef0 0x7efcf006d3b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efd00009a10 tx=0x7efd00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:16.660 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.655+0000 7efd06ffd640 1 -- 172.21.15.59:0/3224570916 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efcf80768d0 con 0x7efd100ce920 2023-10-16T14:27:16.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.857+0000 7efd0f59e640 1 -- 172.21.15.59:0/3224570916 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efd1006aa60 con 0x7efd100ce920 2023-10-16T14:27:16.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.858+0000 7efd06ffd640 1 -- 172.21.15.59:0/3224570916 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7efcf80a9e60 con 0x7efd100ce920 2023-10-16T14:27:16.862 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2023-10-16T14:27:16.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.861+0000 7efd0f59e640 1 -- 172.21.15.59:0/3224570916 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7efcf006aef0 msgr2=0x7efcf006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:16.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.861+0000 7efd0f59e640 1 --2- 172.21.15.59:0/3224570916 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7efcf006aef0 0x7efcf006d3b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7efd00009a10 tx=0x7efd00008040 comp rx=0 tx=0).stop 2023-10-16T14:27:16.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.861+0000 7efd0f59e640 1 -- 172.21.15.59:0/3224570916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd100ce920 msgr2=0x7efd1015bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:16.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.861+0000 7efd0f59e640 1 --2- 172.21.15.59:0/3224570916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd100ce920 0x7efd1015bc20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7efcf8000c00 tx=0x7efcf80046c0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.861+0000 7efd0f59e640 1 -- 172.21.15.59:0/3224570916 shutdown_connections 2023-10-16T14:27:16.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.861+0000 7efd0f59e640 1 --2- 172.21.15.59:0/3224570916 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7efcf006aef0 0x7efcf006d3b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.861+0000 7efd0f59e640 1 --2- 172.21.15.59:0/3224570916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd1015c8e0 0x7efd10156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.861+0000 7efd0f59e640 1 --2- 172.21.15.59:0/3224570916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd100ce920 0x7efd1015bc20 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.861+0000 7efd0f59e640 1 --2- 172.21.15.59:0/3224570916 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd1006d230 0x7efd100c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:16.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.861+0000 7efd0f59e640 1 -- 172.21.15.59:0/3224570916 >> 172.21.15.59:0/3224570916 conn(0x7efd1006a200 msgr2=0x7efd100acb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:16.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.861+0000 7efd0f59e640 1 -- 172.21.15.59:0/3224570916 shutdown_connections 2023-10-16T14:27:16.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:16.861+0000 7efd0f59e640 1 -- 172.21.15.59:0/3224570916 wait complete. 2023-10-16T14:27:16.884 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T14:27:17.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.109+0000 7fe96a478640 1 Processor -- start 2023-10-16T14:27:17.113 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.110+0000 7fe96a478640 1 -- start start 2023-10-16T14:27:17.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.111+0000 7fe96a478640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9640cb250 0x7fe9640c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:17.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.111+0000 7fe96a478640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe96415acb0 con 0x7fe96415a8d0 2023-10-16T14:27:17.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.111+0000 7fe96a478640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9640c1c60 con 0x7fe9640ca660 2023-10-16T14:27:17.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.111+0000 7fe96a478640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96415e350 con 0x7fe9640cb250 2023-10-16T14:27:17.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.112+0000 7fe969476640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe96415a8d0 0x7fe9640cab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34716/0 (socket says 172.21.15.59:34716) 2023-10-16T14:27:17.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.112+0000 7fe969476640 1 -- 172.21.15.59:0/3719517777 learned_addr learned my addr 172.21.15.59:0/3719517777 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:17.116 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.112+0000 7fe968c75640 1 --2- 172.21.15.59:0/3719517777 >> v2:172.21.15.59:3300/0 conn(0x7fe9640cb250 0x7fe9640c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:17.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.112+0000 7fe95bfff640 1 -- 172.21.15.59:0/3719517777 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3933872755 0 0) 0x7fe960001290 con 0x7fe96415a8d0 2023-10-16T14:27:17.117 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.112+0000 7fe95bfff640 1 -- 172.21.15.59:0/3719517777 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe950003520 con 0x7fe96415a8d0 2023-10-16T14:27:17.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.112+0000 7fe968c75640 1 -- 172.21.15.59:0/3719517777 >> v1:172.21.15.151:6789/0 conn(0x7fe9640ca660 legacy=0x7fe9640c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:17.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.112+0000 7fe968c75640 1 -- 172.21.15.59:0/3719517777 >> v1:172.21.15.59:6789/0 conn(0x7fe96415a8d0 legacy=0x7fe9640cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:17.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.112+0000 7fe968c75640 1 -- 172.21.15.59:0/3719517777 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96415e630 con 0x7fe9640cb250 2023-10-16T14:27:17.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.113+0000 7fe968c75640 1 --2- 172.21.15.59:0/3719517777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9640cb250 0x7fe9640c8e10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe9640c1df0 tx=0x7fe95402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b467f3d357d47be1 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:17.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.114+0000 7fe95bfff640 1 -- 172.21.15.59:0/3719517777 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe954031830 con 0x7fe9640cb250 2023-10-16T14:27:17.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.114+0000 7fe95bfff640 1 -- 172.21.15.59:0/3719517777 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe954031990 con 0x7fe9640cb250 2023-10-16T14:27:17.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.114+0000 7fe95bfff640 1 -- 172.21.15.59:0/3719517777 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe954031d00 con 0x7fe9640cb250 2023-10-16T14:27:17.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.114+0000 7fe96a478640 1 -- 172.21.15.59:0/3719517777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9640cb250 msgr2=0x7fe9640c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:17.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.114+0000 7fe96a478640 1 --2- 172.21.15.59:0/3719517777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9640cb250 0x7fe9640c8e10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe9640c1df0 tx=0x7fe95402b8d0 comp rx=0 tx=0).stop 2023-10-16T14:27:17.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.115+0000 7fe96a478640 1 -- 172.21.15.59:0/3719517777 shutdown_connections 2023-10-16T14:27:17.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.115+0000 7fe96a478640 1 --2- 172.21.15.59:0/3719517777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9640cb250 0x7fe9640c8e10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:17.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.115+0000 7fe96a478640 1 -- 172.21.15.59:0/3719517777 >> 172.21.15.59:0/3719517777 conn(0x7fe96406a470 msgr2=0x7fe9640afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:17.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.115+0000 7fe96a478640 1 -- 172.21.15.59:0/3719517777 shutdown_connections 2023-10-16T14:27:17.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.115+0000 7fe96a478640 1 -- 172.21.15.59:0/3719517777 wait complete. 2023-10-16T14:27:17.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.116+0000 7fe96a478640 1 Processor -- start 2023-10-16T14:27:17.122 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.117+0000 7fe96a478640 1 -- start start 2023-10-16T14:27:17.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.118+0000 7fe96a478640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9640ca660 0x7fe964155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:17.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.118+0000 7fe96a478640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9640cb250 0x7fe964154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:17.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.118+0000 7fe96a478640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe96415a8d0 0x7fe9640b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:17.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.118+0000 7fe96a478640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640b17e0 con 0x7fe9640ca660 2023-10-16T14:27:17.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.118+0000 7fe96a478640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640b1ac0 con 0x7fe96415a8d0 2023-10-16T14:27:17.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.118+0000 7fe96a478640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640b1da0 con 0x7fe9640cb250 2023-10-16T14:27:17.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.118+0000 7fe969476640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9640ca660 0x7fe964155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:17.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.118+0000 7fe969476640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9640ca660 0x7fe964155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34808/0 (socket says 172.21.15.59:34808) 2023-10-16T14:27:17.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.118+0000 7fe969476640 1 -- 172.21.15.59:0/2074810484 learned_addr learned my addr 172.21.15.59:0/2074810484 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:17.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.118+0000 7fe968c75640 1 --2- 172.21.15.59:0/2074810484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9640cb250 0x7fe964154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:17.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.118+0000 7fe969c77640 1 --2- 172.21.15.59:0/2074810484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe96415a8d0 0x7fe9640b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:17.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.118+0000 7fe969476640 1 -- 172.21.15.59:0/2074810484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9640cb250 msgr2=0x7fe964154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:17.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.118+0000 7fe969476640 1 --2- 172.21.15.59:0/2074810484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9640cb250 0x7fe964154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:17.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.118+0000 7fe969476640 1 -- 172.21.15.59:0/2074810484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe96415a8d0 msgr2=0x7fe9640b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:17.126 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.119+0000 7fe969476640 1 --2- 172.21.15.59:0/2074810484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe96415a8d0 0x7fe9640b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:17.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.119+0000 7fe969476640 1 -- 172.21.15.59:0/2074810484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe954009400 con 0x7fe9640ca660 2023-10-16T14:27:17.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.119+0000 7fe969c77640 1 --2- 172.21.15.59:0/2074810484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe96415a8d0 0x7fe9640b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:17.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.119+0000 7fe969476640 1 --2- 172.21.15.59:0/2074810484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9640ca660 0x7fe964155600 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe96000c390 tx=0x7fe96000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:17.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.119+0000 7fe959ffb640 1 -- 172.21.15.59:0/2074810484 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9600074e0 con 0x7fe9640ca660 2023-10-16T14:27:17.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.119+0000 7fe959ffb640 1 -- 172.21.15.59:0/2074810484 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe960007640 con 0x7fe9640ca660 2023-10-16T14:27:17.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.119+0000 7fe959ffb640 1 -- 172.21.15.59:0/2074810484 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9600059c0 con 0x7fe9640ca660 2023-10-16T14:27:17.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.119+0000 7fe96a478640 1 -- 172.21.15.59:0/2074810484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9640b2080 con 0x7fe9640ca660 2023-10-16T14:27:17.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.119+0000 7fe96a478640 1 -- 172.21.15.59:0/2074810484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe964155390 con 0x7fe9640ca660 2023-10-16T14:27:17.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.121+0000 7fe96a478640 1 -- 172.21.15.59:0/2074810484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9640b25a0 con 0x7fe9640ca660 2023-10-16T14:27:17.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.121+0000 7fe959ffb640 1 -- 172.21.15.59:0/2074810484 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe960005b20 con 0x7fe9640ca660 2023-10-16T14:27:17.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.123+0000 7fe959ffb640 1 --2- 172.21.15.59:0/2074810484 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe94806ae70 0x7fe94806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:17.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.123+0000 7fe959ffb640 1 -- 172.21.15.59:0/2074810484 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7fe960088d90 con 0x7fe9640ca660 2023-10-16T14:27:17.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.124+0000 7fe968c75640 1 --2- 172.21.15.59:0/2074810484 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe94806ae70 0x7fe94806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:17.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.125+0000 7fe968c75640 1 --2- 172.21.15.59:0/2074810484 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe94806ae70 0x7fe94806d330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe954036000 tx=0x7fe954008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:17.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.128+0000 7fe959ffb640 1 -- 172.21.15.59:0/2074810484 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe960053b10 con 0x7fe9640ca660 2023-10-16T14:27:17.361 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.357+0000 7fe96a478640 1 -- 172.21.15.59:0/2074810484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe96404e9b0 con 0x7fe9640ca660 2023-10-16T14:27:17.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.359+0000 7fe959ffb640 1 -- 172.21.15.59:0/2074810484 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fe960017020 con 0x7fe9640ca660 2023-10-16T14:27:17.362 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:17.363 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3959035293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3959035293},{"type":"v1","addr":"172.21.15.59:6834","nonce":3959035293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1298271347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1298271347},{"type":"v1","addr":"172.21.15.151:6835","nonce":1298271347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/249904108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":249904108},{"type":"v1","addr":"172.21.15.59:6835","nonce":249904108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T14:25:48.130662+0000","modified":"2023-10-16T14:26:09.157993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6837/4004038733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4004038733},{"type":"v1","addr":"172.21.15.151:6837","nonce":4004038733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T14:27:17.363 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 9 2023-10-16T14:27:17.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.361+0000 7fe96a478640 1 -- 172.21.15.59:0/2074810484 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe94806ae70 msgr2=0x7fe94806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:17.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.361+0000 7fe96a478640 1 --2- 172.21.15.59:0/2074810484 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe94806ae70 0x7fe94806d330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe954036000 tx=0x7fe954008030 comp rx=0 tx=0).stop 2023-10-16T14:27:17.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.361+0000 7fe96a478640 1 -- 172.21.15.59:0/2074810484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9640ca660 msgr2=0x7fe964155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:17.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.361+0000 7fe96a478640 1 --2- 172.21.15.59:0/2074810484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9640ca660 0x7fe964155600 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe96000c390 tx=0x7fe96000c850 comp rx=0 tx=0).stop 2023-10-16T14:27:17.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.362+0000 7fe96a478640 1 -- 172.21.15.59:0/2074810484 shutdown_connections 2023-10-16T14:27:17.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.362+0000 7fe96a478640 1 --2- 172.21.15.59:0/2074810484 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe94806ae70 0x7fe94806d330 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:17.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.362+0000 7fe96a478640 1 --2- 172.21.15.59:0/2074810484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe96415a8d0 0x7fe9640b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:17.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.362+0000 7fe96a478640 1 --2- 172.21.15.59:0/2074810484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9640cb250 0x7fe964154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:17.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.362+0000 7fe96a478640 1 --2- 172.21.15.59:0/2074810484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9640ca660 0x7fe964155600 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:17.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.362+0000 7fe96a478640 1 -- 172.21.15.59:0/2074810484 >> 172.21.15.59:0/2074810484 conn(0x7fe96406a470 msgr2=0x7fe9640abcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:17.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.362+0000 7fe96a478640 1 -- 172.21.15.59:0/2074810484 shutdown_connections 2023-10-16T14:27:17.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.362+0000 7fe96a478640 1 -- 172.21.15.59:0/2074810484 wait complete. 2023-10-16T14:27:17.385 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:27:17.611 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.608+0000 7f6cd9bd7640 1 Processor -- start 2023-10-16T14:27:17.612 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.608+0000 7f6cd9bd7640 1 -- start start 2023-10-16T14:27:17.613 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.610+0000 7f6cd9bd7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6cd415cac0 0x7f6cd41611c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:17.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.610+0000 7f6cd9bd7640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6cd40d1530 0x7f6cd40d3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:17.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.610+0000 7f6cd9bd7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd40d36a0 con 0x7f6cd40ce4f0 2023-10-16T14:27:17.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.610+0000 7f6cd9bd7640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd40cd730 con 0x7f6cd40d1530 2023-10-16T14:27:17.614 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.610+0000 7f6cd9bd7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd40cda10 con 0x7f6cd415cac0 2023-10-16T14:27:17.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.610+0000 7f6cd93d6640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6cd40d1530 0x7f6cd40d3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:17.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.610+0000 7f6cd93d6640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6cd40d1530 0x7f6cd40d3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34812/0 (socket says 172.21.15.59:34812) 2023-10-16T14:27:17.615 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.610+0000 7f6cd93d6640 1 -- 172.21.15.59:0/964063353 learned_addr learned my addr 172.21.15.59:0/964063353 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:17.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.611+0000 7f6cd8bd5640 1 --2- 172.21.15.59:0/964063353 >> v2:172.21.15.151:3300/0 conn(0x7f6cd415cac0 0x7f6cd41611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:17.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.611+0000 7f6cd93d6640 1 -- 172.21.15.59:0/964063353 >> v2:172.21.15.151:3300/0 conn(0x7f6cd415cac0 msgr2=0x7f6cd41611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:17.616 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.611+0000 7f6cd93d6640 1 --2- 172.21.15.59:0/964063353 >> v2:172.21.15.151:3300/0 conn(0x7f6cd415cac0 0x7f6cd41611c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:17.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.611+0000 7f6cd93d6640 1 -- 172.21.15.59:0/964063353 >> v1:172.21.15.151:6789/0 conn(0x7f6cd40ce4f0 legacy=0x7f6cd40d0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:17.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.611+0000 7f6cd93d6640 1 -- 172.21.15.59:0/964063353 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd40cdcf0 con 0x7f6cd40d1530 2023-10-16T14:27:17.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.612+0000 7f6cd93d6640 1 --2- 172.21.15.59:0/964063353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cd40d1530 0x7f6cd40d3160 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40723d0 tx=0x7f6ccc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61048642dc04827b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:17.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.612+0000 7f6cd37fe640 1 -- 172.21.15.59:0/964063353 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc030860 con 0x7f6cd40d1530 2023-10-16T14:27:17.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.612+0000 7f6cd37fe640 1 -- 172.21.15.59:0/964063353 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ccc0309c0 con 0x7f6cd40d1530 2023-10-16T14:27:17.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.612+0000 7f6cd37fe640 1 -- 172.21.15.59:0/964063353 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc030d50 con 0x7f6cd40d1530 2023-10-16T14:27:17.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.613+0000 7f6cd9bd7640 1 -- 172.21.15.59:0/964063353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cd40d1530 msgr2=0x7f6cd40d3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:17.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.613+0000 7f6cd9bd7640 1 --2- 172.21.15.59:0/964063353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cd40d1530 0x7f6cd40d3160 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40723d0 tx=0x7f6ccc02b9a0 comp rx=0 tx=0).stop 2023-10-16T14:27:17.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.613+0000 7f6cd9bd7640 1 -- 172.21.15.59:0/964063353 shutdown_connections 2023-10-16T14:27:17.619 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.613+0000 7f6cd9bd7640 1 --2- 172.21.15.59:0/964063353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cd40d1530 0x7f6cd40d3160 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:17.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.613+0000 7f6cd9bd7640 1 --2- 172.21.15.59:0/964063353 >> v2:172.21.15.151:3300/0 conn(0x7f6cd415cac0 0x7f6cd41611c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:17.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.613+0000 7f6cd9bd7640 1 -- 172.21.15.59:0/964063353 >> 172.21.15.59:0/964063353 conn(0x7f6cd4089f70 msgr2=0x7f6cd40d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:17.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.613+0000 7f6cd9bd7640 1 -- 172.21.15.59:0/964063353 shutdown_connections 2023-10-16T14:27:17.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.613+0000 7f6cd9bd7640 1 -- 172.21.15.59:0/964063353 wait complete. 2023-10-16T14:27:17.620 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.616+0000 7f6cd9bd7640 1 Processor -- start 2023-10-16T14:27:17.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.616+0000 7f6cd9bd7640 1 -- start start 2023-10-16T14:27:17.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.617+0000 7f6cd9bd7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cd40ce4f0 0x7f6cd4153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:17.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.617+0000 7f6cd9bd7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cd40d1530 0x7f6cd40c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:17.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.617+0000 7f6cd9bd7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cd415cac0 0x7f6cd41e6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:17.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.617+0000 7f6cd9bd7640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd4153640 con 0x7f6cd40d1530 2023-10-16T14:27:17.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.617+0000 7f6cd9bd7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd40af490 con 0x7f6cd40ce4f0 2023-10-16T14:27:17.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.617+0000 7f6cd9bd7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd40af770 con 0x7f6cd415cac0 2023-10-16T14:27:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.618+0000 7f6cd3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cd40d1530 0x7f6cd40c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.618+0000 7f6cd3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cd40d1530 0x7f6cd40c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34820/0 (socket says 172.21.15.59:34820) 2023-10-16T14:27:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.618+0000 7f6cd3fff640 1 -- 172.21.15.59:0/2562319705 learned_addr learned my addr 172.21.15.59:0/2562319705 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.618+0000 7f6cd3fff640 1 -- 172.21.15.59:0/2562319705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cd415cac0 msgr2=0x7f6cd41e6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.618+0000 7f6cd3fff640 1 --2- 172.21.15.59:0/2562319705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cd415cac0 0x7f6cd41e6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:17.624 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.618+0000 7f6cd3fff640 1 -- 172.21.15.59:0/2562319705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cd40ce4f0 msgr2=0x7f6cd4153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:17.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.618+0000 7f6cd8bd5640 1 --2- 172.21.15.59:0/2562319705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cd40ce4f0 0x7f6cd4153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:17.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.618+0000 7f6cd3fff640 1 --2- 172.21.15.59:0/2562319705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cd40ce4f0 0x7f6cd4153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:17.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.618+0000 7f6cd3fff640 1 -- 172.21.15.59:0/2562319705 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ccc0094d0 con 0x7f6cd40d1530 2023-10-16T14:27:17.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.618+0000 7f6cd8bd5640 1 --2- 172.21.15.59:0/2562319705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cd40ce4f0 0x7f6cd4153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:17.625 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.619+0000 7f6cd3fff640 1 --2- 172.21.15.59:0/2562319705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cd40d1530 0x7f6cd40c9910 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800c430 tx=0x7f6cc800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:17.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.619+0000 7f6cd17fa640 1 -- 172.21.15.59:0/2562319705 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8011790 con 0x7f6cd40d1530 2023-10-16T14:27:17.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.619+0000 7f6cd17fa640 1 -- 172.21.15.59:0/2562319705 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc80118f0 con 0x7f6cd40d1530 2023-10-16T14:27:17.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.619+0000 7f6cd17fa640 1 -- 172.21.15.59:0/2562319705 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8011ce0 con 0x7f6cd40d1530 2023-10-16T14:27:17.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.619+0000 7f6cd9bd7640 1 -- 172.21.15.59:0/2562319705 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd40afa50 con 0x7f6cd40d1530 2023-10-16T14:27:17.626 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.619+0000 7f6cd9bd7640 1 -- 172.21.15.59:0/2562319705 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd40b0010 con 0x7f6cd40d1530 2023-10-16T14:27:17.627 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.620+0000 7f6cd9bd7640 1 -- 172.21.15.59:0/2562319705 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd404e9b0 con 0x7f6cd40d1530 2023-10-16T14:27:17.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.621+0000 7f6cd17fa640 1 -- 172.21.15.59:0/2562319705 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6cc801c460 con 0x7f6cd40d1530 2023-10-16T14:27:17.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.622+0000 7f6cd17fa640 1 --2- 172.21.15.59:0/2562319705 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6cc006ae70 0x7f6cc006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:17.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.622+0000 7f6cd17fa640 1 -- 172.21.15.59:0/2562319705 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f6cc8089950 con 0x7f6cd40d1530 2023-10-16T14:27:17.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.623+0000 7f6cd8bd5640 1 --2- 172.21.15.59:0/2562319705 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6cc006ae70 0x7f6cc006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:17.628 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.624+0000 7f6cd8bd5640 1 --2- 172.21.15.59:0/2562319705 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6cc006ae70 0x7f6cc006d330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009f50 tx=0x7f6cc400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:17.630 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.627+0000 7f6cd17fa640 1 -- 172.21.15.59:0/2562319705 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6cc8054630 con 0x7f6cd40d1530 2023-10-16T14:27:17.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.821+0000 7f6cd9bd7640 1 -- 172.21.15.59:0/2562319705 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cd40d0c00 con 0x7f6cd40d1530 2023-10-16T14:27:17.826 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.823+0000 7f6cd17fa640 1 -- 172.21.15.59:0/2562319705 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18445 (secure 0 0 0) 0x7f6cc8057c50 con 0x7f6cd40d1530 2023-10-16T14:27:17.827 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:17.827 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:26:29.634854+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:27:17.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.826+0000 7f6cd9bd7640 1 -- 172.21.15.59:0/2562319705 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6cc006ae70 msgr2=0x7f6cc006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:17.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.826+0000 7f6cd9bd7640 1 --2- 172.21.15.59:0/2562319705 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6cc006ae70 0x7f6cc006d330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009f50 tx=0x7f6cc400b040 comp rx=0 tx=0).stop 2023-10-16T14:27:17.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.826+0000 7f6cd9bd7640 1 -- 172.21.15.59:0/2562319705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cd40d1530 msgr2=0x7f6cd40c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:17.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.826+0000 7f6cd9bd7640 1 --2- 172.21.15.59:0/2562319705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cd40d1530 0x7f6cd40c9910 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800c430 tx=0x7f6cc800c8f0 comp rx=0 tx=0).stop 2023-10-16T14:27:17.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.826+0000 7f6cd9bd7640 1 -- 172.21.15.59:0/2562319705 shutdown_connections 2023-10-16T14:27:17.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.826+0000 7f6cd9bd7640 1 --2- 172.21.15.59:0/2562319705 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f6cc006ae70 0x7f6cc006d330 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:17.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.826+0000 7f6cd9bd7640 1 --2- 172.21.15.59:0/2562319705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cd415cac0 0x7f6cd41e6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:17.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.826+0000 7f6cd9bd7640 1 --2- 172.21.15.59:0/2562319705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cd40d1530 0x7f6cd40c9910 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:17.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.826+0000 7f6cd9bd7640 1 --2- 172.21.15.59:0/2562319705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cd40ce4f0 0x7f6cd4153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:17.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.826+0000 7f6cd9bd7640 1 -- 172.21.15.59:0/2562319705 >> 172.21.15.59:0/2562319705 conn(0x7f6cd4089f70 msgr2=0x7f6cd4154eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:17.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.826+0000 7f6cd9bd7640 1 -- 172.21.15.59:0/2562319705 shutdown_connections 2023-10-16T14:27:17.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:17.826+0000 7f6cd9bd7640 1 -- 172.21.15.59:0/2562319705 wait complete. 2023-10-16T14:27:17.849 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-16T14:27:17.850 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T14:27:18.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.070+0000 7f9cd3d97640 1 Processor -- start 2023-10-16T14:27:18.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.070+0000 7f9cd3d97640 1 -- start start 2023-10-16T14:27:18.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.072+0000 7f9cd3d97640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9ccc0b0010 0x7f9ccc0701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:18.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.072+0000 7f9cd3d97640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9ccc15f040 0x7f9ccc15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:18.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.072+0000 7f9cd3d97640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ccc0707f0 con 0x7f9ccc15ad00 2023-10-16T14:27:18.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.072+0000 7f9cd3d97640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ccc070ad0 con 0x7f9ccc0b0010 2023-10-16T14:27:18.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.072+0000 7f9cd3d97640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ccc15b1d0 con 0x7f9ccc15f040 2023-10-16T14:27:18.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.072+0000 7f9cd1b33640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9ccc0b0010 0x7f9ccc0701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:18.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.072+0000 7f9cd1332640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9ccc15ad00 0x7f9ccc0b03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34720/0 (socket says 172.21.15.59:34720) 2023-10-16T14:27:18.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.072+0000 7f9cd1332640 1 -- 172.21.15.59:0/2399004501 learned_addr learned my addr 172.21.15.59:0/2399004501 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:18.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.073+0000 7f9cd2334640 1 --2- 172.21.15.59:0/2399004501 >> v2:172.21.15.151:3300/0 conn(0x7f9ccc15f040 0x7f9ccc15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:18.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.073+0000 7f9cd1b33640 1 -- 172.21.15.59:0/2399004501 >> v2:172.21.15.151:3300/0 conn(0x7f9ccc15f040 msgr2=0x7f9ccc15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:18.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.073+0000 7f9cd1b33640 1 --2- 172.21.15.59:0/2399004501 >> v2:172.21.15.151:3300/0 conn(0x7f9ccc15f040 0x7f9ccc15b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:18.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.073+0000 7f9cd1b33640 1 -- 172.21.15.59:0/2399004501 >> v1:172.21.15.59:6789/0 conn(0x7f9ccc15ad00 legacy=0x7f9ccc0b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:18.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.073+0000 7f9cd1b33640 1 -- 172.21.15.59:0/2399004501 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ccc15b4b0 con 0x7f9ccc0b0010 2023-10-16T14:27:18.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.073+0000 7f9cd0b31640 1 -- 172.21.15.59:0/2399004501 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595830961 0 0) 0x7f9ccc0707f0 con 0x7f9ccc15ad00 2023-10-16T14:27:18.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.074+0000 7f9cd1b33640 1 --2- 172.21.15.59:0/2399004501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ccc0b0010 0x7f9ccc0701a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0adf80 tx=0x7f9cc802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c3623223bb9bbf server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:18.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.075+0000 7f9cd0b31640 1 -- 172.21.15.59:0/2399004501 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8031830 con 0x7f9ccc0b0010 2023-10-16T14:27:18.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.075+0000 7f9cd0b31640 1 -- 172.21.15.59:0/2399004501 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc8031990 con 0x7f9ccc0b0010 2023-10-16T14:27:18.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.075+0000 7f9cd0b31640 1 -- 172.21.15.59:0/2399004501 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8031d20 con 0x7f9ccc0b0010 2023-10-16T14:27:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.075+0000 7f9cd3d97640 1 -- 172.21.15.59:0/2399004501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ccc0b0010 msgr2=0x7f9ccc0701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.075+0000 7f9cd3d97640 1 --2- 172.21.15.59:0/2399004501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ccc0b0010 0x7f9ccc0701a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0adf80 tx=0x7f9cc802b8d0 comp rx=0 tx=0).stop 2023-10-16T14:27:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.075+0000 7f9cd3d97640 1 -- 172.21.15.59:0/2399004501 shutdown_connections 2023-10-16T14:27:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.075+0000 7f9cd3d97640 1 --2- 172.21.15.59:0/2399004501 >> v2:172.21.15.151:3300/0 conn(0x7f9ccc15f040 0x7f9ccc15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:18.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.075+0000 7f9cd3d97640 1 --2- 172.21.15.59:0/2399004501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ccc0b0010 0x7f9ccc0701a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:18.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.075+0000 7f9cd3d97640 1 -- 172.21.15.59:0/2399004501 >> 172.21.15.59:0/2399004501 conn(0x7f9ccc06c1c0 msgr2=0x7f9ccc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:18.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.075+0000 7f9cd3d97640 1 -- 172.21.15.59:0/2399004501 shutdown_connections 2023-10-16T14:27:18.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.075+0000 7f9cd3d97640 1 -- 172.21.15.59:0/2399004501 wait complete. 2023-10-16T14:27:18.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.077+0000 7f9cd3d97640 1 Processor -- start 2023-10-16T14:27:18.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.077+0000 7f9cd3d97640 1 -- start start 2023-10-16T14:27:18.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.078+0000 7f9cd3d97640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ccc0b0010 0x7f9ccc1f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:18.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.078+0000 7f9cd3d97640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ccc15ad00 0x7f9ccc158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:18.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.078+0000 7f9cd3d97640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ccc15f040 0x7f9ccc158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:18.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.078+0000 7f9cd3d97640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc0c59a0 con 0x7f9ccc15f040 2023-10-16T14:27:18.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.078+0000 7f9cd3d97640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc0ccc30 con 0x7f9ccc15ad00 2023-10-16T14:27:18.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.078+0000 7f9cd3d97640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc0cd0c0 con 0x7f9ccc0b0010 2023-10-16T14:27:18.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.079+0000 7f9cd2334640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ccc15f040 0x7f9ccc158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:18.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.079+0000 7f9cd2334640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ccc15f040 0x7f9ccc158d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34838/0 (socket says 172.21.15.59:34838) 2023-10-16T14:27:18.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.079+0000 7f9cd2334640 1 -- 172.21.15.59:0/745102536 learned_addr learned my addr 172.21.15.59:0/745102536 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:18.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.079+0000 7f9cd1b33640 1 --2- 172.21.15.59:0/745102536 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ccc0b0010 0x7f9ccc1f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:18.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.079+0000 7f9cd1332640 1 --2- 172.21.15.59:0/745102536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ccc15ad00 0x7f9ccc158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:18.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.079+0000 7f9cd2334640 1 -- 172.21.15.59:0/745102536 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ccc0b0010 msgr2=0x7f9ccc1f1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:18.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.079+0000 7f9cd2334640 1 --2- 172.21.15.59:0/745102536 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ccc0b0010 0x7f9ccc1f1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:18.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.079+0000 7f9cd2334640 1 -- 172.21.15.59:0/745102536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ccc15ad00 msgr2=0x7f9ccc158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:18.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.079+0000 7f9cd2334640 1 --2- 172.21.15.59:0/745102536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ccc15ad00 0x7f9ccc158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:18.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.079+0000 7f9cd2334640 1 -- 172.21.15.59:0/745102536 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc8009400 con 0x7f9ccc15f040 2023-10-16T14:27:18.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.079+0000 7f9cd1332640 1 --2- 172.21.15.59:0/745102536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ccc15ad00 0x7f9ccc158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:18.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.079+0000 7f9cd2334640 1 --2- 172.21.15.59:0/745102536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ccc15f040 0x7f9ccc158d60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4007e60 tx=0x7f9cc400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:18.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.080+0000 7f9cc27fc640 1 -- 172.21.15.59:0/745102536 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4014420 con 0x7f9ccc15f040 2023-10-16T14:27:18.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.080+0000 7f9cc27fc640 1 -- 172.21.15.59:0/745102536 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc40145a0 con 0x7f9ccc15f040 2023-10-16T14:27:18.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.080+0000 7f9cc27fc640 1 -- 172.21.15.59:0/745102536 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4014950 con 0x7f9ccc15f040 2023-10-16T14:27:18.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.080+0000 7f9cd3d97640 1 -- 172.21.15.59:0/745102536 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ccc0cc300 con 0x7f9ccc15f040 2023-10-16T14:27:18.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.080+0000 7f9cd3d97640 1 -- 172.21.15.59:0/745102536 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ccc0cc8c0 con 0x7f9ccc15f040 2023-10-16T14:27:18.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.081+0000 7f9cd3d97640 1 -- 172.21.15.59:0/745102536 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ccc0ccda0 con 0x7f9ccc15f040 2023-10-16T14:27:18.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.082+0000 7f9cc27fc640 1 -- 172.21.15.59:0/745102536 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9cc4014ab0 con 0x7f9ccc15f040 2023-10-16T14:27:18.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.084+0000 7f9cc27fc640 1 --2- 172.21.15.59:0/745102536 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9cb006ae70 0x7f9cb006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:18.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.084+0000 7f9cc27fc640 1 -- 172.21.15.59:0/745102536 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f9cc408a330 con 0x7f9ccc15f040 2023-10-16T14:27:18.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.084+0000 7f9cd1b33640 1 --2- 172.21.15.59:0/745102536 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9cb006ae70 0x7f9cb006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:18.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.085+0000 7f9cd1b33640 1 --2- 172.21.15.59:0/745102536 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9cb006ae70 0x7f9cb006d330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8036000 tx=0x7f9cc803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:18.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.088+0000 7f9cc27fc640 1 -- 172.21.15.59:0/745102536 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9cc4055010 con 0x7f9ccc15f040 2023-10-16T14:27:18.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.318+0000 7f9cd3d97640 1 -- 172.21.15.59:0/745102536 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ccc073ef0 con 0x7f9ccc15f040 2023-10-16T14:27:18.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.319+0000 7f9cc27fc640 1 -- 172.21.15.59:0/745102536 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f9cc4058630 con 0x7f9ccc15f040 2023-10-16T14:27:18.323 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:18.323 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3959035293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3959035293},{"type":"v1","addr":"172.21.15.59:6834","nonce":3959035293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1298271347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1298271347},{"type":"v1","addr":"172.21.15.151:6835","nonce":1298271347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/249904108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":249904108},{"type":"v1","addr":"172.21.15.59:6835","nonce":249904108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T14:25:48.130662+0000","modified":"2023-10-16T14:26:09.157993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6837/4004038733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4004038733},{"type":"v1","addr":"172.21.15.151:6837","nonce":4004038733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T14:27:18.324 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 9 2023-10-16T14:27:18.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.322+0000 7f9cd3d97640 1 -- 172.21.15.59:0/745102536 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9cb006ae70 msgr2=0x7f9cb006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:18.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.322+0000 7f9cd3d97640 1 --2- 172.21.15.59:0/745102536 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9cb006ae70 0x7f9cb006d330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8036000 tx=0x7f9cc803c040 comp rx=0 tx=0).stop 2023-10-16T14:27:18.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.322+0000 7f9cd3d97640 1 -- 172.21.15.59:0/745102536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ccc15f040 msgr2=0x7f9ccc158d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:18.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.322+0000 7f9cd3d97640 1 --2- 172.21.15.59:0/745102536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ccc15f040 0x7f9ccc158d60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4007e60 tx=0x7f9cc400e4b0 comp rx=0 tx=0).stop 2023-10-16T14:27:18.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.322+0000 7f9cd3d97640 1 -- 172.21.15.59:0/745102536 shutdown_connections 2023-10-16T14:27:18.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.322+0000 7f9cd3d97640 1 --2- 172.21.15.59:0/745102536 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f9cb006ae70 0x7f9cb006d330 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:18.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.322+0000 7f9cd3d97640 1 --2- 172.21.15.59:0/745102536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ccc15f040 0x7f9ccc158d60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:18.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.322+0000 7f9cd3d97640 1 --2- 172.21.15.59:0/745102536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ccc15ad00 0x7f9ccc158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:18.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.322+0000 7f9cd3d97640 1 --2- 172.21.15.59:0/745102536 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ccc0b0010 0x7f9ccc1f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:18.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.322+0000 7f9cd3d97640 1 -- 172.21.15.59:0/745102536 >> 172.21.15.59:0/745102536 conn(0x7f9ccc06c1c0 msgr2=0x7f9ccc0aeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:18.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.322+0000 7f9cd3d97640 1 -- 172.21.15.59:0/745102536 shutdown_connections 2023-10-16T14:27:18.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.322+0000 7f9cd3d97640 1 -- 172.21.15.59:0/745102536 wait complete. 2023-10-16T14:27:18.345 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T14:27:18.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.561+0000 7f902dfb8640 1 Processor -- start 2023-10-16T14:27:18.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.561+0000 7f902dfb8640 1 -- start start 2023-10-16T14:27:18.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.562+0000 7f902dfb8640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f902815a8d0 0x7f90280cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:18.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.562+0000 7f902dfb8640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f90280ca660 0x7f90280cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:18.566 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.563+0000 7f902dfb8640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f902815acb0 con 0x7f902806ff40 2023-10-16T14:27:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.563+0000 7f902dfb8640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90280c1c60 con 0x7f90280ca660 2023-10-16T14:27:18.567 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.563+0000 7f902dfb8640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902815e350 con 0x7f902815a8d0 2023-10-16T14:27:18.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.563+0000 7f9027fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f90280ca660 0x7f90280cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:18.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.563+0000 7f902cfb6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f902815a8d0 0x7f90280cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:18.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.563+0000 7f9027fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f90280ca660 0x7f90280cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.59:50384/0 (socket says 172.21.15.59:50384) 2023-10-16T14:27:18.568 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.563+0000 7f9027fff640 1 -- 172.21.15.59:0/1112103047 learned_addr learned my addr 172.21.15.59:0/1112103047 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:18.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.563+0000 7f902cfb6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f902815a8d0 0x7f90280cab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.59:55454/0 (socket says 172.21.15.59:55454) 2023-10-16T14:27:18.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.563+0000 7f902d7b7640 1 --1- 172.21.15.59:0/1112103047 >> v1:172.21.15.151:6789/0 conn(0x7f902806ff40 0x7f902806bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.59:37960/0 (socket says 172.21.15.59:37960) 2023-10-16T14:27:18.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.564+0000 7f9027fff640 1 -- 172.21.15.59:0/1112103047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f902815a8d0 msgr2=0x7f90280cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:18.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.564+0000 7f9027fff640 1 --2- 172.21.15.59:0/1112103047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f902815a8d0 0x7f90280cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:18.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.564+0000 7f9027fff640 1 -- 172.21.15.59:0/1112103047 >> v1:172.21.15.151:6789/0 conn(0x7f902806ff40 legacy=0x7f902806bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:18.569 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.564+0000 7f9027fff640 1 -- 172.21.15.59:0/1112103047 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902815e630 con 0x7f90280ca660 2023-10-16T14:27:18.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.566+0000 7f9027fff640 1 --2- 172.21.15.59:0/1112103047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90280ca660 0x7f90280cb080 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9014009870 tx=0x7f901402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5759d537381468be server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:18.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.566+0000 7f90277fe640 1 -- 172.21.15.59:0/1112103047 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9014030840 con 0x7f90280ca660 2023-10-16T14:27:18.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.566+0000 7f90277fe640 1 -- 172.21.15.59:0/1112103047 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90140309a0 con 0x7f90280ca660 2023-10-16T14:27:18.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.566+0000 7f90277fe640 1 -- 172.21.15.59:0/1112103047 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9014030d30 con 0x7f90280ca660 2023-10-16T14:27:18.571 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.567+0000 7f902dfb8640 1 -- 172.21.15.59:0/1112103047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90280ca660 msgr2=0x7f90280cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:18.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.567+0000 7f902dfb8640 1 --2- 172.21.15.59:0/1112103047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90280ca660 0x7f90280cb080 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9014009870 tx=0x7f901402b980 comp rx=0 tx=0).stop 2023-10-16T14:27:18.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.567+0000 7f902dfb8640 1 -- 172.21.15.59:0/1112103047 shutdown_connections 2023-10-16T14:27:18.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.567+0000 7f902dfb8640 1 --2- 172.21.15.59:0/1112103047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90280ca660 0x7f90280cb080 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:18.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.567+0000 7f902dfb8640 1 --2- 172.21.15.59:0/1112103047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f902815a8d0 0x7f90280cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:18.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.567+0000 7f902dfb8640 1 -- 172.21.15.59:0/1112103047 >> 172.21.15.59:0/1112103047 conn(0x7f902806a470 msgr2=0x7f90280afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:18.572 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.567+0000 7f902dfb8640 1 -- 172.21.15.59:0/1112103047 shutdown_connections 2023-10-16T14:27:18.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.567+0000 7f902dfb8640 1 -- 172.21.15.59:0/1112103047 wait complete. 2023-10-16T14:27:18.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.570+0000 7f902dfb8640 1 Processor -- start 2023-10-16T14:27:18.573 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.570+0000 7f902dfb8640 1 -- start start 2023-10-16T14:27:18.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.571+0000 7f902dfb8640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f902806ff40 0x7f9028155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:18.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.571+0000 7f902dfb8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90280ca660 0x7f90280aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:18.575 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.571+0000 7f902dfb8640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f902815a8d0 0x7f90280af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:18.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.571+0000 7f902dfb8640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90280cdb90 con 0x7f902815a8d0 2023-10-16T14:27:18.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.571+0000 7f902dfb8640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9028155e50 con 0x7f90280ca660 2023-10-16T14:27:18.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.571+0000 7f902dfb8640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90280ccf80 con 0x7f902806ff40 2023-10-16T14:27:18.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.572+0000 7f902d7b7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f902815a8d0 0x7f90280af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:18.576 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.572+0000 7f902d7b7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f902815a8d0 0x7f90280af1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34840/0 (socket says 172.21.15.59:34840) 2023-10-16T14:27:18.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.572+0000 7f902d7b7640 1 -- 172.21.15.59:0/3358747481 learned_addr learned my addr 172.21.15.59:0/3358747481 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:18.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.572+0000 7f9027fff640 1 --2- 172.21.15.59:0/3358747481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90280ca660 0x7f90280aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:18.577 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.572+0000 7f902cfb6640 1 --2- 172.21.15.59:0/3358747481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f902806ff40 0x7f9028155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:18.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.572+0000 7f902d7b7640 1 -- 172.21.15.59:0/3358747481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f902806ff40 msgr2=0x7f9028155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:18.578 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.572+0000 7f902d7b7640 1 --2- 172.21.15.59:0/3358747481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f902806ff40 0x7f9028155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:18.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.572+0000 7f902d7b7640 1 -- 172.21.15.59:0/3358747481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90280ca660 msgr2=0x7f90280aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:18.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.572+0000 7f902d7b7640 1 --2- 172.21.15.59:0/3358747481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90280ca660 0x7f90280aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:18.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.572+0000 7f902d7b7640 1 -- 172.21.15.59:0/3358747481 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90140094d0 con 0x7f902815a8d0 2023-10-16T14:27:18.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.572+0000 7f9027fff640 1 --2- 172.21.15.59:0/3358747481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90280ca660 0x7f90280aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:27:18.579 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.573+0000 7f902d7b7640 1 --2- 172.21.15.59:0/3358747481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f902815a8d0 0x7f90280af1a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f902000c7b0 tx=0x7f902000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:18.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.573+0000 7f90257fa640 1 -- 172.21.15.59:0/3358747481 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902000a640 con 0x7f902815a8d0 2023-10-16T14:27:18.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.573+0000 7f90257fa640 1 -- 172.21.15.59:0/3358747481 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902000a7a0 con 0x7f902815a8d0 2023-10-16T14:27:18.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.573+0000 7f90257fa640 1 -- 172.21.15.59:0/3358747481 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902000ab10 con 0x7f902815a8d0 2023-10-16T14:27:18.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.573+0000 7f902dfb8640 1 -- 172.21.15.59:0/3358747481 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90280cd260 con 0x7f902815a8d0 2023-10-16T14:27:18.580 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.573+0000 7f902dfb8640 1 -- 172.21.15.59:0/3358747481 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90280cd820 con 0x7f902815a8d0 2023-10-16T14:27:18.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.574+0000 7f902dfb8640 1 -- 172.21.15.59:0/3358747481 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90280cdd40 con 0x7f902815a8d0 2023-10-16T14:27:18.581 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.575+0000 7f90257fa640 1 -- 172.21.15.59:0/3358747481 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f902000ac70 con 0x7f902815a8d0 2023-10-16T14:27:18.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.576+0000 7f90257fa640 1 --2- 172.21.15.59:0/3358747481 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f900c06ae70 0x7f900c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:18.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.576+0000 7f90257fa640 1 -- 172.21.15.59:0/3358747481 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f9020088f70 con 0x7f902815a8d0 2023-10-16T14:27:18.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.577+0000 7f902cfb6640 1 --2- 172.21.15.59:0/3358747481 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f900c06ae70 0x7f900c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:18.582 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.578+0000 7f902cfb6640 1 --2- 172.21.15.59:0/3358747481 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f900c06ae70 0x7f900c06d330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f90280b4090 tx=0x7f901c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:18.584 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.581+0000 7f90257fa640 1 -- 172.21.15.59:0/3358747481 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f90280cdd40 con 0x7f902815a8d0 2023-10-16T14:27:18.816 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.812+0000 7f902dfb8640 1 -- 172.21.15.59:0/3358747481 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90280cdd40 con 0x7f902815a8d0 2023-10-16T14:27:18.817 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.814+0000 7f90257fa640 1 -- 172.21.15.59:0/3358747481 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f90280cdd40 con 0x7f902815a8d0 2023-10-16T14:27:18.818 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:18.818 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3959035293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3959035293},{"type":"v1","addr":"172.21.15.59:6834","nonce":3959035293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1298271347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1298271347},{"type":"v1","addr":"172.21.15.151:6835","nonce":1298271347}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/249904108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":249904108},{"type":"v1","addr":"172.21.15.59:6835","nonce":249904108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T14:25:48.130662+0000","modified":"2023-10-16T14:26:09.157993+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6837/4004038733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4004038733},{"type":"v1","addr":"172.21.15.151:6837","nonce":4004038733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-16T14:27:18.818 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 9 2023-10-16T14:27:18.820 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.817+0000 7f902dfb8640 1 -- 172.21.15.59:0/3358747481 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f900c06ae70 msgr2=0x7f900c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:18.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.817+0000 7f902dfb8640 1 --2- 172.21.15.59:0/3358747481 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f900c06ae70 0x7f900c06d330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f90280b4090 tx=0x7f901c008040 comp rx=0 tx=0).stop 2023-10-16T14:27:18.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.817+0000 7f902dfb8640 1 -- 172.21.15.59:0/3358747481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f902815a8d0 msgr2=0x7f90280af1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:18.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.817+0000 7f902dfb8640 1 --2- 172.21.15.59:0/3358747481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f902815a8d0 0x7f90280af1a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f902000c7b0 tx=0x7f902000cc70 comp rx=0 tx=0).stop 2023-10-16T14:27:18.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.817+0000 7f902dfb8640 1 -- 172.21.15.59:0/3358747481 shutdown_connections 2023-10-16T14:27:18.821 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.817+0000 7f902dfb8640 1 --2- 172.21.15.59:0/3358747481 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f900c06ae70 0x7f900c06d330 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:18.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.817+0000 7f902dfb8640 1 --2- 172.21.15.59:0/3358747481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f902815a8d0 0x7f90280af1a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:18.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.817+0000 7f902dfb8640 1 --2- 172.21.15.59:0/3358747481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90280ca660 0x7f90280aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:18.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.817+0000 7f902dfb8640 1 --2- 172.21.15.59:0/3358747481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f902806ff40 0x7f9028155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:18.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.817+0000 7f902dfb8640 1 -- 172.21.15.59:0/3358747481 >> 172.21.15.59:0/3358747481 conn(0x7f902806a470 msgr2=0x7f90280c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:18.822 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.817+0000 7f902dfb8640 1 -- 172.21.15.59:0/3358747481 shutdown_connections 2023-10-16T14:27:18.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:18.817+0000 7f902dfb8640 1 -- 172.21.15.59:0/3358747481 wait complete. 2023-10-16T14:27:18.840 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:27:19.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.065+0000 7ff3f55f0640 1 Processor -- start 2023-10-16T14:27:19.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.066+0000 7ff3f55f0640 1 -- start start 2023-10-16T14:27:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.067+0000 7ff3f55f0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff3f015a9c0 0x7ff3f00cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:19.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.067+0000 7ff3f55f0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3f00af430 0x7ff3f00cd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:19.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.067+0000 7ff3f55f0640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff3f00af980 0x7ff3f00cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:19.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.067+0000 7ff3f55f0640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f00cf6d0 con 0x7ff3f00af980 2023-10-16T14:27:19.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.067+0000 7ff3f55f0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f00d15a0 con 0x7ff3f015a9c0 2023-10-16T14:27:19.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.067+0000 7ff3f55f0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f00d1300 con 0x7ff3f00af430 2023-10-16T14:27:19.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.068+0000 7ff3f4def640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff3f00af980 0x7ff3f00cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:19.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.068+0000 7ff3f4def640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff3f00af980 0x7ff3f00cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34844/0 (socket says 172.21.15.59:34844) 2023-10-16T14:27:19.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.068+0000 7ff3f4def640 1 -- 172.21.15.59:0/3981263911 learned_addr learned my addr 172.21.15.59:0/3981263911 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:19.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.068+0000 7ff3effff640 1 --2- 172.21.15.59:0/3981263911 >> v2:172.21.15.151:3300/0 conn(0x7ff3f015a9c0 0x7ff3f00cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:19.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.068+0000 7ff3ef7fe640 1 --2- 172.21.15.59:0/3981263911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3f00af430 0x7ff3f00cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:19.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.068+0000 7ff3f4def640 1 -- 172.21.15.59:0/3981263911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3f00af430 msgr2=0x7ff3f00cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:19.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.068+0000 7ff3f4def640 1 --2- 172.21.15.59:0/3981263911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3f00af430 0x7ff3f00cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:19.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.068+0000 7ff3f4def640 1 -- 172.21.15.59:0/3981263911 >> v2:172.21.15.151:3300/0 conn(0x7ff3f015a9c0 msgr2=0x7ff3f00cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:19.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.068+0000 7ff3f4def640 1 --2- 172.21.15.59:0/3981263911 >> v2:172.21.15.151:3300/0 conn(0x7ff3f015a9c0 0x7ff3f00cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:19.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.068+0000 7ff3f4def640 1 -- 172.21.15.59:0/3981263911 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f015ada0 con 0x7ff3f00af980 2023-10-16T14:27:19.075 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.070+0000 7ff3f4def640 1 --2- 172.21.15.59:0/3981263911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3f00af980 0x7ff3f00cb150 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0071ad0 tx=0x7ff3e802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5417afa46de30f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:19.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.070+0000 7ff3eeffd640 1 -- 172.21.15.59:0/3981263911 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8031870 con 0x7ff3f00af980 2023-10-16T14:27:19.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.070+0000 7ff3eeffd640 1 -- 172.21.15.59:0/3981263911 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e80319d0 con 0x7ff3f00af980 2023-10-16T14:27:19.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.070+0000 7ff3eeffd640 1 -- 172.21.15.59:0/3981263911 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8031d60 con 0x7ff3f00af980 2023-10-16T14:27:19.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.071+0000 7ff3f55f0640 1 -- 172.21.15.59:0/3981263911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3f00af980 msgr2=0x7ff3f00cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:19.076 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.071+0000 7ff3f55f0640 1 --2- 172.21.15.59:0/3981263911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3f00af980 0x7ff3f00cb150 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0071ad0 tx=0x7ff3e802b910 comp rx=0 tx=0).stop 2023-10-16T14:27:19.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.071+0000 7ff3f55f0640 1 -- 172.21.15.59:0/3981263911 shutdown_connections 2023-10-16T14:27:19.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.071+0000 7ff3f55f0640 1 --2- 172.21.15.59:0/3981263911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3f00af980 0x7ff3f00cb150 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:19.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.071+0000 7ff3f55f0640 1 --2- 172.21.15.59:0/3981263911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3f00af430 0x7ff3f00cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:19.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.071+0000 7ff3f55f0640 1 --2- 172.21.15.59:0/3981263911 >> v2:172.21.15.151:3300/0 conn(0x7ff3f015a9c0 0x7ff3f00cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:19.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.071+0000 7ff3f55f0640 1 -- 172.21.15.59:0/3981263911 >> 172.21.15.59:0/3981263911 conn(0x7ff3f00d0640 msgr2=0x7ff3f00d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:19.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.071+0000 7ff3f55f0640 1 -- 172.21.15.59:0/3981263911 shutdown_connections 2023-10-16T14:27:19.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.071+0000 7ff3f55f0640 1 -- 172.21.15.59:0/3981263911 wait complete. 2023-10-16T14:27:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.073+0000 7ff3f55f0640 1 Processor -- start 2023-10-16T14:27:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.073+0000 7ff3f55f0640 1 -- start start 2023-10-16T14:27:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.074+0000 7ff3f55f0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3f00af430 0x7ff3f015b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.074+0000 7ff3f55f0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3f00af980 0x7ff3f014fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:19.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.074+0000 7ff3f55f0640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3f015a9c0 0x7ff3f015d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.074+0000 7ff3f55f0640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f015cbb0 con 0x7ff3f015a9c0 2023-10-16T14:27:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.074+0000 7ff3f55f0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f015ddc0 con 0x7ff3f00af430 2023-10-16T14:27:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.074+0000 7ff3f55f0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f015bfa0 con 0x7ff3f00af980 2023-10-16T14:27:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.074+0000 7ff3f4def640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3f015a9c0 0x7ff3f015d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:19.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.074+0000 7ff3f4def640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3f015a9c0 0x7ff3f015d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34858/0 (socket says 172.21.15.59:34858) 2023-10-16T14:27:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.074+0000 7ff3f4def640 1 -- 172.21.15.59:0/4038414426 learned_addr learned my addr 172.21.15.59:0/4038414426 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.075+0000 7ff3effff640 1 --2- 172.21.15.59:0/4038414426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3f00af430 0x7ff3f015b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.075+0000 7ff3f4def640 1 -- 172.21.15.59:0/4038414426 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3f00af980 msgr2=0x7ff3f014fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.075+0000 7ff3ef7fe640 1 --2- 172.21.15.59:0/4038414426 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3f00af980 0x7ff3f014fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:19.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.075+0000 7ff3f4def640 1 --2- 172.21.15.59:0/4038414426 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3f00af980 0x7ff3f014fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.075+0000 7ff3f4def640 1 -- 172.21.15.59:0/4038414426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3f00af430 msgr2=0x7ff3f015b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.075+0000 7ff3f4def640 1 --2- 172.21.15.59:0/4038414426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3f00af430 0x7ff3f015b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.075+0000 7ff3f4def640 1 -- 172.21.15.59:0/4038414426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e80094d0 con 0x7ff3f015a9c0 2023-10-16T14:27:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.075+0000 7ff3effff640 1 --2- 172.21.15.59:0/4038414426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3f00af430 0x7ff3f015b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.075+0000 7ff3f4def640 1 --2- 172.21.15.59:0/4038414426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3f015a9c0 0x7ff3f015d880 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80090b0 tx=0x7ff3e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:19.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.075+0000 7ff3ecff9640 1 -- 172.21.15.59:0/4038414426 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e803ac60 con 0x7ff3f015a9c0 2023-10-16T14:27:19.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.076+0000 7ff3ecff9640 1 -- 172.21.15.59:0/4038414426 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e803adc0 con 0x7ff3f015a9c0 2023-10-16T14:27:19.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.076+0000 7ff3ecff9640 1 -- 172.21.15.59:0/4038414426 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8044630 con 0x7ff3f015a9c0 2023-10-16T14:27:19.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.076+0000 7ff3f55f0640 1 -- 172.21.15.59:0/4038414426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f015c280 con 0x7ff3f015a9c0 2023-10-16T14:27:19.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.076+0000 7ff3f55f0640 1 -- 172.21.15.59:0/4038414426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f015c840 con 0x7ff3f015a9c0 2023-10-16T14:27:19.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.077+0000 7ff3f55f0640 1 -- 172.21.15.59:0/4038414426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f004e9b0 con 0x7ff3f015a9c0 2023-10-16T14:27:19.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.078+0000 7ff3ecff9640 1 -- 172.21.15.59:0/4038414426 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff3e804d450 con 0x7ff3f015a9c0 2023-10-16T14:27:19.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.078+0000 7ff3ecff9640 1 --2- 172.21.15.59:0/4038414426 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff3d006ae70 0x7ff3d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:19.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.079+0000 7ff3ecff9640 1 -- 172.21.15.59:0/4038414426 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7ff3e802d040 con 0x7ff3f015a9c0 2023-10-16T14:27:19.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.079+0000 7ff3effff640 1 --2- 172.21.15.59:0/4038414426 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff3d006ae70 0x7ff3d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:19.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.080+0000 7ff3effff640 1 --2- 172.21.15.59:0/4038414426 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff3d006ae70 0x7ff3d006d330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0006fd0 tx=0x7ff3e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:19.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.083+0000 7ff3ecff9640 1 -- 172.21.15.59:0/4038414426 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff3e8076c40 con 0x7ff3f015a9c0 2023-10-16T14:27:19.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.280+0000 7ff3f55f0640 1 -- 172.21.15.59:0/4038414426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3f0070080 con 0x7ff3f015a9c0 2023-10-16T14:27:19.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.282+0000 7ff3ecff9640 1 -- 172.21.15.59:0/4038414426 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18445 (secure 0 0 0) 0x7ff3e8035020 con 0x7ff3f015a9c0 2023-10-16T14:27:19.286 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:19.287 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:26:29.634854+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:25:46.371818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-16T14:25:47.145341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-16T14:25:50.758038+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]},{"pgid":"4.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:27:19.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.285+0000 7ff3f55f0640 1 -- 172.21.15.59:0/4038414426 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff3d006ae70 msgr2=0x7ff3d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:19.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.285+0000 7ff3f55f0640 1 --2- 172.21.15.59:0/4038414426 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff3d006ae70 0x7ff3d006d330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0006fd0 tx=0x7ff3e0008040 comp rx=0 tx=0).stop 2023-10-16T14:27:19.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.285+0000 7ff3f55f0640 1 -- 172.21.15.59:0/4038414426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3f015a9c0 msgr2=0x7ff3f015d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:19.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.285+0000 7ff3f55f0640 1 --2- 172.21.15.59:0/4038414426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3f015a9c0 0x7ff3f015d880 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80090b0 tx=0x7ff3e80046c0 comp rx=0 tx=0).stop 2023-10-16T14:27:19.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.285+0000 7ff3f55f0640 1 -- 172.21.15.59:0/4038414426 shutdown_connections 2023-10-16T14:27:19.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.285+0000 7ff3f55f0640 1 --2- 172.21.15.59:0/4038414426 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff3d006ae70 0x7ff3d006d330 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:19.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.285+0000 7ff3f55f0640 1 --2- 172.21.15.59:0/4038414426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3f015a9c0 0x7ff3f015d880 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:19.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.285+0000 7ff3f55f0640 1 --2- 172.21.15.59:0/4038414426 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3f00af980 0x7ff3f014fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:19.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.285+0000 7ff3f55f0640 1 --2- 172.21.15.59:0/4038414426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3f00af430 0x7ff3f015b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:19.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.286+0000 7ff3f55f0640 1 -- 172.21.15.59:0/4038414426 >> 172.21.15.59:0/4038414426 conn(0x7ff3f00d0640 msgr2=0x7ff3f00cc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:19.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.286+0000 7ff3f55f0640 1 -- 172.21.15.59:0/4038414426 shutdown_connections 2023-10-16T14:27:19.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.286+0000 7ff3f55f0640 1 -- 172.21.15.59:0/4038414426 wait complete. 2023-10-16T14:27:19.310 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-16T14:27:19.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.538+0000 7f125759e640 1 Processor -- start 2023-10-16T14:27:19.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.538+0000 7f125759e640 1 -- start start 2023-10-16T14:27:19.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.539+0000 7f125759e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f12580cea60 0x7f12580ab890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:19.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.540+0000 7f125759e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125815f0d0 con 0x7f12580b2dd0 2023-10-16T14:27:19.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.540+0000 7f125759e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125815ab50 con 0x7f12580ce600 2023-10-16T14:27:19.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.540+0000 7f125759e640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f125815e2b0 con 0x7f12580cea60 2023-10-16T14:27:19.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.540+0000 7f125659c640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f12580b2dd0 0x7f125806d6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34734/0 (socket says 172.21.15.59:34734) 2023-10-16T14:27:19.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.540+0000 7f125659c640 1 -- 172.21.15.59:0/2549310195 learned_addr learned my addr 172.21.15.59:0/2549310195 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:19.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.540+0000 7f1256d9d640 1 --2- 172.21.15.59:0/2549310195 >> v2:172.21.15.59:3300/0 conn(0x7f12580cea60 0x7f12580ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:19.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.540+0000 7f125559a640 1 -- 172.21.15.59:0/2549310195 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078484270 0 0) 0x7f125815f0d0 con 0x7f12580b2dd0 2023-10-16T14:27:19.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.540+0000 7f125559a640 1 -- 172.21.15.59:0/2549310195 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1244003520 con 0x7f12580b2dd0 2023-10-16T14:27:19.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.540+0000 7f1256d9d640 1 -- 172.21.15.59:0/2549310195 >> v1:172.21.15.151:6789/0 conn(0x7f12580ce600 legacy=0x7f12580ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:19.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.540+0000 7f1256d9d640 1 -- 172.21.15.59:0/2549310195 >> v1:172.21.15.59:6789/0 conn(0x7f12580b2dd0 legacy=0x7f125806d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:19.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.540+0000 7f1256d9d640 1 -- 172.21.15.59:0/2549310195 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125806d3a0 con 0x7f12580cea60 2023-10-16T14:27:19.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.542+0000 7f1256d9d640 1 --2- 172.21.15.59:0/2549310195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12580cea60 0x7f12580ab890 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1250009d90 tx=0x7f125002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc3236a098a2bb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:19.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.542+0000 7f125559a640 1 -- 172.21.15.59:0/2549310195 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125002cc60 con 0x7f12580cea60 2023-10-16T14:27:19.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.542+0000 7f125559a640 1 -- 172.21.15.59:0/2549310195 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125002cdc0 con 0x7f12580cea60 2023-10-16T14:27:19.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.542+0000 7f125559a640 1 -- 172.21.15.59:0/2549310195 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1250034640 con 0x7f12580cea60 2023-10-16T14:27:19.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.543+0000 7f125759e640 1 -- 172.21.15.59:0/2549310195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12580cea60 msgr2=0x7f12580ab890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:19.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.543+0000 7f125759e640 1 --2- 172.21.15.59:0/2549310195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12580cea60 0x7f12580ab890 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1250009d90 tx=0x7f125002beb0 comp rx=0 tx=0).stop 2023-10-16T14:27:19.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.543+0000 7f125759e640 1 -- 172.21.15.59:0/2549310195 shutdown_connections 2023-10-16T14:27:19.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.543+0000 7f125759e640 1 --2- 172.21.15.59:0/2549310195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12580cea60 0x7f12580ab890 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:19.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.543+0000 7f125759e640 1 -- 172.21.15.59:0/2549310195 >> 172.21.15.59:0/2549310195 conn(0x7f1258069fc0 msgr2=0x7f125806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:19.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.543+0000 7f125759e640 1 -- 172.21.15.59:0/2549310195 shutdown_connections 2023-10-16T14:27:19.549 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.543+0000 7f125759e640 1 -- 172.21.15.59:0/2549310195 wait complete. 2023-10-16T14:27:19.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.545+0000 7f125759e640 1 Processor -- start 2023-10-16T14:27:19.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.545+0000 7f125759e640 1 -- start start 2023-10-16T14:27:19.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.546+0000 7f125759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12580b2dd0 0x7f12580c4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:19.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.546+0000 7f125759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12580ce600 0x7f125815bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:19.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.546+0000 7f125759e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12580cea60 0x7f125815c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.546+0000 7f125759e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12581efb10 con 0x7f12580cea60 2023-10-16T14:27:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.546+0000 7f125759e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12580c47a0 con 0x7f12580b2dd0 2023-10-16T14:27:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.546+0000 7f125759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125815e050 con 0x7f12580ce600 2023-10-16T14:27:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.546+0000 7f1256d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12580cea60 0x7f125815c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.546+0000 7f1256d9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12580cea60 0x7f125815c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34866/0 (socket says 172.21.15.59:34866) 2023-10-16T14:27:19.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.546+0000 7f1256d9d640 1 -- 172.21.15.59:0/3772800943 learned_addr learned my addr 172.21.15.59:0/3772800943 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:19.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.546+0000 7f125659c640 1 --2- 172.21.15.59:0/3772800943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12580b2dd0 0x7f12580c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:19.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.546+0000 7f1255d9b640 1 --2- 172.21.15.59:0/3772800943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12580ce600 0x7f125815bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:19.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.546+0000 7f1256d9d640 1 -- 172.21.15.59:0/3772800943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12580ce600 msgr2=0x7f125815bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:19.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.546+0000 7f1256d9d640 1 --2- 172.21.15.59:0/3772800943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12580ce600 0x7f125815bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:19.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.547+0000 7f1256d9d640 1 -- 172.21.15.59:0/3772800943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12580b2dd0 msgr2=0x7f12580c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:19.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.547+0000 7f1256d9d640 1 --2- 172.21.15.59:0/3772800943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12580b2dd0 0x7f12580c4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:19.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.547+0000 7f1256d9d640 1 -- 172.21.15.59:0/3772800943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1250009a70 con 0x7f12580cea60 2023-10-16T14:27:19.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.547+0000 7f1255d9b640 1 --2- 172.21.15.59:0/3772800943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12580ce600 0x7f125815bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:19.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.547+0000 7f125659c640 1 --2- 172.21.15.59:0/3772800943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12580b2dd0 0x7f12580c4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:19.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.547+0000 7f1256d9d640 1 --2- 172.21.15.59:0/3772800943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12580cea60 0x7f125815c100 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1250009eb0 tx=0x7f1250004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:19.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.547+0000 7f124effd640 1 -- 172.21.15.59:0/3772800943 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125003e610 con 0x7f12580cea60 2023-10-16T14:27:19.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.547+0000 7f124effd640 1 -- 172.21.15.59:0/3772800943 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125003e770 con 0x7f12580cea60 2023-10-16T14:27:19.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.547+0000 7f125759e640 1 -- 172.21.15.59:0/3772800943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125814b5a0 con 0x7f12580cea60 2023-10-16T14:27:19.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.547+0000 7f124effd640 1 -- 172.21.15.59:0/3772800943 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125003eb20 con 0x7f12580cea60 2023-10-16T14:27:19.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.547+0000 7f125759e640 1 -- 172.21.15.59:0/3772800943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125814bb60 con 0x7f12580cea60 2023-10-16T14:27:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.549+0000 7f125759e640 1 -- 172.21.15.59:0/3772800943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125804e9b0 con 0x7f12580cea60 2023-10-16T14:27:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.549+0000 7f124effd640 1 -- 172.21.15.59:0/3772800943 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f125003b050 con 0x7f12580cea60 2023-10-16T14:27:19.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.550+0000 7f124effd640 1 --2- 172.21.15.59:0/3772800943 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f123806ae70 0x7f123806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:19.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.550+0000 7f124effd640 1 -- 172.21.15.59:0/3772800943 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6518+0+0 (secure 0 0 0) 0x7f12500abb60 con 0x7f12580cea60 2023-10-16T14:27:19.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.551+0000 7f125659c640 1 --2- 172.21.15.59:0/3772800943 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f123806ae70 0x7f123806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:19.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.552+0000 7f125659c640 1 --2- 172.21.15.59:0/3772800943 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f123806ae70 0x7f123806d330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1248007fd0 tx=0x7f1248009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:19.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.555+0000 7f124effd640 1 -- 172.21.15.59:0/3772800943 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1250076840 con 0x7f12580cea60 2023-10-16T14:27:19.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.790+0000 7f125759e640 1 -- 172.21.15.59:0/3772800943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f125806c940 con 0x7f12580cea60 2023-10-16T14:27:19.794 INFO:tasks.ceph.mon.a.smithi059.stderr:2023-10-16T14:27:19.791+0000 7fc63fb84640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-16T14:27:19.798 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.795+0000 7f124effd640 1 -- 172.21.15.59:0/3772800943 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1250039090 con 0x7f12580cea60 2023-10-16T14:27:19.799 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-16T14:27:19.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.798+0000 7f125759e640 1 -- 172.21.15.59:0/3772800943 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f123806ae70 msgr2=0x7f123806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:19.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.799+0000 7f125759e640 1 --2- 172.21.15.59:0/3772800943 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f123806ae70 0x7f123806d330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1248007fd0 tx=0x7f1248009040 comp rx=0 tx=0).stop 2023-10-16T14:27:19.802 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.799+0000 7f125759e640 1 -- 172.21.15.59:0/3772800943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12580cea60 msgr2=0x7f125815c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:19.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.799+0000 7f125759e640 1 --2- 172.21.15.59:0/3772800943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12580cea60 0x7f125815c100 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1250009eb0 tx=0x7f1250004a40 comp rx=0 tx=0).stop 2023-10-16T14:27:19.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.799+0000 7f125759e640 1 -- 172.21.15.59:0/3772800943 shutdown_connections 2023-10-16T14:27:19.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.799+0000 7f125759e640 1 --2- 172.21.15.59:0/3772800943 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f123806ae70 0x7f123806d330 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:19.803 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.799+0000 7f125759e640 1 --2- 172.21.15.59:0/3772800943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12580cea60 0x7f125815c100 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:19.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.799+0000 7f125759e640 1 --2- 172.21.15.59:0/3772800943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12580ce600 0x7f125815bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:19.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.799+0000 7f125759e640 1 --2- 172.21.15.59:0/3772800943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12580b2dd0 0x7f12580c4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:19.805 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.799+0000 7f125759e640 1 -- 172.21.15.59:0/3772800943 >> 172.21.15.59:0/3772800943 conn(0x7f1258069fc0 msgr2=0x7f125806ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:19.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.799+0000 7f125759e640 1 -- 172.21.15.59:0/3772800943 shutdown_connections 2023-10-16T14:27:19.806 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:19.799+0000 7f125759e640 1 -- 172.21.15.59:0/3772800943 wait complete. 2023-10-16T14:27:19.823 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-16T14:27:19.833 INFO:tasks.ceph.mds.d.smithi151.stderr: -5163> 2023-10-16T14:25:54.278+0000 7f0ad50ae640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T14:27:19.912 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-10-16T14:27:20.050 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.047+0000 7f0b157e4640 1 Processor -- start 2023-10-16T14:27:20.051 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.047+0000 7f0b157e4640 1 -- start start 2023-10-16T14:27:20.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.048+0000 7f0b157e4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b100cf030 0x7f0b1006ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:20.052 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.049+0000 7f0b157e4640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b101550f0 con 0x7f0b10154d10 2023-10-16T14:27:20.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.049+0000 7f0b157e4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b1006db50 con 0x7f0b1006d360 2023-10-16T14:27:20.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.049+0000 7f0b157e4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100b13f0 con 0x7f0b100cf030 2023-10-16T14:27:20.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.049+0000 7f0b0ffff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0b10154d10 0x7f0b100ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34748/0 (socket says 172.21.15.59:34748) 2023-10-16T14:27:20.053 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.049+0000 7f0b0ffff640 1 -- 172.21.15.59:0/910393015 learned_addr learned my addr 172.21.15.59:0/910393015 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:20.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.049+0000 7f0b0f7fe640 1 --2- 172.21.15.59:0/910393015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b100cf030 0x7f0b1006ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:20.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.050+0000 7f0b0effd640 1 -- 172.21.15.59:0/910393015 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104580541 0 0) 0x7f0b101550f0 con 0x7f0b10154d10 2023-10-16T14:27:20.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.050+0000 7f0b0effd640 1 -- 172.21.15.59:0/910393015 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0af8003520 con 0x7f0b10154d10 2023-10-16T14:27:20.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.050+0000 7f0b0effd640 1 -- 172.21.15.59:0/910393015 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1750792171 0 0) 0x7f0af8003520 con 0x7f0b10154d10 2023-10-16T14:27:20.056 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.050+0000 7f0b0effd640 1 -- 172.21.15.59:0/910393015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b100cf030 msgr2=0x7f0b1006ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:20.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.050+0000 7f0b0effd640 1 --2- 172.21.15.59:0/910393015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b100cf030 0x7f0b1006ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:20.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.050+0000 7f0b0effd640 1 -- 172.21.15.59:0/910393015 >> v1:172.21.15.151:6789/0 conn(0x7f0b1006d360 legacy=0x7f0b100ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:20.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.050+0000 7f0b0effd640 1 -- 172.21.15.59:0/910393015 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b100b16d0 con 0x7f0b10154d10 2023-10-16T14:27:20.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.050+0000 7f0b0effd640 1 -- 172.21.15.59:0/910393015 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f0b000019f0 con 0x7f0b10154d10 2023-10-16T14:27:20.057 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.050+0000 7f0b0effd640 1 -- 172.21.15.59:0/910393015 >> v1:172.21.15.59:6789/0 conn(0x7f0b10154d10 legacy=0x7f0b100ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:20.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.050+0000 7f0b0effd640 1 --2- 172.21.15.59:0/910393015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b100cf030 0x7f0af8003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:20.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.050+0000 7f0b0effd640 1 --2- 172.21.15.59:0/910393015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0af8003fe0 0x7f0af80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:20.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.050+0000 7f0b0effd640 1 --2- 172.21.15.59:0/910393015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0af8004d00 0x7f0af8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:20.058 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.050+0000 7f0b0effd640 1 -- 172.21.15.59:0/910393015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100b13f0 con 0x7f0af8003fe0 2023-10-16T14:27:20.059 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.050+0000 7f0b0effd640 1 -- 172.21.15.59:0/910393015 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af800bb40 con 0x7f0af8004d00 2023-10-16T14:27:20.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.050+0000 7f0b0effd640 1 -- 172.21.15.59:0/910393015 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af800bd00 con 0x7f0b100cf030 2023-10-16T14:27:20.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.051+0000 7f0b0f7fe640 1 --2- 172.21.15.59:0/910393015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0af8003fe0 0x7f0af80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:20.060 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.051+0000 7f0b0ffff640 1 --2- 172.21.15.59:0/910393015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b100cf030 0x7f0af8003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:20.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.051+0000 7f0b14fe3640 1 --2- 172.21.15.59:0/910393015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0af8004d00 0x7f0af8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:20.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.051+0000 7f0b0f7fe640 1 -- 172.21.15.59:0/910393015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b100cf030 msgr2=0x7f0af8003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:20.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.051+0000 7f0b0f7fe640 1 --2- 172.21.15.59:0/910393015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b100cf030 0x7f0af8003a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:20.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.051+0000 7f0b0f7fe640 1 -- 172.21.15.59:0/910393015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0af8004d00 msgr2=0x7f0af8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:20.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.051+0000 7f0b0f7fe640 1 --2- 172.21.15.59:0/910393015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0af8004d00 0x7f0af8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:20.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.051+0000 7f0b0f7fe640 1 -- 172.21.15.59:0/910393015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af8003520 con 0x7f0af8003fe0 2023-10-16T14:27:20.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.051+0000 7f0b14fe3640 1 --2- 172.21.15.59:0/910393015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0af8004d00 0x7f0af8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:20.062 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.052+0000 7f0b0f7fe640 1 --2- 172.21.15.59:0/910393015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0af8003fe0 0x7f0af80047c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009ac0 tx=0x7f0af80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60eea28fa22c17a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:20.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.052+0000 7f0b0effd640 1 -- 172.21.15.59:0/910393015 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0402c6b0 con 0x7f0af8003fe0 2023-10-16T14:27:20.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.053+0000 7f0b0effd640 1 -- 172.21.15.59:0/910393015 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0402c810 con 0x7f0af8003fe0 2023-10-16T14:27:20.063 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.053+0000 7f0b0effd640 1 -- 172.21.15.59:0/910393015 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0402cba0 con 0x7f0af8003fe0 2023-10-16T14:27:20.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.053+0000 7f0b157e4640 1 -- 172.21.15.59:0/910393015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0af8003fe0 msgr2=0x7f0af80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:20.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.053+0000 7f0b157e4640 1 --2- 172.21.15.59:0/910393015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0af8003fe0 0x7f0af80047c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009ac0 tx=0x7f0af80057f0 comp rx=0 tx=0).stop 2023-10-16T14:27:20.066 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.053+0000 7f0b14fe3640 1 -- 172.21.15.59:0/910393015 reap_dead start 2023-10-16T14:27:20.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.053+0000 7f0b157e4640 1 -- 172.21.15.59:0/910393015 shutdown_connections 2023-10-16T14:27:20.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.053+0000 7f0b157e4640 1 -- 172.21.15.59:0/910393015 >> 172.21.15.59:0/910393015 conn(0x7f0b1006a200 msgr2=0x7f0b1006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:20.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.053+0000 7f0b157e4640 1 -- 172.21.15.59:0/910393015 shutdown_connections 2023-10-16T14:27:20.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.053+0000 7f0b157e4640 1 -- 172.21.15.59:0/910393015 wait complete. 2023-10-16T14:27:20.067 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.055+0000 7f0b157e4640 1 Processor -- start 2023-10-16T14:27:20.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.055+0000 7f0b157e4640 1 -- start start 2023-10-16T14:27:20.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.056+0000 7f0b157e4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0af8003fe0 0x7f0b100ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:20.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.056+0000 7f0b157e4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b101449a0 0x7f0b101f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:20.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.056+0000 7f0b157e4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b1015bf10 0x7f0b1015c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:20.068 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.056+0000 7f0b157e4640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b10144f10 con 0x7f0af8003fe0 2023-10-16T14:27:20.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.056+0000 7f0b157e4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b101451f0 con 0x7f0b1015bf10 2023-10-16T14:27:20.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.056+0000 7f0b157e4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b101454d0 con 0x7f0b101449a0 2023-10-16T14:27:20.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.056+0000 7f0b0ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0af8003fe0 0x7f0b100ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:20.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.056+0000 7f0b0ffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0af8003fe0 0x7f0b100ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34874/0 (socket says 172.21.15.59:34874) 2023-10-16T14:27:20.069 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.057+0000 7f0b0ffff640 1 -- 172.21.15.59:0/1862146419 learned_addr learned my addr 172.21.15.59:0/1862146419 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:20.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.057+0000 7f0b0f7fe640 1 --2- 172.21.15.59:0/1862146419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b101449a0 0x7f0b101f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:20.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.057+0000 7f0b14fe3640 1 --2- 172.21.15.59:0/1862146419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b1015bf10 0x7f0b1015c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:20.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.057+0000 7f0b0ffff640 1 -- 172.21.15.59:0/1862146419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b101449a0 msgr2=0x7f0b101f20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:20.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.057+0000 7f0b0ffff640 1 --2- 172.21.15.59:0/1862146419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b101449a0 0x7f0b101f20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:20.070 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.057+0000 7f0b0ffff640 1 -- 172.21.15.59:0/1862146419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b1015bf10 msgr2=0x7f0b1015c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:20.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.057+0000 7f0b0ffff640 1 --2- 172.21.15.59:0/1862146419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b1015bf10 0x7f0b1015c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:20.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.057+0000 7f0b0ffff640 1 -- 172.21.15.59:0/1862146419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b101457b0 con 0x7f0af8003fe0 2023-10-16T14:27:20.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.057+0000 7f0b14fe3640 1 --2- 172.21.15.59:0/1862146419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b1015bf10 0x7f0b1015c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:20.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.057+0000 7f0b0ffff640 1 --2- 172.21.15.59:0/1862146419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0af8003fe0 0x7f0b100ae8b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0b00002090 tx=0x7f0b0000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:20.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.058+0000 7f0b0cff9640 1 -- 172.21.15.59:0/1862146419 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b00004d60 con 0x7f0af8003fe0 2023-10-16T14:27:20.071 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.058+0000 7f0b0cff9640 1 -- 172.21.15.59:0/1862146419 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0000be80 con 0x7f0af8003fe0 2023-10-16T14:27:20.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.058+0000 7f0b157e4640 1 -- 172.21.15.59:0/1862146419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b10145a90 con 0x7f0af8003fe0 2023-10-16T14:27:20.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.058+0000 7f0b0cff9640 1 -- 172.21.15.59:0/1862146419 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b000072d0 con 0x7f0af8003fe0 2023-10-16T14:27:20.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.058+0000 7f0b157e4640 1 -- 172.21.15.59:0/1862146419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b101f2620 con 0x7f0af8003fe0 2023-10-16T14:27:20.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.059+0000 7f0b157e4640 1 -- 172.21.15.59:0/1862146419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1006d7d0 con 0x7f0af8003fe0 2023-10-16T14:27:20.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.060+0000 7f0b0cff9640 1 -- 172.21.15.59:0/1862146419 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0b00007430 con 0x7f0af8003fe0 2023-10-16T14:27:20.072 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.061+0000 7f0b0cff9640 1 --2- 172.21.15.59:0/1862146419 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0afc06aea0 0x7f0afc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:20.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.061+0000 7f0b0cff9640 1 -- 172.21.15.59:0/1862146419 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6604+0+0 (secure 0 0 0) 0x7f0b00089c60 con 0x7f0af8003fe0 2023-10-16T14:27:20.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.061+0000 7f0b0f7fe640 1 --2- 172.21.15.59:0/1862146419 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0afc06aea0 0x7f0afc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:20.073 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.063+0000 7f0b0f7fe640 1 --2- 172.21.15.59:0/1862146419 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0afc06aea0 0x7f0afc06d360 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0b04036000 tx=0x7f0b04030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:20.074 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.065+0000 7f0b0cff9640 1 -- 172.21.15.59:0/1862146419 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b1006d7d0 con 0x7f0af8003fe0 2023-10-16T14:27:20.304 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.301+0000 7f0b157e4640 1 -- 172.21.15.59:0/1862146419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0b1006d7d0 con 0x7f0af8003fe0 2023-10-16T14:27:20.917 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.913+0000 7f0b0cff9640 1 -- 172.21.15.59:0/1862146419 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0b1006d7d0 con 0x7f0af8003fe0 2023-10-16T14:27:20.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.918+0000 7f0b157e4640 1 -- 172.21.15.59:0/1862146419 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0afc06aea0 msgr2=0x7f0afc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:20.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.918+0000 7f0b157e4640 1 --2- 172.21.15.59:0/1862146419 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0afc06aea0 0x7f0afc06d360 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0b04036000 tx=0x7f0b04030000 comp rx=0 tx=0).stop 2023-10-16T14:27:20.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.918+0000 7f0b157e4640 1 -- 172.21.15.59:0/1862146419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0af8003fe0 msgr2=0x7f0b100ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:20.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.918+0000 7f0b157e4640 1 --2- 172.21.15.59:0/1862146419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0af8003fe0 0x7f0b100ae8b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0b00002090 tx=0x7f0b0000b4a0 comp rx=0 tx=0).stop 2023-10-16T14:27:20.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.918+0000 7f0b157e4640 1 -- 172.21.15.59:0/1862146419 shutdown_connections 2023-10-16T14:27:20.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.918+0000 7f0b157e4640 1 --2- 172.21.15.59:0/1862146419 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0afc06aea0 0x7f0afc06d360 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:20.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.918+0000 7f0b157e4640 1 --2- 172.21.15.59:0/1862146419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b1015bf10 0x7f0b1015c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:20.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.918+0000 7f0b157e4640 1 --2- 172.21.15.59:0/1862146419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b101449a0 0x7f0b101f20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:20.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.918+0000 7f0b157e4640 1 --2- 172.21.15.59:0/1862146419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0af8003fe0 0x7f0b100ae8b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:20.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.918+0000 7f0b157e4640 1 -- 172.21.15.59:0/1862146419 >> 172.21.15.59:0/1862146419 conn(0x7f0b1006a200 msgr2=0x7f0b100ca1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:20.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.918+0000 7f0b157e4640 1 -- 172.21.15.59:0/1862146419 shutdown_connections 2023-10-16T14:27:20.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:20.918+0000 7f0b157e4640 1 -- 172.21.15.59:0/1862146419 wait complete. 2023-10-16T14:27:20.946 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-16T14:27:21.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.170+0000 7ff7401b6640 1 Processor -- start 2023-10-16T14:27:21.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.170+0000 7ff7401b6640 1 -- start start 2023-10-16T14:27:21.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.171+0000 7ff7401b6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff73815cbb0 0x7ff7380d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:21.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.171+0000 7ff7401b6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7380cf230 0x7ff7380d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:21.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.172+0000 7ff7401b6640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff7380d1410 0x7ff7380cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:21.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.172+0000 7ff7401b6640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7380d18a0 con 0x7ff7380d1410 2023-10-16T14:27:21.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.172+0000 7ff7401b6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7380cf7a0 con 0x7ff73815cbb0 2023-10-16T14:27:21.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.172+0000 7ff7401b6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380cfa80 con 0x7ff7380cf230 2023-10-16T14:27:21.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.172+0000 7ff73e753640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff7380d1410 0x7ff7380cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:21.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.172+0000 7ff73e753640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff7380d1410 0x7ff7380cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34890/0 (socket says 172.21.15.59:34890) 2023-10-16T14:27:21.177 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.172+0000 7ff73e753640 1 -- 172.21.15.59:0/2680576295 learned_addr learned my addr 172.21.15.59:0/2680576295 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:21.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.172+0000 7ff73d751640 1 --2- 172.21.15.59:0/2680576295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7380cf230 0x7ff7380d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:21.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.172+0000 7ff73df52640 1 --2- 172.21.15.59:0/2680576295 >> v2:172.21.15.151:3300/0 conn(0x7ff73815cbb0 0x7ff7380d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:21.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.173+0000 7ff73e753640 1 -- 172.21.15.59:0/2680576295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7380cf230 msgr2=0x7ff7380d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:21.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.173+0000 7ff73e753640 1 --2- 172.21.15.59:0/2680576295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7380cf230 0x7ff7380d0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:21.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.173+0000 7ff73e753640 1 -- 172.21.15.59:0/2680576295 >> v2:172.21.15.151:3300/0 conn(0x7ff73815cbb0 msgr2=0x7ff7380d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:21.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.173+0000 7ff73e753640 1 --2- 172.21.15.59:0/2680576295 >> v2:172.21.15.151:3300/0 conn(0x7ff73815cbb0 0x7ff7380d06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:21.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.173+0000 7ff73e753640 1 -- 172.21.15.59:0/2680576295 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7380cfd60 con 0x7ff7380d1410 2023-10-16T14:27:21.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.174+0000 7ff73e753640 1 --2- 172.21.15.59:0/2680576295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7380d1410 0x7ff7380cd3e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff73808ca80 tx=0x7ff73002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659fdb93ad93a39f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:21.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.174+0000 7ff73cf50640 1 -- 172.21.15.59:0/2680576295 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73002ca70 con 0x7ff7380d1410 2023-10-16T14:27:21.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.174+0000 7ff73cf50640 1 -- 172.21.15.59:0/2680576295 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73002cbd0 con 0x7ff7380d1410 2023-10-16T14:27:21.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.174+0000 7ff73cf50640 1 -- 172.21.15.59:0/2680576295 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7300343f0 con 0x7ff7380d1410 2023-10-16T14:27:21.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.175+0000 7ff7401b6640 1 -- 172.21.15.59:0/2680576295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7380d1410 msgr2=0x7ff7380cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:21.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.175+0000 7ff7401b6640 1 --2- 172.21.15.59:0/2680576295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7380d1410 0x7ff7380cd3e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff73808ca80 tx=0x7ff73002bed0 comp rx=0 tx=0).stop 2023-10-16T14:27:21.181 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.175+0000 7ff7401b6640 1 -- 172.21.15.59:0/2680576295 shutdown_connections 2023-10-16T14:27:21.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.175+0000 7ff7401b6640 1 --2- 172.21.15.59:0/2680576295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7380d1410 0x7ff7380cd3e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:21.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.175+0000 7ff7401b6640 1 --2- 172.21.15.59:0/2680576295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7380cf230 0x7ff7380d0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:21.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.175+0000 7ff7401b6640 1 --2- 172.21.15.59:0/2680576295 >> v2:172.21.15.151:3300/0 conn(0x7ff73815cbb0 0x7ff7380d06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:21.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.175+0000 7ff7401b6640 1 -- 172.21.15.59:0/2680576295 >> 172.21.15.59:0/2680576295 conn(0x7ff73809bc60 msgr2=0x7ff7380d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:21.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.175+0000 7ff7401b6640 1 -- 172.21.15.59:0/2680576295 shutdown_connections 2023-10-16T14:27:21.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.176+0000 7ff7401b6640 1 -- 172.21.15.59:0/2680576295 wait complete. 2023-10-16T14:27:21.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.177+0000 7ff7401b6640 1 Processor -- start 2023-10-16T14:27:21.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.178+0000 7ff7401b6640 1 -- start start 2023-10-16T14:27:21.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.178+0000 7ff7401b6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7380cf230 0x7ff73814def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:21.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.179+0000 7ff7401b6640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7380d1410 0x7ff7380b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:21.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.179+0000 7ff7401b6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff73815cbb0 0x7ff73815f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:21.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.179+0000 7ff7401b6640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380b5e20 con 0x7ff7380d1410 2023-10-16T14:27:21.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.179+0000 7ff7401b6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380b6100 con 0x7ff7380cf230 2023-10-16T14:27:21.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.179+0000 7ff7401b6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380b63e0 con 0x7ff73815cbb0 2023-10-16T14:27:21.186 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.179+0000 7ff73d751640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7380d1410 0x7ff7380b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:21.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.179+0000 7ff73d751640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7380d1410 0x7ff7380b54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34904/0 (socket says 172.21.15.59:34904) 2023-10-16T14:27:21.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.179+0000 7ff73d751640 1 -- 172.21.15.59:0/1637684307 learned_addr learned my addr 172.21.15.59:0/1637684307 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:21.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.179+0000 7ff73df52640 1 --2- 172.21.15.59:0/1637684307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7380cf230 0x7ff73814def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:21.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.179+0000 7ff73e753640 1 --2- 172.21.15.59:0/1637684307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff73815cbb0 0x7ff73815f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:21.187 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.179+0000 7ff73d751640 1 -- 172.21.15.59:0/1637684307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff73815cbb0 msgr2=0x7ff73815f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:21.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.179+0000 7ff73d751640 1 --2- 172.21.15.59:0/1637684307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff73815cbb0 0x7ff73815f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:21.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.179+0000 7ff73d751640 1 -- 172.21.15.59:0/1637684307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7380cf230 msgr2=0x7ff73814def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:21.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.179+0000 7ff73d751640 1 --2- 172.21.15.59:0/1637684307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7380cf230 0x7ff73814def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:21.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.179+0000 7ff73d751640 1 -- 172.21.15.59:0/1637684307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff730009b30 con 0x7ff7380d1410 2023-10-16T14:27:21.188 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.180+0000 7ff73d751640 1 --2- 172.21.15.59:0/1637684307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7380d1410 0x7ff7380b54d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff72800e870 tx=0x7ff72800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.180+0000 7ff72e7fc640 1 -- 172.21.15.59:0/1637684307 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7280094f0 con 0x7ff7380d1410 2023-10-16T14:27:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.180+0000 7ff72e7fc640 1 -- 172.21.15.59:0/1637684307 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72800c940 con 0x7ff7380d1410 2023-10-16T14:27:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.180+0000 7ff72e7fc640 1 -- 172.21.15.59:0/1637684307 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72800ccf0 con 0x7ff7380d1410 2023-10-16T14:27:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.180+0000 7ff7401b6640 1 -- 172.21.15.59:0/1637684307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7380b66c0 con 0x7ff7380d1410 2023-10-16T14:27:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.180+0000 7ff7401b6640 1 -- 172.21.15.59:0/1637684307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7380b5a10 con 0x7ff7380d1410 2023-10-16T14:27:21.190 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.181+0000 7ff7401b6640 1 -- 172.21.15.59:0/1637684307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7380c99c0 con 0x7ff7380d1410 2023-10-16T14:27:21.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.183+0000 7ff72e7fc640 1 -- 172.21.15.59:0/1637684307 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff728013470 con 0x7ff7380d1410 2023-10-16T14:27:21.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.183+0000 7ff72e7fc640 1 --2- 172.21.15.59:0/1637684307 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff71c06ae70 0x7ff71c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:21.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.184+0000 7ff72e7fc640 1 -- 172.21.15.59:0/1637684307 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6604+0+0 (secure 0 0 0) 0x7ff728089ac0 con 0x7ff7380d1410 2023-10-16T14:27:21.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.184+0000 7ff73df52640 1 --2- 172.21.15.59:0/1637684307 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff71c06ae70 0x7ff71c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:21.191 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.185+0000 7ff73df52640 1 --2- 172.21.15.59:0/1637684307 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff71c06ae70 0x7ff71c06d330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff734009a50 tx=0x7ff734008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:21.192 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.188+0000 7ff72e7fc640 1 -- 172.21.15.59:0/1637684307 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff7380c99c0 con 0x7ff7380d1410 2023-10-16T14:27:21.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.383+0000 7ff7401b6640 1 -- 172.21.15.59:0/1637684307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff7380c99c0 con 0x7ff7380d1410 2023-10-16T14:27:21.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.929+0000 7ff72e7fc640 1 -- 172.21.15.59:0/1637684307 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff7380c99c0 con 0x7ff7380d1410 2023-10-16T14:27:21.933 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2023-10-16T14:27:21.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.933+0000 7ff7401b6640 1 -- 172.21.15.59:0/1637684307 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff71c06ae70 msgr2=0x7ff71c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:21.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.933+0000 7ff7401b6640 1 --2- 172.21.15.59:0/1637684307 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff71c06ae70 0x7ff71c06d330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff734009a50 tx=0x7ff734008040 comp rx=0 tx=0).stop 2023-10-16T14:27:21.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.933+0000 7ff7401b6640 1 -- 172.21.15.59:0/1637684307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7380d1410 msgr2=0x7ff7380b54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:21.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.933+0000 7ff7401b6640 1 --2- 172.21.15.59:0/1637684307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7380d1410 0x7ff7380b54d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff72800e870 tx=0x7ff72800ed30 comp rx=0 tx=0).stop 2023-10-16T14:27:21.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.934+0000 7ff7401b6640 1 -- 172.21.15.59:0/1637684307 shutdown_connections 2023-10-16T14:27:21.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.934+0000 7ff7401b6640 1 --2- 172.21.15.59:0/1637684307 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff71c06ae70 0x7ff71c06d330 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:21.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.934+0000 7ff7401b6640 1 --2- 172.21.15.59:0/1637684307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff73815cbb0 0x7ff73815f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:21.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.934+0000 7ff7401b6640 1 --2- 172.21.15.59:0/1637684307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7380d1410 0x7ff7380b54d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:21.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.934+0000 7ff7401b6640 1 --2- 172.21.15.59:0/1637684307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7380cf230 0x7ff73814def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:21.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.934+0000 7ff7401b6640 1 -- 172.21.15.59:0/1637684307 >> 172.21.15.59:0/1637684307 conn(0x7ff73809bc60 msgr2=0x7ff73815bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:21.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.934+0000 7ff7401b6640 1 -- 172.21.15.59:0/1637684307 shutdown_connections 2023-10-16T14:27:21.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:21.934+0000 7ff7401b6640 1 -- 172.21.15.59:0/1637684307 wait complete. 2023-10-16T14:27:21.963 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-16T14:27:22.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.189+0000 7f2863fff640 1 Processor -- start 2023-10-16T14:27:22.193 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.189+0000 7f2863fff640 1 -- start start 2023-10-16T14:27:22.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.191+0000 7f2863fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2864070400 0x7f286415e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:22.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.191+0000 7f2863fff640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28640c8e40 con 0x7f28640c8930 2023-10-16T14:27:22.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.191+0000 7f2863fff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28640c9090 con 0x7f28640cb400 2023-10-16T14:27:22.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.191+0000 7f2863fff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28640c9370 con 0x7f2864070400 2023-10-16T14:27:22.195 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.191+0000 7f28627fc640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f28640c8930 0x7f28640cacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56466/0 (socket says 172.21.15.59:56466) 2023-10-16T14:27:22.196 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.191+0000 7f28627fc640 1 -- 172.21.15.59:0/552276968 learned_addr learned my addr 172.21.15.59:0/552276968 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:22.197 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.192+0000 7f2862ffd640 1 --2- 172.21.15.59:0/552276968 >> v2:172.21.15.151:3300/0 conn(0x7f2864070400 0x7f286415e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:22.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.192+0000 7f2861ffb640 1 -- 172.21.15.59:0/552276968 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570204096 0 0) 0x7f28640c8e40 con 0x7f28640c8930 2023-10-16T14:27:22.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.192+0000 7f2861ffb640 1 -- 172.21.15.59:0/552276968 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f284c003520 con 0x7f28640c8930 2023-10-16T14:27:22.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.192+0000 7f2861ffb640 1 -- 172.21.15.59:0/552276968 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1976974573 0 0) 0x7f284c003520 con 0x7f28640c8930 2023-10-16T14:27:22.198 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.192+0000 7f2861ffb640 1 -- 172.21.15.59:0/552276968 >> v2:172.21.15.151:3300/0 conn(0x7f2864070400 msgr2=0x7f286415e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:22.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.192+0000 7f2861ffb640 1 --2- 172.21.15.59:0/552276968 >> v2:172.21.15.151:3300/0 conn(0x7f2864070400 0x7f286415e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:22.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.192+0000 7f2861ffb640 1 -- 172.21.15.59:0/552276968 >> v1:172.21.15.151:6789/0 conn(0x7f28640cb400 legacy=0x7f286415af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:22.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.192+0000 7f2861ffb640 1 -- 172.21.15.59:0/552276968 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28640c9650 con 0x7f28640c8930 2023-10-16T14:27:22.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.192+0000 7f2861ffb640 1 -- 172.21.15.59:0/552276968 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f2858001670 con 0x7f28640c8930 2023-10-16T14:27:22.199 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.193+0000 7f2861ffb640 1 -- 172.21.15.59:0/552276968 >> v1:172.21.15.59:6789/0 conn(0x7f28640c8930 legacy=0x7f28640cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:22.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.193+0000 7f2861ffb640 1 --2- 172.21.15.59:0/552276968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f284c0039c0 0x7f284c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:22.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.193+0000 7f2861ffb640 1 --2- 172.21.15.59:0/552276968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c0047c0 0x7f284c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:22.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.193+0000 7f2861ffb640 1 --2- 172.21.15.59:0/552276968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f284c005180 0x7f284c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:22.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.193+0000 7f2861ffb640 1 -- 172.21.15.59:0/552276968 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28640c9370 con 0x7f284c0047c0 2023-10-16T14:27:22.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.193+0000 7f2861ffb640 1 -- 172.21.15.59:0/552276968 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c00c080 con 0x7f284c005180 2023-10-16T14:27:22.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.193+0000 7f2861ffb640 1 -- 172.21.15.59:0/552276968 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c00c240 con 0x7f284c0039c0 2023-10-16T14:27:22.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.193+0000 7f28627fc640 1 --2- 172.21.15.59:0/552276968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c0047c0 0x7f284c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:22.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.193+0000 7f28637fe640 1 --2- 172.21.15.59:0/552276968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f284c005180 0x7f284c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:22.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.193+0000 7f2862ffd640 1 --2- 172.21.15.59:0/552276968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f284c0039c0 0x7f284c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:22.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.193+0000 7f28627fc640 1 -- 172.21.15.59:0/552276968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f284c0039c0 msgr2=0x7f284c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:22.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.193+0000 7f28627fc640 1 --2- 172.21.15.59:0/552276968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f284c0039c0 0x7f284c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:22.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.193+0000 7f28627fc640 1 -- 172.21.15.59:0/552276968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f284c005180 msgr2=0x7f284c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:22.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.193+0000 7f28627fc640 1 --2- 172.21.15.59:0/552276968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f284c005180 0x7f284c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:22.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.193+0000 7f28627fc640 1 -- 172.21.15.59:0/552276968 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c003520 con 0x7f284c0047c0 2023-10-16T14:27:22.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.193+0000 7f28637fe640 1 -- 172.21.15.59:0/552276968 reap_dead start 2023-10-16T14:27:22.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.193+0000 7f2862ffd640 1 --2- 172.21.15.59:0/552276968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f284c0039c0 0x7f284c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:22.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.195+0000 7f28627fc640 1 --2- 172.21.15.59:0/552276968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c0047c0 0x7f284c004c40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f285800c0e0 tx=0x7f284c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3414f0cbc9282a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:22.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.195+0000 7f2861ffb640 1 -- 172.21.15.59:0/552276968 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2858005ad0 con 0x7f284c0047c0 2023-10-16T14:27:22.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.195+0000 7f2861ffb640 1 -- 172.21.15.59:0/552276968 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2858005c50 con 0x7f284c0047c0 2023-10-16T14:27:22.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.195+0000 7f2861ffb640 1 -- 172.21.15.59:0/552276968 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285802c7f0 con 0x7f284c0047c0 2023-10-16T14:27:22.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.195+0000 7f2863fff640 1 -- 172.21.15.59:0/552276968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c0047c0 msgr2=0x7f284c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:22.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.195+0000 7f2863fff640 1 --2- 172.21.15.59:0/552276968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c0047c0 0x7f284c004c40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f285800c0e0 tx=0x7f284c0057f0 comp rx=0 tx=0).stop 2023-10-16T14:27:22.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.196+0000 7f2863fff640 1 -- 172.21.15.59:0/552276968 shutdown_connections 2023-10-16T14:27:22.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.196+0000 7f2863fff640 1 --2- 172.21.15.59:0/552276968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c0047c0 0x7f284c004c40 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:22.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.196+0000 7f2863fff640 1 -- 172.21.15.59:0/552276968 >> 172.21.15.59:0/552276968 conn(0x7f286406a470 msgr2=0x7f28640afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:22.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.196+0000 7f2863fff640 1 -- 172.21.15.59:0/552276968 shutdown_connections 2023-10-16T14:27:22.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.196+0000 7f2863fff640 1 -- 172.21.15.59:0/552276968 wait complete. 2023-10-16T14:27:22.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.197+0000 7f2863fff640 1 Processor -- start 2023-10-16T14:27:22.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.198+0000 7f2863fff640 1 -- start start 2023-10-16T14:27:22.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.198+0000 7f2863fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c0047c0 0x7f28640c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:22.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.198+0000 7f2863fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2864154160 0x7f28641596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:22.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.199+0000 7f2863fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2864159c30 0x7f28640cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:22.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.199+0000 7f2863fff640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28640c87b0 con 0x7f284c0047c0 2023-10-16T14:27:22.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.199+0000 7f2863fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286415a0b0 con 0x7f2864159c30 2023-10-16T14:27:22.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.199+0000 7f2863fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28640b2890 con 0x7f2864154160 2023-10-16T14:27:22.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.199+0000 7f2862ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c0047c0 0x7f28640c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:22.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.199+0000 7f2862ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c0047c0 0x7f28640c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45008/0 (socket says 172.21.15.59:45008) 2023-10-16T14:27:22.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.199+0000 7f2862ffd640 1 -- 172.21.15.59:0/3320199038 learned_addr learned my addr 172.21.15.59:0/3320199038 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:22.209 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.199+0000 7f28627fc640 1 --2- 172.21.15.59:0/3320199038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2864154160 0x7f28641596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:22.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.199+0000 7f2862ffd640 1 -- 172.21.15.59:0/3320199038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2864154160 msgr2=0x7f28641596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:22.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.199+0000 7f2862ffd640 1 --2- 172.21.15.59:0/3320199038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2864154160 0x7f28641596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:22.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.199+0000 7f2862ffd640 1 -- 172.21.15.59:0/3320199038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2864159c30 msgr2=0x7f28640cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:22.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.199+0000 7f2862ffd640 1 --2- 172.21.15.59:0/3320199038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2864159c30 0x7f28640cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:22.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.199+0000 7f2862ffd640 1 -- 172.21.15.59:0/3320199038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28640b2b70 con 0x7f284c0047c0 2023-10-16T14:27:22.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.200+0000 7f2862ffd640 1 --2- 172.21.15.59:0/3320199038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c0047c0 0x7f28640c8270 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f28540107c0 tx=0x7f2854010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:22.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.200+0000 7f284b7fe640 1 -- 172.21.15.59:0/3320199038 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285400eb60 con 0x7f284c0047c0 2023-10-16T14:27:22.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.200+0000 7f284b7fe640 1 -- 172.21.15.59:0/3320199038 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285400ecc0 con 0x7f284c0047c0 2023-10-16T14:27:22.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.200+0000 7f284b7fe640 1 -- 172.21.15.59:0/3320199038 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854010e70 con 0x7f284c0047c0 2023-10-16T14:27:22.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.200+0000 7f2863fff640 1 -- 172.21.15.59:0/3320199038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28640b2e50 con 0x7f284c0047c0 2023-10-16T14:27:22.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.200+0000 7f2863fff640 1 -- 172.21.15.59:0/3320199038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28640b3410 con 0x7f284c0047c0 2023-10-16T14:27:22.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.201+0000 7f2863fff640 1 -- 172.21.15.59:0/3320199038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f286404e9b0 con 0x7f284c0047c0 2023-10-16T14:27:22.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.202+0000 7f284b7fe640 1 -- 172.21.15.59:0/3320199038 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f285401c400 con 0x7f284c0047c0 2023-10-16T14:27:22.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.204+0000 7f284b7fe640 1 --2- 172.21.15.59:0/3320199038 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f285006ae70 0x7f285006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:22.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.204+0000 7f284b7fe640 1 -- 172.21.15.59:0/3320199038 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6166+0+0 (secure 0 0 0) 0x7f2854089cd0 con 0x7f284c0047c0 2023-10-16T14:27:22.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.204+0000 7f28627fc640 1 --2- 172.21.15.59:0/3320199038 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f285006ae70 0x7f285006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:22.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.205+0000 7f28627fc640 1 --2- 172.21.15.59:0/3320199038 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f285006ae70 0x7f285006d330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2858034000 tx=0x7f2858009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:22.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.208+0000 7f284b7fe640 1 -- 172.21.15.59:0/3320199038 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2854054bc0 con 0x7f284c0047c0 2023-10-16T14:27:22.404 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.400+0000 7f2863fff640 1 -- 172.21.15.59:0/3320199038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f28640b0b70 con 0x7f284c0047c0 2023-10-16T14:27:22.950 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.946+0000 7f284b7fe640 1 -- 172.21.15.59:0/3320199038 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7f28540210d0 con 0x7f284c0047c0 2023-10-16T14:27:22.950 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2023-10-16T14:27:22.953 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.950+0000 7f2863fff640 1 -- 172.21.15.59:0/3320199038 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f285006ae70 msgr2=0x7f285006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:22.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.950+0000 7f2863fff640 1 --2- 172.21.15.59:0/3320199038 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f285006ae70 0x7f285006d330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2858034000 tx=0x7f2858009030 comp rx=0 tx=0).stop 2023-10-16T14:27:22.954 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.950+0000 7f2863fff640 1 -- 172.21.15.59:0/3320199038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c0047c0 msgr2=0x7f28640c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:22.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.950+0000 7f2863fff640 1 --2- 172.21.15.59:0/3320199038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c0047c0 0x7f28640c8270 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f28540107c0 tx=0x7f2854010c80 comp rx=0 tx=0).stop 2023-10-16T14:27:22.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.951+0000 7f2863fff640 1 -- 172.21.15.59:0/3320199038 shutdown_connections 2023-10-16T14:27:22.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.951+0000 7f2863fff640 1 --2- 172.21.15.59:0/3320199038 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f285006ae70 0x7f285006d330 secure :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2858034000 tx=0x7f2858009030 comp rx=0 tx=0).stop 2023-10-16T14:27:22.955 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.951+0000 7f2863fff640 1 --2- 172.21.15.59:0/3320199038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2864159c30 0x7f28640cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:22.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.951+0000 7f2863fff640 1 --2- 172.21.15.59:0/3320199038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2864154160 0x7f28641596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:22.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.951+0000 7f2863fff640 1 --2- 172.21.15.59:0/3320199038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c0047c0 0x7f28640c8270 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:22.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.951+0000 7f2863fff640 1 -- 172.21.15.59:0/3320199038 >> 172.21.15.59:0/3320199038 conn(0x7f286406a470 msgr2=0x7f28640c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:22.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.952+0000 7f2863fff640 1 -- 172.21.15.59:0/3320199038 shutdown_connections 2023-10-16T14:27:22.957 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:22.953+0000 7f2863fff640 1 -- 172.21.15.59:0/3320199038 wait complete. 2023-10-16T14:27:22.983 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-16T14:27:23.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.197+0000 7f810f159640 1 Processor -- start 2023-10-16T14:27:23.201 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.197+0000 7f810f159640 1 -- start start 2023-10-16T14:27:23.202 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.199+0000 7f810f159640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8108071b50 0x7f8108159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:23.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.199+0000 7f810f159640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81080cdc00 0x7f810806bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:23.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.199+0000 7f810f159640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81080c89d0 con 0x7f8108071f30 2023-10-16T14:27:23.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.199+0000 7f810f159640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8108071600 con 0x7f81080cdc00 2023-10-16T14:27:23.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.199+0000 7f810f159640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810815a260 con 0x7f8108071b50 2023-10-16T14:27:23.203 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.199+0000 7f810e958640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81080cdc00 0x7f810806bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:23.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.199+0000 7f810d956640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8108071f30 0x7f8108070ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56472/0 (socket says 172.21.15.59:56472) 2023-10-16T14:27:23.204 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.199+0000 7f810d956640 1 -- 172.21.15.59:0/1729109386 learned_addr learned my addr 172.21.15.59:0/1729109386 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:23.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.200+0000 7f810e157640 1 --2- 172.21.15.59:0/1729109386 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8108071b50 0x7f8108159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:23.205 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.200+0000 7f810e958640 1 -- 172.21.15.59:0/1729109386 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8108071b50 msgr2=0x7f8108159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:23.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.200+0000 7f810e958640 1 --2- 172.21.15.59:0/1729109386 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8108071b50 0x7f8108159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:23.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.200+0000 7f810e958640 1 -- 172.21.15.59:0/1729109386 >> v1:172.21.15.59:6789/0 conn(0x7f8108071f30 legacy=0x7f8108070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:23.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.200+0000 7f810e958640 1 -- 172.21.15.59:0/1729109386 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810815a540 con 0x7f81080cdc00 2023-10-16T14:27:23.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.201+0000 7f810e958640 1 --2- 172.21.15.59:0/1729109386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81080cdc00 0x7f810806bf20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8100009d90 tx=0x7f810002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9d2f933ecb0ad3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:23.206 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.201+0000 7f810d155640 1 -- 172.21.15.59:0/1729109386 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810002cc60 con 0x7f81080cdc00 2023-10-16T14:27:23.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.201+0000 7f810d155640 1 -- 172.21.15.59:0/1729109386 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810002cdc0 con 0x7f81080cdc00 2023-10-16T14:27:23.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.201+0000 7f810d155640 1 -- 172.21.15.59:0/1729109386 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100034660 con 0x7f81080cdc00 2023-10-16T14:27:23.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.202+0000 7f810f159640 1 -- 172.21.15.59:0/1729109386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81080cdc00 msgr2=0x7f810806bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:23.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.202+0000 7f810f159640 1 --2- 172.21.15.59:0/1729109386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81080cdc00 0x7f810806bf20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8100009d90 tx=0x7f810002beb0 comp rx=0 tx=0).stop 2023-10-16T14:27:23.207 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.202+0000 7f810f159640 1 -- 172.21.15.59:0/1729109386 shutdown_connections 2023-10-16T14:27:23.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.202+0000 7f810f159640 1 --2- 172.21.15.59:0/1729109386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81080cdc00 0x7f810806bf20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:23.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.202+0000 7f810f159640 1 --2- 172.21.15.59:0/1729109386 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8108071b50 0x7f8108159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:23.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.202+0000 7f810f159640 1 -- 172.21.15.59:0/1729109386 >> 172.21.15.59:0/1729109386 conn(0x7f810806a470 msgr2=0x7f81080afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:23.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.202+0000 7f810f159640 1 -- 172.21.15.59:0/1729109386 shutdown_connections 2023-10-16T14:27:23.208 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.202+0000 7f810f159640 1 -- 172.21.15.59:0/1729109386 wait complete. 2023-10-16T14:27:23.210 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.204+0000 7f810f159640 1 Processor -- start 2023-10-16T14:27:23.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.204+0000 7f810f159640 1 -- start start 2023-10-16T14:27:23.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.205+0000 7f810f159640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8108071b50 0x7f81080c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:23.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.205+0000 7f810f159640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8108071f30 0x7f81081f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:23.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.205+0000 7f810f159640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81080cdc00 0x7f81081586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:23.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.205+0000 7f810f159640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81080c5550 con 0x7f8108071f30 2023-10-16T14:27:23.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.205+0000 7f810f159640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810815c0f0 con 0x7f81080cdc00 2023-10-16T14:27:23.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.205+0000 7f810f159640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810815c3d0 con 0x7f8108071b50 2023-10-16T14:27:23.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.205+0000 7f810d956640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8108071f30 0x7f81081f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:23.212 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.205+0000 7f810d956640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8108071f30 0x7f81081f4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45028/0 (socket says 172.21.15.59:45028) 2023-10-16T14:27:23.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.205+0000 7f810d956640 1 -- 172.21.15.59:0/3118511576 learned_addr learned my addr 172.21.15.59:0/3118511576 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:23.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.206+0000 7f810e157640 1 --2- 172.21.15.59:0/3118511576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8108071b50 0x7f81080c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:23.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.206+0000 7f810d956640 1 -- 172.21.15.59:0/3118511576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8108071b50 msgr2=0x7f81080c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:23.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.206+0000 7f810d956640 1 --2- 172.21.15.59:0/3118511576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8108071b50 0x7f81080c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:23.213 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.206+0000 7f810d956640 1 -- 172.21.15.59:0/3118511576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81080cdc00 msgr2=0x7f81081586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:23.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.206+0000 7f810e958640 1 --2- 172.21.15.59:0/3118511576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81080cdc00 0x7f81081586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:23.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.206+0000 7f810d956640 1 --2- 172.21.15.59:0/3118511576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81080cdc00 0x7f81081586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:23.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.206+0000 7f810d956640 1 -- 172.21.15.59:0/3118511576 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8100009a70 con 0x7f8108071f30 2023-10-16T14:27:23.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.206+0000 7f810e157640 1 --2- 172.21.15.59:0/3118511576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8108071b50 0x7f81080c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:23.214 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.206+0000 7f810d956640 1 --2- 172.21.15.59:0/3118511576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8108071f30 0x7f81081f4780 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f80f800c4a0 tx=0x7f80f800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:23.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.207+0000 7f80feffd640 1 -- 172.21.15.59:0/3118511576 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f8005ce0 con 0x7f8108071f30 2023-10-16T14:27:23.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.207+0000 7f80feffd640 1 -- 172.21.15.59:0/3118511576 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f8005e40 con 0x7f8108071f30 2023-10-16T14:27:23.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.207+0000 7f80feffd640 1 -- 172.21.15.59:0/3118511576 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f8007270 con 0x7f8108071f30 2023-10-16T14:27:23.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.207+0000 7f810f159640 1 -- 172.21.15.59:0/3118511576 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810815c6b0 con 0x7f8108071f30 2023-10-16T14:27:23.215 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.207+0000 7f810f159640 1 -- 172.21.15.59:0/3118511576 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810815c990 con 0x7f8108071f30 2023-10-16T14:27:23.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.208+0000 7f810f159640 1 -- 172.21.15.59:0/3118511576 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810804e9b0 con 0x7f8108071f30 2023-10-16T14:27:23.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.209+0000 7f80feffd640 1 -- 172.21.15.59:0/3118511576 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f80f8007490 con 0x7f8108071f30 2023-10-16T14:27:23.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.210+0000 7f80feffd640 1 --2- 172.21.15.59:0/3118511576 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f80ec06aec0 0x7f80ec06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:23.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.210+0000 7f80feffd640 1 -- 172.21.15.59:0/3118511576 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5723+0+0 (secure 0 0 0) 0x7f80f8088a20 con 0x7f8108071f30 2023-10-16T14:27:23.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.211+0000 7f810e157640 1 --2- 172.21.15.59:0/3118511576 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f80ec06aec0 0x7f80ec06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:23.217 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.212+0000 7f810e157640 1 --2- 172.21.15.59:0/3118511576 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f80ec06aec0 0x7f80ec06d380 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8104006fd0 tx=0x7f8104008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:23.218 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.215+0000 7f80feffd640 1 -- 172.21.15.59:0/3118511576 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f80f8053be0 con 0x7f8108071f30 2023-10-16T14:27:23.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.410+0000 7f810f159640 1 -- 172.21.15.59:0/3118511576 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f81080b0080 con 0x7f8108071f30 2023-10-16T14:27:23.975 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.972+0000 7f80feffd640 1 -- 172.21.15.59:0/3118511576 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) v1 ==== 178+0+0 (secure 0 0 0) 0x7f80f8017020 con 0x7f8108071f30 2023-10-16T14:27:23.976 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data_ec' removed 2023-10-16T14:27:23.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.976+0000 7f810f159640 1 -- 172.21.15.59:0/3118511576 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f80ec06aec0 msgr2=0x7f80ec06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:23.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.976+0000 7f810f159640 1 --2- 172.21.15.59:0/3118511576 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f80ec06aec0 0x7f80ec06d380 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8104006fd0 tx=0x7f8104008040 comp rx=0 tx=0).stop 2023-10-16T14:27:23.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.976+0000 7f810f159640 1 -- 172.21.15.59:0/3118511576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8108071f30 msgr2=0x7f81081f4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:23.979 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.976+0000 7f810f159640 1 --2- 172.21.15.59:0/3118511576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8108071f30 0x7f81081f4780 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f80f800c4a0 tx=0x7f80f800c960 comp rx=0 tx=0).stop 2023-10-16T14:27:23.980 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.976+0000 7f810f159640 1 -- 172.21.15.59:0/3118511576 shutdown_connections 2023-10-16T14:27:23.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.976+0000 7f810f159640 1 --2- 172.21.15.59:0/3118511576 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f80ec06aec0 0x7f80ec06d380 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:23.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.976+0000 7f810f159640 1 --2- 172.21.15.59:0/3118511576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81080cdc00 0x7f81081586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:23.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.976+0000 7f810f159640 1 --2- 172.21.15.59:0/3118511576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8108071f30 0x7f81081f4780 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:23.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.976+0000 7f810f159640 1 --2- 172.21.15.59:0/3118511576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8108071b50 0x7f81080c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:23.981 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.976+0000 7f810f159640 1 -- 172.21.15.59:0/3118511576 >> 172.21.15.59:0/3118511576 conn(0x7f810806a470 msgr2=0x7f8108153810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:23.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.976+0000 7f810f159640 1 -- 172.21.15.59:0/3118511576 shutdown_connections 2023-10-16T14:27:23.982 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:23.976+0000 7f810f159640 1 -- 172.21.15.59:0/3118511576 wait complete. 2023-10-16T14:27:24.007 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-16T14:27:24.007 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-16T14:27:24.007 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T14:27:24.008 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T14:27:24.008 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-16T14:27:24.008 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-16T14:27:24.009 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T14:27:24.009 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T14:27:24.009 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-16T14:27:24.009 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-16T14:27:24.010 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T14:27:24.010 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T14:27:24.010 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-16T14:27:24.011 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-16T14:27:24.011 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T14:27:24.011 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T14:27:24.025 INFO:tasks.ceph.mds.a:Stopped 2023-10-16T14:27:24.026 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-16T14:27:24.027 INFO:tasks.ceph.mds.c:Stopped 2023-10-16T14:27:24.027 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-16T14:27:24.029 INFO:tasks.ceph.mds.d:Stopped 2023-10-16T14:27:24.030 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-16T14:27:24.031 INFO:tasks.ceph.mds.b:Stopped 2023-10-16T14:27:24.031 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-16T14:27:24.075 INFO:tasks.ceph.mds.a:Started 2023-10-16T14:27:24.076 DEBUG:teuthology.parallel:result is None 2023-10-16T14:27:24.079 INFO:tasks.ceph.mds.d:Started 2023-10-16T14:27:24.079 DEBUG:teuthology.parallel:result is None 2023-10-16T14:27:24.083 INFO:tasks.ceph.mds.c:Started 2023-10-16T14:27:24.083 DEBUG:teuthology.parallel:result is None 2023-10-16T14:27:24.086 INFO:tasks.ceph.mds.b:Started 2023-10-16T14:27:24.086 DEBUG:teuthology.parallel:result is None 2023-10-16T14:27:24.087 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-16T14:27:24.236 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2023-10-16T14:27:24.244 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2023-10-16T14:27:24.245 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-10-16T14:27:24.246 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-10-16T14:27:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.278+0000 7f8482516640 1 Processor -- start 2023-10-16T14:27:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.279+0000 7f8482516640 1 -- start start 2023-10-16T14:27:24.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.280+0000 7f8482516640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f847c0c9260 0x7f847c06c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:24.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.280+0000 7f8482516640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f847c15ae40 con 0x7f847c0b08c0 2023-10-16T14:27:24.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.280+0000 7f8482516640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f847c0b1580 con 0x7f847c15aa60 2023-10-16T14:27:24.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.280+0000 7f8482516640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f847c0c96f0 con 0x7f847c0c9260 2023-10-16T14:27:24.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.280+0000 7f847b7fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f847c0b08c0 0x7f847c0b1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56490/0 (socket says 172.21.15.59:56490) 2023-10-16T14:27:24.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.280+0000 7f847b7fe640 1 -- 172.21.15.59:0/1016623921 learned_addr learned my addr 172.21.15.59:0/1016623921 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.280+0000 7f8480ab3640 1 --2- 172.21.15.59:0/1016623921 >> v2:172.21.15.59:3300/0 conn(0x7f847c0c9260 0x7f847c06c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:24.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.281+0000 7f847affd640 1 -- 172.21.15.59:0/1016623921 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2396562406 0 0) 0x7f847c15ae40 con 0x7f847c0b08c0 2023-10-16T14:27:24.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.281+0000 7f847affd640 1 -- 172.21.15.59:0/1016623921 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8464003520 con 0x7f847c0b08c0 2023-10-16T14:27:24.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.281+0000 7f847affd640 1 -- 172.21.15.59:0/1016623921 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4053133165 0 0) 0x7f847c0b1580 con 0x7f847c15aa60 2023-10-16T14:27:24.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.281+0000 7f847affd640 1 -- 172.21.15.59:0/1016623921 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f847c15ae40 con 0x7f847c15aa60 2023-10-16T14:27:24.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.281+0000 7f8480ab3640 1 -- 172.21.15.59:0/1016623921 >> v1:172.21.15.151:6789/0 conn(0x7f847c15aa60 legacy=0x7f847c0b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:24.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.281+0000 7f8480ab3640 1 -- 172.21.15.59:0/1016623921 >> v1:172.21.15.59:6789/0 conn(0x7f847c0b08c0 legacy=0x7f847c0b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:24.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.281+0000 7f8480ab3640 1 -- 172.21.15.59:0/1016623921 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847c0c98f0 con 0x7f847c0c9260 2023-10-16T14:27:24.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.282+0000 7f8480ab3640 1 --2- 172.21.15.59:0/1016623921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c0c9260 0x7f847c06c760 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8474009d90 tx=0x7f847402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3854741b807630 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:24.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.282+0000 7f847affd640 1 -- 172.21.15.59:0/1016623921 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847402cc60 con 0x7f847c0c9260 2023-10-16T14:27:24.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.282+0000 7f847affd640 1 -- 172.21.15.59:0/1016623921 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847402cdc0 con 0x7f847c0c9260 2023-10-16T14:27:24.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.282+0000 7f847affd640 1 -- 172.21.15.59:0/1016623921 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8474034640 con 0x7f847c0c9260 2023-10-16T14:27:24.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.283+0000 7f8482516640 1 -- 172.21.15.59:0/1016623921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c0c9260 msgr2=0x7f847c06c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:24.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.283+0000 7f8482516640 1 --2- 172.21.15.59:0/1016623921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c0c9260 0x7f847c06c760 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8474009d90 tx=0x7f847402beb0 comp rx=0 tx=0).stop 2023-10-16T14:27:24.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.283+0000 7f8482516640 1 -- 172.21.15.59:0/1016623921 shutdown_connections 2023-10-16T14:27:24.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.283+0000 7f8482516640 1 --2- 172.21.15.59:0/1016623921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c0c9260 0x7f847c06c760 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:24.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.283+0000 7f8482516640 1 -- 172.21.15.59:0/1016623921 >> 172.21.15.59:0/1016623921 conn(0x7f847c0cb1b0 msgr2=0x7f847c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:24.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.283+0000 7f8482516640 1 -- 172.21.15.59:0/1016623921 shutdown_connections 2023-10-16T14:27:24.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.283+0000 7f8482516640 1 -- 172.21.15.59:0/1016623921 wait complete. 2023-10-16T14:27:24.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.285+0000 7f8482516640 1 Processor -- start 2023-10-16T14:27:24.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.285+0000 7f8482516640 1 -- start start 2023-10-16T14:27:24.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.286+0000 7f8482516640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c0b08c0 0x7f847c14f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:24.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.286+0000 7f8482516640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f847c0c9260 0x7f847c0abf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:24.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.286+0000 7f8482516640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f847c15aa60 0x7f847c0ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:24.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.286+0000 7f8482516640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847c0ae400 con 0x7f847c0b08c0 2023-10-16T14:27:24.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.286+0000 7f8482516640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847c150020 con 0x7f847c0c9260 2023-10-16T14:27:24.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.286+0000 7f8482516640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847c152630 con 0x7f847c15aa60 2023-10-16T14:27:24.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.286+0000 7f847bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c0b08c0 0x7f847c14f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:24.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.286+0000 7f847bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c0b08c0 0x7f847c14f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45094/0 (socket says 172.21.15.59:45094) 2023-10-16T14:27:24.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.286+0000 7f847bfff640 1 -- 172.21.15.59:0/1463926593 learned_addr learned my addr 172.21.15.59:0/1463926593 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:24.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.286+0000 7f847b7fe640 1 --2- 172.21.15.59:0/1463926593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f847c0c9260 0x7f847c0abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:24.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.286+0000 7f8480ab3640 1 --2- 172.21.15.59:0/1463926593 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f847c15aa60 0x7f847c0ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:24.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.287+0000 7f847bfff640 1 -- 172.21.15.59:0/1463926593 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f847c15aa60 msgr2=0x7f847c0ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:24.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.287+0000 7f847bfff640 1 --2- 172.21.15.59:0/1463926593 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f847c15aa60 0x7f847c0ac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:24.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.287+0000 7f847bfff640 1 -- 172.21.15.59:0/1463926593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f847c0c9260 msgr2=0x7f847c0abf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:24.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.287+0000 7f847bfff640 1 --2- 172.21.15.59:0/1463926593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f847c0c9260 0x7f847c0abf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:24.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.287+0000 7f847bfff640 1 -- 172.21.15.59:0/1463926593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8474009a70 con 0x7f847c0b08c0 2023-10-16T14:27:24.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.287+0000 7f8480ab3640 1 --2- 172.21.15.59:0/1463926593 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f847c15aa60 0x7f847c0ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:27:24.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.287+0000 7f847bfff640 1 --2- 172.21.15.59:0/1463926593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c0b08c0 0x7f847c14f560 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f846c00c430 tx=0x7f846c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:24.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.287+0000 7f8478ff9640 1 -- 172.21.15.59:0/1463926593 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c0052d0 con 0x7f847c0b08c0 2023-10-16T14:27:24.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.287+0000 7f8478ff9640 1 -- 172.21.15.59:0/1463926593 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846c005450 con 0x7f847c0b08c0 2023-10-16T14:27:24.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.287+0000 7f8478ff9640 1 -- 172.21.15.59:0/1463926593 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c003830 con 0x7f847c0b08c0 2023-10-16T14:27:24.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.287+0000 7f8482516640 1 -- 172.21.15.59:0/1463926593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f847c152910 con 0x7f847c0b08c0 2023-10-16T14:27:24.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.288+0000 7f8482516640 1 -- 172.21.15.59:0/1463926593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f847c0ae090 con 0x7f847c0b08c0 2023-10-16T14:27:24.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.289+0000 7f8482516640 1 -- 172.21.15.59:0/1463926593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f847c0cafb0 con 0x7f847c0b08c0 2023-10-16T14:27:24.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.290+0000 7f8478ff9640 1 -- 172.21.15.59:0/1463926593 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f846c003990 con 0x7f847c0b08c0 2023-10-16T14:27:24.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.291+0000 7f8478ff9640 1 --2- 172.21.15.59:0/1463926593 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f846806ae70 0x7f846806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:24.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.291+0000 7f8478ff9640 1 -- 172.21.15.59:0/1463926593 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f846c088980 con 0x7f847c0b08c0 2023-10-16T14:27:24.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.291+0000 7f847b7fe640 1 --2- 172.21.15.59:0/1463926593 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f846806ae70 0x7f846806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:24.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.292+0000 7f847b7fe640 1 --2- 172.21.15.59:0/1463926593 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f846806ae70 0x7f846806d330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f847c0ce4e0 tx=0x7f8470007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:24.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.295+0000 7f8478ff9640 1 -- 172.21.15.59:0/1463926593 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f846c053ca0 con 0x7f847c0b08c0 2023-10-16T14:27:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.503+0000 7f8482516640 1 -- 172.21.15.59:0/1463926593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f847c073ef0 con 0x7f847c0b08c0 2023-10-16T14:27:25.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:24.998+0000 7f8478ff9640 1 -- 172.21.15.59:0/1463926593 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) v1 ==== 97+0+0 (secure 0 0 0) 0x7f846c017080 con 0x7f847c0b08c0 2023-10-16T14:27:25.002 INFO:teuthology.orchestra.run.smithi059.stderr: removed all blocklist entries 2023-10-16T14:27:25.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.002+0000 7f8482516640 1 -- 172.21.15.59:0/1463926593 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f846806ae70 msgr2=0x7f846806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:25.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.002+0000 7f8482516640 1 --2- 172.21.15.59:0/1463926593 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f846806ae70 0x7f846806d330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f847c0ce4e0 tx=0x7f8470007d30 comp rx=0 tx=0).stop 2023-10-16T14:27:25.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.002+0000 7f8482516640 1 -- 172.21.15.59:0/1463926593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c0b08c0 msgr2=0x7f847c14f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:25.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.002+0000 7f8482516640 1 --2- 172.21.15.59:0/1463926593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c0b08c0 0x7f847c14f560 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f846c00c430 tx=0x7f846c00c8f0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.003+0000 7f8482516640 1 -- 172.21.15.59:0/1463926593 shutdown_connections 2023-10-16T14:27:25.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.003+0000 7f8482516640 1 --2- 172.21.15.59:0/1463926593 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f846806ae70 0x7f846806d330 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.003+0000 7f8482516640 1 --2- 172.21.15.59:0/1463926593 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f847c15aa60 0x7f847c0ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.003+0000 7f8482516640 1 --2- 172.21.15.59:0/1463926593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f847c0c9260 0x7f847c0abf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.003+0000 7f8482516640 1 --2- 172.21.15.59:0/1463926593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f847c0b08c0 0x7f847c14f560 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.003+0000 7f8482516640 1 -- 172.21.15.59:0/1463926593 >> 172.21.15.59:0/1463926593 conn(0x7f847c0cb1b0 msgr2=0x7f847c06c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:25.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.003+0000 7f8482516640 1 -- 172.21.15.59:0/1463926593 shutdown_connections 2023-10-16T14:27:25.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.003+0000 7f8482516640 1 -- 172.21.15.59:0/1463926593 wait complete. 2023-10-16T14:27:25.028 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-16T14:27:25.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.249+0000 7fd670e52640 1 Processor -- start 2023-10-16T14:27:25.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.249+0000 7fd670e52640 1 -- start start 2023-10-16T14:27:25.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.251+0000 7fd670e52640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd66c15ad00 0x7fd66c0701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:25.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.251+0000 7fd670e52640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd66c15f040 0x7fd66c15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:25.255 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.251+0000 7fd670e52640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd66c0707f0 con 0x7fd66c0b0010 2023-10-16T14:27:25.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.251+0000 7fd670e52640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd66c070ad0 con 0x7fd66c15ad00 2023-10-16T14:27:25.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.251+0000 7fd670e52640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd66c15b1d0 con 0x7fd66c15f040 2023-10-16T14:27:25.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.251+0000 7fd663fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd66c15ad00 0x7fd66c0701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:25.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.252+0000 7fd663fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd66c15ad00 0x7fd66c0701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45096/0 (socket says 172.21.15.59:45096) 2023-10-16T14:27:25.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.252+0000 7fd663fff640 1 -- 172.21.15.59:0/397643197 learned_addr learned my addr 172.21.15.59:0/397643197 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:25.256 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.252+0000 7fd66ad9d640 1 --2- 172.21.15.59:0/397643197 >> v2:172.21.15.151:3300/0 conn(0x7fd66c15f040 0x7fd66c15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:25.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.252+0000 7fd663fff640 1 -- 172.21.15.59:0/397643197 >> v2:172.21.15.151:3300/0 conn(0x7fd66c15f040 msgr2=0x7fd66c15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:25.258 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.252+0000 7fd663fff640 1 --2- 172.21.15.59:0/397643197 >> v2:172.21.15.151:3300/0 conn(0x7fd66c15f040 0x7fd66c15b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.252+0000 7fd663fff640 1 -- 172.21.15.59:0/397643197 >> v1:172.21.15.151:6789/0 conn(0x7fd66c0b0010 legacy=0x7fd66c0b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:25.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.252+0000 7fd663fff640 1 -- 172.21.15.59:0/397643197 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c15b4b0 con 0x7fd66c15ad00 2023-10-16T14:27:25.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.253+0000 7fd663fff640 1 --2- 172.21.15.59:0/397643197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd66c15ad00 0x7fd66c0701a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0adf80 tx=0x7fd65402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d5af4e687b994e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:25.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.254+0000 7fd669d9b640 1 -- 172.21.15.59:0/397643197 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd654030860 con 0x7fd66c15ad00 2023-10-16T14:27:25.259 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.254+0000 7fd669d9b640 1 -- 172.21.15.59:0/397643197 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6540309c0 con 0x7fd66c15ad00 2023-10-16T14:27:25.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.254+0000 7fd669d9b640 1 -- 172.21.15.59:0/397643197 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd654030d50 con 0x7fd66c15ad00 2023-10-16T14:27:25.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.255+0000 7fd670e52640 1 -- 172.21.15.59:0/397643197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd66c15ad00 msgr2=0x7fd66c0701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:25.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.255+0000 7fd670e52640 1 --2- 172.21.15.59:0/397643197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd66c15ad00 0x7fd66c0701a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0adf80 tx=0x7fd65402b9a0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.255+0000 7fd670e52640 1 -- 172.21.15.59:0/397643197 shutdown_connections 2023-10-16T14:27:25.260 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.255+0000 7fd670e52640 1 --2- 172.21.15.59:0/397643197 >> v2:172.21.15.151:3300/0 conn(0x7fd66c15f040 0x7fd66c15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.255+0000 7fd670e52640 1 --2- 172.21.15.59:0/397643197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd66c15ad00 0x7fd66c0701a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.255+0000 7fd670e52640 1 -- 172.21.15.59:0/397643197 >> 172.21.15.59:0/397643197 conn(0x7fd66c06c1c0 msgr2=0x7fd66c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:25.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.255+0000 7fd670e52640 1 -- 172.21.15.59:0/397643197 shutdown_connections 2023-10-16T14:27:25.261 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.255+0000 7fd670e52640 1 -- 172.21.15.59:0/397643197 wait complete. 2023-10-16T14:27:25.263 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.257+0000 7fd670e52640 1 Processor -- start 2023-10-16T14:27:25.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.257+0000 7fd670e52640 1 -- start start 2023-10-16T14:27:25.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.258+0000 7fd670e52640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd66c0b0010 0x7fd66c155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:25.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.258+0000 7fd670e52640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd66c15ad00 0x7fd66c0b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:25.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.258+0000 7fd670e52640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd66c15f040 0x7fd66c0c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:25.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.258+0000 7fd670e52640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c0b22b0 con 0x7fd66c15ad00 2023-10-16T14:27:25.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.258+0000 7fd670e52640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c0b2590 con 0x7fd66c0b0010 2023-10-16T14:27:25.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.258+0000 7fd670e52640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c0b2870 con 0x7fd66c15f040 2023-10-16T14:27:25.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.258+0000 7fd663fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd66c15ad00 0x7fd66c0b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:25.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.258+0000 7fd663fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd66c15ad00 0x7fd66c0b3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45102/0 (socket says 172.21.15.59:45102) 2023-10-16T14:27:25.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.258+0000 7fd663fff640 1 -- 172.21.15.59:0/2646221164 learned_addr learned my addr 172.21.15.59:0/2646221164 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:25.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.259+0000 7fd66ad9d640 1 --2- 172.21.15.59:0/2646221164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd66c15f040 0x7fd66c0c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:25.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.259+0000 7fd66a59c640 1 --2- 172.21.15.59:0/2646221164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd66c0b0010 0x7fd66c155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:25.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.259+0000 7fd663fff640 1 -- 172.21.15.59:0/2646221164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd66c15f040 msgr2=0x7fd66c0c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:25.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.259+0000 7fd663fff640 1 --2- 172.21.15.59:0/2646221164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd66c15f040 0x7fd66c0c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.259+0000 7fd663fff640 1 -- 172.21.15.59:0/2646221164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd66c0b0010 msgr2=0x7fd66c155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:25.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.259+0000 7fd663fff640 1 --2- 172.21.15.59:0/2646221164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd66c0b0010 0x7fd66c155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.259+0000 7fd663fff640 1 -- 172.21.15.59:0/2646221164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6540094d0 con 0x7fd66c15ad00 2023-10-16T14:27:25.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.259+0000 7fd663fff640 1 --2- 172.21.15.59:0/2646221164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd66c15ad00 0x7fd66c0b3350 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd65402b9e0 tx=0x7fd654004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:25.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.260+0000 7fd662ffd640 1 -- 172.21.15.59:0/2646221164 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd654039d60 con 0x7fd66c15ad00 2023-10-16T14:27:25.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.260+0000 7fd662ffd640 1 -- 172.21.15.59:0/2646221164 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd654043400 con 0x7fd66c15ad00 2023-10-16T14:27:25.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.260+0000 7fd662ffd640 1 -- 172.21.15.59:0/2646221164 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6540437b0 con 0x7fd66c15ad00 2023-10-16T14:27:25.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.260+0000 7fd670e52640 1 -- 172.21.15.59:0/2646221164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd66c0b2b50 con 0x7fd66c15ad00 2023-10-16T14:27:25.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.260+0000 7fd670e52640 1 -- 172.21.15.59:0/2646221164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd66c0b1f60 con 0x7fd66c15ad00 2023-10-16T14:27:25.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.261+0000 7fd670e52640 1 -- 172.21.15.59:0/2646221164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd66c0b3070 con 0x7fd66c15ad00 2023-10-16T14:27:25.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.262+0000 7fd662ffd640 1 -- 172.21.15.59:0/2646221164 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd654043910 con 0x7fd66c15ad00 2023-10-16T14:27:25.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.263+0000 7fd662ffd640 1 --2- 172.21.15.59:0/2646221164 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd64c06ae70 0x7fd64c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:25.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.263+0000 7fd662ffd640 1 -- 172.21.15.59:0/2646221164 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd65403e070 con 0x7fd66c15ad00 2023-10-16T14:27:25.270 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.264+0000 7fd66a59c640 1 --2- 172.21.15.59:0/2646221164 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd64c06ae70 0x7fd64c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:25.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.265+0000 7fd66a59c640 1 --2- 172.21.15.59:0/2646221164 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd64c06ae70 0x7fd64c06d330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd65c000f60 tx=0x7fd65c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:25.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.267+0000 7fd662ffd640 1 -- 172.21.15.59:0/2646221164 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd66c0b3070 con 0x7fd66c15ad00 2023-10-16T14:27:25.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.535+0000 7fd670e52640 1 -- 172.21.15.59:0/2646221164 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd66c0b3070 con 0x7fd66c15ad00 2023-10-16T14:27:25.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.536+0000 7fd662ffd640 1 -- 172.21.15.59:0/2646221164 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fd66c0b3070 con 0x7fd66c15ad00 2023-10-16T14:27:25.539 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:25.540 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-16T14:27:25.540 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_dump": [ 2023-10-16T14:27:25.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.540 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.a", 2023-10-16T14:27:25.541 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCjRy1l4GwTEBAANcB53Pn8FMjW98g6q2LIrQ==", 2023-10-16T14:27:25.541 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.541 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2023-10-16T14:27:25.541 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2023-10-16T14:27:25.541 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2023-10-16T14:27:25.542 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-10-16T14:27:25.542 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.542 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.b", 2023-10-16T14:27:25.543 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCjRy1lBoJsNRAAhl3lxc7MOAOjQOOqO+v1Pg==", 2023-10-16T14:27:25.543 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.543 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2023-10-16T14:27:25.543 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2023-10-16T14:27:25.543 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2023-10-16T14:27:25.544 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-10-16T14:27:25.545 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.546 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.c", 2023-10-16T14:27:25.546 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCjRy1l4kB9IxAAkhhiHutclRiE7RyYp7sdSA==", 2023-10-16T14:27:25.546 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.546 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2023-10-16T14:27:25.547 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2023-10-16T14:27:25.547 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2023-10-16T14:27:25.547 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-10-16T14:27:25.547 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.548 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.d", 2023-10-16T14:27:25.548 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCkRy1lgPL+ChAATd1DKeNsbkWz32ljaGE9VA==", 2023-10-16T14:27:25.548 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.548 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2023-10-16T14:27:25.549 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2023-10-16T14:27:25.549 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2023-10-16T14:27:25.549 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-10-16T14:27:25.549 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.550 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.0", 2023-10-16T14:27:25.550 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpRy1l5szHERAAcTBgMktkB3e9yjqrfimPtw==", 2023-10-16T14:27:25.550 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.550 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2023-10-16T14:27:25.551 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2023-10-16T14:27:25.551 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-10-16T14:27:25.551 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.551 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.1", 2023-10-16T14:27:25.552 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCsRy1l5jp4LBAAA0WYE8TuSsxd/Ho/+AeQug==", 2023-10-16T14:27:25.552 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.552 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2023-10-16T14:27:25.552 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2023-10-16T14:27:25.553 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-10-16T14:27:25.553 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.553 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.2", 2023-10-16T14:27:25.553 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCwRy1lQXDvCxAA38WqySNCjb7tecXdGcR92w==", 2023-10-16T14:27:25.554 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.554 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2023-10-16T14:27:25.554 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2023-10-16T14:27:25.554 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-10-16T14:27:25.554 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.555 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.3", 2023-10-16T14:27:25.555 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCzRy1lQ77fJhAAt+P92hLij3seqawmbqgC8Q==", 2023-10-16T14:27:25.555 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.556 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2023-10-16T14:27:25.556 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2023-10-16T14:27:25.556 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-10-16T14:27:25.556 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.557 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.4", 2023-10-16T14:27:25.557 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC6Ry1lgpltOBAA4lrfv/3xxtxjzVG9exDNtg==", 2023-10-16T14:27:25.557 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.557 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2023-10-16T14:27:25.558 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2023-10-16T14:27:25.558 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-10-16T14:27:25.558 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.559 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.5", 2023-10-16T14:27:25.559 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC+Ry1lei2BBxAA/eK6hS9d0cTtF17v7r+VPA==", 2023-10-16T14:27:25.559 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.559 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2023-10-16T14:27:25.559 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2023-10-16T14:27:25.560 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-10-16T14:27:25.560 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.560 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.6", 2023-10-16T14:27:25.560 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDBRy1l2ZgLEhAAJZFG0Xe+RNg5WFwRDdBJRA==", 2023-10-16T14:27:25.561 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.561 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2023-10-16T14:27:25.561 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2023-10-16T14:27:25.561 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-10-16T14:27:25.561 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.562 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.7", 2023-10-16T14:27:25.562 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDERy1lTt1YKhAAvfzPPoWd7iQXYMO1tK0eoA==", 2023-10-16T14:27:25.562 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.563 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2023-10-16T14:27:25.563 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2023-10-16T14:27:25.563 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-10-16T14:27:25.563 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.564 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.0", 2023-10-16T14:27:25.564 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCkRy1l4wK6GRAAR5d+NsU5HztNqOlUy6gD+Q==", 2023-10-16T14:27:25.564 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.565 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2023-10-16T14:27:25.565 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2023-10-16T14:27:25.565 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2023-10-16T14:27:25.565 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2023-10-16T14:27:25.565 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.566 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.1", 2023-10-16T14:27:25.566 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCkRy1ln38BMhAAYJ1x976qWsRBfjZobRv/+g==", 2023-10-16T14:27:25.566 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.566 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2023-10-16T14:27:25.567 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2023-10-16T14:27:25.567 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2023-10-16T14:27:25.567 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2023-10-16T14:27:25.567 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.568 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.2", 2023-10-16T14:27:25.568 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCkRy1lNbmxJhAAif4uBVPV2dSJDSJx6W3V4A==", 2023-10-16T14:27:25.568 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.568 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2023-10-16T14:27:25.568 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2023-10-16T14:27:25.568 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2023-10-16T14:27:25.569 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2023-10-16T14:27:25.569 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.569 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.3", 2023-10-16T14:27:25.570 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQClRy1lUSrzABAAZhXtyAszl0XcI3ZCs09UVw==", 2023-10-16T14:27:25.570 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.570 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2023-10-16T14:27:25.570 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2023-10-16T14:27:25.570 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2023-10-16T14:27:25.571 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2023-10-16T14:27:25.571 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.571 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.admin", 2023-10-16T14:27:25.572 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQChRy1lixAlOhAABCo098LXhMaDIe8aTj5D3w==", 2023-10-16T14:27:25.572 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.572 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2023-10-16T14:27:25.572 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2023-10-16T14:27:25.572 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2023-10-16T14:27:25.573 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-10-16T14:27:25.573 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.573 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-mds", 2023-10-16T14:27:25.574 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDSRy1lRETdMhAAzXZ72PNCxFcu6+GjRxPSYA==", 2023-10-16T14:27:25.574 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.574 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-mds" 2023-10-16T14:27:25.574 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.575 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-mgr", 2023-10-16T14:27:25.575 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDSRy1l0mDdMhAA6y1brL2DV/pCQ0jgaHKWEw==", 2023-10-16T14:27:25.575 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.575 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-16T14:27:25.576 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.576 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-osd", 2023-10-16T14:27:25.576 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDSRy1l6XndMhAA/tQ6voEbPS8/JACOecLAEQ==", 2023-10-16T14:27:25.577 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.577 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-osd" 2023-10-16T14:27:25.577 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.577 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-rbd", 2023-10-16T14:27:25.578 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDSRy1liJLdMhAALzPCTyJ0BoiaP/z+k68ZFg==", 2023-10-16T14:27:25.578 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.578 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-16T14:27:25.578 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.579 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-16T14:27:25.579 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDSRy1lUKzdMhAA0tI2WzGpMGVULKGt477PUA==", 2023-10-16T14:27:25.579 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.579 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-16T14:27:25.580 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.580 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-rgw", 2023-10-16T14:27:25.580 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDSRy1lFcbdMhAAQMmDVP7HHveYY2vtItssSg==", 2023-10-16T14:27:25.581 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.581 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-16T14:27:25.581 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.581 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.x", 2023-10-16T14:27:25.582 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCjRy1lde27AhAAYFsZui4JAeWc8L6X+QnpqA==", 2023-10-16T14:27:25.582 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.582 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2023-10-16T14:27:25.582 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2023-10-16T14:27:25.582 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-10-16T14:27:25.583 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:25.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:25.583 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.y", 2023-10-16T14:27:25.583 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCiRy1lLVrdMRAAJQwqX2hxjfJ7yMlliTmyNg==", 2023-10-16T14:27:25.584 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2023-10-16T14:27:25.584 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2023-10-16T14:27:25.584 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2023-10-16T14:27:25.584 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2023-10-16T14:27:25.584 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.585 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:25.585 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2023-10-16T14:27:25.585 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-16T14:27:25.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.538+0000 7fd670e52640 1 -- 172.21.15.59:0/2646221164 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd64c06ae70 msgr2=0x7fd64c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:25.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.538+0000 7fd670e52640 1 --2- 172.21.15.59:0/2646221164 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd64c06ae70 0x7fd64c06d330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd65c000f60 tx=0x7fd65c009040 comp rx=0 tx=0).stop 2023-10-16T14:27:25.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.538+0000 7fd670e52640 1 -- 172.21.15.59:0/2646221164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd66c15ad00 msgr2=0x7fd66c0b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:25.587 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.538+0000 7fd670e52640 1 --2- 172.21.15.59:0/2646221164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd66c15ad00 0x7fd66c0b3350 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd65402b9e0 tx=0x7fd654004730 comp rx=0 tx=0).stop 2023-10-16T14:27:25.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.539+0000 7fd670e52640 1 -- 172.21.15.59:0/2646221164 shutdown_connections 2023-10-16T14:27:25.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.539+0000 7fd670e52640 1 --2- 172.21.15.59:0/2646221164 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fd64c06ae70 0x7fd64c06d330 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.539+0000 7fd670e52640 1 --2- 172.21.15.59:0/2646221164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd66c15f040 0x7fd66c0c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.539+0000 7fd670e52640 1 --2- 172.21.15.59:0/2646221164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd66c15ad00 0x7fd66c0b3350 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.588 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.539+0000 7fd670e52640 1 --2- 172.21.15.59:0/2646221164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd66c0b0010 0x7fd66c155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.539+0000 7fd670e52640 1 -- 172.21.15.59:0/2646221164 >> 172.21.15.59:0/2646221164 conn(0x7fd66c06c1c0 msgr2=0x7fd66c072800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:25.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.539+0000 7fd670e52640 1 -- 172.21.15.59:0/2646221164 shutdown_connections 2023-10-16T14:27:25.589 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.539+0000 7fd670e52640 1 -- 172.21.15.59:0/2646221164 wait complete. 2023-10-16T14:27:25.589 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-16T14:27:25.823 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.820+0000 7fe81289e640 1 Processor -- start 2023-10-16T14:27:25.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.820+0000 7fe81289e640 1 -- start start 2023-10-16T14:27:25.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.821+0000 7fe81289e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80c0ced10 0x7fe80c0b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:25.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.821+0000 7fe81289e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80c0c8a10 con 0x7fe80c0b2e90 2023-10-16T14:27:25.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.821+0000 7fe81289e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80c15d1a0 con 0x7fe80c0ad970 2023-10-16T14:27:25.825 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.821+0000 7fe81289e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c159b40 con 0x7fe80c0ced10 2023-10-16T14:27:25.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.822+0000 7fe81209d640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe80c0b2e90 0x7fe80c06c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56498/0 (socket says 172.21.15.59:56498) 2023-10-16T14:27:25.827 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.822+0000 7fe81209d640 1 -- 172.21.15.59:0/553540920 learned_addr learned my addr 172.21.15.59:0/553540920 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:25.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.822+0000 7fe81109b640 1 --2- 172.21.15.59:0/553540920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80c0ced10 0x7fe80c0b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:25.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.822+0000 7fe81089a640 1 -- 172.21.15.59:0/553540920 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780294502 0 0) 0x7fe80c0c8a10 con 0x7fe80c0b2e90 2023-10-16T14:27:25.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.822+0000 7fe81089a640 1 -- 172.21.15.59:0/553540920 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7f8003520 con 0x7fe80c0b2e90 2023-10-16T14:27:25.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.823+0000 7fe81089a640 1 -- 172.21.15.59:0/553540920 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 189481119 0 0) 0x7fe7f8003520 con 0x7fe80c0b2e90 2023-10-16T14:27:25.828 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.823+0000 7fe81089a640 1 -- 172.21.15.59:0/553540920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80c0ced10 msgr2=0x7fe80c0b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:25.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.823+0000 7fe81089a640 1 --2- 172.21.15.59:0/553540920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80c0ced10 0x7fe80c0b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.823+0000 7fe81089a640 1 -- 172.21.15.59:0/553540920 >> v1:172.21.15.151:6789/0 conn(0x7fe80c0ad970 legacy=0x7fe80c0ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:25.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.823+0000 7fe81089a640 1 -- 172.21.15.59:0/553540920 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c15d3f0 con 0x7fe80c0b2e90 2023-10-16T14:27:25.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.823+0000 7fe81089a640 1 -- 172.21.15.59:0/553540920 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7fe8040019f0 con 0x7fe80c0b2e90 2023-10-16T14:27:25.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.823+0000 7fe81089a640 1 -- 172.21.15.59:0/553540920 >> v1:172.21.15.59:6789/0 conn(0x7fe80c0b2e90 legacy=0x7fe80c06c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:25.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.823+0000 7fe81089a640 1 --2- 172.21.15.59:0/553540920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80c0ced10 0x7fe7f80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:25.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.823+0000 7fe81089a640 1 --2- 172.21.15.59:0/553540920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7f8003f70 0x7fe7f80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:25.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.823+0000 7fe81089a640 1 --2- 172.21.15.59:0/553540920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7f8004d00 0x7fe7f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:25.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.823+0000 7fe81089a640 1 -- 172.21.15.59:0/553540920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c159b40 con 0x7fe7f8004d00 2023-10-16T14:27:25.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.823+0000 7fe81089a640 1 -- 172.21.15.59:0/553540920 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f800bb70 con 0x7fe7f8003f70 2023-10-16T14:27:25.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.823+0000 7fe81089a640 1 -- 172.21.15.59:0/553540920 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f800bd30 con 0x7fe80c0ced10 2023-10-16T14:27:25.830 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.823+0000 7fe81209d640 1 --2- 172.21.15.59:0/553540920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7f8004d00 0x7fe7f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:25.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.824+0000 7fe81109b640 1 --2- 172.21.15.59:0/553540920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7f8003f70 0x7fe7f80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:25.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.824+0000 7fe81189c640 1 --2- 172.21.15.59:0/553540920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80c0ced10 0x7fe7f80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:25.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.824+0000 7fe81209d640 1 -- 172.21.15.59:0/553540920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80c0ced10 msgr2=0x7fe7f80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:25.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.824+0000 7fe81209d640 1 --2- 172.21.15.59:0/553540920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80c0ced10 0x7fe7f80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.824+0000 7fe81209d640 1 -- 172.21.15.59:0/553540920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7f8003f70 msgr2=0x7fe7f80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:25.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.824+0000 7fe81209d640 1 --2- 172.21.15.59:0/553540920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7f8003f70 0x7fe7f80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.824+0000 7fe81209d640 1 -- 172.21.15.59:0/553540920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f8003520 con 0x7fe7f8004d00 2023-10-16T14:27:25.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.824+0000 7fe81109b640 1 --2- 172.21.15.59:0/553540920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7f8003f70 0x7fe7f80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:27:25.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.825+0000 7fe81209d640 1 --2- 172.21.15.59:0/553540920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7f8004d00 0x7fe7f8005180 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe80400a760 tx=0x7fe7f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b9db4dc2f4619d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:25.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.825+0000 7fe81089a640 1 -- 172.21.15.59:0/553540920 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804034630 con 0x7fe7f8004d00 2023-10-16T14:27:25.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.825+0000 7fe81089a640 1 -- 172.21.15.59:0/553540920 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80402f070 con 0x7fe7f8004d00 2023-10-16T14:27:25.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.825+0000 7fe81089a640 1 -- 172.21.15.59:0/553540920 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804034a50 con 0x7fe7f8004d00 2023-10-16T14:27:25.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.826+0000 7fe81289e640 1 -- 172.21.15.59:0/553540920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7f8004d00 msgr2=0x7fe7f8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:25.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.826+0000 7fe81289e640 1 --2- 172.21.15.59:0/553540920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7f8004d00 0x7fe7f8005180 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe80400a760 tx=0x7fe7f80057f0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.826+0000 7fe81209d640 1 -- 172.21.15.59:0/553540920 reap_dead start 2023-10-16T14:27:25.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.826+0000 7fe81289e640 1 -- 172.21.15.59:0/553540920 shutdown_connections 2023-10-16T14:27:25.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.826+0000 7fe81289e640 1 -- 172.21.15.59:0/553540920 >> 172.21.15.59:0/553540920 conn(0x7fe80c069fc0 msgr2=0x7fe80c06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:25.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.826+0000 7fe81289e640 1 -- 172.21.15.59:0/553540920 shutdown_connections 2023-10-16T14:27:25.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.826+0000 7fe81289e640 1 -- 172.21.15.59:0/553540920 wait complete. 2023-10-16T14:27:25.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.828+0000 7fe81289e640 1 Processor -- start 2023-10-16T14:27:25.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.828+0000 7fe81289e640 1 -- start start 2023-10-16T14:27:25.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.829+0000 7fe81289e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7f8004d00 0x7fe80c0acca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:25.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.829+0000 7fe81289e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c158220 0x7fe80c0c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:25.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.829+0000 7fe81289e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80c0c4200 0x7fe80c0c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:25.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.829+0000 7fe81289e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0c4c70 con 0x7fe80c158220 2023-10-16T14:27:25.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.829+0000 7fe81289e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0c9710 con 0x7fe7f8004d00 2023-10-16T14:27:25.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.829+0000 7fe81289e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0c4990 con 0x7fe80c0c4200 2023-10-16T14:27:25.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.829+0000 7fe81109b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c158220 0x7fe80c0c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:25.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.829+0000 7fe81109b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c158220 0x7fe80c0c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45128/0 (socket says 172.21.15.59:45128) 2023-10-16T14:27:25.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.829+0000 7fe81109b640 1 -- 172.21.15.59:0/1441183109 learned_addr learned my addr 172.21.15.59:0/1441183109 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:25.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.830+0000 7fe81209d640 1 --2- 172.21.15.59:0/1441183109 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80c0c4200 0x7fe80c0c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:25.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.830+0000 7fe81109b640 1 -- 172.21.15.59:0/1441183109 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80c0c4200 msgr2=0x7fe80c0c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:25.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.830+0000 7fe81109b640 1 --2- 172.21.15.59:0/1441183109 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80c0c4200 0x7fe80c0c20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.830+0000 7fe81109b640 1 -- 172.21.15.59:0/1441183109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7f8004d00 msgr2=0x7fe80c0acca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:25.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.830+0000 7fe81189c640 1 --2- 172.21.15.59:0/1441183109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7f8004d00 0x7fe80c0acca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:25.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.830+0000 7fe81109b640 1 --2- 172.21.15.59:0/1441183109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7f8004d00 0x7fe80c0acca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:25.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.830+0000 7fe81109b640 1 -- 172.21.15.59:0/1441183109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c0ac1c0 con 0x7fe80c158220 2023-10-16T14:27:25.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.830+0000 7fe81109b640 1 --2- 172.21.15.59:0/1441183109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c158220 0x7fe80c0c91d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc011960 tx=0x7fe7fc011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:25.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.830+0000 7fe8027fc640 1 -- 172.21.15.59:0/1441183109 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc016070 con 0x7fe80c158220 2023-10-16T14:27:25.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.830+0000 7fe8027fc640 1 -- 172.21.15.59:0/1441183109 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc00ec10 con 0x7fe80c158220 2023-10-16T14:27:25.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.830+0000 7fe81289e640 1 -- 172.21.15.59:0/1441183109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80c0ac4a0 con 0x7fe80c158220 2023-10-16T14:27:25.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.830+0000 7fe8027fc640 1 -- 172.21.15.59:0/1441183109 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc01a410 con 0x7fe80c158220 2023-10-16T14:27:25.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.831+0000 7fe81289e640 1 -- 172.21.15.59:0/1441183109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c0c4680 con 0x7fe80c158220 2023-10-16T14:27:25.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.832+0000 7fe81289e640 1 -- 172.21.15.59:0/1441183109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80c0ac020 con 0x7fe80c158220 2023-10-16T14:27:25.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.833+0000 7fe8027fc640 1 -- 172.21.15.59:0/1441183109 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe7fc01a570 con 0x7fe80c158220 2023-10-16T14:27:25.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.834+0000 7fe8027fc640 1 --2- 172.21.15.59:0/1441183109 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe7f006ae70 0x7fe7f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:25.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.834+0000 7fe8027fc640 1 -- 172.21.15.59:0/1441183109 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe7fc08b470 con 0x7fe80c158220 2023-10-16T14:27:25.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.835+0000 7fe81189c640 1 --2- 172.21.15.59:0/1441183109 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe7f006ae70 0x7fe7f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:25.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.836+0000 7fe81189c640 1 --2- 172.21.15.59:0/1441183109 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe7f006ae70 0x7fe7f006d330 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe808001600 tx=0x7fe808009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:25.839+0000 7fe8027fc640 1 -- 172.21.15.59:0/1441183109 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe80c0ac020 con 0x7fe80c158220 2023-10-16T14:27:26.118 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.114+0000 7fe81289e640 1 -- 172.21.15.59:0/1441183109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fe80c0ac020 con 0x7fe80c158220 2023-10-16T14:27:26.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.120+0000 7fe8027fc640 1 -- 172.21.15.59:0/1441183109 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe80c0ac020 con 0x7fe80c158220 2023-10-16T14:27:26.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.124+0000 7fe81289e640 1 -- 172.21.15.59:0/1441183109 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe7f006ae70 msgr2=0x7fe7f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:26.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.124+0000 7fe81289e640 1 --2- 172.21.15.59:0/1441183109 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe7f006ae70 0x7fe7f006d330 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe808001600 tx=0x7fe808009040 comp rx=0 tx=0).stop 2023-10-16T14:27:26.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.124+0000 7fe81289e640 1 -- 172.21.15.59:0/1441183109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c158220 msgr2=0x7fe80c0c91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:26.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.124+0000 7fe81289e640 1 --2- 172.21.15.59:0/1441183109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c158220 0x7fe80c0c91d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc011960 tx=0x7fe7fc011e20 comp rx=0 tx=0).stop 2023-10-16T14:27:26.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.124+0000 7fe81289e640 1 -- 172.21.15.59:0/1441183109 shutdown_connections 2023-10-16T14:27:26.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.124+0000 7fe81289e640 1 --2- 172.21.15.59:0/1441183109 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe7f006ae70 0x7fe7f006d330 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:26.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.124+0000 7fe81289e640 1 --2- 172.21.15.59:0/1441183109 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80c0c4200 0x7fe80c0c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:26.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.124+0000 7fe81289e640 1 --2- 172.21.15.59:0/1441183109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe80c158220 0x7fe80c0c91d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:26.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.124+0000 7fe81289e640 1 --2- 172.21.15.59:0/1441183109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7f8004d00 0x7fe80c0acca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:26.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.124+0000 7fe81289e640 1 -- 172.21.15.59:0/1441183109 >> 172.21.15.59:0/1441183109 conn(0x7fe80c069fc0 msgr2=0x7fe80c06c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:26.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.124+0000 7fe81289e640 1 -- 172.21.15.59:0/1441183109 shutdown_connections 2023-10-16T14:27:26.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.124+0000 7fe81289e640 1 -- 172.21.15.59:0/1441183109 wait complete. 2023-10-16T14:27:26.146 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-16T14:27:26.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.373+0000 7fb1bbfff640 1 Processor -- start 2023-10-16T14:27:26.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.374+0000 7fb1bbfff640 1 -- start start 2023-10-16T14:27:26.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.376+0000 7fb1bbfff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb1bc0ce0d0 0x7fb1bc0d0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:26.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.376+0000 7fb1bbfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1bc0ce560 0x7fb1bc0d0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:26.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.376+0000 7fb1bbfff640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1bc0cdc40 con 0x7fb1bc0d27d0 2023-10-16T14:27:26.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.376+0000 7fb1bbfff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1bc0cd3e0 con 0x7fb1bc0ce0d0 2023-10-16T14:27:26.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.376+0000 7fb1bbfff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc0d0e90 con 0x7fb1bc0ce560 2023-10-16T14:27:26.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.376+0000 7fb1baffd640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb1bc0d27d0 0x7fb1bc0d2bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56506/0 (socket says 172.21.15.59:56506) 2023-10-16T14:27:26.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.376+0000 7fb1baffd640 1 -- 172.21.15.59:0/3018812589 learned_addr learned my addr 172.21.15.59:0/3018812589 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:26.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.376+0000 7fb1bb7fe640 1 --2- 172.21.15.59:0/3018812589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1bc0ce560 0x7fb1bc0d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:26.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.376+0000 7fb1b3fff640 1 --2- 172.21.15.59:0/3018812589 >> v2:172.21.15.151:3300/0 conn(0x7fb1bc0ce0d0 0x7fb1bc0d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:26.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.376+0000 7fb1ba7fc640 1 -- 172.21.15.59:0/3018812589 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307662584 0 0) 0x7fb1bc0cdc40 con 0x7fb1bc0d27d0 2023-10-16T14:27:26.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.377+0000 7fb1ba7fc640 1 -- 172.21.15.59:0/3018812589 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a8003520 con 0x7fb1bc0d27d0 2023-10-16T14:27:26.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.377+0000 7fb1ba7fc640 1 -- 172.21.15.59:0/3018812589 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1404722065 0 0) 0x7fb1a8003520 con 0x7fb1bc0d27d0 2023-10-16T14:27:26.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.377+0000 7fb1ba7fc640 1 -- 172.21.15.59:0/3018812589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1bc0ce560 msgr2=0x7fb1bc0d0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:26.385 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.377+0000 7fb1ba7fc640 1 --2- 172.21.15.59:0/3018812589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1bc0ce560 0x7fb1bc0d0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:26.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.377+0000 7fb1ba7fc640 1 -- 172.21.15.59:0/3018812589 >> v2:172.21.15.151:3300/0 conn(0x7fb1bc0ce0d0 msgr2=0x7fb1bc0d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:26.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.377+0000 7fb1ba7fc640 1 --2- 172.21.15.59:0/3018812589 >> v2:172.21.15.151:3300/0 conn(0x7fb1bc0ce0d0 0x7fb1bc0d0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:26.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.377+0000 7fb1ba7fc640 1 -- 172.21.15.59:0/3018812589 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc0d00c0 con 0x7fb1bc0d27d0 2023-10-16T14:27:26.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.377+0000 7fb1ba7fc640 1 -- 172.21.15.59:0/3018812589 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7fb1ac0017f0 con 0x7fb1bc0d27d0 2023-10-16T14:27:26.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.377+0000 7fb1ba7fc640 1 -- 172.21.15.59:0/3018812589 >> v1:172.21.15.59:6789/0 conn(0x7fb1bc0d27d0 legacy=0x7fb1bc0d2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:26.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.377+0000 7fb1ba7fc640 1 --2- 172.21.15.59:0/3018812589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a8003970 0x7fb1a8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:26.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.377+0000 7fb1ba7fc640 1 --2- 172.21.15.59:0/3018812589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1bc0ce560 0x7fb1a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:26.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.377+0000 7fb1ba7fc640 1 --2- 172.21.15.59:0/3018812589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1a8004d00 0x7fb1a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:26.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.377+0000 7fb1ba7fc640 1 -- 172.21.15.59:0/3018812589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc0cd3e0 con 0x7fb1a8003970 2023-10-16T14:27:26.387 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.377+0000 7fb1ba7fc640 1 -- 172.21.15.59:0/3018812589 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc0d0e90 con 0x7fb1a8004d00 2023-10-16T14:27:26.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.377+0000 7fb1ba7fc640 1 -- 172.21.15.59:0/3018812589 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a800b980 con 0x7fb1bc0ce560 2023-10-16T14:27:26.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.378+0000 7fb1baffd640 1 --2- 172.21.15.59:0/3018812589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a8003970 0x7fb1a8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:26.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.378+0000 7fb1b3fff640 1 --2- 172.21.15.59:0/3018812589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1bc0ce560 0x7fb1a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:26.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.378+0000 7fb1bb7fe640 1 --2- 172.21.15.59:0/3018812589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1a8004d00 0x7fb1a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:26.388 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.378+0000 7fb1baffd640 1 -- 172.21.15.59:0/3018812589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1bc0ce560 msgr2=0x7fb1a80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.378+0000 7fb1baffd640 1 --2- 172.21.15.59:0/3018812589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1bc0ce560 0x7fb1a80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.378+0000 7fb1baffd640 1 -- 172.21.15.59:0/3018812589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1a8004d00 msgr2=0x7fb1a8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.378+0000 7fb1baffd640 1 --2- 172.21.15.59:0/3018812589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1a8004d00 0x7fb1a8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.378+0000 7fb1baffd640 1 -- 172.21.15.59:0/3018812589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a8003520 con 0x7fb1a8003970 2023-10-16T14:27:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.378+0000 7fb1b3fff640 1 --2- 172.21.15.59:0/3018812589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1bc0ce560 0x7fb1a80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:27:26.389 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.380+0000 7fb1baffd640 1 --2- 172.21.15.59:0/3018812589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a8003970 0x7fb1a8003d90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00c0e0 tx=0x7fb1a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54fb0f34895ba071 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:26.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.380+0000 7fb1ba7fc640 1 -- 172.21.15.59:0/3018812589 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac0072f0 con 0x7fb1a8003970 2023-10-16T14:27:26.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.380+0000 7fb1ba7fc640 1 -- 172.21.15.59:0/3018812589 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac007450 con 0x7fb1a8003970 2023-10-16T14:27:26.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.380+0000 7fb1ba7fc640 1 -- 172.21.15.59:0/3018812589 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac02c810 con 0x7fb1a8003970 2023-10-16T14:27:26.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.380+0000 7fb1bbfff640 1 -- 172.21.15.59:0/3018812589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a8003970 msgr2=0x7fb1a8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:26.390 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.380+0000 7fb1bbfff640 1 --2- 172.21.15.59:0/3018812589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a8003970 0x7fb1a8003d90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00c0e0 tx=0x7fb1a80057f0 comp rx=0 tx=0).stop 2023-10-16T14:27:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.380+0000 7fb1bb7fe640 1 -- 172.21.15.59:0/3018812589 reap_dead start 2023-10-16T14:27:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.381+0000 7fb1bbfff640 1 -- 172.21.15.59:0/3018812589 shutdown_connections 2023-10-16T14:27:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.381+0000 7fb1bbfff640 1 -- 172.21.15.59:0/3018812589 >> 172.21.15.59:0/3018812589 conn(0x7fb1bc09bbc0 msgr2=0x7fb1bc089f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.381+0000 7fb1bbfff640 1 -- 172.21.15.59:0/3018812589 shutdown_connections 2023-10-16T14:27:26.391 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.381+0000 7fb1bbfff640 1 -- 172.21.15.59:0/3018812589 wait complete. 2023-10-16T14:27:26.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.383+0000 7fb1bbfff640 1 Processor -- start 2023-10-16T14:27:26.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.383+0000 7fb1bbfff640 1 -- start start 2023-10-16T14:27:26.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.384+0000 7fb1bbfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1a8003970 0x7fb1bc0b7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:26.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.384+0000 7fb1bbfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1bc14a370 0x7fb1bc06b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:26.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.384+0000 7fb1bbfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1bc06b8c0 0x7fb1bc0c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:26.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.384+0000 7fb1bbfff640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc06bd40 con 0x7fb1bc14a370 2023-10-16T14:27:26.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.384+0000 7fb1bbfff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc0b82f0 con 0x7fb1bc06b8c0 2023-10-16T14:27:26.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.384+0000 7fb1bbfff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1bc14cd10 con 0x7fb1a8003970 2023-10-16T14:27:26.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.384+0000 7fb1b3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1bc14a370 0x7fb1bc06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:26.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.384+0000 7fb1b3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1bc14a370 0x7fb1bc06b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45144/0 (socket says 172.21.15.59:45144) 2023-10-16T14:27:26.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.384+0000 7fb1b3fff640 1 -- 172.21.15.59:0/3583141257 learned_addr learned my addr 172.21.15.59:0/3583141257 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:26.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.385+0000 7fb1baffd640 1 --2- 172.21.15.59:0/3583141257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1a8003970 0x7fb1bc0b7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:26.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.385+0000 7fb1b3fff640 1 -- 172.21.15.59:0/3583141257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1a8003970 msgr2=0x7fb1bc0b7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:26.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.385+0000 7fb1b3fff640 1 --2- 172.21.15.59:0/3583141257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1a8003970 0x7fb1bc0b7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:26.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.385+0000 7fb1bb7fe640 1 --2- 172.21.15.59:0/3583141257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1bc06b8c0 0x7fb1bc0c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:26.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.385+0000 7fb1b3fff640 1 -- 172.21.15.59:0/3583141257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1bc06b8c0 msgr2=0x7fb1bc0c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:26.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.385+0000 7fb1b3fff640 1 --2- 172.21.15.59:0/3583141257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1bc06b8c0 0x7fb1bc0c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:26.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.385+0000 7fb1b3fff640 1 -- 172.21.15.59:0/3583141257 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc14cff0 con 0x7fb1bc14a370 2023-10-16T14:27:26.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.385+0000 7fb1b3fff640 1 --2- 172.21.15.59:0/3583141257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1bc14a370 0x7fb1bc06b380 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4011600 tx=0x7fb1a4011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:26.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.385+0000 7fb1b37fe640 1 -- 172.21.15.59:0/3583141257 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a400f920 con 0x7fb1bc14a370 2023-10-16T14:27:26.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.385+0000 7fb1b37fe640 1 -- 172.21.15.59:0/3583141257 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a400fa80 con 0x7fb1bc14a370 2023-10-16T14:27:26.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.385+0000 7fb1b37fe640 1 -- 172.21.15.59:0/3583141257 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a400fe10 con 0x7fb1bc14a370 2023-10-16T14:27:26.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.385+0000 7fb1bbfff640 1 -- 172.21.15.59:0/3583141257 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1bc14d2d0 con 0x7fb1bc14a370 2023-10-16T14:27:26.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.386+0000 7fb1bbfff640 1 -- 172.21.15.59:0/3583141257 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1bc14d890 con 0x7fb1bc14a370 2023-10-16T14:27:26.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.387+0000 7fb1bbfff640 1 -- 172.21.15.59:0/3583141257 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1bc04e9b0 con 0x7fb1bc14a370 2023-10-16T14:27:26.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.388+0000 7fb1b37fe640 1 -- 172.21.15.59:0/3583141257 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb1a4015460 con 0x7fb1bc14a370 2023-10-16T14:27:26.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.389+0000 7fb1b37fe640 1 --2- 172.21.15.59:0/3583141257 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb19c06aea0 0x7fb19c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:26.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.389+0000 7fb1b37fe640 1 -- 172.21.15.59:0/3583141257 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb1a4089bf0 con 0x7fb1bc14a370 2023-10-16T14:27:26.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.389+0000 7fb1baffd640 1 --2- 172.21.15.59:0/3583141257 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb19c06aea0 0x7fb19c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:26.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.391+0000 7fb1baffd640 1 --2- 172.21.15.59:0/3583141257 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb19c06aea0 0x7fb19c06d360 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac034000 tx=0x7fb1ac007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:26.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.393+0000 7fb1b37fe640 1 -- 172.21.15.59:0/3583141257 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1a4054e10 con 0x7fb1bc14a370 2023-10-16T14:27:26.666 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.662+0000 7fb1bbfff640 1 -- 172.21.15.59:0/3583141257 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fb1bc072f50 con 0x7fb1bc14a370 2023-10-16T14:27:26.671 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.667+0000 7fb1b37fe640 1 -- 172.21.15.59:0/3583141257 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb1a40220a0 con 0x7fb1bc14a370 2023-10-16T14:27:26.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.670+0000 7fb1bbfff640 1 -- 172.21.15.59:0/3583141257 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb19c06aea0 msgr2=0x7fb19c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:26.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.670+0000 7fb1bbfff640 1 --2- 172.21.15.59:0/3583141257 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb19c06aea0 0x7fb19c06d360 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac034000 tx=0x7fb1ac007000 comp rx=0 tx=0).stop 2023-10-16T14:27:26.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.670+0000 7fb1bbfff640 1 -- 172.21.15.59:0/3583141257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1bc14a370 msgr2=0x7fb1bc06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:26.675 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.670+0000 7fb1bbfff640 1 --2- 172.21.15.59:0/3583141257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1bc14a370 0x7fb1bc06b380 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4011600 tx=0x7fb1a4011ac0 comp rx=0 tx=0).stop 2023-10-16T14:27:26.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.671+0000 7fb1bbfff640 1 -- 172.21.15.59:0/3583141257 shutdown_connections 2023-10-16T14:27:26.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.671+0000 7fb1bbfff640 1 --2- 172.21.15.59:0/3583141257 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fb19c06aea0 0x7fb19c06d360 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:26.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.671+0000 7fb1bbfff640 1 --2- 172.21.15.59:0/3583141257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1bc06b8c0 0x7fb1bc0c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:26.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.671+0000 7fb1bbfff640 1 --2- 172.21.15.59:0/3583141257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1bc14a370 0x7fb1bc06b380 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:26.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.671+0000 7fb1bbfff640 1 --2- 172.21.15.59:0/3583141257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1a8003970 0x7fb1bc0b7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:26.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.671+0000 7fb1bbfff640 1 -- 172.21.15.59:0/3583141257 >> 172.21.15.59:0/3583141257 conn(0x7fb1bc09bbc0 msgr2=0x7fb1bc0cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:26.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.671+0000 7fb1bbfff640 1 -- 172.21.15.59:0/3583141257 shutdown_connections 2023-10-16T14:27:26.677 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.671+0000 7fb1bbfff640 1 -- 172.21.15.59:0/3583141257 wait complete. 2023-10-16T14:27:26.696 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-16T14:27:26.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.922+0000 7f1ebc84e640 1 Processor -- start 2023-10-16T14:27:26.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.922+0000 7f1ebc84e640 1 -- start start 2023-10-16T14:27:26.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.923+0000 7f1ebc84e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1eb80cd950 0x7f1eb80cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:26.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.923+0000 7f1ebc84e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb80cefa0 con 0x7f1eb80ce600 2023-10-16T14:27:26.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.923+0000 7f1ebc84e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb806d4c0 con 0x7f1eb8157040 2023-10-16T14:27:26.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.923+0000 7f1ebc84e640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb80cdde0 con 0x7f1eb80cd950 2023-10-16T14:27:26.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.924+0000 7f1eae59c640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1eb80ce600 0x7f1eb80cd240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56514/0 (socket says 172.21.15.59:56514) 2023-10-16T14:27:26.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.924+0000 7f1eae59c640 1 -- 172.21.15.59:0/3290114652 learned_addr learned my addr 172.21.15.59:0/3290114652 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:26.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.924+0000 7f1eb759e640 1 --2- 172.21.15.59:0/3290114652 >> v2:172.21.15.59:3300/0 conn(0x7f1eb80cd950 0x7f1eb80cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:26.929 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.924+0000 7f1eb659c640 1 -- 172.21.15.59:0/3290114652 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770198442 0 0) 0x7f1eb80cefa0 con 0x7f1eb80ce600 2023-10-16T14:27:26.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.924+0000 7f1eb659c640 1 -- 172.21.15.59:0/3290114652 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ea4003520 con 0x7f1eb80ce600 2023-10-16T14:27:26.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.924+0000 7f1eb759e640 1 -- 172.21.15.59:0/3290114652 >> v1:172.21.15.151:6789/0 conn(0x7f1eb8157040 legacy=0x7f1eb806d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:26.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.924+0000 7f1eb759e640 1 -- 172.21.15.59:0/3290114652 >> v1:172.21.15.59:6789/0 conn(0x7f1eb80ce600 legacy=0x7f1eb80cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:26.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.924+0000 7f1eb759e640 1 -- 172.21.15.59:0/3290114652 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb80cdfc0 con 0x7f1eb80cd950 2023-10-16T14:27:26.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.926+0000 7f1eb759e640 1 --2- 172.21.15.59:0/3290114652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb80cd950 0x7f1eb80cea60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00097a0 tx=0x7f1eb002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b5769f4e2aae22 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:26.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.926+0000 7f1eb659c640 1 -- 172.21.15.59:0/3290114652 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0030610 con 0x7f1eb80cd950 2023-10-16T14:27:26.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.926+0000 7f1eb659c640 1 -- 172.21.15.59:0/3290114652 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb0030770 con 0x7f1eb80cd950 2023-10-16T14:27:26.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.927+0000 7f1eb659c640 1 -- 172.21.15.59:0/3290114652 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0030ae0 con 0x7f1eb80cd950 2023-10-16T14:27:26.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.927+0000 7f1ebc84e640 1 -- 172.21.15.59:0/3290114652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb80cd950 msgr2=0x7f1eb80cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:26.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.927+0000 7f1ebc84e640 1 --2- 172.21.15.59:0/3290114652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb80cd950 0x7f1eb80cea60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00097a0 tx=0x7f1eb002b960 comp rx=0 tx=0).stop 2023-10-16T14:27:26.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.927+0000 7f1ebc84e640 1 -- 172.21.15.59:0/3290114652 shutdown_connections 2023-10-16T14:27:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.927+0000 7f1ebc84e640 1 --2- 172.21.15.59:0/3290114652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb80cd950 0x7f1eb80cea60 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.927+0000 7f1ebc84e640 1 -- 172.21.15.59:0/3290114652 >> 172.21.15.59:0/3290114652 conn(0x7f1eb8069fc0 msgr2=0x7f1eb806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.928+0000 7f1ebc84e640 1 -- 172.21.15.59:0/3290114652 shutdown_connections 2023-10-16T14:27:26.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.928+0000 7f1ebc84e640 1 -- 172.21.15.59:0/3290114652 wait complete. 2023-10-16T14:27:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.929+0000 7f1ebc84e640 1 Processor -- start 2023-10-16T14:27:26.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.929+0000 7f1ebc84e640 1 -- start start 2023-10-16T14:27:26.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.930+0000 7f1ebc84e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1eb80cd950 0x7f1eb8155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:26.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.930+0000 7f1ebc84e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1eb80ce600 0x7f1eb81f2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:26.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.930+0000 7f1ebc84e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb8157040 0x7f1eb80c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:26.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.930+0000 7f1ebc84e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb81f32a0 con 0x7f1eb8157040 2023-10-16T14:27:26.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.930+0000 7f1ebc84e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb81f3410 con 0x7f1eb80cd950 2023-10-16T14:27:26.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.930+0000 7f1ebc84e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb8156260 con 0x7f1eb80ce600 2023-10-16T14:27:26.939 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.931+0000 7f1eb759e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb8157040 0x7f1eb80c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.931+0000 7f1eb759e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb8157040 0x7f1eb80c8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45168/0 (socket says 172.21.15.59:45168) 2023-10-16T14:27:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.931+0000 7f1eb759e640 1 -- 172.21.15.59:0/272744169 learned_addr learned my addr 172.21.15.59:0/272744169 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.931+0000 7f1eae59c640 1 --2- 172.21.15.59:0/272744169 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1eb80ce600 0x7f1eb81f2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:26.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.931+0000 7f1eb6d9d640 1 --2- 172.21.15.59:0/272744169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1eb80cd950 0x7f1eb8155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.931+0000 7f1eb759e640 1 -- 172.21.15.59:0/272744169 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1eb80ce600 msgr2=0x7f1eb81f2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.931+0000 7f1eb759e640 1 --2- 172.21.15.59:0/272744169 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1eb80ce600 0x7f1eb81f2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.931+0000 7f1eb759e640 1 -- 172.21.15.59:0/272744169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1eb80cd950 msgr2=0x7f1eb8155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.931+0000 7f1eb759e640 1 --2- 172.21.15.59:0/272744169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1eb80cd950 0x7f1eb8155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.931+0000 7f1eb759e640 1 -- 172.21.15.59:0/272744169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb0009400 con 0x7f1eb8157040 2023-10-16T14:27:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.931+0000 7f1eb6d9d640 1 --2- 172.21.15.59:0/272744169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1eb80cd950 0x7f1eb8155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.932+0000 7f1eb759e640 1 --2- 172.21.15.59:0/272744169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb8157040 0x7f1eb80c8ec0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00097a0 tx=0x7f1eb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.932+0000 7f1eaffff640 1 -- 172.21.15.59:0/272744169 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0004230 con 0x7f1eb8157040 2023-10-16T14:27:26.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.932+0000 7f1eaffff640 1 -- 172.21.15.59:0/272744169 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb003f040 con 0x7f1eb8157040 2023-10-16T14:27:26.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.932+0000 7f1eaffff640 1 -- 172.21.15.59:0/272744169 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0039660 con 0x7f1eb8157040 2023-10-16T14:27:26.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.932+0000 7f1ebc84e640 1 -- 172.21.15.59:0/272744169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb80cb100 con 0x7f1eb8157040 2023-10-16T14:27:26.943 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.932+0000 7f1ebc84e640 1 -- 172.21.15.59:0/272744169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb80cb6c0 con 0x7f1eb8157040 2023-10-16T14:27:26.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.933+0000 7f1ebc84e640 1 -- 172.21.15.59:0/272744169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb81f35c0 con 0x7f1eb8157040 2023-10-16T14:27:26.944 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.934+0000 7f1eaffff640 1 -- 172.21.15.59:0/272744169 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1eb00397c0 con 0x7f1eb8157040 2023-10-16T14:27:26.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.935+0000 7f1eaffff640 1 --2- 172.21.15.59:0/272744169 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f1e9806ae70 0x7f1e9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:26.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.935+0000 7f1eaffff640 1 -- 172.21.15.59:0/272744169 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1eb00ab220 con 0x7f1eb8157040 2023-10-16T14:27:26.945 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.936+0000 7f1eb6d9d640 1 --2- 172.21.15.59:0/272744169 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f1e9806ae70 0x7f1e9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:26.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.937+0000 7f1eb6d9d640 1 --2- 172.21.15.59:0/272744169 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f1e9806ae70 0x7f1e9806d330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8007fd0 tx=0x7f1ea8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:26.946 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:26.940+0000 7f1eaffff640 1 -- 172.21.15.59:0/272744169 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1eb81f35c0 con 0x7f1eb8157040 2023-10-16T14:27:27.211 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.207+0000 7f1ebc84e640 1 -- 172.21.15.59:0/272744169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f1eb81f35c0 con 0x7f1eb8157040 2023-10-16T14:27:27.216 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.212+0000 7f1eaffff640 1 -- 172.21.15.59:0/272744169 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1eb81f35c0 con 0x7f1eb8157040 2023-10-16T14:27:27.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.216+0000 7f1ebc84e640 1 -- 172.21.15.59:0/272744169 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f1e9806ae70 msgr2=0x7f1e9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:27.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.216+0000 7f1ebc84e640 1 --2- 172.21.15.59:0/272744169 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f1e9806ae70 0x7f1e9806d330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8007fd0 tx=0x7f1ea8009040 comp rx=0 tx=0).stop 2023-10-16T14:27:27.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.216+0000 7f1ebc84e640 1 -- 172.21.15.59:0/272744169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb8157040 msgr2=0x7f1eb80c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:27.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.216+0000 7f1ebc84e640 1 --2- 172.21.15.59:0/272744169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb8157040 0x7f1eb80c8ec0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00097a0 tx=0x7f1eb00046c0 comp rx=0 tx=0).stop 2023-10-16T14:27:27.220 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.216+0000 7f1ebc84e640 1 -- 172.21.15.59:0/272744169 shutdown_connections 2023-10-16T14:27:27.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.216+0000 7f1ebc84e640 1 --2- 172.21.15.59:0/272744169 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f1e9806ae70 0x7f1e9806d330 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:27.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.216+0000 7f1ebc84e640 1 --2- 172.21.15.59:0/272744169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb8157040 0x7f1eb80c8ec0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:27.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.216+0000 7f1ebc84e640 1 --2- 172.21.15.59:0/272744169 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1eb80ce600 0x7f1eb81f2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:27.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.216+0000 7f1ebc84e640 1 --2- 172.21.15.59:0/272744169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1eb80cd950 0x7f1eb8155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:27.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.216+0000 7f1ebc84e640 1 -- 172.21.15.59:0/272744169 >> 172.21.15.59:0/272744169 conn(0x7f1eb8069fc0 msgr2=0x7f1eb815eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:27.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.216+0000 7f1ebc84e640 1 -- 172.21.15.59:0/272744169 shutdown_connections 2023-10-16T14:27:27.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.216+0000 7f1ebc84e640 1 -- 172.21.15.59:0/272744169 wait complete. 2023-10-16T14:27:27.240 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-16T14:27:27.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.462+0000 7f580a161640 1 Processor -- start 2023-10-16T14:27:27.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.463+0000 7f580a161640 1 -- start start 2023-10-16T14:27:27.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.464+0000 7f580a161640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58040b08c0 0x7f58040c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:27.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.464+0000 7f580a161640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f580406c760 0x7f58040b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:27.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.464+0000 7f580a161640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580406cbf0 con 0x7f580415aa60 2023-10-16T14:27:27.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.464+0000 7f580a161640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f580415ae40 con 0x7f580406c760 2023-10-16T14:27:27.468 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.464+0000 7f580a161640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58040b1580 con 0x7f58040b08c0 2023-10-16T14:27:27.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.464+0000 7f58037fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f580415aa60 0x7f58040b01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56530/0 (socket says 172.21.15.59:56530) 2023-10-16T14:27:27.469 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.464+0000 7f58037fe640 1 -- 172.21.15.59:0/2009350054 learned_addr learned my addr 172.21.15.59:0/2009350054 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:27.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.465+0000 7f5802ffd640 1 -- 172.21.15.59:0/2009350054 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134273946 0 0) 0x7f580406cbf0 con 0x7f580415aa60 2023-10-16T14:27:27.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.465+0000 7f5803fff640 1 --2- 172.21.15.59:0/2009350054 >> v2:172.21.15.151:3300/0 conn(0x7f580406c760 0x7f58040b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:27.471 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.465+0000 7f5802ffd640 1 -- 172.21.15.59:0/2009350054 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57f0003520 con 0x7f580415aa60 2023-10-16T14:27:27.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.465+0000 7f57fbfff640 1 --2- 172.21.15.59:0/2009350054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58040b08c0 0x7f58040c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:27.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.465+0000 7f5802ffd640 1 -- 172.21.15.59:0/2009350054 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3744054693 0 0) 0x7f57f0003520 con 0x7f580415aa60 2023-10-16T14:27:27.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.465+0000 7f5802ffd640 1 -- 172.21.15.59:0/2009350054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58040b08c0 msgr2=0x7f58040c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:27.472 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.465+0000 7f5802ffd640 1 --2- 172.21.15.59:0/2009350054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58040b08c0 0x7f58040c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:27.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.465+0000 7f5802ffd640 1 -- 172.21.15.59:0/2009350054 >> v2:172.21.15.151:3300/0 conn(0x7f580406c760 msgr2=0x7f58040b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:27.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.465+0000 7f5802ffd640 1 --2- 172.21.15.59:0/2009350054 >> v2:172.21.15.151:3300/0 conn(0x7f580406c760 0x7f58040b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:27.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.465+0000 7f5802ffd640 1 -- 172.21.15.59:0/2009350054 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58040c98f0 con 0x7f580415aa60 2023-10-16T14:27:27.473 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.465+0000 7f5802ffd640 1 -- 172.21.15.59:0/2009350054 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f57f4001670 con 0x7f580415aa60 2023-10-16T14:27:27.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.466+0000 7f5803fff640 1 --2- 172.21.15.59:0/2009350054 >> v2:172.21.15.151:3300/0 conn(0x7f580406c760 0x7f58040b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:27:27.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.466+0000 7f5802ffd640 1 -- 172.21.15.59:0/2009350054 >> v1:172.21.15.59:6789/0 conn(0x7f580415aa60 legacy=0x7f58040b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:27.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.466+0000 7f5802ffd640 1 --2- 172.21.15.59:0/2009350054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f0003970 0x7f57f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:27.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.466+0000 7f5802ffd640 1 --2- 172.21.15.59:0/2009350054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57f00047c0 0x7f57f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:27.474 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.466+0000 7f5802ffd640 1 --2- 172.21.15.59:0/2009350054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58040b08c0 0x7f57f00051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:27.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.466+0000 7f5802ffd640 1 -- 172.21.15.59:0/2009350054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580415ae40 con 0x7f57f0003970 2023-10-16T14:27:27.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.466+0000 7f5802ffd640 1 -- 172.21.15.59:0/2009350054 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58040b1580 con 0x7f57f00047c0 2023-10-16T14:27:27.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.466+0000 7f5802ffd640 1 -- 172.21.15.59:0/2009350054 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f000bb10 con 0x7f58040b08c0 2023-10-16T14:27:27.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.466+0000 7f58037fe640 1 --2- 172.21.15.59:0/2009350054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f0003970 0x7f57f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:27.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.466+0000 7f58037fe640 1 -- 172.21.15.59:0/2009350054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58040b08c0 msgr2=0x7f57f00051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:27.475 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.466+0000 7f58037fe640 1 --2- 172.21.15.59:0/2009350054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58040b08c0 0x7f57f00051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:27.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.466+0000 7f58037fe640 1 -- 172.21.15.59:0/2009350054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57f00047c0 msgr2=0x7f57f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:27.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.466+0000 7f57fbfff640 1 --2- 172.21.15.59:0/2009350054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57f00047c0 0x7f57f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:27.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.466+0000 7f58037fe640 1 --2- 172.21.15.59:0/2009350054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57f00047c0 0x7f57f0004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:27.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.466+0000 7f58037fe640 1 -- 172.21.15.59:0/2009350054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f0003520 con 0x7f57f0003970 2023-10-16T14:27:27.476 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.467+0000 7f58037fe640 1 --2- 172.21.15.59:0/2009350054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f0003970 0x7f57f0003d90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f57f400c110 tx=0x7f57f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23b974c43a949c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:27.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.468+0000 7f5802ffd640 1 -- 172.21.15.59:0/2009350054 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f4005ad0 con 0x7f57f0003970 2023-10-16T14:27:27.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.468+0000 7f5802ffd640 1 -- 172.21.15.59:0/2009350054 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f4005c50 con 0x7f57f0003970 2023-10-16T14:27:27.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.468+0000 7f5802ffd640 1 -- 172.21.15.59:0/2009350054 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f402ca70 con 0x7f57f0003970 2023-10-16T14:27:27.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.468+0000 7f580a161640 1 -- 172.21.15.59:0/2009350054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f0003970 msgr2=0x7f57f0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.468+0000 7f580a161640 1 --2- 172.21.15.59:0/2009350054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57f0003970 0x7f57f0003d90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f57f400c110 tx=0x7f57f00057f0 comp rx=0 tx=0).stop 2023-10-16T14:27:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.468+0000 7f5803fff640 1 -- 172.21.15.59:0/2009350054 reap_dead start 2023-10-16T14:27:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.469+0000 7f580a161640 1 -- 172.21.15.59:0/2009350054 shutdown_connections 2023-10-16T14:27:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.469+0000 7f580a161640 1 -- 172.21.15.59:0/2009350054 >> 172.21.15.59:0/2009350054 conn(0x7f58040cb1b0 msgr2=0x7f58040cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:27.480 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.469+0000 7f580a161640 1 -- 172.21.15.59:0/2009350054 shutdown_connections 2023-10-16T14:27:27.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.469+0000 7f580a161640 1 -- 172.21.15.59:0/2009350054 wait complete. 2023-10-16T14:27:27.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.471+0000 7f580a161640 1 Processor -- start 2023-10-16T14:27:27.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.471+0000 7f580a161640 1 -- start start 2023-10-16T14:27:27.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.472+0000 7f580a161640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57f0003970 0x7f58040c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:27.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.472+0000 7f580a161640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f580415b030 0x7f5804150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:27.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.472+0000 7f580a161640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58040af1e0 0x7f58040af660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:27.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.472+0000 7f580a161640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580415cb60 con 0x7f58040af1e0 2023-10-16T14:27:27.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.472+0000 7f580a161640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58040afba0 con 0x7f580415b030 2023-10-16T14:27:27.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.472+0000 7f580a161640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58040c7240 con 0x7f57f0003970 2023-10-16T14:27:27.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.472+0000 7f5803fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58040af1e0 0x7f58040af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:27.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.472+0000 7f5803fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58040af1e0 0x7f58040af660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45190/0 (socket says 172.21.15.59:45190) 2023-10-16T14:27:27.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.472+0000 7f5803fff640 1 -- 172.21.15.59:0/3625943354 learned_addr learned my addr 172.21.15.59:0/3625943354 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:27.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.473+0000 7f58037fe640 1 --2- 172.21.15.59:0/3625943354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57f0003970 0x7f58040c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:27.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.473+0000 7f57fbfff640 1 --2- 172.21.15.59:0/3625943354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f580415b030 0x7f5804150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:27.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.473+0000 7f5803fff640 1 -- 172.21.15.59:0/3625943354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57f0003970 msgr2=0x7f58040c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.473+0000 7f5803fff640 1 --2- 172.21.15.59:0/3625943354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57f0003970 0x7f58040c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.473+0000 7f5803fff640 1 -- 172.21.15.59:0/3625943354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f580415b030 msgr2=0x7f5804150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.473+0000 7f5803fff640 1 --2- 172.21.15.59:0/3625943354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f580415b030 0x7f5804150a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.473+0000 7f5803fff640 1 -- 172.21.15.59:0/3625943354 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58040c74e0 con 0x7f58040af1e0 2023-10-16T14:27:27.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.473+0000 7f5803fff640 1 --2- 172.21.15.59:0/3625943354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58040af1e0 0x7f58040af660 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f58040adc40 tx=0x7f57fc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.474+0000 7f5800ff9640 1 -- 172.21.15.59:0/3625943354 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc00de90 con 0x7f58040af1e0 2023-10-16T14:27:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.474+0000 7f5800ff9640 1 -- 172.21.15.59:0/3625943354 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc00f040 con 0x7f58040af1e0 2023-10-16T14:27:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.474+0000 7f5800ff9640 1 -- 172.21.15.59:0/3625943354 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc003bd0 con 0x7f58040af1e0 2023-10-16T14:27:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.474+0000 7f580a161640 1 -- 172.21.15.59:0/3625943354 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58040c77c0 con 0x7f58040af1e0 2023-10-16T14:27:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.474+0000 7f580a161640 1 -- 172.21.15.59:0/3625943354 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58040c7d80 con 0x7f58040af1e0 2023-10-16T14:27:27.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.475+0000 7f580a161640 1 -- 172.21.15.59:0/3625943354 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58040cafb0 con 0x7f58040af1e0 2023-10-16T14:27:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.476+0000 7f5800ff9640 1 -- 172.21.15.59:0/3625943354 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f57fc003d30 con 0x7f58040af1e0 2023-10-16T14:27:27.486 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.477+0000 7f5800ff9640 1 --2- 172.21.15.59:0/3625943354 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f57e406ae70 0x7f57e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:27.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.477+0000 7f5800ff9640 1 -- 172.21.15.59:0/3625943354 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f57fc089360 con 0x7f58040af1e0 2023-10-16T14:27:27.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.478+0000 7f58037fe640 1 --2- 172.21.15.59:0/3625943354 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f57e406ae70 0x7f57e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:27.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.479+0000 7f58037fe640 1 --2- 172.21.15.59:0/3625943354 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f57e406ae70 0x7f57e406d330 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f57f4034000 tx=0x7f57f4007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:27.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.481+0000 7f5800ff9640 1 -- 172.21.15.59:0/3625943354 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f57fc0544f0 con 0x7f58040af1e0 2023-10-16T14:27:27.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.748+0000 7f580a161640 1 -- 172.21.15.59:0/3625943354 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f5804073ef0 con 0x7f58040af1e0 2023-10-16T14:27:27.757 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.753+0000 7f5800ff9640 1 -- 172.21.15.59:0/3625943354 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f57fc057b10 con 0x7f58040af1e0 2023-10-16T14:27:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.756+0000 7f580a161640 1 -- 172.21.15.59:0/3625943354 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f57e406ae70 msgr2=0x7f57e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.756+0000 7f580a161640 1 --2- 172.21.15.59:0/3625943354 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f57e406ae70 0x7f57e406d330 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f57f4034000 tx=0x7f57f4007000 comp rx=0 tx=0).stop 2023-10-16T14:27:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.756+0000 7f580a161640 1 -- 172.21.15.59:0/3625943354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58040af1e0 msgr2=0x7f58040af660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.756+0000 7f580a161640 1 --2- 172.21.15.59:0/3625943354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58040af1e0 0x7f58040af660 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f58040adc40 tx=0x7f57fc00d4a0 comp rx=0 tx=0).stop 2023-10-16T14:27:27.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.757+0000 7f580a161640 1 -- 172.21.15.59:0/3625943354 shutdown_connections 2023-10-16T14:27:27.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.757+0000 7f580a161640 1 --2- 172.21.15.59:0/3625943354 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f57e406ae70 0x7f57e406d330 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:27.761 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.757+0000 7f580a161640 1 --2- 172.21.15.59:0/3625943354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58040af1e0 0x7f58040af660 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:27.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.757+0000 7f580a161640 1 --2- 172.21.15.59:0/3625943354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f580415b030 0x7f5804150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:27.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.757+0000 7f580a161640 1 --2- 172.21.15.59:0/3625943354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57f0003970 0x7f58040c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:27.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.757+0000 7f580a161640 1 -- 172.21.15.59:0/3625943354 >> 172.21.15.59:0/3625943354 conn(0x7f58040cb1b0 msgr2=0x7f58040ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:27.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.757+0000 7f580a161640 1 -- 172.21.15.59:0/3625943354 shutdown_connections 2023-10-16T14:27:27.762 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.757+0000 7f580a161640 1 -- 172.21.15.59:0/3625943354 wait complete. 2023-10-16T14:27:27.780 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-16T14:27:28.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.997+0000 7f7bfbd3c640 1 Processor -- start 2023-10-16T14:27:28.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.997+0000 7f7bfbd3c640 1 -- start start 2023-10-16T14:27:28.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.998+0000 7f7bfbd3c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7bf4159c80 0x7f7bf406cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:28.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.999+0000 7f7bfbd3c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7bf406d440 0x7f7bf40b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:28.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.999+0000 7f7bfbd3c640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf415a2c0 con 0x7f7bf415d700 2023-10-16T14:27:28.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.999+0000 7f7bfbd3c640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf415a5a0 con 0x7f7bf4159c80 2023-10-16T14:27:28.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.999+0000 7f7bfbd3c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf415a880 con 0x7f7bf406d440 2023-10-16T14:27:28.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.999+0000 7f7bf9ad8640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7bf415d700 0x7f7bf415dae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56546/0 (socket says 172.21.15.59:56546) 2023-10-16T14:27:28.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.999+0000 7f7bf9ad8640 1 -- 172.21.15.59:0/1697576629 learned_addr learned my addr 172.21.15.59:0/1697576629 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:28.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.999+0000 7f7bf92d7640 1 --2- 172.21.15.59:0/1697576629 >> v2:172.21.15.59:3300/0 conn(0x7f7bf4159c80 0x7f7bf406cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:28.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.999+0000 7f7bfa2d9640 1 --2- 172.21.15.59:0/1697576629 >> v2:172.21.15.151:3300/0 conn(0x7f7bf406d440 0x7f7bf40b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:28.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.999+0000 7f7bf92d7640 1 -- 172.21.15.59:0/1697576629 >> v2:172.21.15.151:3300/0 conn(0x7f7bf406d440 msgr2=0x7f7bf40b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:28.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.999+0000 7f7bf92d7640 1 --2- 172.21.15.59:0/1697576629 >> v2:172.21.15.151:3300/0 conn(0x7f7bf406d440 0x7f7bf40b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.999+0000 7f7bf92d7640 1 -- 172.21.15.59:0/1697576629 >> v1:172.21.15.59:6789/0 conn(0x7f7bf415d700 legacy=0x7f7bf415dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:28.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.999+0000 7f7bf92d7640 1 -- 172.21.15.59:0/1697576629 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf415ab60 con 0x7f7bf4159c80 2023-10-16T14:27:28.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:27.999+0000 7f7bfa2d9640 1 --2- 172.21.15.59:0/1697576629 >> v2:172.21.15.151:3300/0 conn(0x7f7bf406d440 0x7f7bf40b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:28.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.001+0000 7f7bf92d7640 1 --2- 172.21.15.59:0/1697576629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bf4159c80 0x7f7bf406cf00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7bf41577b0 tx=0x7f7be402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161f79bc0064bcb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:28.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.001+0000 7f7bf8ad6640 1 -- 172.21.15.59:0/1697576629 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be4031830 con 0x7f7bf4159c80 2023-10-16T14:27:28.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.001+0000 7f7bf8ad6640 1 -- 172.21.15.59:0/1697576629 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be4031990 con 0x7f7bf4159c80 2023-10-16T14:27:28.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.001+0000 7f7bf8ad6640 1 -- 172.21.15.59:0/1697576629 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be4031d20 con 0x7f7bf4159c80 2023-10-16T14:27:28.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.002+0000 7f7bfbd3c640 1 -- 172.21.15.59:0/1697576629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bf4159c80 msgr2=0x7f7bf406cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:28.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.002+0000 7f7bfbd3c640 1 --2- 172.21.15.59:0/1697576629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bf4159c80 0x7f7bf406cf00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7bf41577b0 tx=0x7f7be402b8d0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.002+0000 7f7bfbd3c640 1 -- 172.21.15.59:0/1697576629 shutdown_connections 2023-10-16T14:27:28.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.002+0000 7f7bfbd3c640 1 --2- 172.21.15.59:0/1697576629 >> v2:172.21.15.151:3300/0 conn(0x7f7bf406d440 0x7f7bf40b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.002+0000 7f7bfbd3c640 1 --2- 172.21.15.59:0/1697576629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bf4159c80 0x7f7bf406cf00 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.002+0000 7f7bfbd3c640 1 -- 172.21.15.59:0/1697576629 >> 172.21.15.59:0/1697576629 conn(0x7f7bf40cb1b0 msgr2=0x7f7bf40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.002+0000 7f7bfbd3c640 1 -- 172.21.15.59:0/1697576629 shutdown_connections 2023-10-16T14:27:28.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.002+0000 7f7bfbd3c640 1 -- 172.21.15.59:0/1697576629 wait complete. 2023-10-16T14:27:28.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.004+0000 7f7bfbd3c640 1 Processor -- start 2023-10-16T14:27:28.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.004+0000 7f7bfbd3c640 1 -- start start 2023-10-16T14:27:28.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.005+0000 7f7bfbd3c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bf406d440 0x7f7bf4165710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:28.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.005+0000 7f7bfbd3c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bf4159c80 0x7f7bf40cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:28.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.005+0000 7f7bfbd3c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bf415d700 0x7f7bf41663e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:28.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.005+0000 7f7bfbd3c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4165c50 con 0x7f7bf415d700 2023-10-16T14:27:28.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.005+0000 7f7bfbd3c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4165e60 con 0x7f7bf406d440 2023-10-16T14:27:28.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.005+0000 7f7bfbd3c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf4158a60 con 0x7f7bf4159c80 2023-10-16T14:27:28.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.005+0000 7f7bfa2d9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bf415d700 0x7f7bf41663e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:28.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.005+0000 7f7bfa2d9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bf415d700 0x7f7bf41663e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45196/0 (socket says 172.21.15.59:45196) 2023-10-16T14:27:28.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.005+0000 7f7bfa2d9640 1 -- 172.21.15.59:0/322659776 learned_addr learned my addr 172.21.15.59:0/322659776 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:28.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.006+0000 7f7bf9ad8640 1 --2- 172.21.15.59:0/322659776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bf406d440 0x7f7bf4165710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:28.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.006+0000 7f7bf92d7640 1 --2- 172.21.15.59:0/322659776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bf4159c80 0x7f7bf40cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:28.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.006+0000 7f7bfa2d9640 1 -- 172.21.15.59:0/322659776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bf4159c80 msgr2=0x7f7bf40cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:28.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.006+0000 7f7bfa2d9640 1 --2- 172.21.15.59:0/322659776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bf4159c80 0x7f7bf40cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.006+0000 7f7bfa2d9640 1 -- 172.21.15.59:0/322659776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bf406d440 msgr2=0x7f7bf4165710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:28.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.006+0000 7f7bfa2d9640 1 --2- 172.21.15.59:0/322659776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bf406d440 0x7f7bf4165710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.006+0000 7f7bfa2d9640 1 -- 172.21.15.59:0/322659776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be4009400 con 0x7f7bf415d700 2023-10-16T14:27:28.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.006+0000 7f7bfa2d9640 1 --2- 172.21.15.59:0/322659776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bf415d700 0x7f7bf41663e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00cef0 tx=0x7f7bec00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:28.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.009+0000 7f7bea7fc640 1 -- 172.21.15.59:0/322659776 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec00d840 con 0x7f7bf415d700 2023-10-16T14:27:28.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.009+0000 7f7bea7fc640 1 -- 172.21.15.59:0/322659776 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bec00d9c0 con 0x7f7bf415d700 2023-10-16T14:27:28.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.009+0000 7f7bfbd3c640 1 -- 172.21.15.59:0/322659776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf4158d40 con 0x7f7bf415d700 2023-10-16T14:27:28.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.009+0000 7f7bea7fc640 1 -- 172.21.15.59:0/322659776 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec00dd70 con 0x7f7bf415d700 2023-10-16T14:27:28.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.009+0000 7f7bfbd3c640 1 -- 172.21.15.59:0/322659776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf4159300 con 0x7f7bf415d700 2023-10-16T14:27:28.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.010+0000 7f7bfbd3c640 1 -- 172.21.15.59:0/322659776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf40cd570 con 0x7f7bf415d700 2023-10-16T14:27:28.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.011+0000 7f7bea7fc640 1 -- 172.21.15.59:0/322659776 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7bec01e3b0 con 0x7f7bf415d700 2023-10-16T14:27:28.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.012+0000 7f7bea7fc640 1 --2- 172.21.15.59:0/322659776 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7bd806ae70 0x7f7bd806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:28.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.012+0000 7f7bea7fc640 1 -- 172.21.15.59:0/322659776 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7bec089e50 con 0x7f7bf415d700 2023-10-16T14:27:28.017 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.013+0000 7f7bf9ad8640 1 --2- 172.21.15.59:0/322659776 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7bd806ae70 0x7f7bd806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:28.018 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.014+0000 7f7bf9ad8640 1 --2- 172.21.15.59:0/322659776 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7bd806ae70 0x7f7bd806d330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0005880 tx=0x7f7bf0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:28.020 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.017+0000 7f7bea7fc640 1 -- 172.21.15.59:0/322659776 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7bec055260 con 0x7f7bf415d700 2023-10-16T14:27:28.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.285+0000 7f7bfbd3c640 1 -- 172.21.15.59:0/322659776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f7bf41594f0 con 0x7f7bf415d700 2023-10-16T14:27:28.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.290+0000 7f7bea7fc640 1 -- 172.21.15.59:0/322659776 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7bec01a0a0 con 0x7f7bf415d700 2023-10-16T14:27:28.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.294+0000 7f7bfbd3c640 1 -- 172.21.15.59:0/322659776 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7bd806ae70 msgr2=0x7f7bd806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:28.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.294+0000 7f7bfbd3c640 1 --2- 172.21.15.59:0/322659776 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7bd806ae70 0x7f7bd806d330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0005880 tx=0x7f7bf0009040 comp rx=0 tx=0).stop 2023-10-16T14:27:28.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.294+0000 7f7bfbd3c640 1 -- 172.21.15.59:0/322659776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bf415d700 msgr2=0x7f7bf41663e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:28.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.294+0000 7f7bfbd3c640 1 --2- 172.21.15.59:0/322659776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bf415d700 0x7f7bf41663e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00cef0 tx=0x7f7bec00a710 comp rx=0 tx=0).stop 2023-10-16T14:27:28.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.294+0000 7f7bfbd3c640 1 -- 172.21.15.59:0/322659776 shutdown_connections 2023-10-16T14:27:28.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.294+0000 7f7bfbd3c640 1 --2- 172.21.15.59:0/322659776 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7bd806ae70 0x7f7bd806d330 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.294+0000 7f7bfbd3c640 1 --2- 172.21.15.59:0/322659776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bf415d700 0x7f7bf41663e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.294+0000 7f7bfbd3c640 1 --2- 172.21.15.59:0/322659776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bf4159c80 0x7f7bf40cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.299 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.294+0000 7f7bfbd3c640 1 --2- 172.21.15.59:0/322659776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bf406d440 0x7f7bf4165710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.294+0000 7f7bfbd3c640 1 -- 172.21.15.59:0/322659776 >> 172.21.15.59:0/322659776 conn(0x7f7bf40cb1b0 msgr2=0x7f7bf415af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:28.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.295+0000 7f7bfbd3c640 1 -- 172.21.15.59:0/322659776 shutdown_connections 2023-10-16T14:27:28.300 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.295+0000 7f7bfbd3c640 1 -- 172.21.15.59:0/322659776 wait complete. 2023-10-16T14:27:28.318 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-16T14:27:28.538 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.535+0000 7f98b1e7c640 1 Processor -- start 2023-10-16T14:27:28.539 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.535+0000 7f98b1e7c640 1 -- start start 2023-10-16T14:27:28.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.536+0000 7f98b1e7c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f98ac0b1ea0 0x7f98ac160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:28.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.537+0000 7f98b1e7c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98ac0d1470 0x7f98ac160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:28.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.537+0000 7f98b1e7c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ac0cff90 con 0x7f98ac0b1ac0 2023-10-16T14:27:28.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.537+0000 7f98b1e7c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac0cfdb0 con 0x7f98ac0b1ea0 2023-10-16T14:27:28.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.537+0000 7f98b1e7c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0caf80 con 0x7f98ac0d1470 2023-10-16T14:27:28.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.537+0000 7f98abfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98ac0d1470 0x7f98ac160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.537+0000 7f98abfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98ac0d1470 0x7f98ac160fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.59:58614/0 (socket says 172.21.15.59:58614) 2023-10-16T14:27:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.538+0000 7f98abfff640 1 -- 172.21.15.59:0/3630179381 learned_addr learned my addr 172.21.15.59:0/3630179381 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:28.543 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.538+0000 7f98aaffd640 1 --2- 172.21.15.59:0/3630179381 >> v2:172.21.15.151:3300/0 conn(0x7f98ac0b1ea0 0x7f98ac160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:28.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.538+0000 7f98abfff640 1 -- 172.21.15.59:0/3630179381 >> v2:172.21.15.151:3300/0 conn(0x7f98ac0b1ea0 msgr2=0x7f98ac160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:28.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.538+0000 7f98abfff640 1 --2- 172.21.15.59:0/3630179381 >> v2:172.21.15.151:3300/0 conn(0x7f98ac0b1ea0 0x7f98ac160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.538+0000 7f98abfff640 1 -- 172.21.15.59:0/3630179381 >> v1:172.21.15.151:6789/0 conn(0x7f98ac0b1ac0 legacy=0x7f98ac0cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:28.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.538+0000 7f98abfff640 1 -- 172.21.15.59:0/3630179381 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac0cb260 con 0x7f98ac0d1470 2023-10-16T14:27:28.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.538+0000 7f98aaffd640 1 --2- 172.21.15.59:0/3630179381 >> v2:172.21.15.151:3300/0 conn(0x7f98ac0b1ea0 0x7f98ac160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:27:28.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.540+0000 7f98abfff640 1 --2- 172.21.15.59:0/3630179381 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98ac0d1470 0x7f98ac160fa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f98a4009870 tx=0x7f98a402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0e21f58176a7e30 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:28.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.540+0000 7f98aa7fc640 1 -- 172.21.15.59:0/3630179381 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4031640 con 0x7f98ac0d1470 2023-10-16T14:27:28.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.540+0000 7f98aa7fc640 1 -- 172.21.15.59:0/3630179381 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a40317a0 con 0x7f98ac0d1470 2023-10-16T14:27:28.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.540+0000 7f98aa7fc640 1 -- 172.21.15.59:0/3630179381 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4031b30 con 0x7f98ac0d1470 2023-10-16T14:27:28.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.541+0000 7f98b1e7c640 1 -- 172.21.15.59:0/3630179381 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98ac0d1470 msgr2=0x7f98ac160fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:28.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.541+0000 7f98b1e7c640 1 --2- 172.21.15.59:0/3630179381 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98ac0d1470 0x7f98ac160fa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f98a4009870 tx=0x7f98a402b8f0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.541+0000 7f98b1e7c640 1 -- 172.21.15.59:0/3630179381 shutdown_connections 2023-10-16T14:27:28.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.541+0000 7f98b1e7c640 1 --2- 172.21.15.59:0/3630179381 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98ac0d1470 0x7f98ac160fa0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.541+0000 7f98b1e7c640 1 --2- 172.21.15.59:0/3630179381 >> v2:172.21.15.151:3300/0 conn(0x7f98ac0b1ea0 0x7f98ac160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.541+0000 7f98b1e7c640 1 -- 172.21.15.59:0/3630179381 >> 172.21.15.59:0/3630179381 conn(0x7f98ac099ad0 msgr2=0x7f98ac0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:28.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.541+0000 7f98b1e7c640 1 -- 172.21.15.59:0/3630179381 shutdown_connections 2023-10-16T14:27:28.548 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.541+0000 7f98b1e7c640 1 -- 172.21.15.59:0/3630179381 wait complete. 2023-10-16T14:27:28.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.543+0000 7f98b1e7c640 1 Processor -- start 2023-10-16T14:27:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.543+0000 7f98b1e7c640 1 -- start start 2023-10-16T14:27:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.544+0000 7f98b1e7c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98ac0b1ac0 0x7f98ac1495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.544+0000 7f98b1e7c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98ac0b1ea0 0x7f98ac0c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:28.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.544+0000 7f98b1e7c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98ac0d1470 0x7f98ac0c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:28.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.544+0000 7f98b1e7c640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0b6140 con 0x7f98ac0b1ea0 2023-10-16T14:27:28.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.544+0000 7f98b1e7c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0c5890 con 0x7f98ac0d1470 2023-10-16T14:27:28.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.544+0000 7f98b1e7c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0c5b70 con 0x7f98ac0b1ac0 2023-10-16T14:27:28.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.545+0000 7f98aaffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98ac0b1ea0 0x7f98ac0c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:28.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.545+0000 7f98aaffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98ac0b1ea0 0x7f98ac0c4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45206/0 (socket says 172.21.15.59:45206) 2023-10-16T14:27:28.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.545+0000 7f98aaffd640 1 -- 172.21.15.59:0/1014023430 learned_addr learned my addr 172.21.15.59:0/1014023430 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:28.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.545+0000 7f98ab7fe640 1 --2- 172.21.15.59:0/1014023430 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98ac0b1ac0 0x7f98ac1495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:28.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.545+0000 7f98abfff640 1 --2- 172.21.15.59:0/1014023430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98ac0d1470 0x7f98ac0c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:28.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.545+0000 7f98aaffd640 1 -- 172.21.15.59:0/1014023430 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98ac0b1ac0 msgr2=0x7f98ac1495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:28.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.545+0000 7f98aaffd640 1 --2- 172.21.15.59:0/1014023430 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98ac0b1ac0 0x7f98ac1495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.545+0000 7f98aaffd640 1 -- 172.21.15.59:0/1014023430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98ac0d1470 msgr2=0x7f98ac0c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:28.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.545+0000 7f98aaffd640 1 --2- 172.21.15.59:0/1014023430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98ac0d1470 0x7f98ac0c5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.545+0000 7f98aaffd640 1 -- 172.21.15.59:0/1014023430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a40094d0 con 0x7f98ac0b1ea0 2023-10-16T14:27:28.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.545+0000 7f98ab7fe640 1 --2- 172.21.15.59:0/1014023430 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98ac0b1ac0 0x7f98ac1495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:28.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.545+0000 7f98aaffd640 1 --2- 172.21.15.59:0/1014023430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98ac0b1ea0 0x7f98ac0c4d20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f989400e7e0 tx=0x7f989400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:28.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.546+0000 7f98a3fff640 1 -- 172.21.15.59:0/1014023430 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894004030 con 0x7f98ac0b1ea0 2023-10-16T14:27:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.546+0000 7f98a3fff640 1 -- 172.21.15.59:0/1014023430 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9894004190 con 0x7f98ac0b1ea0 2023-10-16T14:27:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.546+0000 7f98a3fff640 1 -- 172.21.15.59:0/1014023430 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894004520 con 0x7f98ac0b1ea0 2023-10-16T14:27:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.546+0000 7f98b1e7c640 1 -- 172.21.15.59:0/1014023430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ac149c70 con 0x7f98ac0b1ea0 2023-10-16T14:27:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.546+0000 7f98b1e7c640 1 -- 172.21.15.59:0/1014023430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ac14a230 con 0x7f98ac0b1ea0 2023-10-16T14:27:28.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.547+0000 7f98b1e7c640 1 -- 172.21.15.59:0/1014023430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ac073ef0 con 0x7f98ac0b1ea0 2023-10-16T14:27:28.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.548+0000 7f98a3fff640 1 -- 172.21.15.59:0/1014023430 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f989400c6d0 con 0x7f98ac0b1ea0 2023-10-16T14:27:28.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.549+0000 7f98a3fff640 1 --2- 172.21.15.59:0/1014023430 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f988c06ae70 0x7f988c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:28.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.549+0000 7f98a3fff640 1 -- 172.21.15.59:0/1014023430 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f98940890d0 con 0x7f98ac0b1ea0 2023-10-16T14:27:28.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.550+0000 7f98ab7fe640 1 --2- 172.21.15.59:0/1014023430 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f988c06ae70 0x7f988c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:28.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.551+0000 7f98ab7fe640 1 --2- 172.21.15.59:0/1014023430 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f988c06ae70 0x7f988c06d330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f989c0012e0 tx=0x7f989c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:28.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.555+0000 7f98a3fff640 1 -- 172.21.15.59:0/1014023430 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9894054420 con 0x7f98ac0b1ea0 2023-10-16T14:27:28.824 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.820+0000 7f98b1e7c640 1 -- 172.21.15.59:0/1014023430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f98ac065f00 con 0x7f98ac0b1ea0 2023-10-16T14:27:28.829 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.825+0000 7f98a3fff640 1 -- 172.21.15.59:0/1014023430 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9894057a40 con 0x7f98ac0b1ea0 2023-10-16T14:27:28.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.828+0000 7f98b1e7c640 1 -- 172.21.15.59:0/1014023430 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f988c06ae70 msgr2=0x7f988c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:28.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.828+0000 7f98b1e7c640 1 --2- 172.21.15.59:0/1014023430 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f988c06ae70 0x7f988c06d330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f989c0012e0 tx=0x7f989c009040 comp rx=0 tx=0).stop 2023-10-16T14:27:28.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.828+0000 7f98b1e7c640 1 -- 172.21.15.59:0/1014023430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98ac0b1ea0 msgr2=0x7f98ac0c4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:28.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.828+0000 7f98b1e7c640 1 --2- 172.21.15.59:0/1014023430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98ac0b1ea0 0x7f98ac0c4d20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f989400e7e0 tx=0x7f989400eca0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.832 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.828+0000 7f98b1e7c640 1 -- 172.21.15.59:0/1014023430 shutdown_connections 2023-10-16T14:27:28.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.828+0000 7f98b1e7c640 1 --2- 172.21.15.59:0/1014023430 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f988c06ae70 0x7f988c06d330 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.828+0000 7f98b1e7c640 1 --2- 172.21.15.59:0/1014023430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98ac0d1470 0x7f98ac0c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.828+0000 7f98b1e7c640 1 --2- 172.21.15.59:0/1014023430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98ac0b1ea0 0x7f98ac0c4d20 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.828+0000 7f98b1e7c640 1 --2- 172.21.15.59:0/1014023430 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98ac0b1ac0 0x7f98ac1495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:28.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.828+0000 7f98b1e7c640 1 -- 172.21.15.59:0/1014023430 >> 172.21.15.59:0/1014023430 conn(0x7f98ac099ad0 msgr2=0x7f98ac0d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:28.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.829+0000 7f98b1e7c640 1 -- 172.21.15.59:0/1014023430 shutdown_connections 2023-10-16T14:27:28.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:28.829+0000 7f98b1e7c640 1 -- 172.21.15.59:0/1014023430 wait complete. 2023-10-16T14:27:28.849 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:27:29.077 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.074+0000 7f0ef3809640 1 Processor -- start 2023-10-16T14:27:29.078 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.074+0000 7f0ef3809640 1 -- start start 2023-10-16T14:27:29.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.076+0000 7f0ef3809640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0eec15ad00 0x7f0eec0701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:29.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.076+0000 7f0ef3809640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0eec15f040 0x7f0eec15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:29.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.076+0000 7f0ef3809640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eec0707f0 con 0x7f0eec0b0010 2023-10-16T14:27:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.076+0000 7f0ef3809640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eec070ad0 con 0x7f0eec15ad00 2023-10-16T14:27:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.076+0000 7f0ef3809640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eec15b1d0 con 0x7f0eec15f040 2023-10-16T14:27:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.076+0000 7f0ef0da4640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0eec15ad00 0x7f0eec0701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.076+0000 7f0ef0da4640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0eec15ad00 0x7f0eec0701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45222/0 (socket says 172.21.15.59:45222) 2023-10-16T14:27:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.076+0000 7f0ef0da4640 1 -- 172.21.15.59:0/3662255792 learned_addr learned my addr 172.21.15.59:0/3662255792 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.077+0000 7f0ef0da4640 1 -- 172.21.15.59:0/3662255792 >> v2:172.21.15.151:3300/0 conn(0x7f0eec15f040 msgr2=0x7f0eec15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:29.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.077+0000 7f0ef1da6640 1 --2- 172.21.15.59:0/3662255792 >> v2:172.21.15.151:3300/0 conn(0x7f0eec15f040 0x7f0eec15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:29.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.077+0000 7f0ef0da4640 1 --2- 172.21.15.59:0/3662255792 >> v2:172.21.15.151:3300/0 conn(0x7f0eec15f040 0x7f0eec15b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:29.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.077+0000 7f0ef0da4640 1 -- 172.21.15.59:0/3662255792 >> v1:172.21.15.151:6789/0 conn(0x7f0eec0b0010 legacy=0x7f0eec0b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:29.082 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.077+0000 7f0ef0da4640 1 -- 172.21.15.59:0/3662255792 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec15b4b0 con 0x7f0eec15ad00 2023-10-16T14:27:29.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.078+0000 7f0ef0da4640 1 --2- 172.21.15.59:0/3662255792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eec15ad00 0x7f0eec0701a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0adf80 tx=0x7f0edc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e15934dbc9ddf0f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:29.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.078+0000 7f0ee3fff640 1 -- 172.21.15.59:0/3662255792 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc031870 con 0x7f0eec15ad00 2023-10-16T14:27:29.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.078+0000 7f0ee3fff640 1 -- 172.21.15.59:0/3662255792 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc0319d0 con 0x7f0eec15ad00 2023-10-16T14:27:29.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.078+0000 7f0ee3fff640 1 -- 172.21.15.59:0/3662255792 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc031d60 con 0x7f0eec15ad00 2023-10-16T14:27:29.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.079+0000 7f0ef3809640 1 -- 172.21.15.59:0/3662255792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eec15ad00 msgr2=0x7f0eec0701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:29.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.079+0000 7f0ef3809640 1 --2- 172.21.15.59:0/3662255792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eec15ad00 0x7f0eec0701a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0adf80 tx=0x7f0edc02b910 comp rx=0 tx=0).stop 2023-10-16T14:27:29.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.079+0000 7f0ef3809640 1 -- 172.21.15.59:0/3662255792 shutdown_connections 2023-10-16T14:27:29.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.079+0000 7f0ef3809640 1 --2- 172.21.15.59:0/3662255792 >> v2:172.21.15.151:3300/0 conn(0x7f0eec15f040 0x7f0eec15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:29.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.079+0000 7f0ef3809640 1 --2- 172.21.15.59:0/3662255792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eec15ad00 0x7f0eec0701a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:29.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.079+0000 7f0ef3809640 1 -- 172.21.15.59:0/3662255792 >> 172.21.15.59:0/3662255792 conn(0x7f0eec06c1c0 msgr2=0x7f0eec06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:29.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.079+0000 7f0ef3809640 1 -- 172.21.15.59:0/3662255792 shutdown_connections 2023-10-16T14:27:29.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.079+0000 7f0ef3809640 1 -- 172.21.15.59:0/3662255792 wait complete. 2023-10-16T14:27:29.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.081+0000 7f0ef3809640 1 Processor -- start 2023-10-16T14:27:29.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.081+0000 7f0ef3809640 1 -- start start 2023-10-16T14:27:29.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.082+0000 7f0ef3809640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0eec0b0010 0x7f0eec1f1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:29.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.082+0000 7f0ef3809640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eec15ad00 0x7f0eec0acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:29.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.082+0000 7f0ef3809640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0eec15f040 0x7f0eec157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:29.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.082+0000 7f0ef3809640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec1f6680 con 0x7f0eec15ad00 2023-10-16T14:27:29.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.082+0000 7f0ef3809640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec1f5b00 con 0x7f0eec0b0010 2023-10-16T14:27:29.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.082+0000 7f0ef3809640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec1f5de0 con 0x7f0eec15f040 2023-10-16T14:27:29.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.082+0000 7f0ef0da4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eec15ad00 0x7f0eec0acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:29.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.083+0000 7f0ef0da4640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eec15ad00 0x7f0eec0acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45238/0 (socket says 172.21.15.59:45238) 2023-10-16T14:27:29.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.083+0000 7f0ef0da4640 1 -- 172.21.15.59:0/254977967 learned_addr learned my addr 172.21.15.59:0/254977967 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:29.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.083+0000 7f0ef15a5640 1 --2- 172.21.15.59:0/254977967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0eec0b0010 0x7f0eec1f1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:29.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.083+0000 7f0ef0da4640 1 -- 172.21.15.59:0/254977967 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0eec15f040 msgr2=0x7f0eec157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:29.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.083+0000 7f0ef0da4640 1 --2- 172.21.15.59:0/254977967 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0eec15f040 0x7f0eec157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:29.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.083+0000 7f0ef0da4640 1 -- 172.21.15.59:0/254977967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0eec0b0010 msgr2=0x7f0eec1f1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:29.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.083+0000 7f0ef0da4640 1 --2- 172.21.15.59:0/254977967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0eec0b0010 0x7f0eec1f1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:29.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.083+0000 7f0ef0da4640 1 -- 172.21.15.59:0/254977967 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0edc0094d0 con 0x7f0eec15ad00 2023-10-16T14:27:29.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.083+0000 7f0ef0da4640 1 --2- 172.21.15.59:0/254977967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eec15ad00 0x7f0eec0acb40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0edc000c00 tx=0x7f0edc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:29.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.084+0000 7f0ee1ffb640 1 -- 172.21.15.59:0/254977967 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc031840 con 0x7f0eec15ad00 2023-10-16T14:27:29.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.084+0000 7f0ee1ffb640 1 -- 172.21.15.59:0/254977967 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc0443f0 con 0x7f0eec15ad00 2023-10-16T14:27:29.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.084+0000 7f0ee1ffb640 1 -- 172.21.15.59:0/254977967 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc0447a0 con 0x7f0eec15ad00 2023-10-16T14:27:29.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.084+0000 7f0ef3809640 1 -- 172.21.15.59:0/254977967 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eec1f60c0 con 0x7f0eec15ad00 2023-10-16T14:27:29.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.084+0000 7f0ef3809640 1 -- 172.21.15.59:0/254977967 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eec1f1fe0 con 0x7f0eec15ad00 2023-10-16T14:27:29.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.085+0000 7f0ef3809640 1 -- 172.21.15.59:0/254977967 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eec0ab860 con 0x7f0eec15ad00 2023-10-16T14:27:29.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.086+0000 7f0ee1ffb640 1 -- 172.21.15.59:0/254977967 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0edc04d450 con 0x7f0eec15ad00 2023-10-16T14:27:29.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.087+0000 7f0ee1ffb640 1 --2- 172.21.15.59:0/254977967 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0ed006aea0 0x7f0ed006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:29.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.087+0000 7f0ee1ffb640 1 -- 172.21.15.59:0/254977967 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0edc02d040 con 0x7f0eec15ad00 2023-10-16T14:27:29.094 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.088+0000 7f0ef15a5640 1 --2- 172.21.15.59:0/254977967 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0ed006aea0 0x7f0ed006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:29.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.089+0000 7f0ef15a5640 1 --2- 172.21.15.59:0/254977967 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0ed006aea0 0x7f0ed006d360 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8004ea0 tx=0x7f0ee8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:29.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.091+0000 7f0ee1ffb640 1 -- 172.21.15.59:0/254977967 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0eec0ab860 con 0x7f0eec15ad00 2023-10-16T14:27:29.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.284+0000 7f0ef3809640 1 -- 172.21.15.59:0/254977967 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0eec0ab860 con 0x7f0eec15ad00 2023-10-16T14:27:29.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.286+0000 7f0ee1ffb640 1 -- 172.21.15.59:0/254977967 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+13062 (secure 0 0 0) 0x7f0eec0ab860 con 0x7f0eec15ad00 2023-10-16T14:27:29.290 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:29.290 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":36,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:27:25.014436+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:27:29.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.288+0000 7f0ef3809640 1 -- 172.21.15.59:0/254977967 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0ed006aea0 msgr2=0x7f0ed006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:29.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.288+0000 7f0ef3809640 1 --2- 172.21.15.59:0/254977967 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0ed006aea0 0x7f0ed006d360 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8004ea0 tx=0x7f0ee8009040 comp rx=0 tx=0).stop 2023-10-16T14:27:29.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.288+0000 7f0ef3809640 1 -- 172.21.15.59:0/254977967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eec15ad00 msgr2=0x7f0eec0acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:29.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.288+0000 7f0ef3809640 1 --2- 172.21.15.59:0/254977967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eec15ad00 0x7f0eec0acb40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0edc000c00 tx=0x7f0edc0046c0 comp rx=0 tx=0).stop 2023-10-16T14:27:29.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.289+0000 7f0ef3809640 1 -- 172.21.15.59:0/254977967 shutdown_connections 2023-10-16T14:27:29.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.289+0000 7f0ef3809640 1 --2- 172.21.15.59:0/254977967 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0ed006aea0 0x7f0ed006d360 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:29.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.289+0000 7f0ef3809640 1 --2- 172.21.15.59:0/254977967 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0eec15f040 0x7f0eec157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:29.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.289+0000 7f0ef3809640 1 --2- 172.21.15.59:0/254977967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eec15ad00 0x7f0eec0acb40 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:29.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.289+0000 7f0ef3809640 1 --2- 172.21.15.59:0/254977967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0eec0b0010 0x7f0eec1f1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:29.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.289+0000 7f0ef3809640 1 -- 172.21.15.59:0/254977967 >> 172.21.15.59:0/254977967 conn(0x7f0eec06c1c0 msgr2=0x7f0eec0ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:29.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.289+0000 7f0ef3809640 1 -- 172.21.15.59:0/254977967 shutdown_connections 2023-10-16T14:27:29.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.289+0000 7f0ef3809640 1 -- 172.21.15.59:0/254977967 wait complete. 2023-10-16T14:27:29.313 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-16T14:25:35.938794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-16T14:27:29.313 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-16T14:27:29.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.536+0000 7f8fa0397640 1 Processor -- start 2023-10-16T14:27:29.540 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.536+0000 7f8fa0397640 1 -- start start 2023-10-16T14:27:29.541 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.538+0000 7f8fa0397640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8f98159890 0x7f8f98071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:29.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.538+0000 7f8fa0397640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8f980ca5a0 0x7f8f9815db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:29.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.538+0000 7f8fa0397640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f98072480 con 0x7f8f980ca110 2023-10-16T14:27:29.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.538+0000 7f8fa0397640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f980cd0c0 con 0x7f8f980ca5a0 2023-10-16T14:27:29.542 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.538+0000 7f8fa0397640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f980caa10 con 0x7f8f98159890 2023-10-16T14:27:29.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.538+0000 7f8f9d932640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8f980ca110 0x7f8f9815d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56552/0 (socket says 172.21.15.59:56552) 2023-10-16T14:27:29.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.538+0000 7f8f9d932640 1 -- 172.21.15.59:0/3552981136 learned_addr learned my addr 172.21.15.59:0/3552981136 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:29.544 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.538+0000 7f8f9e934640 1 --2- 172.21.15.59:0/3552981136 >> v2:172.21.15.59:3300/0 conn(0x7f8f980ca5a0 0x7f8f9815db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:29.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.539+0000 7f8f9e133640 1 --2- 172.21.15.59:0/3552981136 >> v2:172.21.15.151:3300/0 conn(0x7f8f98159890 0x7f8f98071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:29.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.539+0000 7f8f9d131640 1 -- 172.21.15.59:0/3552981136 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513699061 0 0) 0x7f8f98072480 con 0x7f8f980ca110 2023-10-16T14:27:29.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.539+0000 7f8f9d131640 1 -- 172.21.15.59:0/3552981136 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f84003520 con 0x7f8f980ca110 2023-10-16T14:27:29.545 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.539+0000 7f8f9e934640 1 -- 172.21.15.59:0/3552981136 >> v2:172.21.15.151:3300/0 conn(0x7f8f98159890 msgr2=0x7f8f98071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.539+0000 7f8f9e934640 1 --2- 172.21.15.59:0/3552981136 >> v2:172.21.15.151:3300/0 conn(0x7f8f98159890 0x7f8f98071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.539+0000 7f8f9e934640 1 -- 172.21.15.59:0/3552981136 >> v1:172.21.15.59:6789/0 conn(0x7f8f980ca110 legacy=0x7f8f9815d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.539+0000 7f8f9e934640 1 -- 172.21.15.59:0/3552981136 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f980cc540 con 0x7f8f980ca5a0 2023-10-16T14:27:29.546 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.540+0000 7f8f9e934640 1 --2- 172.21.15.59:0/3552981136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f980ca5a0 0x7f8f9815db00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8f9806e450 tx=0x7f8f9002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788d9c3fcfe5ae67 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:29.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.541+0000 7f8f9d131640 1 -- 172.21.15.59:0/3552981136 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f90031830 con 0x7f8f980ca5a0 2023-10-16T14:27:29.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.541+0000 7f8f9d131640 1 -- 172.21.15.59:0/3552981136 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f90031990 con 0x7f8f980ca5a0 2023-10-16T14:27:29.547 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.541+0000 7f8f9d131640 1 -- 172.21.15.59:0/3552981136 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f90031d20 con 0x7f8f980ca5a0 2023-10-16T14:27:29.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.541+0000 7f8fa0397640 1 -- 172.21.15.59:0/3552981136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f980ca5a0 msgr2=0x7f8f9815db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:29.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.541+0000 7f8fa0397640 1 --2- 172.21.15.59:0/3552981136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f980ca5a0 0x7f8f9815db00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8f9806e450 tx=0x7f8f9002b8d0 comp rx=0 tx=0).stop 2023-10-16T14:27:29.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.541+0000 7f8fa0397640 1 -- 172.21.15.59:0/3552981136 shutdown_connections 2023-10-16T14:27:29.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.541+0000 7f8fa0397640 1 --2- 172.21.15.59:0/3552981136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f980ca5a0 0x7f8f9815db00 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:29.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.541+0000 7f8fa0397640 1 --2- 172.21.15.59:0/3552981136 >> v2:172.21.15.151:3300/0 conn(0x7f8f98159890 0x7f8f98071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:29.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.541+0000 7f8fa0397640 1 -- 172.21.15.59:0/3552981136 >> 172.21.15.59:0/3552981136 conn(0x7f8f980b0030 msgr2=0x7f8f980b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:29.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.541+0000 7f8fa0397640 1 -- 172.21.15.59:0/3552981136 shutdown_connections 2023-10-16T14:27:29.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.542+0000 7f8fa0397640 1 -- 172.21.15.59:0/3552981136 wait complete. 2023-10-16T14:27:29.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.543+0000 7f8fa0397640 1 Processor -- start 2023-10-16T14:27:29.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.544+0000 7f8fa0397640 1 -- start start 2023-10-16T14:27:29.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.545+0000 7f8fa0397640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f980ca110 0x7f8f980ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:29.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.545+0000 7f8fa0397640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f980ca5a0 0x7f8f981f4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:29.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.545+0000 7f8fa0397640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f98159890 0x7f8f980ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:29.552 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.545+0000 7f8fa0397640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f98157150 con 0x7f8f980ca110 2023-10-16T14:27:29.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.545+0000 7f8fa0397640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f981560b0 con 0x7f8f98159890 2023-10-16T14:27:29.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.545+0000 7f8fa0397640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f98156390 con 0x7f8f980ca5a0 2023-10-16T14:27:29.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.545+0000 7f8f9e133640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f980ca110 0x7f8f980ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:29.553 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.545+0000 7f8f9e133640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f980ca110 0x7f8f980ac270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45264/0 (socket says 172.21.15.59:45264) 2023-10-16T14:27:29.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.545+0000 7f8f9e133640 1 -- 172.21.15.59:0/3144135003 learned_addr learned my addr 172.21.15.59:0/3144135003 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:29.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.545+0000 7f8f9e133640 1 -- 172.21.15.59:0/3144135003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f980ca5a0 msgr2=0x7f8f981f4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:29.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.545+0000 7f8f9e133640 1 --2- 172.21.15.59:0/3144135003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f980ca5a0 0x7f8f981f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:29.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.545+0000 7f8f9e133640 1 -- 172.21.15.59:0/3144135003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f98159890 msgr2=0x7f8f980ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:29.554 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.545+0000 7f8f9e133640 1 --2- 172.21.15.59:0/3144135003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f98159890 0x7f8f980ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:29.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.545+0000 7f8f9e133640 1 -- 172.21.15.59:0/3144135003 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f90009400 con 0x7f8f980ca110 2023-10-16T14:27:29.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.546+0000 7f8f9e133640 1 --2- 172.21.15.59:0/3144135003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f980ca110 0x7f8f980ac270 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400efc0 tx=0x7f8f9400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:29.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.546+0000 7f8f8effd640 1 -- 172.21.15.59:0/3144135003 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f94014480 con 0x7f8f980ca110 2023-10-16T14:27:29.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.546+0000 7f8f8effd640 1 -- 172.21.15.59:0/3144135003 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9400f040 con 0x7f8f980ca110 2023-10-16T14:27:29.555 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.546+0000 7f8f8effd640 1 -- 172.21.15.59:0/3144135003 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f94014800 con 0x7f8f980ca110 2023-10-16T14:27:29.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.546+0000 7f8fa0397640 1 -- 172.21.15.59:0/3144135003 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f98156670 con 0x7f8f980ca110 2023-10-16T14:27:29.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.546+0000 7f8fa0397640 1 -- 172.21.15.59:0/3144135003 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f98156c30 con 0x7f8f980ca110 2023-10-16T14:27:29.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.547+0000 7f8fa0397640 1 -- 172.21.15.59:0/3144135003 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f98073ef0 con 0x7f8f980ca110 2023-10-16T14:27:29.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.548+0000 7f8f8effd640 1 -- 172.21.15.59:0/3144135003 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8f94014960 con 0x7f8f980ca110 2023-10-16T14:27:29.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.549+0000 7f8f8effd640 1 --2- 172.21.15.59:0/3144135003 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8f7c06ae70 0x7f8f7c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:29.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.549+0000 7f8f8effd640 1 -- 172.21.15.59:0/3144135003 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8f9408a2d0 con 0x7f8f980ca110 2023-10-16T14:27:29.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.550+0000 7f8f9d932640 1 --2- 172.21.15.59:0/3144135003 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8f7c06ae70 0x7f8f7c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:29.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.551+0000 7f8f9d932640 1 --2- 172.21.15.59:0/3144135003 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8f7c06ae70 0x7f8f7c06d330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8f980c8b00 tx=0x7f8f88007930 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:29.559 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.554+0000 7f8f8effd640 1 -- 172.21.15.59:0/3144135003 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8f94055580 con 0x7f8f980ca110 2023-10-16T14:27:29.747 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.744+0000 7f8fa0397640 1 -- 172.21.15.59:0/3144135003 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8f980ccad0 con 0x7f8f980ca110 2023-10-16T14:27:29.748 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.745+0000 7f8f8effd640 1 -- 172.21.15.59:0/3144135003 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8f94058ba0 con 0x7f8f980ca110 2023-10-16T14:27:29.748 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2023-10-16T14:27:29.751 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.747+0000 7f8fa0397640 1 -- 172.21.15.59:0/3144135003 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8f7c06ae70 msgr2=0x7f8f7c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:29.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.747+0000 7f8fa0397640 1 --2- 172.21.15.59:0/3144135003 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8f7c06ae70 0x7f8f7c06d330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8f980c8b00 tx=0x7f8f88007930 comp rx=0 tx=0).stop 2023-10-16T14:27:29.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.747+0000 7f8fa0397640 1 -- 172.21.15.59:0/3144135003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f980ca110 msgr2=0x7f8f980ac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:29.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.747+0000 7f8fa0397640 1 --2- 172.21.15.59:0/3144135003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f980ca110 0x7f8f980ac270 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8f9400efc0 tx=0x7f8f9400c490 comp rx=0 tx=0).stop 2023-10-16T14:27:29.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.748+0000 7f8fa0397640 1 -- 172.21.15.59:0/3144135003 shutdown_connections 2023-10-16T14:27:29.752 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.748+0000 7f8fa0397640 1 --2- 172.21.15.59:0/3144135003 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8f7c06ae70 0x7f8f7c06d330 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:29.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.748+0000 7f8fa0397640 1 --2- 172.21.15.59:0/3144135003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f98159890 0x7f8f980ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:29.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.748+0000 7f8fa0397640 1 --2- 172.21.15.59:0/3144135003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f980ca5a0 0x7f8f981f4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:29.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.748+0000 7f8fa0397640 1 --2- 172.21.15.59:0/3144135003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f980ca110 0x7f8f980ac270 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:29.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.748+0000 7f8fa0397640 1 -- 172.21.15.59:0/3144135003 >> 172.21.15.59:0/3144135003 conn(0x7f8f980b0030 msgr2=0x7f8f980c8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:29.753 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.748+0000 7f8fa0397640 1 -- 172.21.15.59:0/3144135003 shutdown_connections 2023-10-16T14:27:29.754 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.748+0000 7f8fa0397640 1 -- 172.21.15.59:0/3144135003 wait complete. 2023-10-16T14:27:29.769 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-16T14:27:29.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.994+0000 7f8efcc4e640 1 Processor -- start 2023-10-16T14:27:29.998 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.994+0000 7f8efcc4e640 1 -- start start 2023-10-16T14:27:29.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.996+0000 7f8efcc4e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8ef80cb250 0x7f8ef80c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:29.999 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.996+0000 7f8efcc4e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef80ca660 0x7f8ef80c9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:30.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.996+0000 7f8efcc4e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef815acb0 con 0x7f8ef815a8d0 2023-10-16T14:27:30.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.996+0000 7f8efcc4e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef80c1c60 con 0x7f8ef80cb250 2023-10-16T14:27:30.000 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.996+0000 7f8efcc4e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef815e350 con 0x7f8ef80ca660 2023-10-16T14:27:30.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.997+0000 7f8ef6ffd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8ef80cb250 0x7f8ef80c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:30.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.997+0000 7f8ef7fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef80ca660 0x7f8ef80c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:30.001 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.997+0000 7f8ef77fe640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f8ef815a8d0 0x7f8ef80cab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.59:47744/0 (socket says 172.21.15.59:47744) 2023-10-16T14:27:30.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.997+0000 7f8ef77fe640 1 -- 172.21.15.59:0/1834519976 learned_addr learned my addr 172.21.15.59:0/1834519976 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:30.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.997+0000 7f8ef6ffd640 1 -- 172.21.15.59:0/1834519976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef80ca660 msgr2=0x7f8ef80c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:30.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.997+0000 7f8ef6ffd640 1 --2- 172.21.15.59:0/1834519976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef80ca660 0x7f8ef80c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:30.002 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.997+0000 7f8ef6ffd640 1 -- 172.21.15.59:0/1834519976 >> v1:172.21.15.151:6789/0 conn(0x7f8ef815a8d0 legacy=0x7f8ef80cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:30.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.997+0000 7f8ef6ffd640 1 -- 172.21.15.59:0/1834519976 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef815e630 con 0x7f8ef80cb250 2023-10-16T14:27:30.003 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.999+0000 7f8ef6ffd640 1 --2- 172.21.15.59:0/1834519976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ef80cb250 0x7f8ef80c8e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0097a0 tx=0x7f8eec02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=120040c755392449 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.999+0000 7f8ef67fc640 1 -- 172.21.15.59:0/1834519976 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec031830 con 0x7f8ef80cb250 2023-10-16T14:27:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.999+0000 7f8ef67fc640 1 -- 172.21.15.59:0/1834519976 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec031990 con 0x7f8ef80cb250 2023-10-16T14:27:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:29.999+0000 7f8ef67fc640 1 -- 172.21.15.59:0/1834519976 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec031d20 con 0x7f8ef80cb250 2023-10-16T14:27:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.000+0000 7f8efcc4e640 1 -- 172.21.15.59:0/1834519976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ef80cb250 msgr2=0x7f8ef80c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.000+0000 7f8efcc4e640 1 --2- 172.21.15.59:0/1834519976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ef80cb250 0x7f8ef80c8e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8eec0097a0 tx=0x7f8eec02b8d0 comp rx=0 tx=0).stop 2023-10-16T14:27:30.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.001+0000 7f8efcc4e640 1 -- 172.21.15.59:0/1834519976 shutdown_connections 2023-10-16T14:27:30.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.001+0000 7f8efcc4e640 1 --2- 172.21.15.59:0/1834519976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef80ca660 0x7f8ef80c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:30.005 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.001+0000 7f8efcc4e640 1 --2- 172.21.15.59:0/1834519976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ef80cb250 0x7f8ef80c8e10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:30.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.001+0000 7f8efcc4e640 1 -- 172.21.15.59:0/1834519976 >> 172.21.15.59:0/1834519976 conn(0x7f8ef806a470 msgr2=0x7f8ef80afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:30.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.001+0000 7f8efcc4e640 1 -- 172.21.15.59:0/1834519976 shutdown_connections 2023-10-16T14:27:30.006 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.001+0000 7f8efcc4e640 1 -- 172.21.15.59:0/1834519976 wait complete. 2023-10-16T14:27:30.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.003+0000 7f8efcc4e640 1 Processor -- start 2023-10-16T14:27:30.007 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.003+0000 7f8efcc4e640 1 -- start start 2023-10-16T14:27:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.004+0000 7f8efcc4e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef80ca660 0x7f8ef81465b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.004+0000 7f8efcc4e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef80cb250 0x7f8ef80ac220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.004+0000 7f8efcc4e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ef815a8d0 0x7f8ef8144500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.004+0000 7f8efcc4e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef8147070 con 0x7f8ef80ca660 2023-10-16T14:27:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.004+0000 7f8efcc4e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef8147350 con 0x7f8ef815a8d0 2023-10-16T14:27:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.004+0000 7f8efcc4e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef80aba20 con 0x7f8ef80cb250 2023-10-16T14:27:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.005+0000 7f8ef77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef80ca660 0x7f8ef81465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.005+0000 7f8ef77fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef80ca660 0x7f8ef81465b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45274/0 (socket says 172.21.15.59:45274) 2023-10-16T14:27:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.005+0000 7f8ef77fe640 1 -- 172.21.15.59:0/3829176604 learned_addr learned my addr 172.21.15.59:0/3829176604 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.005+0000 7f8ef7fff640 1 --2- 172.21.15.59:0/3829176604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ef815a8d0 0x7f8ef8144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.005+0000 7f8ef6ffd640 1 --2- 172.21.15.59:0/3829176604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef80cb250 0x7f8ef80ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.005+0000 7f8ef77fe640 1 -- 172.21.15.59:0/3829176604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef80cb250 msgr2=0x7f8ef80ac220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.005+0000 7f8ef77fe640 1 --2- 172.21.15.59:0/3829176604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef80cb250 0x7f8ef80ac220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.005+0000 7f8ef77fe640 1 -- 172.21.15.59:0/3829176604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ef815a8d0 msgr2=0x7f8ef8144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.005+0000 7f8ef77fe640 1 --2- 172.21.15.59:0/3829176604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ef815a8d0 0x7f8ef8144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.005+0000 7f8ef77fe640 1 -- 172.21.15.59:0/3829176604 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eec009400 con 0x7f8ef80ca660 2023-10-16T14:27:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.006+0000 7f8ef77fe640 1 --2- 172.21.15.59:0/3829176604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef80ca660 0x7f8ef81465b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800c430 tx=0x7f8ee800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.006+0000 7f8edffff640 1 -- 172.21.15.59:0/3829176604 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8005d30 con 0x7f8ef80ca660 2023-10-16T14:27:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.006+0000 7f8edffff640 1 -- 172.21.15.59:0/3829176604 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee8005e90 con 0x7f8ef80ca660 2023-10-16T14:27:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.006+0000 7f8efcc4e640 1 -- 172.21.15.59:0/3829176604 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef80abd00 con 0x7f8ef80ca660 2023-10-16T14:27:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.006+0000 7f8edffff640 1 -- 172.21.15.59:0/3829176604 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee80072d0 con 0x7f8ef80ca660 2023-10-16T14:27:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.006+0000 7f8efcc4e640 1 -- 172.21.15.59:0/3829176604 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef8146af0 con 0x7f8ef80ca660 2023-10-16T14:27:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.007+0000 7f8efcc4e640 1 -- 172.21.15.59:0/3829176604 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef80ab860 con 0x7f8ef80ca660 2023-10-16T14:27:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.008+0000 7f8edffff640 1 -- 172.21.15.59:0/3829176604 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8ee80074f0 con 0x7f8ef80ca660 2023-10-16T14:27:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.011+0000 7f8edffff640 1 --2- 172.21.15.59:0/3829176604 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8ee406ae70 0x7f8ee406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.011+0000 7f8edffff640 1 -- 172.21.15.59:0/3829176604 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8ee8088840 con 0x7f8ef80ca660 2023-10-16T14:27:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.011+0000 7f8ef6ffd640 1 --2- 172.21.15.59:0/3829176604 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8ee406ae70 0x7f8ee406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.012+0000 7f8ef6ffd640 1 --2- 172.21.15.59:0/3829176604 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8ee406ae70 0x7f8ee406d330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8eec036000 tx=0x7f8eec03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:30.021 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.017+0000 7f8edffff640 1 -- 172.21.15.59:0/3829176604 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8ee8053af0 con 0x7f8ef80ca660 2023-10-16T14:27:30.221 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.218+0000 7f8efcc4e640 1 -- 172.21.15.59:0/3829176604 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8ef815acb0 con 0x7f8ef80ca660 2023-10-16T14:27:30.222 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.219+0000 7f8edffff640 1 -- 172.21.15.59:0/3829176604 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8ee8017060 con 0x7f8ef80ca660 2023-10-16T14:27:30.223 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:30.223 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2023-10-16T14:27:30.223 INFO:teuthology.orchestra.run.smithi059.stdout: { 2023-10-16T14:27:30.223 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2023-10-16T14:27:30.223 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2023-10-16T14:27:30.224 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:30.224 INFO:teuthology.orchestra.run.smithi059.stdout:] 2023-10-16T14:27:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.221+0000 7f8efcc4e640 1 -- 172.21.15.59:0/3829176604 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8ee406ae70 msgr2=0x7f8ee406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.221+0000 7f8efcc4e640 1 --2- 172.21.15.59:0/3829176604 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8ee406ae70 0x7f8ee406d330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8eec036000 tx=0x7f8eec03c040 comp rx=0 tx=0).stop 2023-10-16T14:27:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.221+0000 7f8efcc4e640 1 -- 172.21.15.59:0/3829176604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef80ca660 msgr2=0x7f8ef81465b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.221+0000 7f8efcc4e640 1 --2- 172.21.15.59:0/3829176604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef80ca660 0x7f8ef81465b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800c430 tx=0x7f8ee800c8f0 comp rx=0 tx=0).stop 2023-10-16T14:27:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.221+0000 7f8efcc4e640 1 -- 172.21.15.59:0/3829176604 shutdown_connections 2023-10-16T14:27:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.221+0000 7f8efcc4e640 1 --2- 172.21.15.59:0/3829176604 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f8ee406ae70 0x7f8ee406d330 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.221+0000 7f8efcc4e640 1 --2- 172.21.15.59:0/3829176604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ef815a8d0 0x7f8ef8144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.221+0000 7f8efcc4e640 1 --2- 172.21.15.59:0/3829176604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef80cb250 0x7f8ef80ac220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.221+0000 7f8efcc4e640 1 --2- 172.21.15.59:0/3829176604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef80ca660 0x7f8ef81465b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.222+0000 7f8efcc4e640 1 -- 172.21.15.59:0/3829176604 >> 172.21.15.59:0/3829176604 conn(0x7f8ef806a470 msgr2=0x7f8ef80af170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.222+0000 7f8efcc4e640 1 -- 172.21.15.59:0/3829176604 shutdown_connections 2023-10-16T14:27:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.222+0000 7f8efcc4e640 1 -- 172.21.15.59:0/3829176604 wait complete. 2023-10-16T14:27:30.245 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-16T14:27:30.246 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-16T14:27:30.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.473+0000 7f3cdb516640 1 Processor -- start 2023-10-16T14:27:30.477 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.473+0000 7f3cdb516640 1 -- start start 2023-10-16T14:27:30.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.475+0000 7f3cdb516640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cd40aff50 0x7f3cd40b0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:30.478 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.475+0000 7f3cdb516640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3cd415ab30 0x7f3cd40c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:30.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.475+0000 7f3cdb516640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd40b0870 con 0x7f3cd415e440 2023-10-16T14:27:30.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.475+0000 7f3cdb516640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd40c9660 con 0x7f3cd415ab30 2023-10-16T14:27:30.479 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.475+0000 7f3cdb516640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd415ee20 con 0x7f3cd40aff50 2023-10-16T14:27:30.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.475+0000 7f3cd8ab1640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3cd415ab30 0x7f3cd40c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:30.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.475+0000 7f3cd9ab3640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3cd415e440 0x7f3cd40b1320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56568/0 (socket says 172.21.15.59:56568) 2023-10-16T14:27:30.481 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.475+0000 7f3cd9ab3640 1 -- 172.21.15.59:0/1711864144 learned_addr learned my addr 172.21.15.59:0/1711864144 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:30.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.476+0000 7f3cd92b2640 1 --2- 172.21.15.59:0/1711864144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cd40aff50 0x7f3cd40b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:30.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.476+0000 7f3ccbfff640 1 -- 172.21.15.59:0/1711864144 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928091465 0 0) 0x7f3cd40b0870 con 0x7f3cd415e440 2023-10-16T14:27:30.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.476+0000 7f3ccbfff640 1 -- 172.21.15.59:0/1711864144 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cc0003520 con 0x7f3cd415e440 2023-10-16T14:27:30.482 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.476+0000 7f3cd8ab1640 1 -- 172.21.15.59:0/1711864144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cd40aff50 msgr2=0x7f3cd40b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:30.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.476+0000 7f3cd8ab1640 1 --2- 172.21.15.59:0/1711864144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cd40aff50 0x7f3cd40b0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:30.483 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.476+0000 7f3cd8ab1640 1 -- 172.21.15.59:0/1711864144 >> v1:172.21.15.59:6789/0 conn(0x7f3cd415e440 legacy=0x7f3cd40b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:30.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.476+0000 7f3cd8ab1640 1 -- 172.21.15.59:0/1711864144 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd415f100 con 0x7f3cd415ab30 2023-10-16T14:27:30.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.477+0000 7f3cd8ab1640 1 --2- 172.21.15.59:0/1711864144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd415ab30 0x7f3cd40c9a80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40097a0 tx=0x7f3cc402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41724753e589a25d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:30.484 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.477+0000 7f3ccbfff640 1 -- 172.21.15.59:0/1711864144 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc402d040 con 0x7f3cd415ab30 2023-10-16T14:27:30.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.477+0000 7f3ccbfff640 1 -- 172.21.15.59:0/1711864144 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc4031810 con 0x7f3cd415ab30 2023-10-16T14:27:30.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.477+0000 7f3ccbfff640 1 -- 172.21.15.59:0/1711864144 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4031b80 con 0x7f3cd415ab30 2023-10-16T14:27:30.487 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.478+0000 7f3cdb516640 1 -- 172.21.15.59:0/1711864144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd415ab30 msgr2=0x7f3cd40c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:30.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.478+0000 7f3cdb516640 1 --2- 172.21.15.59:0/1711864144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd415ab30 0x7f3cd40c9a80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40097a0 tx=0x7f3cc402b8b0 comp rx=0 tx=0).stop 2023-10-16T14:27:30.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.478+0000 7f3cdb516640 1 -- 172.21.15.59:0/1711864144 shutdown_connections 2023-10-16T14:27:30.488 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.478+0000 7f3cdb516640 1 --2- 172.21.15.59:0/1711864144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd415ab30 0x7f3cd40c9a80 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:30.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.478+0000 7f3cdb516640 1 --2- 172.21.15.59:0/1711864144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cd40aff50 0x7f3cd40b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:30.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.478+0000 7f3cdb516640 1 -- 172.21.15.59:0/1711864144 >> 172.21.15.59:0/1711864144 conn(0x7f3cd406c190 msgr2=0x7f3cd406c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:30.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.478+0000 7f3cdb516640 1 -- 172.21.15.59:0/1711864144 shutdown_connections 2023-10-16T14:27:30.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.478+0000 7f3cdb516640 1 -- 172.21.15.59:0/1711864144 wait complete. 2023-10-16T14:27:30.489 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.480+0000 7f3cdb516640 1 Processor -- start 2023-10-16T14:27:30.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.480+0000 7f3cdb516640 1 -- start start 2023-10-16T14:27:30.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.481+0000 7f3cdb516640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cd40aff50 0x7f3cd414f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:30.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.481+0000 7f3cdb516640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cd415ab30 0x7f3cd415d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:30.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.481+0000 7f3cdb516640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd415e440 0x7f3cd40cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:30.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.481+0000 7f3cdb516640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd415dfe0 con 0x7f3cd415e440 2023-10-16T14:27:30.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.481+0000 7f3cdb516640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd41f20b0 con 0x7f3cd415ab30 2023-10-16T14:27:30.491 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.481+0000 7f3cdb516640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd41f66f0 con 0x7f3cd40aff50 2023-10-16T14:27:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.482+0000 7f3cd9ab3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd415e440 0x7f3cd40cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.482+0000 7f3cd9ab3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd415e440 0x7f3cd40cc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45296/0 (socket says 172.21.15.59:45296) 2023-10-16T14:27:30.492 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.482+0000 7f3cd9ab3640 1 -- 172.21.15.59:0/1175989588 learned_addr learned my addr 172.21.15.59:0/1175989588 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:30.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.482+0000 7f3cd92b2640 1 --2- 172.21.15.59:0/1175989588 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cd40aff50 0x7f3cd414f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:30.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.482+0000 7f3cd8ab1640 1 --2- 172.21.15.59:0/1175989588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cd415ab30 0x7f3cd415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:30.493 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.482+0000 7f3cd9ab3640 1 -- 172.21.15.59:0/1175989588 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cd40aff50 msgr2=0x7f3cd414f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:30.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.482+0000 7f3cd9ab3640 1 --2- 172.21.15.59:0/1175989588 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cd40aff50 0x7f3cd414f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:30.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.482+0000 7f3cd9ab3640 1 -- 172.21.15.59:0/1175989588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cd415ab30 msgr2=0x7f3cd415d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:30.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.482+0000 7f3cd9ab3640 1 --2- 172.21.15.59:0/1175989588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cd415ab30 0x7f3cd415d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:30.494 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.482+0000 7f3cd9ab3640 1 -- 172.21.15.59:0/1175989588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc4009400 con 0x7f3cd415e440 2023-10-16T14:27:30.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.482+0000 7f3cd9ab3640 1 --2- 172.21.15.59:0/1175989588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd415e440 0x7f3cd40cc0a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00cad0 tx=0x7f3ccc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:30.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.483+0000 7f3cc9ffb640 1 -- 172.21.15.59:0/1175989588 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc00ac30 con 0x7f3cd415e440 2023-10-16T14:27:30.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.483+0000 7f3cc9ffb640 1 -- 172.21.15.59:0/1175989588 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ccc00ad90 con 0x7f3cd415e440 2023-10-16T14:27:30.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.483+0000 7f3cc9ffb640 1 -- 172.21.15.59:0/1175989588 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc012620 con 0x7f3cd415e440 2023-10-16T14:27:30.495 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.483+0000 7f3cdb516640 1 -- 172.21.15.59:0/1175989588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd414fa90 con 0x7f3cd415e440 2023-10-16T14:27:30.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.483+0000 7f3cdb516640 1 -- 172.21.15.59:0/1175989588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd41f5930 con 0x7f3cd415e440 2023-10-16T14:27:30.496 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.484+0000 7f3cdb516640 1 -- 172.21.15.59:0/1175989588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd4073ef0 con 0x7f3cd415e440 2023-10-16T14:27:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.485+0000 7f3cc9ffb640 1 -- 172.21.15.59:0/1175989588 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3ccc007070 con 0x7f3cd415e440 2023-10-16T14:27:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.486+0000 7f3cc9ffb640 1 --2- 172.21.15.59:0/1175989588 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f3cb806ae70 0x7f3cb806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:30.498 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.486+0000 7f3cc9ffb640 1 -- 172.21.15.59:0/1175989588 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f3ccc089490 con 0x7f3cd415e440 2023-10-16T14:27:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.487+0000 7f3cd92b2640 1 --2- 172.21.15.59:0/1175989588 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f3cb806ae70 0x7f3cb806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.488+0000 7f3cd92b2640 1 --2- 172.21.15.59:0/1175989588 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f3cb806ae70 0x7f3cb806d330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0006fd0 tx=0x7f3cd0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:30.499 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.490+0000 7f3cc9ffb640 1 -- 172.21.15.59:0/1175989588 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3ccc0546b0 con 0x7f3cd415e440 2023-10-16T14:27:30.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:30.682+0000 7f3cdb516640 1 -- 172.21.15.59:0/1175989588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3cd4158880 con 0x7f3cd415e440 2023-10-16T14:27:31.035 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.032+0000 7f3cc9ffb640 1 -- 172.21.15.59:0/1175989588 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3ccc057cd0 con 0x7f3cd415e440 2023-10-16T14:27:31.036 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2023-10-16T14:27:31.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.036+0000 7f3cdb516640 1 -- 172.21.15.59:0/1175989588 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f3cb806ae70 msgr2=0x7f3cb806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:31.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.036+0000 7f3cdb516640 1 --2- 172.21.15.59:0/1175989588 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f3cb806ae70 0x7f3cb806d330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0006fd0 tx=0x7f3cd0008040 comp rx=0 tx=0).stop 2023-10-16T14:27:31.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.036+0000 7f3cdb516640 1 -- 172.21.15.59:0/1175989588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd415e440 msgr2=0x7f3cd40cc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:31.040 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.036+0000 7f3cdb516640 1 --2- 172.21.15.59:0/1175989588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd415e440 0x7f3cd40cc0a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00cad0 tx=0x7f3ccc00cf90 comp rx=0 tx=0).stop 2023-10-16T14:27:31.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.037+0000 7f3cdb516640 1 -- 172.21.15.59:0/1175989588 shutdown_connections 2023-10-16T14:27:31.041 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.037+0000 7f3cdb516640 1 --2- 172.21.15.59:0/1175989588 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f3cb806ae70 0x7f3cb806d330 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:31.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.037+0000 7f3cdb516640 1 --2- 172.21.15.59:0/1175989588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd415e440 0x7f3cd40cc0a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:31.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.037+0000 7f3cdb516640 1 --2- 172.21.15.59:0/1175989588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cd415ab30 0x7f3cd415d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:31.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.037+0000 7f3cdb516640 1 --2- 172.21.15.59:0/1175989588 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cd40aff50 0x7f3cd414f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:31.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.037+0000 7f3cdb516640 1 -- 172.21.15.59:0/1175989588 >> 172.21.15.59:0/1175989588 conn(0x7f3cd406c190 msgr2=0x7f3cd4159e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:31.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.037+0000 7f3cdb516640 1 -- 172.21.15.59:0/1175989588 shutdown_connections 2023-10-16T14:27:31.043 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.037+0000 7f3cdb516640 1 -- 172.21.15.59:0/1175989588 wait complete. 2023-10-16T14:27:31.067 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-16T14:27:31.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.276+0000 7fc5f5cbb640 1 Processor -- start 2023-10-16T14:27:31.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.277+0000 7fc5f5cbb640 1 -- start start 2023-10-16T14:27:31.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.278+0000 7fc5f5cbb640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc5f01599e0 0x7fc5f006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:31.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.278+0000 7fc5f5cbb640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc5f00ce1a0 0x7fc5f00708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:31.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.278+0000 7fc5f5cbb640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f015e140 con 0x7fc5f0159600 2023-10-16T14:27:31.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.278+0000 7fc5f5cbb640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f006d370 con 0x7fc5f01599e0 2023-10-16T14:27:31.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.278+0000 7fc5f5cbb640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f00cebd0 con 0x7fc5f00ce1a0 2023-10-16T14:27:31.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.279+0000 7fc5ef7fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc5f0159600 0x7fc5f015da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:56574/0 (socket says 172.21.15.59:56574) 2023-10-16T14:27:31.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.279+0000 7fc5ef7fe640 1 -- 172.21.15.59:0/527042742 learned_addr learned my addr 172.21.15.59:0/527042742 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:31.285 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.279+0000 7fc5eeffd640 1 --2- 172.21.15.59:0/527042742 >> v2:172.21.15.59:3300/0 conn(0x7fc5f01599e0 0x7fc5f006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:31.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.279+0000 7fc5effff640 1 --2- 172.21.15.59:0/527042742 >> v2:172.21.15.151:3300/0 conn(0x7fc5f00ce1a0 0x7fc5f00708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:31.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.279+0000 7fc5ee7fc640 1 -- 172.21.15.59:0/527042742 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139947429 0 0) 0x7fc5f015e140 con 0x7fc5f0159600 2023-10-16T14:27:31.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.279+0000 7fc5ee7fc640 1 -- 172.21.15.59:0/527042742 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5dc005730 con 0x7fc5f0159600 2023-10-16T14:27:31.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.280+0000 7fc5eeffd640 1 -- 172.21.15.59:0/527042742 >> v2:172.21.15.151:3300/0 conn(0x7fc5f00ce1a0 msgr2=0x7fc5f00708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:31.286 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.280+0000 7fc5eeffd640 1 --2- 172.21.15.59:0/527042742 >> v2:172.21.15.151:3300/0 conn(0x7fc5f00ce1a0 0x7fc5f00708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:31.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.280+0000 7fc5eeffd640 1 -- 172.21.15.59:0/527042742 >> v1:172.21.15.59:6789/0 conn(0x7fc5f0159600 legacy=0x7fc5f015da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:31.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.280+0000 7fc5eeffd640 1 -- 172.21.15.59:0/527042742 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f006cad0 con 0x7fc5f01599e0 2023-10-16T14:27:31.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.281+0000 7fc5eeffd640 1 --2- 172.21.15.59:0/527042742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f01599e0 0x7fc5f006c4f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00c8f70 tx=0x7fc5d802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52dbb0465eb621e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:31.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.281+0000 7fc5ee7fc640 1 -- 172.21.15.59:0/527042742 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d802e070 con 0x7fc5f01599e0 2023-10-16T14:27:31.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.281+0000 7fc5ee7fc640 1 -- 172.21.15.59:0/527042742 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d80315a0 con 0x7fc5f01599e0 2023-10-16T14:27:31.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.281+0000 7fc5ee7fc640 1 -- 172.21.15.59:0/527042742 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8031930 con 0x7fc5f01599e0 2023-10-16T14:27:31.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.282+0000 7fc5f5cbb640 1 -- 172.21.15.59:0/527042742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f01599e0 msgr2=0x7fc5f006c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:31.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.282+0000 7fc5f5cbb640 1 --2- 172.21.15.59:0/527042742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f01599e0 0x7fc5f006c4f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00c8f70 tx=0x7fc5d802b840 comp rx=0 tx=0).stop 2023-10-16T14:27:31.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.282+0000 7fc5f5cbb640 1 -- 172.21.15.59:0/527042742 shutdown_connections 2023-10-16T14:27:31.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.282+0000 7fc5f5cbb640 1 --2- 172.21.15.59:0/527042742 >> v2:172.21.15.151:3300/0 conn(0x7fc5f00ce1a0 0x7fc5f00708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:31.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.282+0000 7fc5f5cbb640 1 --2- 172.21.15.59:0/527042742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f01599e0 0x7fc5f006c4f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:31.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.282+0000 7fc5f5cbb640 1 -- 172.21.15.59:0/527042742 >> 172.21.15.59:0/527042742 conn(0x7fc5f00660e0 msgr2=0x7fc5f0069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:31.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.282+0000 7fc5f5cbb640 1 -- 172.21.15.59:0/527042742 shutdown_connections 2023-10-16T14:27:31.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.282+0000 7fc5f5cbb640 1 -- 172.21.15.59:0/527042742 wait complete. 2023-10-16T14:27:31.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.284+0000 7fc5f5cbb640 1 Processor -- start 2023-10-16T14:27:31.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.284+0000 7fc5f5cbb640 1 -- start start 2023-10-16T14:27:31.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.285+0000 7fc5f5cbb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f00ce1a0 0x7fc5f0151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:31.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.285+0000 7fc5f5cbb640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f0159600 0x7fc5f00c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:31.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.285+0000 7fc5f5cbb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f01599e0 0x7fc5f00cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:31.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.285+0000 7fc5f5cbb640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f00c7eb0 con 0x7fc5f0159600 2023-10-16T14:27:31.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.285+0000 7fc5f5cbb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f00c8190 con 0x7fc5f01599e0 2023-10-16T14:27:31.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.285+0000 7fc5f5cbb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f00c8470 con 0x7fc5f00ce1a0 2023-10-16T14:27:31.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.285+0000 7fc5eeffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f0159600 0x7fc5f00c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:31.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.285+0000 7fc5eeffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f0159600 0x7fc5f00c7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45320/0 (socket says 172.21.15.59:45320) 2023-10-16T14:27:31.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.285+0000 7fc5eeffd640 1 -- 172.21.15.59:0/2842002519 learned_addr learned my addr 172.21.15.59:0/2842002519 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:31.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.286+0000 7fc5effff640 1 --2- 172.21.15.59:0/2842002519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f01599e0 0x7fc5f00cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:31.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.286+0000 7fc5eeffd640 1 -- 172.21.15.59:0/2842002519 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f00ce1a0 msgr2=0x7fc5f0151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:31.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.286+0000 7fc5eeffd640 1 --2- 172.21.15.59:0/2842002519 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f00ce1a0 0x7fc5f0151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:31.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.286+0000 7fc5eeffd640 1 -- 172.21.15.59:0/2842002519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f01599e0 msgr2=0x7fc5f00cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:31.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.286+0000 7fc5eeffd640 1 --2- 172.21.15.59:0/2842002519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f01599e0 0x7fc5f00cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:31.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.286+0000 7fc5eeffd640 1 -- 172.21.15.59:0/2842002519 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d8009400 con 0x7fc5f0159600 2023-10-16T14:27:31.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.286+0000 7fc5effff640 1 --2- 172.21.15.59:0/2842002519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f01599e0 0x7fc5f00cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:31.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.286+0000 7fc5eeffd640 1 --2- 172.21.15.59:0/2842002519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f0159600 0x7fc5f00c7680 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009890 tx=0x7fc5d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:31.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.286+0000 7fc5e7fff640 1 -- 172.21.15.59:0/2842002519 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8032840 con 0x7fc5f0159600 2023-10-16T14:27:31.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.286+0000 7fc5e7fff640 1 -- 172.21.15.59:0/2842002519 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d8031f00 con 0x7fc5f0159600 2023-10-16T14:27:31.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.287+0000 7fc5e7fff640 1 -- 172.21.15.59:0/2842002519 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8032be0 con 0x7fc5f0159600 2023-10-16T14:27:31.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.287+0000 7fc5f5cbb640 1 -- 172.21.15.59:0/2842002519 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f00c8750 con 0x7fc5f0159600 2023-10-16T14:27:31.295 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.287+0000 7fc5f5cbb640 1 -- 172.21.15.59:0/2842002519 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f00c7bc0 con 0x7fc5f0159600 2023-10-16T14:27:31.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.288+0000 7fc5f5cbb640 1 -- 172.21.15.59:0/2842002519 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f0073ef0 con 0x7fc5f0159600 2023-10-16T14:27:31.296 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.289+0000 7fc5e7fff640 1 -- 172.21.15.59:0/2842002519 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc5d8032d40 con 0x7fc5f0159600 2023-10-16T14:27:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.290+0000 7fc5e7fff640 1 --2- 172.21.15.59:0/2842002519 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc5d006aec0 0x7fc5d006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.290+0000 7fc5e7fff640 1 -- 172.21.15.59:0/2842002519 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5547+0+0 (secure 0 0 0) 0x7fc5d80ab3b0 con 0x7fc5f0159600 2023-10-16T14:27:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.291+0000 7fc5ef7fe640 1 --2- 172.21.15.59:0/2842002519 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc5d006aec0 0x7fc5d006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:31.297 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.292+0000 7fc5ef7fe640 1 --2- 172.21.15.59:0/2842002519 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc5d006aec0 0x7fc5d006d380 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc5e00020a0 tx=0x7fc5e0001690 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:31.298 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.295+0000 7fc5e7fff640 1 -- 172.21.15.59:0/2842002519 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc5d80765e0 con 0x7fc5f0159600 2023-10-16T14:27:31.490 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:31.486+0000 7fc5f5cbb640 1 -- 172.21.15.59:0/2842002519 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc5f00706a0 con 0x7fc5f0159600 2023-10-16T14:27:31.684 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:27:31.694 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:27:32.042 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.038+0000 7fc5e7fff640 1 -- 172.21.15.59:0/2842002519 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc5d8079c00 con 0x7fc5f0159600 2023-10-16T14:27:32.042 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2023-10-16T14:27:32.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.042+0000 7fc5f5cbb640 1 -- 172.21.15.59:0/2842002519 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc5d006aec0 msgr2=0x7fc5d006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:32.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.042+0000 7fc5f5cbb640 1 --2- 172.21.15.59:0/2842002519 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc5d006aec0 0x7fc5d006d380 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc5e00020a0 tx=0x7fc5e0001690 comp rx=0 tx=0).stop 2023-10-16T14:27:32.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.042+0000 7fc5f5cbb640 1 -- 172.21.15.59:0/2842002519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f0159600 msgr2=0x7fc5f00c7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:32.046 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.042+0000 7fc5f5cbb640 1 --2- 172.21.15.59:0/2842002519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f0159600 0x7fc5f00c7680 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009890 tx=0x7fc5d80046c0 comp rx=0 tx=0).stop 2023-10-16T14:27:32.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.042+0000 7fc5f5cbb640 1 -- 172.21.15.59:0/2842002519 shutdown_connections 2023-10-16T14:27:32.047 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.042+0000 7fc5f5cbb640 1 --2- 172.21.15.59:0/2842002519 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc5d006aec0 0x7fc5d006d380 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:32.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.042+0000 7fc5f5cbb640 1 --2- 172.21.15.59:0/2842002519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f01599e0 0x7fc5f00cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:32.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.042+0000 7fc5f5cbb640 1 --2- 172.21.15.59:0/2842002519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5f0159600 0x7fc5f00c7680 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:32.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.042+0000 7fc5f5cbb640 1 --2- 172.21.15.59:0/2842002519 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f00ce1a0 0x7fc5f0151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:32.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.042+0000 7fc5f5cbb640 1 -- 172.21.15.59:0/2842002519 >> 172.21.15.59:0/2842002519 conn(0x7fc5f00660e0 msgr2=0x7fc5f0069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:32.048 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.043+0000 7fc5f5cbb640 1 -- 172.21.15.59:0/2842002519 shutdown_connections 2023-10-16T14:27:32.049 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.043+0000 7fc5f5cbb640 1 -- 172.21.15.59:0/2842002519 wait complete. 2023-10-16T14:27:32.080 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-16T14:27:32.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.269+0000 7ff577fff640 1 Processor -- start 2023-10-16T14:27:32.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.269+0000 7ff577fff640 1 -- start start 2023-10-16T14:27:32.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.270+0000 7ff577fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff5780ad940 0x7ff57806c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:32.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.270+0000 7ff577fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff57806cbf0 0x7ff5780ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:32.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.270+0000 7ff577fff640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff578159ca0 con 0x7ff5780ca3a0 2023-10-16T14:27:32.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.270+0000 7ff577fff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5780b34c0 con 0x7ff5780ad940 2023-10-16T14:27:32.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.270+0000 7ff577fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780b2fd0 con 0x7ff57806cbf0 2023-10-16T14:27:32.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.271+0000 7ff5777fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff5780ca3a0 0x7ff57815d370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47636/0 (socket says 172.21.15.59:47636) 2023-10-16T14:27:32.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.271+0000 7ff5777fe640 1 -- 172.21.15.59:0/312631417 learned_addr learned my addr 172.21.15.59:0/312631417 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:32.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.271+0000 7ff576ffd640 1 --2- 172.21.15.59:0/312631417 >> v2:172.21.15.151:3300/0 conn(0x7ff5780ad940 0x7ff57806c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:32.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.271+0000 7ff5767fc640 1 -- 172.21.15.59:0/312631417 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026793088 0 0) 0x7ff578159ca0 con 0x7ff5780ca3a0 2023-10-16T14:27:32.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.271+0000 7ff56ffff640 1 --2- 172.21.15.59:0/312631417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff57806cbf0 0x7ff5780ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:32.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.271+0000 7ff5767fc640 1 -- 172.21.15.59:0/312631417 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff564003520 con 0x7ff5780ca3a0 2023-10-16T14:27:32.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.272+0000 7ff5767fc640 1 -- 172.21.15.59:0/312631417 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3038299872 0 0) 0x7ff564003520 con 0x7ff5780ca3a0 2023-10-16T14:27:32.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.272+0000 7ff5767fc640 1 -- 172.21.15.59:0/312631417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff57806cbf0 msgr2=0x7ff5780ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:32.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.272+0000 7ff5767fc640 1 --2- 172.21.15.59:0/312631417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff57806cbf0 0x7ff5780ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:32.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.272+0000 7ff5767fc640 1 -- 172.21.15.59:0/312631417 >> v2:172.21.15.151:3300/0 conn(0x7ff5780ad940 msgr2=0x7ff57806c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:32.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.272+0000 7ff5767fc640 1 --2- 172.21.15.59:0/312631417 >> v2:172.21.15.151:3300/0 conn(0x7ff5780ad940 0x7ff57806c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:32.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.272+0000 7ff5767fc640 1 -- 172.21.15.59:0/312631417 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5780cac20 con 0x7ff5780ca3a0 2023-10-16T14:27:32.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.272+0000 7ff5767fc640 1 -- 172.21.15.59:0/312631417 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7ff5700019f0 con 0x7ff5780ca3a0 2023-10-16T14:27:32.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.272+0000 7ff56ffff640 1 --2- 172.21.15.59:0/312631417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff57806cbf0 0x7ff5780ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:27:32.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.272+0000 7ff576ffd640 1 --2- 172.21.15.59:0/312631417 >> v2:172.21.15.151:3300/0 conn(0x7ff5780ad940 0x7ff57806c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:27:32.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.272+0000 7ff5767fc640 1 -- 172.21.15.59:0/312631417 >> v1:172.21.15.59:6789/0 conn(0x7ff5780ca3a0 legacy=0x7ff57815d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:32.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.272+0000 7ff5767fc640 1 --2- 172.21.15.59:0/312631417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5640039e0 0x7ff564003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:32.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.272+0000 7ff5767fc640 1 --2- 172.21.15.59:0/312631417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5640047c0 0x7ff564004bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:32.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.272+0000 7ff5767fc640 1 --2- 172.21.15.59:0/312631417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff564005100 0x7ff56400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:32.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.272+0000 7ff5767fc640 1 -- 172.21.15.59:0/312631417 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780b34c0 con 0x7ff5640039e0 2023-10-16T14:27:32.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.272+0000 7ff5767fc640 1 -- 172.21.15.59:0/312631417 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780b2fd0 con 0x7ff564005100 2023-10-16T14:27:32.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.272+0000 7ff5767fc640 1 -- 172.21.15.59:0/312631417 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56400bec0 con 0x7ff5640047c0 2023-10-16T14:27:32.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.272+0000 7ff576ffd640 1 --2- 172.21.15.59:0/312631417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5640039e0 0x7ff564003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:32.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.273+0000 7ff5777fe640 1 --2- 172.21.15.59:0/312631417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff564005100 0x7ff56400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:32.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.273+0000 7ff56ffff640 1 --2- 172.21.15.59:0/312631417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5640047c0 0x7ff564004bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:32.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.273+0000 7ff576ffd640 1 -- 172.21.15.59:0/312631417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5640047c0 msgr2=0x7ff564004bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:32.282 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.273+0000 7ff576ffd640 1 --2- 172.21.15.59:0/312631417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5640047c0 0x7ff564004bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:32.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.273+0000 7ff576ffd640 1 -- 172.21.15.59:0/312631417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff564005100 msgr2=0x7ff56400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:32.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.273+0000 7ff576ffd640 1 --2- 172.21.15.59:0/312631417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff564005100 0x7ff56400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:32.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.273+0000 7ff576ffd640 1 -- 172.21.15.59:0/312631417 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff564003520 con 0x7ff5640039e0 2023-10-16T14:27:32.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.273+0000 7ff56ffff640 1 --2- 172.21.15.59:0/312631417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5640047c0 0x7ff564004bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:32.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.274+0000 7ff576ffd640 1 --2- 172.21.15.59:0/312631417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5640039e0 0x7ff564003e00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff5680098d0 tx=0x7ff5640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c92366ad41e43f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:32.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.274+0000 7ff5767fc640 1 -- 172.21.15.59:0/312631417 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff568004230 con 0x7ff5640039e0 2023-10-16T14:27:32.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.274+0000 7ff5767fc640 1 -- 172.21.15.59:0/312631417 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff568004390 con 0x7ff5640039e0 2023-10-16T14:27:32.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.274+0000 7ff5767fc640 1 -- 172.21.15.59:0/312631417 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff568003830 con 0x7ff5640039e0 2023-10-16T14:27:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.275+0000 7ff577fff640 1 -- 172.21.15.59:0/312631417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5640039e0 msgr2=0x7ff564003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.275+0000 7ff577fff640 1 --2- 172.21.15.59:0/312631417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5640039e0 0x7ff564003e00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff5680098d0 tx=0x7ff5640057f0 comp rx=0 tx=0).stop 2023-10-16T14:27:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.275+0000 7ff5777fe640 1 -- 172.21.15.59:0/312631417 reap_dead start 2023-10-16T14:27:32.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.275+0000 7ff577fff640 1 -- 172.21.15.59:0/312631417 shutdown_connections 2023-10-16T14:27:32.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.275+0000 7ff577fff640 1 -- 172.21.15.59:0/312631417 >> 172.21.15.59:0/312631417 conn(0x7ff57806a200 msgr2=0x7ff57806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:32.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.275+0000 7ff577fff640 1 -- 172.21.15.59:0/312631417 shutdown_connections 2023-10-16T14:27:32.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.275+0000 7ff577fff640 1 -- 172.21.15.59:0/312631417 wait complete. 2023-10-16T14:27:32.288 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.277+0000 7ff577fff640 1 Processor -- start 2023-10-16T14:27:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.277+0000 7ff577fff640 1 -- start start 2023-10-16T14:27:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.278+0000 7ff577fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5640039e0 0x7ff5780c1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.278+0000 7ff577fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5780c4d20 0x7ff5780c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.278+0000 7ff577fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5780cbdf0 0x7ff5781580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.278+0000 7ff577fff640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780afdf0 con 0x7ff5640039e0 2023-10-16T14:27:32.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.278+0000 7ff577fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780ae910 con 0x7ff5780c4d20 2023-10-16T14:27:32.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.278+0000 7ff577fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780aee70 con 0x7ff5780cbdf0 2023-10-16T14:27:32.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.279+0000 7ff576ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5640039e0 0x7ff5780c1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:32.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.279+0000 7ff576ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5640039e0 0x7ff5780c1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43548/0 (socket says 172.21.15.59:43548) 2023-10-16T14:27:32.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.279+0000 7ff576ffd640 1 -- 172.21.15.59:0/639536531 learned_addr learned my addr 172.21.15.59:0/639536531 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:32.290 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.279+0000 7ff56ffff640 1 --2- 172.21.15.59:0/639536531 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5780c4d20 0x7ff5780c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:32.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.279+0000 7ff576ffd640 1 -- 172.21.15.59:0/639536531 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5780cbdf0 msgr2=0x7ff5781580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:32.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.279+0000 7ff576ffd640 1 --2- 172.21.15.59:0/639536531 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5780cbdf0 0x7ff5781580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:32.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.279+0000 7ff576ffd640 1 -- 172.21.15.59:0/639536531 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5780c4d20 msgr2=0x7ff5780c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:32.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.279+0000 7ff576ffd640 1 --2- 172.21.15.59:0/639536531 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5780c4d20 0x7ff5780c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:32.291 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.279+0000 7ff576ffd640 1 -- 172.21.15.59:0/639536531 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5780aeb90 con 0x7ff5640039e0 2023-10-16T14:27:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.279+0000 7ff56ffff640 1 --2- 172.21.15.59:0/639536531 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5780c4d20 0x7ff5780c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.279+0000 7ff576ffd640 1 --2- 172.21.15.59:0/639536531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5640039e0 0x7ff5780c1420 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff5680099f0 tx=0x7ff568004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.280+0000 7ff56f7fe640 1 -- 172.21.15.59:0/639536531 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff568042600 con 0x7ff5640039e0 2023-10-16T14:27:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.280+0000 7ff56f7fe640 1 -- 172.21.15.59:0/639536531 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5680427a0 con 0x7ff5640039e0 2023-10-16T14:27:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.280+0000 7ff56f7fe640 1 -- 172.21.15.59:0/639536531 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff568042b50 con 0x7ff5640039e0 2023-10-16T14:27:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.280+0000 7ff577fff640 1 -- 172.21.15.59:0/639536531 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5780afa80 con 0x7ff5640039e0 2023-10-16T14:27:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.280+0000 7ff577fff640 1 -- 172.21.15.59:0/639536531 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5780c5b10 con 0x7ff5640039e0 2023-10-16T14:27:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.281+0000 7ff577fff640 1 -- 172.21.15.59:0/639536531 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff57804e9b0 con 0x7ff5640039e0 2023-10-16T14:27:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.282+0000 7ff56f7fe640 1 -- 172.21.15.59:0/639536531 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff568042cb0 con 0x7ff5640039e0 2023-10-16T14:27:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.283+0000 7ff56f7fe640 1 --2- 172.21.15.59:0/639536531 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff55806ae70 0x7ff55806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.283+0000 7ff56f7fe640 1 -- 172.21.15.59:0/639536531 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5929+0+0 (secure 0 0 0) 0x7ff5680aaed0 con 0x7ff5640039e0 2023-10-16T14:27:32.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.284+0000 7ff56ffff640 1 --2- 172.21.15.59:0/639536531 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff55806ae70 0x7ff55806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:32.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.285+0000 7ff56ffff640 1 --2- 172.21.15.59:0/639536531 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff55806ae70 0x7ff55806d330 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff5781f4e40 tx=0x7ff560007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:32.294 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.288+0000 7ff56f7fe640 1 -- 172.21.15.59:0/639536531 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff568075f50 con 0x7ff5640039e0 2023-10-16T14:27:32.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:32.519+0000 7ff577fff640 1 -- 172.21.15.59:0/639536531 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff57806dc30 con 0x7ff5640039e0 2023-10-16T14:27:33.083 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.079+0000 7ff56f7fe640 1 -- 172.21.15.59:0/639536531 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff568047020 con 0x7ff5640039e0 2023-10-16T14:27:33.083 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 5 and data pool 6 2023-10-16T14:27:33.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.083+0000 7ff577fff640 1 -- 172.21.15.59:0/639536531 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff55806ae70 msgr2=0x7ff55806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:33.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.083+0000 7ff577fff640 1 --2- 172.21.15.59:0/639536531 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff55806ae70 0x7ff55806d330 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff5781f4e40 tx=0x7ff560007040 comp rx=0 tx=0).stop 2023-10-16T14:27:33.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.083+0000 7ff577fff640 1 -- 172.21.15.59:0/639536531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5640039e0 msgr2=0x7ff5780c1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:33.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.083+0000 7ff577fff640 1 --2- 172.21.15.59:0/639536531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5640039e0 0x7ff5780c1420 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff5680099f0 tx=0x7ff568004730 comp rx=0 tx=0).stop 2023-10-16T14:27:33.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.083+0000 7ff577fff640 1 -- 172.21.15.59:0/639536531 shutdown_connections 2023-10-16T14:27:33.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.083+0000 7ff577fff640 1 --2- 172.21.15.59:0/639536531 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7ff55806ae70 0x7ff55806d330 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.083+0000 7ff577fff640 1 --2- 172.21.15.59:0/639536531 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5780cbdf0 0x7ff5781580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.083+0000 7ff577fff640 1 --2- 172.21.15.59:0/639536531 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5780c4d20 0x7ff5780c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.083+0000 7ff577fff640 1 --2- 172.21.15.59:0/639536531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5640039e0 0x7ff5780c1420 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.083+0000 7ff577fff640 1 -- 172.21.15.59:0/639536531 >> 172.21.15.59:0/639536531 conn(0x7ff57806a200 msgr2=0x7ff578071140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:33.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.083+0000 7ff577fff640 1 -- 172.21.15.59:0/639536531 shutdown_connections 2023-10-16T14:27:33.089 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.083+0000 7ff577fff640 1 -- 172.21.15.59:0/639536531 wait complete. 2023-10-16T14:27:33.114 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:27:33.306 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.303+0000 7f74b636e640 1 Processor -- start 2023-10-16T14:27:33.307 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.303+0000 7f74b636e640 1 -- start start 2023-10-16T14:27:33.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.305+0000 7f74b636e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f74b015a8d0 0x7f74b00cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:33.308 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.305+0000 7f74b636e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b015acb0 con 0x7f74b006ff40 2023-10-16T14:27:33.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.305+0000 7f74b636e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b00c1c60 con 0x7f74b00ca660 2023-10-16T14:27:33.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.305+0000 7f74b636e640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b006cd50 con 0x7f74b015a8d0 2023-10-16T14:27:33.309 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.305+0000 7f74b536c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f74b015a8d0 0x7f74b00cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:33.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.305+0000 7f74b5b6d640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f74b006ff40 0x7f74b006c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47642/0 (socket says 172.21.15.59:47642) 2023-10-16T14:27:33.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.305+0000 7f74b5b6d640 1 -- 172.21.15.59:0/725000732 learned_addr learned my addr 172.21.15.59:0/725000732 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:33.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.306+0000 7f74b536c640 1 -- 172.21.15.59:0/725000732 >> v1:172.21.15.151:6789/0 conn(0x7f74b00ca660 legacy=0x7f74b006bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:33.310 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.306+0000 7f74b536c640 1 -- 172.21.15.59:0/725000732 >> v1:172.21.15.59:6789/0 conn(0x7f74b006ff40 legacy=0x7f74b006c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:33.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.306+0000 7f74b536c640 1 -- 172.21.15.59:0/725000732 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b015e350 con 0x7f74b015a8d0 2023-10-16T14:27:33.311 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.306+0000 7f74a7fff640 1 -- 172.21.15.59:0/725000732 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324706668 0 0) 0x7f74a8001490 con 0x7f74b006ff40 2023-10-16T14:27:33.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.307+0000 7f74b536c640 1 --2- 172.21.15.59:0/725000732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74b015a8d0 0x7f74b00cab40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009790 tx=0x7f74ac02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84fe142275ff591 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:33.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.308+0000 7f74a7fff640 1 -- 172.21.15.59:0/725000732 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac030610 con 0x7f74b015a8d0 2023-10-16T14:27:33.312 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.308+0000 7f74a7fff640 1 -- 172.21.15.59:0/725000732 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac030770 con 0x7f74b015a8d0 2023-10-16T14:27:33.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.308+0000 7f74a7fff640 1 -- 172.21.15.59:0/725000732 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac030b00 con 0x7f74b015a8d0 2023-10-16T14:27:33.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.308+0000 7f74b636e640 1 -- 172.21.15.59:0/725000732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74b015a8d0 msgr2=0x7f74b00cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:33.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.308+0000 7f74b636e640 1 --2- 172.21.15.59:0/725000732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74b015a8d0 0x7f74b00cab40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009790 tx=0x7f74ac02b960 comp rx=0 tx=0).stop 2023-10-16T14:27:33.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.308+0000 7f74b636e640 1 -- 172.21.15.59:0/725000732 shutdown_connections 2023-10-16T14:27:33.313 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.308+0000 7f74b636e640 1 --2- 172.21.15.59:0/725000732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74b015a8d0 0x7f74b00cab40 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.308+0000 7f74b636e640 1 -- 172.21.15.59:0/725000732 >> 172.21.15.59:0/725000732 conn(0x7f74b006a470 msgr2=0x7f74b00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:33.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.308+0000 7f74b636e640 1 -- 172.21.15.59:0/725000732 shutdown_connections 2023-10-16T14:27:33.314 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.308+0000 7f74b636e640 1 -- 172.21.15.59:0/725000732 wait complete. 2023-10-16T14:27:33.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.310+0000 7f74b636e640 1 Processor -- start 2023-10-16T14:27:33.316 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.310+0000 7f74b636e640 1 -- start start 2023-10-16T14:27:33.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.311+0000 7f74b636e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74b006ff40 0x7f74b014d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:33.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.311+0000 7f74b636e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74b00ca660 0x7f74b015bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:33.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.311+0000 7f74b636e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74b015a8d0 0x7f74b00c3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:33.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.311+0000 7f74b636e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b015c960 con 0x7f74b015a8d0 2023-10-16T14:27:33.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.311+0000 7f74b636e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b015cc40 con 0x7f74b00ca660 2023-10-16T14:27:33.317 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.311+0000 7f74b636e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b015cf20 con 0x7f74b006ff40 2023-10-16T14:27:33.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.311+0000 7f74b5b6d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74b015a8d0 0x7f74b00c3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:33.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.312+0000 7f74b5b6d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74b015a8d0 0x7f74b00c3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43558/0 (socket says 172.21.15.59:43558) 2023-10-16T14:27:33.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.312+0000 7f74b5b6d640 1 -- 172.21.15.59:0/393600025 learned_addr learned my addr 172.21.15.59:0/393600025 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:33.318 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.312+0000 7f74b4b6b640 1 --2- 172.21.15.59:0/393600025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74b00ca660 0x7f74b015bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:33.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.312+0000 7f74b536c640 1 --2- 172.21.15.59:0/393600025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74b006ff40 0x7f74b014d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:33.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.312+0000 7f74b5b6d640 1 -- 172.21.15.59:0/393600025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74b006ff40 msgr2=0x7f74b014d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:33.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.312+0000 7f74b5b6d640 1 --2- 172.21.15.59:0/393600025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74b006ff40 0x7f74b014d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.312+0000 7f74b5b6d640 1 -- 172.21.15.59:0/393600025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74b00ca660 msgr2=0x7f74b015bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:33.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.312+0000 7f74b5b6d640 1 --2- 172.21.15.59:0/393600025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74b00ca660 0x7f74b015bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.319 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.312+0000 7f74b5b6d640 1 -- 172.21.15.59:0/393600025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac0093a0 con 0x7f74b015a8d0 2023-10-16T14:27:33.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.312+0000 7f74b536c640 1 --2- 172.21.15.59:0/393600025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74b006ff40 0x7f74b014d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:33.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.312+0000 7f74b5b6d640 1 --2- 172.21.15.59:0/393600025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74b015a8d0 0x7f74b00c3400 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f74a800c7f0 tx=0x7f74a800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:33.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.313+0000 7f74a5ffb640 1 -- 172.21.15.59:0/393600025 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a800a640 con 0x7f74b015a8d0 2023-10-16T14:27:33.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.313+0000 7f74a5ffb640 1 -- 172.21.15.59:0/393600025 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a800a7c0 con 0x7f74b015a8d0 2023-10-16T14:27:33.320 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.313+0000 7f74b636e640 1 -- 172.21.15.59:0/393600025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b015d200 con 0x7f74b015a8d0 2023-10-16T14:27:33.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.313+0000 7f74a5ffb640 1 -- 172.21.15.59:0/393600025 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a800ab70 con 0x7f74b015a8d0 2023-10-16T14:27:33.321 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.313+0000 7f74b636e640 1 -- 172.21.15.59:0/393600025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b00b3c50 con 0x7f74b015a8d0 2023-10-16T14:27:33.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.314+0000 7f74b636e640 1 -- 172.21.15.59:0/393600025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b015d720 con 0x7f74b015a8d0 2023-10-16T14:27:33.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.315+0000 7f74a5ffb640 1 -- 172.21.15.59:0/393600025 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f74a800acd0 con 0x7f74b015a8d0 2023-10-16T14:27:33.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.317+0000 7f74a5ffb640 1 --2- 172.21.15.59:0/393600025 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f749406ae70 0x7f749406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:33.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.317+0000 7f74a5ffb640 1 -- 172.21.15.59:0/393600025 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f74a8088e20 con 0x7f74b015a8d0 2023-10-16T14:27:33.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.317+0000 7f74b536c640 1 --2- 172.21.15.59:0/393600025 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f749406ae70 0x7f749406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:33.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.319+0000 7f74b536c640 1 --2- 172.21.15.59:0/393600025 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f749406ae70 0x7f749406d330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f74ac036000 tx=0x7f74ac03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:33.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.322+0000 7f74a5ffb640 1 -- 172.21.15.59:0/393600025 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f74b015d720 con 0x7f74b015a8d0 2023-10-16T14:27:33.522 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.518+0000 7f74b636e640 1 -- 172.21.15.59:0/393600025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74b015d720 con 0x7f74b015a8d0 2023-10-16T14:27:33.523 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.520+0000 7f74a5ffb640 1 -- 172.21.15.59:0/393600025 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16787 (secure 0 0 0) 0x7f74b015d720 con 0x7f74b015a8d0 2023-10-16T14:27:33.524 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:33.524 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":39,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:27:32.522062+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:27:30.736808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-16T14:27:31.542632+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:27:33.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.522+0000 7f74b636e640 1 -- 172.21.15.59:0/393600025 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f749406ae70 msgr2=0x7f749406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:33.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.522+0000 7f74b636e640 1 --2- 172.21.15.59:0/393600025 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f749406ae70 0x7f749406d330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f74ac036000 tx=0x7f74ac03b040 comp rx=0 tx=0).stop 2023-10-16T14:27:33.526 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.522+0000 7f74b636e640 1 -- 172.21.15.59:0/393600025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74b015a8d0 msgr2=0x7f74b00c3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:33.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.522+0000 7f74b636e640 1 --2- 172.21.15.59:0/393600025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74b015a8d0 0x7f74b00c3400 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f74a800c7f0 tx=0x7f74a800ccb0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.522+0000 7f74b636e640 1 -- 172.21.15.59:0/393600025 shutdown_connections 2023-10-16T14:27:33.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.523+0000 7f74b636e640 1 --2- 172.21.15.59:0/393600025 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f749406ae70 0x7f749406d330 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.527 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.523+0000 7f74b636e640 1 --2- 172.21.15.59:0/393600025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74b015a8d0 0x7f74b00c3400 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.523+0000 7f74b636e640 1 --2- 172.21.15.59:0/393600025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74b00ca660 0x7f74b015bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.523+0000 7f74b636e640 1 --2- 172.21.15.59:0/393600025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74b006ff40 0x7f74b014d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.523+0000 7f74b636e640 1 -- 172.21.15.59:0/393600025 >> 172.21.15.59:0/393600025 conn(0x7f74b006a470 msgr2=0x7f74b00cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:33.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.523+0000 7f74b636e640 1 -- 172.21.15.59:0/393600025 shutdown_connections 2023-10-16T14:27:33.528 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.523+0000 7f74b636e640 1 -- 172.21.15.59:0/393600025 wait complete. 2023-10-16T14:27:33.546 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:27:33.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.768+0000 7f0985b47640 1 Processor -- start 2023-10-16T14:27:33.772 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.769+0000 7f0985b47640 1 -- start start 2023-10-16T14:27:33.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.770+0000 7f0985b47640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09800af8f0 0x7f09800cf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:33.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.770+0000 7f0985b47640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09800cac90 con 0x7f09800cf8a0 2023-10-16T14:27:33.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.771+0000 7f0985b47640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09800cb810 con 0x7f098006c010 2023-10-16T14:27:33.774 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.771+0000 7f0985b47640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09800caee0 con 0x7f09800af8f0 2023-10-16T14:27:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.771+0000 7f097ffff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f09800cf8a0 0x7f098006b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47656/0 (socket says 172.21.15.59:47656) 2023-10-16T14:27:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.771+0000 7f097ffff640 1 -- 172.21.15.59:0/1913475613 learned_addr learned my addr 172.21.15.59:0/1913475613 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.771+0000 7f0984b45640 1 --2- 172.21.15.59:0/1913475613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09800af8f0 0x7f09800cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:33.776 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.771+0000 7f097f7fe640 1 -- 172.21.15.59:0/1913475613 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814834803 0 0) 0x7f09800cac90 con 0x7f09800cf8a0 2023-10-16T14:27:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.771+0000 7f097f7fe640 1 -- 172.21.15.59:0/1913475613 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0970003520 con 0x7f09800cf8a0 2023-10-16T14:27:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.772+0000 7f097f7fe640 1 -- 172.21.15.59:0/1913475613 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3297053450 0 0) 0x7f0970003520 con 0x7f09800cf8a0 2023-10-16T14:27:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.772+0000 7f097f7fe640 1 -- 172.21.15.59:0/1913475613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09800af8f0 msgr2=0x7f09800cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.772+0000 7f097f7fe640 1 --2- 172.21.15.59:0/1913475613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09800af8f0 0x7f09800cf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.777 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.772+0000 7f097f7fe640 1 -- 172.21.15.59:0/1913475613 >> v1:172.21.15.151:6789/0 conn(0x7f098006c010 legacy=0x7f098015c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:33.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.772+0000 7f097f7fe640 1 -- 172.21.15.59:0/1913475613 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09800cb1c0 con 0x7f09800cf8a0 2023-10-16T14:27:33.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.772+0000 7f097f7fe640 1 -- 172.21.15.59:0/1913475613 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f096c001670 con 0x7f09800cf8a0 2023-10-16T14:27:33.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.772+0000 7f097f7fe640 1 -- 172.21.15.59:0/1913475613 >> v1:172.21.15.59:6789/0 conn(0x7f09800cf8a0 legacy=0x7f098006b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:33.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.772+0000 7f097f7fe640 1 --2- 172.21.15.59:0/1913475613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09800af8f0 0x7f09700039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:33.778 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.772+0000 7f097f7fe640 1 --2- 172.21.15.59:0/1913475613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0970003f70 0x7f09700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:33.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.772+0000 7f097f7fe640 1 --2- 172.21.15.59:0/1913475613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0970004d00 0x7f0970005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:33.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.772+0000 7f097f7fe640 1 -- 172.21.15.59:0/1913475613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09800caee0 con 0x7f0970004d00 2023-10-16T14:27:33.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.772+0000 7f097f7fe640 1 -- 172.21.15.59:0/1913475613 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097000bac0 con 0x7f0970003f70 2023-10-16T14:27:33.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.772+0000 7f097f7fe640 1 -- 172.21.15.59:0/1913475613 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097000bc80 con 0x7f09800af8f0 2023-10-16T14:27:33.779 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.772+0000 7f0985346640 1 --2- 172.21.15.59:0/1913475613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0970004d00 0x7f0970005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:33.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.773+0000 7f0984b45640 1 --2- 172.21.15.59:0/1913475613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09800af8f0 0x7f09700039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:33.780 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.773+0000 7f097ffff640 1 --2- 172.21.15.59:0/1913475613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0970003f70 0x7f09700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:33.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.773+0000 7f0985346640 1 -- 172.21.15.59:0/1913475613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09800af8f0 msgr2=0x7f09700039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:33.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.773+0000 7f0985346640 1 --2- 172.21.15.59:0/1913475613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09800af8f0 0x7f09700039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.773+0000 7f0985346640 1 -- 172.21.15.59:0/1913475613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0970003f70 msgr2=0x7f09700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:33.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.773+0000 7f0985346640 1 --2- 172.21.15.59:0/1913475613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0970003f70 0x7f09700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.783 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.773+0000 7f0985346640 1 -- 172.21.15.59:0/1913475613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0970003520 con 0x7f0970004d00 2023-10-16T14:27:33.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.774+0000 7f0985346640 1 --2- 172.21.15.59:0/1913475613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0970004d00 0x7f0970005180 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0978001e20 tx=0x7f09700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce21e0e8ebebc9e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:33.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.774+0000 7f097f7fe640 1 -- 172.21.15.59:0/1913475613 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978003b70 con 0x7f0970004d00 2023-10-16T14:27:33.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.775+0000 7f097f7fe640 1 -- 172.21.15.59:0/1913475613 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0978003cd0 con 0x7f0970004d00 2023-10-16T14:27:33.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.775+0000 7f097f7fe640 1 -- 172.21.15.59:0/1913475613 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978005310 con 0x7f0970004d00 2023-10-16T14:27:33.784 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.775+0000 7f0985b47640 1 -- 172.21.15.59:0/1913475613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0970004d00 msgr2=0x7f0970005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:33.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.775+0000 7f0985b47640 1 --2- 172.21.15.59:0/1913475613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0970004d00 0x7f0970005180 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0978001e20 tx=0x7f09700057f0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.775+0000 7f0985346640 1 -- 172.21.15.59:0/1913475613 reap_dead start 2023-10-16T14:27:33.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.775+0000 7f0985b47640 1 -- 172.21.15.59:0/1913475613 shutdown_connections 2023-10-16T14:27:33.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.775+0000 7f0985b47640 1 -- 172.21.15.59:0/1913475613 >> 172.21.15.59:0/1913475613 conn(0x7f09800d0640 msgr2=0x7f09800d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:33.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.775+0000 7f0985b47640 1 -- 172.21.15.59:0/1913475613 shutdown_connections 2023-10-16T14:27:33.785 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.775+0000 7f0985b47640 1 -- 172.21.15.59:0/1913475613 wait complete. 2023-10-16T14:27:33.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.777+0000 7f0985b47640 1 Processor -- start 2023-10-16T14:27:33.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.777+0000 7f0985b47640 1 -- start start 2023-10-16T14:27:33.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.778+0000 7f0985b47640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0970004d00 0x7f09800c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:33.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.778+0000 7f0985b47640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f098015a4c0 0x7f09800b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:33.786 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.778+0000 7f0985b47640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09800b1530 0x7f09800c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:33.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.778+0000 7f0985b47640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09800b19e0 con 0x7f09800b1530 2023-10-16T14:27:33.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.778+0000 7f0985b47640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09800b45b0 con 0x7f0970004d00 2023-10-16T14:27:33.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.778+0000 7f0985b47640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09801f5630 con 0x7f098015a4c0 2023-10-16T14:27:33.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.779+0000 7f0985346640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09800b1530 0x7f09800c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:33.787 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.779+0000 7f0985346640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09800b1530 0x7f09800c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43580/0 (socket says 172.21.15.59:43580) 2023-10-16T14:27:33.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.779+0000 7f0985346640 1 -- 172.21.15.59:0/1683555155 learned_addr learned my addr 172.21.15.59:0/1683555155 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:33.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.779+0000 7f097ffff640 1 --2- 172.21.15.59:0/1683555155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f098015a4c0 0x7f09800b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:33.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.779+0000 7f0984b45640 1 --2- 172.21.15.59:0/1683555155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0970004d00 0x7f09800c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:33.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.779+0000 7f0985346640 1 -- 172.21.15.59:0/1683555155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f098015a4c0 msgr2=0x7f09800b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:33.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.779+0000 7f0985346640 1 --2- 172.21.15.59:0/1683555155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f098015a4c0 0x7f09800b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.788 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.779+0000 7f0985346640 1 -- 172.21.15.59:0/1683555155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0970004d00 msgr2=0x7f09800c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:33.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.779+0000 7f0985346640 1 --2- 172.21.15.59:0/1683555155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0970004d00 0x7f09800c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.779+0000 7f0985346640 1 -- 172.21.15.59:0/1683555155 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09801f5910 con 0x7f09800b1530 2023-10-16T14:27:33.789 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.780+0000 7f0985346640 1 --2- 172.21.15.59:0/1683555155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09800b1530 0x7f09800c7710 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0978005040 tx=0x7f09780014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:33.790 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.780+0000 7f097d7fa640 1 -- 172.21.15.59:0/1683555155 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097803e070 con 0x7f09800b1530 2023-10-16T14:27:33.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.780+0000 7f097d7fa640 1 -- 172.21.15.59:0/1683555155 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0978006b50 con 0x7f09800b1530 2023-10-16T14:27:33.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.780+0000 7f097d7fa640 1 -- 172.21.15.59:0/1683555155 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978007030 con 0x7f09800b1530 2023-10-16T14:27:33.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.780+0000 7f0985b47640 1 -- 172.21.15.59:0/1683555155 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09801f5bf0 con 0x7f09800b1530 2023-10-16T14:27:33.791 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.780+0000 7f0985b47640 1 -- 172.21.15.59:0/1683555155 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09801f61b0 con 0x7f09800b1530 2023-10-16T14:27:33.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.781+0000 7f0985b47640 1 -- 172.21.15.59:0/1683555155 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09800b19e0 con 0x7f09800b1530 2023-10-16T14:27:33.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.782+0000 7f097d7fa640 1 -- 172.21.15.59:0/1683555155 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0978007190 con 0x7f09800b1530 2023-10-16T14:27:33.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.783+0000 7f097d7fa640 1 --2- 172.21.15.59:0/1683555155 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f096406aea0 0x7f096406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:33.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.783+0000 7f097d7fa640 1 -- 172.21.15.59:0/1683555155 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f09780aaa20 con 0x7f09800b1530 2023-10-16T14:27:33.792 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.784+0000 7f0984b45640 1 --2- 172.21.15.59:0/1683555155 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f096406aea0 0x7f096406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:33.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.785+0000 7f0984b45640 1 --2- 172.21.15.59:0/1683555155 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f096406aea0 0x7f096406d360 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0974009b00 tx=0x7f0974008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:33.793 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.787+0000 7f097d7fa640 1 -- 172.21.15.59:0/1683555155 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f09800b19e0 con 0x7f09800b1530 2023-10-16T14:27:33.986 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.983+0000 7f0985b47640 1 -- 172.21.15.59:0/1683555155 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09800b19e0 con 0x7f09800b1530 2023-10-16T14:27:33.988 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.985+0000 7f097d7fa640 1 -- 172.21.15.59:0/1683555155 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16774 (secure 0 0 0) 0x7f09800b19e0 con 0x7f09800b1530 2023-10-16T14:27:33.989 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:33.989 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":40,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:27:33.646653+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:27:30.736808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-16T14:27:31.542632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:27:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.988+0000 7f0985b47640 1 -- 172.21.15.59:0/1683555155 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f096406aea0 msgr2=0x7f096406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.988+0000 7f0985b47640 1 --2- 172.21.15.59:0/1683555155 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f096406aea0 0x7f096406d360 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0974009b00 tx=0x7f0974008040 comp rx=0 tx=0).stop 2023-10-16T14:27:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.988+0000 7f0985b47640 1 -- 172.21.15.59:0/1683555155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09800b1530 msgr2=0x7f09800c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.988+0000 7f0985b47640 1 --2- 172.21.15.59:0/1683555155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09800b1530 0x7f09800c7710 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0978005040 tx=0x7f09780014a0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.988+0000 7f0985b47640 1 -- 172.21.15.59:0/1683555155 shutdown_connections 2023-10-16T14:27:33.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.988+0000 7f0985b47640 1 --2- 172.21.15.59:0/1683555155 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f096406aea0 0x7f096406d360 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.988+0000 7f0985b47640 1 --2- 172.21.15.59:0/1683555155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09800b1530 0x7f09800c7710 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.988+0000 7f0985b47640 1 --2- 172.21.15.59:0/1683555155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f098015a4c0 0x7f09800b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.993 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.988+0000 7f0985b47640 1 --2- 172.21.15.59:0/1683555155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0970004d00 0x7f09800c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:33.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.988+0000 7f0985b47640 1 -- 172.21.15.59:0/1683555155 >> 172.21.15.59:0/1683555155 conn(0x7f09800d0640 msgr2=0x7f09800cbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:33.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.988+0000 7f0985b47640 1 -- 172.21.15.59:0/1683555155 shutdown_connections 2023-10-16T14:27:33.994 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:33.988+0000 7f0985b47640 1 -- 172.21.15.59:0/1683555155 wait complete. 2023-10-16T14:27:34.012 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-16T14:27:34.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.228+0000 7f62f9d25640 1 Processor -- start 2023-10-16T14:27:34.232 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.228+0000 7f62f9d25640 1 -- start start 2023-10-16T14:27:34.233 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.230+0000 7f62f9d25640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f62f415a830 0x7f62f40cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:34.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.230+0000 7f62f9d25640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62f4070a30 0x7f62f40c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:34.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.230+0000 7f62f9d25640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f40cf040 con 0x7f62f40ca550 2023-10-16T14:27:34.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.230+0000 7f62f9d25640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f40ca9e0 con 0x7f62f415a830 2023-10-16T14:27:34.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.230+0000 7f62f9d25640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40ce430 con 0x7f62f4070a30 2023-10-16T14:27:34.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.230+0000 7f62ebfff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f62f40ca550 0x7f62f4070320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47666/0 (socket says 172.21.15.59:47666) 2023-10-16T14:27:34.236 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.231+0000 7f62ebfff640 1 -- 172.21.15.59:0/261415657 learned_addr learned my addr 172.21.15.59:0/261415657 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:34.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.231+0000 7f62f37fe640 1 --2- 172.21.15.59:0/261415657 >> v2:172.21.15.151:3300/0 conn(0x7f62f415a830 0x7f62f40cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:34.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.231+0000 7f62f3fff640 1 --2- 172.21.15.59:0/261415657 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62f4070a30 0x7f62f40c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:34.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.231+0000 7f62f2ffd640 1 -- 172.21.15.59:0/261415657 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012016907 0 0) 0x7f62f40cf040 con 0x7f62f40ca550 2023-10-16T14:27:34.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.231+0000 7f62f2ffd640 1 -- 172.21.15.59:0/261415657 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62e0003520 con 0x7f62f40ca550 2023-10-16T14:27:34.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.231+0000 7f62f2ffd640 1 -- 172.21.15.59:0/261415657 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1047634278 0 0) 0x7f62e0003520 con 0x7f62f40ca550 2023-10-16T14:27:34.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.231+0000 7f62f2ffd640 1 -- 172.21.15.59:0/261415657 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62f4070a30 msgr2=0x7f62f40c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:34.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.231+0000 7f62f2ffd640 1 --2- 172.21.15.59:0/261415657 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62f4070a30 0x7f62f40c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:34.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.231+0000 7f62f2ffd640 1 -- 172.21.15.59:0/261415657 >> v2:172.21.15.151:3300/0 conn(0x7f62f415a830 msgr2=0x7f62f40cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:34.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.231+0000 7f62f2ffd640 1 --2- 172.21.15.59:0/261415657 >> v2:172.21.15.151:3300/0 conn(0x7f62f415a830 0x7f62f40cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:34.238 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.231+0000 7f62f2ffd640 1 -- 172.21.15.59:0/261415657 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f40ce710 con 0x7f62f40ca550 2023-10-16T14:27:34.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.231+0000 7f62f2ffd640 1 -- 172.21.15.59:0/261415657 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f62dc001670 con 0x7f62f40ca550 2023-10-16T14:27:34.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.232+0000 7f62f2ffd640 1 -- 172.21.15.59:0/261415657 >> v1:172.21.15.59:6789/0 conn(0x7f62f40ca550 legacy=0x7f62f4070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:34.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.232+0000 7f62f2ffd640 1 --2- 172.21.15.59:0/261415657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62e0003970 0x7f62e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:34.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.232+0000 7f62f2ffd640 1 --2- 172.21.15.59:0/261415657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62e00047c0 0x7f62e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:34.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.232+0000 7f62f2ffd640 1 --2- 172.21.15.59:0/261415657 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62f4070a30 0x7f62e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:34.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.232+0000 7f62f2ffd640 1 -- 172.21.15.59:0/261415657 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40ca9e0 con 0x7f62e00047c0 2023-10-16T14:27:34.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.232+0000 7f62f2ffd640 1 -- 172.21.15.59:0/261415657 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40ce430 con 0x7f62e0003970 2023-10-16T14:27:34.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.232+0000 7f62f2ffd640 1 -- 172.21.15.59:0/261415657 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e000b980 con 0x7f62f4070a30 2023-10-16T14:27:34.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.232+0000 7f62ebfff640 1 --2- 172.21.15.59:0/261415657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62e00047c0 0x7f62e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:34.240 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.232+0000 7f62f37fe640 1 --2- 172.21.15.59:0/261415657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62e0003970 0x7f62e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:34.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.232+0000 7f62f3fff640 1 --2- 172.21.15.59:0/261415657 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62f4070a30 0x7f62e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:34.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.232+0000 7f62ebfff640 1 -- 172.21.15.59:0/261415657 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62f4070a30 msgr2=0x7f62e0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:34.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.232+0000 7f62ebfff640 1 --2- 172.21.15.59:0/261415657 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62f4070a30 0x7f62e0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:34.241 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.232+0000 7f62ebfff640 1 -- 172.21.15.59:0/261415657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62e0003970 msgr2=0x7f62e0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:34.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.232+0000 7f62ebfff640 1 --2- 172.21.15.59:0/261415657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62e0003970 0x7f62e0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:34.242 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.233+0000 7f62ebfff640 1 -- 172.21.15.59:0/261415657 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e0003520 con 0x7f62e00047c0 2023-10-16T14:27:34.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.234+0000 7f62ebfff640 1 --2- 172.21.15.59:0/261415657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62e00047c0 0x7f62e0004c40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00c2c0 tx=0x7f62e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e5027f787d54e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:34.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.234+0000 7f62f2ffd640 1 -- 172.21.15.59:0/261415657 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc005ad0 con 0x7f62e00047c0 2023-10-16T14:27:34.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.234+0000 7f62f2ffd640 1 -- 172.21.15.59:0/261415657 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc005c30 con 0x7f62e00047c0 2023-10-16T14:27:34.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.234+0000 7f62f2ffd640 1 -- 172.21.15.59:0/261415657 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc02c8b0 con 0x7f62e00047c0 2023-10-16T14:27:34.245 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.235+0000 7f62f9d25640 1 -- 172.21.15.59:0/261415657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62e00047c0 msgr2=0x7f62e0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:34.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.235+0000 7f62f9d25640 1 --2- 172.21.15.59:0/261415657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62e00047c0 0x7f62e0004c40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00c2c0 tx=0x7f62e00057f0 comp rx=0 tx=0).stop 2023-10-16T14:27:34.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.235+0000 7f62f3fff640 1 -- 172.21.15.59:0/261415657 reap_dead start 2023-10-16T14:27:34.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.235+0000 7f62f9d25640 1 -- 172.21.15.59:0/261415657 shutdown_connections 2023-10-16T14:27:34.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.235+0000 7f62f9d25640 1 -- 172.21.15.59:0/261415657 >> 172.21.15.59:0/261415657 conn(0x7f62f40b0030 msgr2=0x7f62f40b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:34.246 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.235+0000 7f62f9d25640 1 -- 172.21.15.59:0/261415657 shutdown_connections 2023-10-16T14:27:34.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.235+0000 7f62f9d25640 1 -- 172.21.15.59:0/261415657 wait complete. 2023-10-16T14:27:34.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.237+0000 7f62f9d25640 1 Processor -- start 2023-10-16T14:27:34.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.237+0000 7f62f9d25640 1 -- start start 2023-10-16T14:27:34.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.238+0000 7f62f9d25640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62e00047c0 0x7f62f40c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:34.247 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.238+0000 7f62f9d25640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62f41f57e0 0x7f62f40a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:34.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.238+0000 7f62f9d25640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f40a7c30 0x7f62f40c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:34.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.238+0000 7f62f9d25640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40a80e0 con 0x7f62f40a7c30 2023-10-16T14:27:34.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.238+0000 7f62f9d25640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f41592d0 con 0x7f62f41f57e0 2023-10-16T14:27:34.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.238+0000 7f62f9d25640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f40c6fa0 con 0x7f62e00047c0 2023-10-16T14:27:34.248 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.238+0000 7f62f3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f40a7c30 0x7f62f40c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:34.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.238+0000 7f62f3fff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f40a7c30 0x7f62f40c7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43608/0 (socket says 172.21.15.59:43608) 2023-10-16T14:27:34.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.238+0000 7f62f3fff640 1 -- 172.21.15.59:0/2005456368 learned_addr learned my addr 172.21.15.59:0/2005456368 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:34.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.238+0000 7f62ebfff640 1 --2- 172.21.15.59:0/2005456368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62f41f57e0 0x7f62f40a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:34.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.238+0000 7f62f3fff640 1 -- 172.21.15.59:0/2005456368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62e00047c0 msgr2=0x7f62f40c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:34.249 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.238+0000 7f62f3fff640 1 --2- 172.21.15.59:0/2005456368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62e00047c0 0x7f62f40c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:34.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.238+0000 7f62f3fff640 1 -- 172.21.15.59:0/2005456368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62f41f57e0 msgr2=0x7f62f40a76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:34.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.238+0000 7f62f3fff640 1 --2- 172.21.15.59:0/2005456368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62f41f57e0 0x7f62f40a76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:34.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.238+0000 7f62f3fff640 1 -- 172.21.15.59:0/2005456368 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f40c5f20 con 0x7f62f40a7c30 2023-10-16T14:27:34.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.238+0000 7f62ebfff640 1 --2- 172.21.15.59:0/2005456368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62f41f57e0 0x7f62f40a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:34.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.239+0000 7f62f3fff640 1 --2- 172.21.15.59:0/2005456368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f40a7c30 0x7f62f40c7900 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f62f40adf70 tx=0x7f62ec0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:34.250 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.239+0000 7f62f0ff9640 1 -- 172.21.15.59:0/2005456368 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec00e070 con 0x7f62f40a7c30 2023-10-16T14:27:34.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.239+0000 7f62f0ff9640 1 -- 172.21.15.59:0/2005456368 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ec011e10 con 0x7f62f40a7c30 2023-10-16T14:27:34.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.239+0000 7f62f9d25640 1 -- 172.21.15.59:0/2005456368 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f40c6200 con 0x7f62f40a7c30 2023-10-16T14:27:34.251 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.239+0000 7f62f0ff9640 1 -- 172.21.15.59:0/2005456368 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec003990 con 0x7f62f40a7c30 2023-10-16T14:27:34.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.239+0000 7f62f9d25640 1 -- 172.21.15.59:0/2005456368 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f40c67c0 con 0x7f62f40a7c30 2023-10-16T14:27:34.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.241+0000 7f62f9d25640 1 -- 172.21.15.59:0/2005456368 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f4073ef0 con 0x7f62f40a7c30 2023-10-16T14:27:34.252 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.241+0000 7f62f0ff9640 1 -- 172.21.15.59:0/2005456368 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f62ec003af0 con 0x7f62f40a7c30 2023-10-16T14:27:34.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.242+0000 7f62f0ff9640 1 --2- 172.21.15.59:0/2005456368 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f62d406ae70 0x7f62d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:34.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.243+0000 7f62f0ff9640 1 -- 172.21.15.59:0/2005456368 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f62ec089db0 con 0x7f62f40a7c30 2023-10-16T14:27:34.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.243+0000 7f62f37fe640 1 --2- 172.21.15.59:0/2005456368 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f62d406ae70 0x7f62d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:34.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.244+0000 7f62f37fe640 1 --2- 172.21.15.59:0/2005456368 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f62d406ae70 0x7f62d406d330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009910 tx=0x7f62e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:34.254 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.247+0000 7f62f0ff9640 1 -- 172.21.15.59:0/2005456368 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f62ec08e070 con 0x7f62f40a7c30 2023-10-16T14:27:34.485 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:34.482+0000 7f62f9d25640 1 -- 172.21.15.59:0/2005456368 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f62f40b3770 con 0x7f62f40a7c30 2023-10-16T14:27:35.000 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-10-16T14:27:34.996+0000 7fc7364ae640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-16T14:27:35.105 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.101+0000 7f62f0ff9640 1 -- 172.21.15.59:0/2005456368 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f62ec054c80 con 0x7f62f40a7c30 2023-10-16T14:27:35.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.105+0000 7f62f9d25640 1 -- 172.21.15.59:0/2005456368 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f62d406ae70 msgr2=0x7f62d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:35.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.105+0000 7f62f9d25640 1 --2- 172.21.15.59:0/2005456368 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f62d406ae70 0x7f62d406d330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009910 tx=0x7f62e4008040 comp rx=0 tx=0).stop 2023-10-16T14:27:35.109 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.105+0000 7f62f9d25640 1 -- 172.21.15.59:0/2005456368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f40a7c30 msgr2=0x7f62f40c7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:35.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.105+0000 7f62f9d25640 1 --2- 172.21.15.59:0/2005456368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f40a7c30 0x7f62f40c7900 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f62f40adf70 tx=0x7f62ec0115a0 comp rx=0 tx=0).stop 2023-10-16T14:27:35.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.105+0000 7f62f9d25640 1 -- 172.21.15.59:0/2005456368 shutdown_connections 2023-10-16T14:27:35.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.105+0000 7f62f9d25640 1 --2- 172.21.15.59:0/2005456368 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f62d406ae70 0x7f62d406d330 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:35.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.105+0000 7f62f9d25640 1 --2- 172.21.15.59:0/2005456368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f40a7c30 0x7f62f40c7900 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:35.110 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.105+0000 7f62f9d25640 1 --2- 172.21.15.59:0/2005456368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62f41f57e0 0x7f62f40a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:35.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.105+0000 7f62f9d25640 1 --2- 172.21.15.59:0/2005456368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62e00047c0 0x7f62f40c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:35.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.105+0000 7f62f9d25640 1 -- 172.21.15.59:0/2005456368 >> 172.21.15.59:0/2005456368 conn(0x7f62f40b0030 msgr2=0x7f62f40cd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:35.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.106+0000 7f62f9d25640 1 -- 172.21.15.59:0/2005456368 shutdown_connections 2023-10-16T14:27:35.111 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.106+0000 7f62f9d25640 1 -- 172.21.15.59:0/2005456368 wait complete. 2023-10-16T14:27:35.129 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-16T14:27:35.129 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-16T14:27:35.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.356+0000 7f82cf59e640 1 Processor -- start 2023-10-16T14:27:35.360 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.357+0000 7f82cf59e640 1 -- start start 2023-10-16T14:27:35.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.358+0000 7f82cf59e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f82d00cf030 0x7f82d006ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:35.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.358+0000 7f82cf59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82d006d360 0x7f82d00ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:35.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.358+0000 7f82cf59e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d01550f0 con 0x7f82d0154d10 2023-10-16T14:27:35.362 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.358+0000 7f82cf59e640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d006db50 con 0x7f82d00cf030 2023-10-16T14:27:35.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.358+0000 7f82cf59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00b13f0 con 0x7f82d006d360 2023-10-16T14:27:35.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.358+0000 7f82c7fff640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f82d00cf030 0x7f82d006ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:35.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.358+0000 7f82ce59c640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f82d0154d10 0x7f82d00ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47676/0 (socket says 172.21.15.59:47676) 2023-10-16T14:27:35.363 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.359+0000 7f82ce59c640 1 -- 172.21.15.59:0/2200983936 learned_addr learned my addr 172.21.15.59:0/2200983936 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.359+0000 7f82ced9d640 1 --2- 172.21.15.59:0/2200983936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82d006d360 0x7f82d00ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.359+0000 7f82c7fff640 1 -- 172.21.15.59:0/2200983936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82d006d360 msgr2=0x7f82d00ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.359+0000 7f82c7fff640 1 --2- 172.21.15.59:0/2200983936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82d006d360 0x7f82d00ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.359+0000 7f82c7fff640 1 -- 172.21.15.59:0/2200983936 >> v1:172.21.15.59:6789/0 conn(0x7f82d0154d10 legacy=0x7f82d00ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.359+0000 7f82c7fff640 1 -- 172.21.15.59:0/2200983936 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d00b16d0 con 0x7f82d00cf030 2023-10-16T14:27:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.359+0000 7f82ced9d640 1 --2- 172.21.15.59:0/2200983936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82d006d360 0x7f82d00ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.359+0000 7f82cdd9b640 1 -- 172.21.15.59:0/2200983936 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685144213 0 0) 0x7f82d01550f0 con 0x7f82d0154d10 2023-10-16T14:27:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.360+0000 7f82c7fff640 1 --2- 172.21.15.59:0/2200983936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d00cf030 0x7f82d006ce20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f82b80097a0 tx=0x7f82b802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b086b071f5a181 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.361+0000 7f82cdd9b640 1 -- 172.21.15.59:0/2200983936 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b802d040 con 0x7f82d00cf030 2023-10-16T14:27:35.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.361+0000 7f82cdd9b640 1 -- 172.21.15.59:0/2200983936 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b8031810 con 0x7f82d00cf030 2023-10-16T14:27:35.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.361+0000 7f82cdd9b640 1 -- 172.21.15.59:0/2200983936 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8031ba0 con 0x7f82d00cf030 2023-10-16T14:27:35.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.361+0000 7f82cf59e640 1 -- 172.21.15.59:0/2200983936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d00cf030 msgr2=0x7f82d006ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:35.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.361+0000 7f82cf59e640 1 --2- 172.21.15.59:0/2200983936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d00cf030 0x7f82d006ce20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f82b80097a0 tx=0x7f82b802b8b0 comp rx=0 tx=0).stop 2023-10-16T14:27:35.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.361+0000 7f82cf59e640 1 -- 172.21.15.59:0/2200983936 shutdown_connections 2023-10-16T14:27:35.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.361+0000 7f82cf59e640 1 --2- 172.21.15.59:0/2200983936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82d006d360 0x7f82d00ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:35.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.361+0000 7f82cf59e640 1 --2- 172.21.15.59:0/2200983936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d00cf030 0x7f82d006ce20 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:35.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.361+0000 7f82cf59e640 1 -- 172.21.15.59:0/2200983936 >> 172.21.15.59:0/2200983936 conn(0x7f82d006a200 msgr2=0x7f82d006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:35.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.361+0000 7f82cf59e640 1 -- 172.21.15.59:0/2200983936 shutdown_connections 2023-10-16T14:27:35.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.361+0000 7f82cf59e640 1 -- 172.21.15.59:0/2200983936 wait complete. 2023-10-16T14:27:35.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.363+0000 7f82cf59e640 1 Processor -- start 2023-10-16T14:27:35.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.363+0000 7f82cf59e640 1 -- start start 2023-10-16T14:27:35.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.364+0000 7f82cf59e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d006d360 0x7f82d015a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:35.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.364+0000 7f82cf59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82d00cf030 0x7f82d0152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:35.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.364+0000 7f82cf59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82d0154d10 0x7f82d0153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:35.371 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.364+0000 7f82cf59e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d0159fa0 con 0x7f82d006d360 2023-10-16T14:27:35.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.364+0000 7f82cf59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00b27d0 con 0x7f82d00cf030 2023-10-16T14:27:35.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.364+0000 7f82cf59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d0159390 con 0x7f82d0154d10 2023-10-16T14:27:35.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.365+0000 7f82ce59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d006d360 0x7f82d015a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:35.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.365+0000 7f82ce59c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d006d360 0x7f82d015a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43620/0 (socket says 172.21.15.59:43620) 2023-10-16T14:27:35.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.365+0000 7f82ce59c640 1 -- 172.21.15.59:0/1183948912 learned_addr learned my addr 172.21.15.59:0/1183948912 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:35.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.365+0000 7f82ce59c640 1 -- 172.21.15.59:0/1183948912 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82d0154d10 msgr2=0x7f82d0153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:35.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.365+0000 7f82ce59c640 1 --2- 172.21.15.59:0/1183948912 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82d0154d10 0x7f82d0153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:35.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.365+0000 7f82ce59c640 1 -- 172.21.15.59:0/1183948912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82d00cf030 msgr2=0x7f82d0152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:35.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.365+0000 7f82ce59c640 1 --2- 172.21.15.59:0/1183948912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82d00cf030 0x7f82d0152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:35.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.365+0000 7f82ce59c640 1 -- 172.21.15.59:0/1183948912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b8009400 con 0x7f82d006d360 2023-10-16T14:27:35.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.365+0000 7f82ce59c640 1 --2- 172.21.15.59:0/1183948912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d006d360 0x7f82d015a430 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f82c000c430 tx=0x7f82c000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.366+0000 7f82c6ffd640 1 -- 172.21.15.59:0/1183948912 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c00074e0 con 0x7f82d006d360 2023-10-16T14:27:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.366+0000 7f82c6ffd640 1 -- 172.21.15.59:0/1183948912 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c0007660 con 0x7f82d006d360 2023-10-16T14:27:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.366+0000 7f82c6ffd640 1 -- 172.21.15.59:0/1183948912 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c0004a20 con 0x7f82d006d360 2023-10-16T14:27:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.366+0000 7f82cf59e640 1 -- 172.21.15.59:0/1183948912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d0159670 con 0x7f82d006d360 2023-10-16T14:27:35.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.366+0000 7f82cf59e640 1 -- 172.21.15.59:0/1183948912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d0159c30 con 0x7f82d006d360 2023-10-16T14:27:35.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.367+0000 7f82cf59e640 1 -- 172.21.15.59:0/1183948912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d004e9b0 con 0x7f82d006d360 2023-10-16T14:27:35.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.368+0000 7f82c6ffd640 1 -- 172.21.15.59:0/1183948912 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f82c0004b80 con 0x7f82d006d360 2023-10-16T14:27:35.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.369+0000 7f82c6ffd640 1 --2- 172.21.15.59:0/1183948912 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f82b006f280 0x7f82b0071740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:35.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.369+0000 7f82c6ffd640 1 -- 172.21.15.59:0/1183948912 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f82c0089640 con 0x7f82d006d360 2023-10-16T14:27:35.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.370+0000 7f82c7fff640 1 --2- 172.21.15.59:0/1183948912 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f82b006f280 0x7f82b0071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:35.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.371+0000 7f82c7fff640 1 --2- 172.21.15.59:0/1183948912 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f82b006f280 0x7f82b0071740 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f82b8036000 tx=0x7f82b8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:35.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.374+0000 7f82c6ffd640 1 -- 172.21.15.59:0/1183948912 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f82c00545b0 con 0x7f82d006d360 2023-10-16T14:27:35.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:35.613+0000 7f82cf59e640 1 -- 172.21.15.59:0/1183948912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f82d006c9d0 con 0x7f82d006d360 2023-10-16T14:27:36.115 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.112+0000 7f82c6ffd640 1 -- 172.21.15.59:0/1183948912 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f82c0057bd0 con 0x7f82d006d360 2023-10-16T14:27:36.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.115+0000 7f82cf59e640 1 -- 172.21.15.59:0/1183948912 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f82b006f280 msgr2=0x7f82b0071740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:36.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.115+0000 7f82cf59e640 1 --2- 172.21.15.59:0/1183948912 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f82b006f280 0x7f82b0071740 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f82b8036000 tx=0x7f82b8030000 comp rx=0 tx=0).stop 2023-10-16T14:27:36.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.115+0000 7f82cf59e640 1 -- 172.21.15.59:0/1183948912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d006d360 msgr2=0x7f82d015a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:36.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.115+0000 7f82cf59e640 1 --2- 172.21.15.59:0/1183948912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d006d360 0x7f82d015a430 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f82c000c430 tx=0x7f82c000c8f0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.119 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.115+0000 7f82cf59e640 1 -- 172.21.15.59:0/1183948912 shutdown_connections 2023-10-16T14:27:36.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.115+0000 7f82cf59e640 1 --2- 172.21.15.59:0/1183948912 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f82b006f280 0x7f82b0071740 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.115+0000 7f82cf59e640 1 --2- 172.21.15.59:0/1183948912 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82d0154d10 0x7f82d0153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.115+0000 7f82cf59e640 1 --2- 172.21.15.59:0/1183948912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82d00cf030 0x7f82d0152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.115+0000 7f82cf59e640 1 --2- 172.21.15.59:0/1183948912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d006d360 0x7f82d015a430 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.120 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.115+0000 7f82cf59e640 1 -- 172.21.15.59:0/1183948912 >> 172.21.15.59:0/1183948912 conn(0x7f82d006a200 msgr2=0x7f82d00ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:36.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.115+0000 7f82cf59e640 1 -- 172.21.15.59:0/1183948912 shutdown_connections 2023-10-16T14:27:36.121 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.116+0000 7f82cf59e640 1 -- 172.21.15.59:0/1183948912 wait complete. 2023-10-16T14:27:36.139 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-16T14:27:36.140 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T14:27:36.367 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.364+0000 7f29d14c9640 1 Processor -- start 2023-10-16T14:27:36.368 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.364+0000 7f29d14c9640 1 -- start start 2023-10-16T14:27:36.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.365+0000 7f29d14c9640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f29cc15ad00 0x7f29cc0701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:36.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.365+0000 7f29d14c9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29cc15f040 0x7f29cc15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:36.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.365+0000 7f29d14c9640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29cc0707f0 con 0x7f29cc0b0010 2023-10-16T14:27:36.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.365+0000 7f29d14c9640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29cc070ad0 con 0x7f29cc15ad00 2023-10-16T14:27:36.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.365+0000 7f29d14c9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc15b1d0 con 0x7f29cc15f040 2023-10-16T14:27:36.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.366+0000 7f29caffd640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f29cc0b0010 0x7f29cc0b03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47690/0 (socket says 172.21.15.59:47690) 2023-10-16T14:27:36.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.366+0000 7f29caffd640 1 -- 172.21.15.59:0/1465031056 learned_addr learned my addr 172.21.15.59:0/1465031056 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:36.370 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.366+0000 7f29ca7fc640 1 --2- 172.21.15.59:0/1465031056 >> v2:172.21.15.59:3300/0 conn(0x7f29cc15ad00 0x7f29cc0701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:36.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.366+0000 7f29cb7fe640 1 --2- 172.21.15.59:0/1465031056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29cc15f040 0x7f29cc15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:36.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.366+0000 7f29c9ffb640 1 -- 172.21.15.59:0/1465031056 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132123947 0 0) 0x7f29cc0707f0 con 0x7f29cc0b0010 2023-10-16T14:27:36.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.366+0000 7f29c9ffb640 1 -- 172.21.15.59:0/1465031056 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29b8003520 con 0x7f29cc0b0010 2023-10-16T14:27:36.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.366+0000 7f29ca7fc640 1 -- 172.21.15.59:0/1465031056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29cc15f040 msgr2=0x7f29cc15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:36.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.366+0000 7f29ca7fc640 1 --2- 172.21.15.59:0/1465031056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29cc15f040 0x7f29cc15b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.366+0000 7f29ca7fc640 1 -- 172.21.15.59:0/1465031056 >> v1:172.21.15.59:6789/0 conn(0x7f29cc0b0010 legacy=0x7f29cc0b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:36.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.366+0000 7f29ca7fc640 1 -- 172.21.15.59:0/1465031056 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc15b4b0 con 0x7f29cc15ad00 2023-10-16T14:27:36.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.368+0000 7f29ca7fc640 1 --2- 172.21.15.59:0/1465031056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29cc15ad00 0x7f29cc0701a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009d90 tx=0x7f29b402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306bd629adc3d976 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:36.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.368+0000 7f29c9ffb640 1 -- 172.21.15.59:0/1465031056 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b402cc50 con 0x7f29cc15ad00 2023-10-16T14:27:36.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.368+0000 7f29c9ffb640 1 -- 172.21.15.59:0/1465031056 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b402cdb0 con 0x7f29cc15ad00 2023-10-16T14:27:36.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.368+0000 7f29c9ffb640 1 -- 172.21.15.59:0/1465031056 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4034660 con 0x7f29cc15ad00 2023-10-16T14:27:36.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.369+0000 7f29d14c9640 1 -- 172.21.15.59:0/1465031056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29cc15ad00 msgr2=0x7f29cc0701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:36.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.369+0000 7f29d14c9640 1 --2- 172.21.15.59:0/1465031056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29cc15ad00 0x7f29cc0701a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009d90 tx=0x7f29b402bea0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.369+0000 7f29d14c9640 1 -- 172.21.15.59:0/1465031056 shutdown_connections 2023-10-16T14:27:36.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.369+0000 7f29d14c9640 1 --2- 172.21.15.59:0/1465031056 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29cc15f040 0x7f29cc15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.369+0000 7f29d14c9640 1 --2- 172.21.15.59:0/1465031056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29cc15ad00 0x7f29cc0701a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.369+0000 7f29d14c9640 1 -- 172.21.15.59:0/1465031056 >> 172.21.15.59:0/1465031056 conn(0x7f29cc06c1c0 msgr2=0x7f29cc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:36.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.369+0000 7f29d14c9640 1 -- 172.21.15.59:0/1465031056 shutdown_connections 2023-10-16T14:27:36.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.369+0000 7f29d14c9640 1 -- 172.21.15.59:0/1465031056 wait complete. 2023-10-16T14:27:36.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.371+0000 7f29d14c9640 1 Processor -- start 2023-10-16T14:27:36.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.371+0000 7f29d14c9640 1 -- start start 2023-10-16T14:27:36.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.372+0000 7f29d14c9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29cc0b0010 0x7f29cc147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:36.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.372+0000 7f29d14c9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29cc15ad00 0x7f29cc0c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:36.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.372+0000 7f29d14c9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29cc15f040 0x7f29cc0c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:36.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.372+0000 7f29d14c9640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0c4b60 con 0x7f29cc15ad00 2023-10-16T14:27:36.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.372+0000 7f29d14c9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0c6110 con 0x7f29cc15f040 2023-10-16T14:27:36.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.372+0000 7f29d14c9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0c63f0 con 0x7f29cc0b0010 2023-10-16T14:27:36.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.372+0000 7f29ca7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29cc15ad00 0x7f29cc0c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:36.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.373+0000 7f29ca7fc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29cc15ad00 0x7f29cc0c20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43628/0 (socket says 172.21.15.59:43628) 2023-10-16T14:27:36.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.373+0000 7f29ca7fc640 1 -- 172.21.15.59:0/778717317 learned_addr learned my addr 172.21.15.59:0/778717317 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:36.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.373+0000 7f29caffd640 1 --2- 172.21.15.59:0/778717317 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29cc0b0010 0x7f29cc147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:36.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.373+0000 7f29cb7fe640 1 --2- 172.21.15.59:0/778717317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29cc15f040 0x7f29cc0c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:36.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.373+0000 7f29ca7fc640 1 -- 172.21.15.59:0/778717317 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29cc0b0010 msgr2=0x7f29cc147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:36.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.373+0000 7f29ca7fc640 1 --2- 172.21.15.59:0/778717317 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29cc0b0010 0x7f29cc147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.373+0000 7f29ca7fc640 1 -- 172.21.15.59:0/778717317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29cc15f040 msgr2=0x7f29cc0c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:36.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.373+0000 7f29ca7fc640 1 --2- 172.21.15.59:0/778717317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29cc15f040 0x7f29cc0c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.373+0000 7f29ca7fc640 1 -- 172.21.15.59:0/778717317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b4009a70 con 0x7f29cc15ad00 2023-10-16T14:27:36.381 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.373+0000 7f29ca7fc640 1 --2- 172.21.15.59:0/778717317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29cc15ad00 0x7f29cc0c20c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009d90 tx=0x7f29b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:36.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.374+0000 7f29c37fe640 1 -- 172.21.15.59:0/778717317 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4040650 con 0x7f29cc15ad00 2023-10-16T14:27:36.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.374+0000 7f29c37fe640 1 -- 172.21.15.59:0/778717317 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b40407b0 con 0x7f29cc15ad00 2023-10-16T14:27:36.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.374+0000 7f29d14c9640 1 -- 172.21.15.59:0/778717317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29cc0c66d0 con 0x7f29cc15ad00 2023-10-16T14:27:36.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.374+0000 7f29c37fe640 1 -- 172.21.15.59:0/778717317 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4040b60 con 0x7f29cc15ad00 2023-10-16T14:27:36.382 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.374+0000 7f29d14c9640 1 -- 172.21.15.59:0/778717317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29cc1481a0 con 0x7f29cc15ad00 2023-10-16T14:27:36.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.375+0000 7f29d14c9640 1 -- 172.21.15.59:0/778717317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29cc0c68e0 con 0x7f29cc15ad00 2023-10-16T14:27:36.383 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.376+0000 7f29c37fe640 1 -- 172.21.15.59:0/778717317 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f29b4040cc0 con 0x7f29cc15ad00 2023-10-16T14:27:36.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.378+0000 7f29c37fe640 1 --2- 172.21.15.59:0/778717317 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f29ac06aea0 0x7f29ac06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:36.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.378+0000 7f29c37fe640 1 -- 172.21.15.59:0/778717317 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f29b40ac2c0 con 0x7f29cc15ad00 2023-10-16T14:27:36.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.379+0000 7f29caffd640 1 --2- 172.21.15.59:0/778717317 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f29ac06aea0 0x7f29ac06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:36.384 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.380+0000 7f29caffd640 1 --2- 172.21.15.59:0/778717317 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f29ac06aea0 0x7f29ac06d360 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0011e0 tx=0x7f29bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:36.386 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.382+0000 7f29c37fe640 1 -- 172.21.15.59:0/778717317 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f29b40773e0 con 0x7f29cc15ad00 2023-10-16T14:27:36.617 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.613+0000 7f29d14c9640 1 -- 172.21.15.59:0/778717317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29cc073ef0 con 0x7f29cc15ad00 2023-10-16T14:27:36.618 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.615+0000 7f29c37fe640 1 -- 172.21.15.59:0/778717317 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f29b407aa00 con 0x7f29cc15ad00 2023-10-16T14:27:36.618 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:36.619 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2783803543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2783803543},{"type":"v1","addr":"172.21.15.59:6835","nonce":2783803543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/1792159151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1792159151},{"type":"v1","addr":"172.21.15.151:6836","nonce":1792159151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/2122504326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":2122504326},{"type":"v1","addr":"172.21.15.151:6837","nonce":2122504326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T14:27:32.522877+0000","modified":"2023-10-16T14:27:35.615208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5418":{"gid":5418,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6833/1364699887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1364699887},{"type":"v1","addr":"172.21.15.59:6833","nonce":1364699887}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T14:27:36.619 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 18 2023-10-16T14:27:36.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.617+0000 7f29d14c9640 1 -- 172.21.15.59:0/778717317 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f29ac06aea0 msgr2=0x7f29ac06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:36.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.617+0000 7f29d14c9640 1 --2- 172.21.15.59:0/778717317 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f29ac06aea0 0x7f29ac06d360 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0011e0 tx=0x7f29bc009040 comp rx=0 tx=0).stop 2023-10-16T14:27:36.621 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.617+0000 7f29d14c9640 1 -- 172.21.15.59:0/778717317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29cc15ad00 msgr2=0x7f29cc0c20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:36.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.617+0000 7f29d14c9640 1 --2- 172.21.15.59:0/778717317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29cc15ad00 0x7f29cc0c20c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009d90 tx=0x7f29b4004a40 comp rx=0 tx=0).stop 2023-10-16T14:27:36.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.617+0000 7f29d14c9640 1 -- 172.21.15.59:0/778717317 shutdown_connections 2023-10-16T14:27:36.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.617+0000 7f29d14c9640 1 --2- 172.21.15.59:0/778717317 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f29ac06aea0 0x7f29ac06d360 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.618+0000 7f29d14c9640 1 --2- 172.21.15.59:0/778717317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29cc15f040 0x7f29cc0c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.618+0000 7f29d14c9640 1 --2- 172.21.15.59:0/778717317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29cc15ad00 0x7f29cc0c20c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.622 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.618+0000 7f29d14c9640 1 --2- 172.21.15.59:0/778717317 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29cc0b0010 0x7f29cc147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.618+0000 7f29d14c9640 1 -- 172.21.15.59:0/778717317 >> 172.21.15.59:0/778717317 conn(0x7f29cc06c1c0 msgr2=0x7f29cc0adfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:36.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.618+0000 7f29d14c9640 1 -- 172.21.15.59:0/778717317 shutdown_connections 2023-10-16T14:27:36.623 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.618+0000 7f29d14c9640 1 -- 172.21.15.59:0/778717317 wait complete. 2023-10-16T14:27:36.641 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-16T14:27:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.863+0000 7f03a496b640 1 Processor -- start 2023-10-16T14:27:36.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.863+0000 7f03a496b640 1 -- start start 2023-10-16T14:27:36.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.864+0000 7f03a496b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03a00cb250 0x7f03a00c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:36.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.864+0000 7f03a496b640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f03a00ca660 0x7f03a00c9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:36.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.864+0000 7f03a496b640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a015acb0 con 0x7f03a015a8d0 2023-10-16T14:27:36.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.864+0000 7f03a496b640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a00c1c60 con 0x7f03a00ca660 2023-10-16T14:27:36.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.864+0000 7f03a496b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a015e350 con 0x7f03a00cb250 2023-10-16T14:27:36.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.865+0000 7f039ed9d640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f03a015a8d0 0x7f03a00cab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47702/0 (socket says 172.21.15.59:47702) 2023-10-16T14:27:36.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.865+0000 7f039ed9d640 1 -- 172.21.15.59:0/3742801182 learned_addr learned my addr 172.21.15.59:0/3742801182 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:36.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.865+0000 7f039f59e640 1 --2- 172.21.15.59:0/3742801182 >> v2:172.21.15.59:3300/0 conn(0x7f03a00ca660 0x7f03a00c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:36.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.865+0000 7f039dd9b640 1 -- 172.21.15.59:0/3742801182 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200078268 0 0) 0x7f0390001290 con 0x7f03a015a8d0 2023-10-16T14:27:36.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.865+0000 7f039e59c640 1 --2- 172.21.15.59:0/3742801182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03a00cb250 0x7f03a00c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:36.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.865+0000 7f039dd9b640 1 -- 172.21.15.59:0/3742801182 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0388003520 con 0x7f03a015a8d0 2023-10-16T14:27:36.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.865+0000 7f039f59e640 1 -- 172.21.15.59:0/3742801182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03a00cb250 msgr2=0x7f03a00c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:36.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.865+0000 7f039f59e640 1 --2- 172.21.15.59:0/3742801182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03a00cb250 0x7f03a00c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.865+0000 7f039f59e640 1 -- 172.21.15.59:0/3742801182 >> v1:172.21.15.59:6789/0 conn(0x7f03a015a8d0 legacy=0x7f03a00cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:36.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.865+0000 7f039f59e640 1 -- 172.21.15.59:0/3742801182 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a015e630 con 0x7f03a00ca660 2023-10-16T14:27:36.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.867+0000 7f039f59e640 1 --2- 172.21.15.59:0/3742801182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03a00ca660 0x7f03a00c9350 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0398009d90 tx=0x7f039802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fd492c0da9f815 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:36.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.867+0000 7f039dd9b640 1 -- 172.21.15.59:0/3742801182 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039802cc50 con 0x7f03a00ca660 2023-10-16T14:27:36.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.867+0000 7f039dd9b640 1 -- 172.21.15.59:0/3742801182 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039802cdb0 con 0x7f03a00ca660 2023-10-16T14:27:36.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.867+0000 7f039dd9b640 1 -- 172.21.15.59:0/3742801182 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0398034660 con 0x7f03a00ca660 2023-10-16T14:27:36.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.867+0000 7f03a496b640 1 -- 172.21.15.59:0/3742801182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03a00ca660 msgr2=0x7f03a00c9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:36.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.867+0000 7f03a496b640 1 --2- 172.21.15.59:0/3742801182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03a00ca660 0x7f03a00c9350 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0398009d90 tx=0x7f039802bea0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.868+0000 7f03a496b640 1 -- 172.21.15.59:0/3742801182 shutdown_connections 2023-10-16T14:27:36.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.868+0000 7f03a496b640 1 --2- 172.21.15.59:0/3742801182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03a00ca660 0x7f03a00c9350 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.868+0000 7f03a496b640 1 --2- 172.21.15.59:0/3742801182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03a00cb250 0x7f03a00c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.868+0000 7f03a496b640 1 -- 172.21.15.59:0/3742801182 >> 172.21.15.59:0/3742801182 conn(0x7f03a006a470 msgr2=0x7f03a00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:36.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.868+0000 7f03a496b640 1 -- 172.21.15.59:0/3742801182 shutdown_connections 2023-10-16T14:27:36.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.868+0000 7f03a496b640 1 -- 172.21.15.59:0/3742801182 wait complete. 2023-10-16T14:27:36.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.869+0000 7f03a496b640 1 Processor -- start 2023-10-16T14:27:36.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.870+0000 7f03a496b640 1 -- start start 2023-10-16T14:27:36.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.870+0000 7f03a496b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03a00ca660 0x7f03a014fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:36.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.870+0000 7f03a496b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03a00cb250 0x7f03a015b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:36.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.870+0000 7f03a496b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03a015a8d0 0x7f03a00c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:36.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.870+0000 7f03a496b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a01f5b90 con 0x7f03a00ca660 2023-10-16T14:27:36.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.870+0000 7f03a496b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a01f5e70 con 0x7f03a015a8d0 2023-10-16T14:27:36.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.870+0000 7f03a496b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a01f6150 con 0x7f03a00cb250 2023-10-16T14:27:36.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.871+0000 7f039ed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03a00ca660 0x7f03a014fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:36.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.871+0000 7f039ed9d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03a00ca660 0x7f03a014fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43644/0 (socket says 172.21.15.59:43644) 2023-10-16T14:27:36.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.871+0000 7f039ed9d640 1 -- 172.21.15.59:0/3657124642 learned_addr learned my addr 172.21.15.59:0/3657124642 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:36.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.871+0000 7f039e59c640 1 --2- 172.21.15.59:0/3657124642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03a00cb250 0x7f03a015b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:36.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.871+0000 7f039f59e640 1 --2- 172.21.15.59:0/3657124642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03a015a8d0 0x7f03a00c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:36.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.871+0000 7f039ed9d640 1 -- 172.21.15.59:0/3657124642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03a00cb250 msgr2=0x7f03a015b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:36.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.871+0000 7f039ed9d640 1 --2- 172.21.15.59:0/3657124642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03a00cb250 0x7f03a015b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.871+0000 7f039ed9d640 1 -- 172.21.15.59:0/3657124642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03a015a8d0 msgr2=0x7f03a00c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:36.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.871+0000 7f039ed9d640 1 --2- 172.21.15.59:0/3657124642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03a015a8d0 0x7f03a00c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:36.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.871+0000 7f039ed9d640 1 -- 172.21.15.59:0/3657124642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0398009a70 con 0x7f03a00ca660 2023-10-16T14:27:36.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.871+0000 7f039f59e640 1 --2- 172.21.15.59:0/3657124642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03a015a8d0 0x7f03a00c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:36.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.871+0000 7f039e59c640 1 --2- 172.21.15.59:0/3657124642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03a00cb250 0x7f03a015b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:36.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.872+0000 7f039ed9d640 1 --2- 172.21.15.59:0/3657124642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03a00ca660 0x7f03a014fbb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f039000c400 tx=0x7f039000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:36.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.872+0000 7f03877fe640 1 -- 172.21.15.59:0/3657124642 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03900074e0 con 0x7f03a00ca660 2023-10-16T14:27:36.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.872+0000 7f03877fe640 1 -- 172.21.15.59:0/3657124642 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0390007640 con 0x7f03a00ca660 2023-10-16T14:27:36.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.872+0000 7f03877fe640 1 -- 172.21.15.59:0/3657124642 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03900059c0 con 0x7f03a00ca660 2023-10-16T14:27:36.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.872+0000 7f03a496b640 1 -- 172.21.15.59:0/3657124642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a01f6430 con 0x7f03a00ca660 2023-10-16T14:27:36.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.872+0000 7f03a496b640 1 -- 172.21.15.59:0/3657124642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a0150b70 con 0x7f03a00ca660 2023-10-16T14:27:36.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.873+0000 7f03a496b640 1 -- 172.21.15.59:0/3657124642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a01f6950 con 0x7f03a00ca660 2023-10-16T14:27:36.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.874+0000 7f03877fe640 1 -- 172.21.15.59:0/3657124642 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0390005b20 con 0x7f03a00ca660 2023-10-16T14:27:36.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.876+0000 7f03877fe640 1 --2- 172.21.15.59:0/3657124642 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f038c06ae70 0x7f038c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:36.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.876+0000 7f03877fe640 1 -- 172.21.15.59:0/3657124642 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0390088cf0 con 0x7f03a00ca660 2023-10-16T14:27:36.883 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.876+0000 7f039e59c640 1 --2- 172.21.15.59:0/3657124642 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f038c06ae70 0x7f038c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:36.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.878+0000 7f039e59c640 1 --2- 172.21.15.59:0/3657124642 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f038c06ae70 0x7f038c06d330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f03a00c5e80 tx=0x7f0394008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:36.884 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:36.880+0000 7f03877fe640 1 -- 172.21.15.59:0/3657124642 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f03a01f6950 con 0x7f03a00ca660 2023-10-16T14:27:37.079 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.076+0000 7f03a496b640 1 -- 172.21.15.59:0/3657124642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03a015acb0 con 0x7f03a00ca660 2023-10-16T14:27:37.081 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.078+0000 7f03877fe640 1 -- 172.21.15.59:0/3657124642 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16774 (secure 0 0 0) 0x7f03a015acb0 con 0x7f03a00ca660 2023-10-16T14:27:37.082 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:37.083 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":40,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","created":"2023-10-16T14:25:22.851899+0000","modified":"2023-10-16T14:27:33.646653+0000","last_up_change":"2023-10-16T14:25:36.449944+0000","last_in_change":"2023-10-16T14:25:27.139559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-16T14:25:35.938794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-16T14:27:30.736808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-16T14:27:31.542632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ecfef601-5846-4644-9d90-39255222e833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6825","nonce":3017630955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6827","nonce":3017630955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6831","nonce":3017630955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":3017630955},{"type":"v1","addr":"172.21.15.59:6829","nonce":3017630955}]},"public_addr":"172.21.15.59:6825/3017630955","cluster_addr":"172.21.15.59:6827/3017630955","heartbeat_back_addr":"172.21.15.59:6831/3017630955","heartbeat_front_addr":"172.21.15.59:6829/3017630955","state":["exists","up"]},{"osd":1,"uuid":"24e481f7-971b-465f-92f4-55ae0c62b865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6801","nonce":1115424190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6803","nonce":1115424190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6807","nonce":1115424190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":1115424190},{"type":"v1","addr":"172.21.15.59:6805","nonce":1115424190}]},"public_addr":"172.21.15.59:6801/1115424190","cluster_addr":"172.21.15.59:6803/1115424190","heartbeat_back_addr":"172.21.15.59:6807/1115424190","heartbeat_front_addr":"172.21.15.59:6805/1115424190","state":["exists","up"]},{"osd":2,"uuid":"a6bfd0b1-f20b-4e88-acde-68c5c088b10b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6812","nonce":3082385432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6813","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6815","nonce":3082385432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6821","nonce":3082385432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":3082385432},{"type":"v1","addr":"172.21.15.59:6818","nonce":3082385432}]},"public_addr":"172.21.15.59:6812/3082385432","cluster_addr":"172.21.15.59:6815/3082385432","heartbeat_back_addr":"172.21.15.59:6821/3082385432","heartbeat_front_addr":"172.21.15.59:6818/3082385432","state":["exists","up"]},{"osd":3,"uuid":"cb0fe00b-467a-4b4c-8387-8d5a27c0377e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6809","nonce":991070902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6814","nonce":991070902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6823","nonce":991070902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6817","nonce":991070902},{"type":"v1","addr":"172.21.15.59:6819","nonce":991070902}]},"public_addr":"172.21.15.59:6809/991070902","cluster_addr":"172.21.15.59:6814/991070902","heartbeat_back_addr":"172.21.15.59:6823/991070902","heartbeat_front_addr":"172.21.15.59:6819/991070902","state":["exists","up"]},{"osd":4,"uuid":"d18a92fc-8162-44ba-9199-d862e7fa99d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6827","nonce":2389221530}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6829","nonce":2389221530}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6833","nonce":2389221530}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2389221530},{"type":"v1","addr":"172.21.15.151:6831","nonce":2389221530}]},"public_addr":"172.21.15.151:6827/2389221530","cluster_addr":"172.21.15.151:6829/2389221530","heartbeat_back_addr":"172.21.15.151:6833/2389221530","heartbeat_front_addr":"172.21.15.151:6831/2389221530","state":["exists","up"]},{"osd":5,"uuid":"b0bbab42-0435-48b3-bc04-b16fdcfe05f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6803","nonce":2616669147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6805","nonce":2616669147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6809","nonce":2616669147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":2616669147},{"type":"v1","addr":"172.21.15.151:6807","nonce":2616669147}]},"public_addr":"172.21.15.151:6803/2616669147","cluster_addr":"172.21.15.151:6805/2616669147","heartbeat_back_addr":"172.21.15.151:6809/2616669147","heartbeat_front_addr":"172.21.15.151:6807/2616669147","state":["exists","up"]},{"osd":6,"uuid":"a8d8fd95-461a-4e77-8c7c-fab5630fe973","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6811","nonce":2667191375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6813","nonce":2667191375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6817","nonce":2667191375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2667191375},{"type":"v1","addr":"172.21.15.151:6815","nonce":2667191375}]},"public_addr":"172.21.15.151:6811/2667191375","cluster_addr":"172.21.15.151:6813/2667191375","heartbeat_back_addr":"172.21.15.151:6817/2667191375","heartbeat_front_addr":"172.21.15.151:6815/2667191375","state":["exists","up"]},{"osd":7,"uuid":"08a304fa-295c-480a-bb67-9e263e07760b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6819","nonce":2847259334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6821","nonce":2847259334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6825","nonce":2847259334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":2847259334},{"type":"v1","addr":"172.21.15.151:6823","nonce":2847259334}]},"public_addr":"172.21.15.151:6819/2847259334","cluster_addr":"172.21.15.151:6821/2847259334","heartbeat_back_addr":"172.21.15.151:6825/2847259334","heartbeat_front_addr":"172.21.15.151:6823/2847259334","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.567010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.240837+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.463072+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.442094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.510396+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:31.969387+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.472894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-16T14:25:32.480932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-16T14:27:37.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.081+0000 7f03a496b640 1 -- 172.21.15.59:0/3657124642 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f038c06ae70 msgr2=0x7f038c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:37.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.081+0000 7f03a496b640 1 --2- 172.21.15.59:0/3657124642 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f038c06ae70 0x7f038c06d330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f03a00c5e80 tx=0x7f0394008040 comp rx=0 tx=0).stop 2023-10-16T14:27:37.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.081+0000 7f03a496b640 1 -- 172.21.15.59:0/3657124642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03a00ca660 msgr2=0x7f03a014fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:37.085 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.081+0000 7f03a496b640 1 --2- 172.21.15.59:0/3657124642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03a00ca660 0x7f03a014fbb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f039000c400 tx=0x7f039000c8c0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.081+0000 7f03a496b640 1 -- 172.21.15.59:0/3657124642 shutdown_connections 2023-10-16T14:27:37.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.081+0000 7f03a496b640 1 --2- 172.21.15.59:0/3657124642 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f038c06ae70 0x7f038c06d330 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.086 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.081+0000 7f03a496b640 1 --2- 172.21.15.59:0/3657124642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03a015a8d0 0x7f03a00c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.081+0000 7f03a496b640 1 --2- 172.21.15.59:0/3657124642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03a00cb250 0x7f03a015b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.081+0000 7f03a496b640 1 --2- 172.21.15.59:0/3657124642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03a00ca660 0x7f03a014fbb0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.081+0000 7f03a496b640 1 -- 172.21.15.59:0/3657124642 >> 172.21.15.59:0/3657124642 conn(0x7f03a006a470 msgr2=0x7f03a00aef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:37.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.082+0000 7f03a496b640 1 -- 172.21.15.59:0/3657124642 shutdown_connections 2023-10-16T14:27:37.087 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.082+0000 7f03a496b640 1 -- 172.21.15.59:0/3657124642 wait complete. 2023-10-16T14:27:37.106 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-16T14:27:37.106 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T14:27:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.319+0000 7fe806064640 1 Processor -- start 2023-10-16T14:27:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.319+0000 7fe806064640 1 -- start start 2023-10-16T14:27:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.320+0000 7fe806064640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe8000b0010 0x7fe8000701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.320+0000 7fe806064640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80015ad00 0x7fe80015f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.320+0000 7fe806064640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80015f580 con 0x7fe8000b03f0 2023-10-16T14:27:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.320+0000 7fe806064640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8000707f0 con 0x7fe8000b0010 2023-10-16T14:27:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.320+0000 7fe806064640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe800070ad0 con 0x7fe80015ad00 2023-10-16T14:27:37.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.321+0000 7fe7fffff640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fe8000b03f0 0x7fe80015b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.59:41770/0 (socket says 172.21.15.59:41770) 2023-10-16T14:27:37.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.321+0000 7fe7f6ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80015ad00 0x7fe80015f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:37.325 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.321+0000 7fe7fffff640 1 -- 172.21.15.59:0/2636312610 learned_addr learned my addr 172.21.15.59:0/2636312610 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.321+0000 7fe7ff7fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe8000b0010 0x7fe8000701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.322+0000 7fe7ff7fe640 1 -- 172.21.15.59:0/2636312610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80015ad00 msgr2=0x7fe80015f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.322+0000 7fe7ff7fe640 1 --2- 172.21.15.59:0/2636312610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80015ad00 0x7fe80015f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.322+0000 7fe7ff7fe640 1 -- 172.21.15.59:0/2636312610 >> v1:172.21.15.151:6789/0 conn(0x7fe8000b03f0 legacy=0x7fe80015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:37.326 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.322+0000 7fe7ff7fe640 1 -- 172.21.15.59:0/2636312610 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80015b1d0 con 0x7fe8000b0010 2023-10-16T14:27:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.322+0000 7fe7f6ffd640 1 --2- 172.21.15.59:0/2636312610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80015ad00 0x7fe80015f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-16T14:27:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.323+0000 7fe7ff7fe640 1 --2- 172.21.15.59:0/2636312610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8000b0010 0x7fe8000701a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0009d90 tx=0x7fe7f002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0ad7ef4ba2188c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.324+0000 7fe7feffd640 1 -- 172.21.15.59:0/2636312610 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f002cc50 con 0x7fe8000b0010 2023-10-16T14:27:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.324+0000 7fe7feffd640 1 -- 172.21.15.59:0/2636312610 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f002cdb0 con 0x7fe8000b0010 2023-10-16T14:27:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.324+0000 7fe7feffd640 1 -- 172.21.15.59:0/2636312610 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0034660 con 0x7fe8000b0010 2023-10-16T14:27:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.324+0000 7fe806064640 1 -- 172.21.15.59:0/2636312610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8000b0010 msgr2=0x7fe8000701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.324+0000 7fe806064640 1 --2- 172.21.15.59:0/2636312610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8000b0010 0x7fe8000701a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0009d90 tx=0x7fe7f002bea0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.324+0000 7fe806064640 1 -- 172.21.15.59:0/2636312610 shutdown_connections 2023-10-16T14:27:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.324+0000 7fe806064640 1 --2- 172.21.15.59:0/2636312610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80015ad00 0x7fe80015f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.324+0000 7fe806064640 1 --2- 172.21.15.59:0/2636312610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8000b0010 0x7fe8000701a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.324+0000 7fe806064640 1 -- 172.21.15.59:0/2636312610 >> 172.21.15.59:0/2636312610 conn(0x7fe80006c1c0 msgr2=0x7fe80006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.324+0000 7fe806064640 1 -- 172.21.15.59:0/2636312610 shutdown_connections 2023-10-16T14:27:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.324+0000 7fe806064640 1 -- 172.21.15.59:0/2636312610 wait complete. 2023-10-16T14:27:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.326+0000 7fe806064640 1 Processor -- start 2023-10-16T14:27:37.332 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.326+0000 7fe806064640 1 -- start start 2023-10-16T14:27:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.327+0000 7fe806064640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8000b0010 0x7fe800155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.327+0000 7fe806064640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8000b03f0 0x7fe80015e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.327+0000 7fe806064640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80015ad00 0x7fe8000c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.327+0000 7fe806064640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80015d590 con 0x7fe8000b03f0 2023-10-16T14:27:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.327+0000 7fe806064640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80015c910 con 0x7fe8000b0010 2023-10-16T14:27:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.327+0000 7fe806064640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80015cbf0 con 0x7fe80015ad00 2023-10-16T14:27:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.328+0000 7fe7f6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8000b03f0 0x7fe80015e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.328+0000 7fe7f6ffd640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8000b03f0 0x7fe80015e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43656/0 (socket says 172.21.15.59:43656) 2023-10-16T14:27:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.328+0000 7fe7f6ffd640 1 -- 172.21.15.59:0/2562070237 learned_addr learned my addr 172.21.15.59:0/2562070237 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.328+0000 7fe7ff7fe640 1 --2- 172.21.15.59:0/2562070237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8000b0010 0x7fe800155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:37.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.328+0000 7fe7fffff640 1 --2- 172.21.15.59:0/2562070237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80015ad00 0x7fe8000c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:37.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.328+0000 7fe7f6ffd640 1 -- 172.21.15.59:0/2562070237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80015ad00 msgr2=0x7fe8000c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:37.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.328+0000 7fe7f6ffd640 1 --2- 172.21.15.59:0/2562070237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80015ad00 0x7fe8000c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.328+0000 7fe7f6ffd640 1 -- 172.21.15.59:0/2562070237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8000b0010 msgr2=0x7fe800155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:37.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.328+0000 7fe7f6ffd640 1 --2- 172.21.15.59:0/2562070237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8000b0010 0x7fe800155c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.335 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.328+0000 7fe7f6ffd640 1 -- 172.21.15.59:0/2562070237 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e8009400 con 0x7fe8000b03f0 2023-10-16T14:27:37.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.328+0000 7fe7fffff640 1 --2- 172.21.15.59:0/2562070237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80015ad00 0x7fe8000c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:37.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.329+0000 7fe7f6ffd640 1 --2- 172.21.15.59:0/2562070237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8000b03f0 0x7fe80015e140 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe7e800e900 tx=0x7fe7e800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:37.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.329+0000 7fe7fcff9640 1 -- 172.21.15.59:0/2562070237 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e8009660 con 0x7fe8000b03f0 2023-10-16T14:27:37.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.329+0000 7fe7fcff9640 1 -- 172.21.15.59:0/2562070237 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e800ca00 con 0x7fe8000b03f0 2023-10-16T14:27:37.336 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.329+0000 7fe7fcff9640 1 -- 172.21.15.59:0/2562070237 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e800cdb0 con 0x7fe8000b03f0 2023-10-16T14:27:37.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.329+0000 7fe806064640 1 -- 172.21.15.59:0/2562070237 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f0009a70 con 0x7fe8000b03f0 2023-10-16T14:27:37.337 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.329+0000 7fe806064640 1 -- 172.21.15.59:0/2562070237 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80015d1b0 con 0x7fe8000b03f0 2023-10-16T14:27:37.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.330+0000 7fe806064640 1 -- 172.21.15.59:0/2562070237 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8000c2150 con 0x7fe8000b03f0 2023-10-16T14:27:37.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.331+0000 7fe7fcff9640 1 -- 172.21.15.59:0/2562070237 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe7e8013470 con 0x7fe8000b03f0 2023-10-16T14:27:37.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.332+0000 7fe7fcff9640 1 --2- 172.21.15.59:0/2562070237 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe7e006ae70 0x7fe7e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:37.338 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.332+0000 7fe7fcff9640 1 -- 172.21.15.59:0/2562070237 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe7e80895c0 con 0x7fe8000b03f0 2023-10-16T14:27:37.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.333+0000 7fe7ff7fe640 1 --2- 172.21.15.59:0/2562070237 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe7e006ae70 0x7fe7e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:37.339 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.334+0000 7fe7ff7fe640 1 --2- 172.21.15.59:0/2562070237 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe7e006ae70 0x7fe7e006d330 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0036000 tx=0x7fe7f0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:37.340 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.336+0000 7fe7fcff9640 1 -- 172.21.15.59:0/2562070237 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe7e8054520 con 0x7fe8000b03f0 2023-10-16T14:27:37.529 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.525+0000 7fe806064640 1 -- 172.21.15.59:0/2562070237 --> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe800070db0 con 0x7fe7e006ae70 2023-10-16T14:27:37.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.552+0000 7fe7fcff9640 1 -- 172.21.15.59:0/2562070237 <== mgr.4100 v2:172.21.15.151:6800/518957627 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278366 (secure 0 0 0) 0x7fe7f0009450 con 0x7fe7e006ae70 2023-10-16T14:27:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:37.561 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-16T14:27:37.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.558+0000 7fe806064640 1 -- 172.21.15.59:0/2562070237 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe7e006ae70 msgr2=0x7fe7e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:37.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.558+0000 7fe806064640 1 --2- 172.21.15.59:0/2562070237 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe7e006ae70 0x7fe7e006d330 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0036000 tx=0x7fe7f0030000 comp rx=0 tx=0).stop 2023-10-16T14:27:37.563 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.558+0000 7fe806064640 1 -- 172.21.15.59:0/2562070237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8000b03f0 msgr2=0x7fe80015e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:37.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.558+0000 7fe806064640 1 --2- 172.21.15.59:0/2562070237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8000b03f0 0x7fe80015e140 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe7e800e900 tx=0x7fe7e800edc0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.558+0000 7fe806064640 1 -- 172.21.15.59:0/2562070237 shutdown_connections 2023-10-16T14:27:37.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.558+0000 7fe806064640 1 --2- 172.21.15.59:0/2562070237 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fe7e006ae70 0x7fe7e006d330 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.558+0000 7fe806064640 1 --2- 172.21.15.59:0/2562070237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe80015ad00 0x7fe8000c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.564 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.558+0000 7fe806064640 1 --2- 172.21.15.59:0/2562070237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8000b03f0 0x7fe80015e140 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.558+0000 7fe806064640 1 --2- 172.21.15.59:0/2562070237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8000b0010 0x7fe800155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.559+0000 7fe806064640 1 -- 172.21.15.59:0/2562070237 >> 172.21.15.59:0/2562070237 conn(0x7fe80006c1c0 msgr2=0x7fe800158ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:37.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.559+0000 7fe806064640 1 -- 172.21.15.59:0/2562070237 shutdown_connections 2023-10-16T14:27:37.565 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.559+0000 7fe806064640 1 -- 172.21.15.59:0/2562070237 wait complete. 2023-10-16T14:27:37.580 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-10-16T14:27:35.910628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":140,"acting":140,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":24,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220568,"kb_used_data":4396,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754152,"statfs":{"total":773094113280,"available":772868251648,"internally_reserved":0,"allocated":4501504,"data_stored":2556905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.875374"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.058217+0000","last_change":"2023-10-16T14:27:32.058217+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.058217+0000","last_undegraded":"2023-10-16T14:27:32.058217+0000","last_fullsized":"2023-10-16T14:27:32.058217+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.060738+0000","last_change":"2023-10-16T14:27:32.060738+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.060738+0000","last_undegraded":"2023-10-16T14:27:32.060738+0000","last_fullsized":"2023-10-16T14:27:32.060738+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.062112+0000","last_change":"2023-10-16T14:27:32.062112+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.062112+0000","last_undegraded":"2023-10-16T14:27:32.062112+0000","last_fullsized":"2023-10-16T14:27:32.062112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.062705+0000","last_change":"2023-10-16T14:27:32.062705+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.062705+0000","last_undegraded":"2023-10-16T14:27:32.062705+0000","last_fullsized":"2023-10-16T14:27:32.062705+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.051001+0000","last_change":"2023-10-16T14:27:32.051001+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.051001+0000","last_undegraded":"2023-10-16T14:27:32.051001+0000","last_fullsized":"2023-10-16T14:27:32.051001+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.064912+0000","last_change":"2023-10-16T14:27:32.064912+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.064912+0000","last_undegraded":"2023-10-16T14:27:32.064912+0000","last_fullsized":"2023-10-16T14:27:32.064912+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.058546+0000","last_change":"2023-10-16T14:27:32.058546+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.058546+0000","last_undegraded":"2023-10-16T14:27:32.058546+0000","last_fullsized":"2023-10-16T14:27:32.058546+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.064240+0000","last_change":"2023-10-16T14:27:32.064240+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.064240+0000","last_undegraded":"2023-10-16T14:27:32.064240+0000","last_fullsized":"2023-10-16T14:27:32.064240+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.058760+0000","last_change":"2023-10-16T14:27:32.058760+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.058760+0000","last_undegraded":"2023-10-16T14:27:32.058760+0000","last_fullsized":"2023-10-16T14:27:32.058760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.990881+0000","last_change":"2023-10-16T14:27:32.687725+0000","last_active":"2023-10-16T14:27:33.990881+0000","last_peered":"2023-10-16T14:27:33.990881+0000","last_clean":"2023-10-16T14:27:33.990881+0000","last_became_active":"2023-10-16T14:27:32.687356+0000","last_became_peered":"2023-10-16T14:27:32.687356+0000","last_unstale":"2023-10-16T14:27:33.990881+0000","last_undegraded":"2023-10-16T14:27:33.990881+0000","last_fullsized":"2023-10-16T14:27:33.990881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:53:16.642399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.055084+0000","last_change":"2023-10-16T14:27:32.055084+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.055084+0000","last_undegraded":"2023-10-16T14:27:32.055084+0000","last_fullsized":"2023-10-16T14:27:32.055084+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.055960+0000","last_change":"2023-10-16T14:27:32.055960+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.055960+0000","last_undegraded":"2023-10-16T14:27:32.055960+0000","last_fullsized":"2023-10-16T14:27:32.055960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.055526+0000","last_change":"2023-10-16T14:27:32.055526+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.055526+0000","last_undegraded":"2023-10-16T14:27:32.055526+0000","last_fullsized":"2023-10-16T14:27:32.055526+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.057031+0000","last_change":"2023-10-16T14:27:32.057031+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.057031+0000","last_undegraded":"2023-10-16T14:27:32.057031+0000","last_fullsized":"2023-10-16T14:27:32.057031+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.050653+0000","last_change":"2023-10-16T14:27:32.050653+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.050653+0000","last_undegraded":"2023-10-16T14:27:32.050653+0000","last_fullsized":"2023-10-16T14:27:32.050653+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.061689+0000","last_change":"2023-10-16T14:27:32.061689+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.061689+0000","last_undegraded":"2023-10-16T14:27:32.061689+0000","last_fullsized":"2023-10-16T14:27:32.061689+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.059816+0000","last_change":"2023-10-16T14:27:32.059816+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.059816+0000","last_undegraded":"2023-10-16T14:27:32.059816+0000","last_fullsized":"2023-10-16T14:27:32.059816+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.057182+0000","last_change":"2023-10-16T14:27:32.057182+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.057182+0000","last_undegraded":"2023-10-16T14:27:32.057182+0000","last_fullsized":"2023-10-16T14:27:32.057182+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.059622+0000","last_change":"2023-10-16T14:27:32.059622+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.059622+0000","last_undegraded":"2023-10-16T14:27:32.059622+0000","last_fullsized":"2023-10-16T14:27:32.059622+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.057655+0000","last_change":"2023-10-16T14:27:32.057655+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.057655+0000","last_undegraded":"2023-10-16T14:27:32.057655+0000","last_fullsized":"2023-10-16T14:27:32.057655+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.057528+0000","last_change":"2023-10-16T14:27:32.057528+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.057528+0000","last_undegraded":"2023-10-16T14:27:32.057528+0000","last_fullsized":"2023-10-16T14:27:32.057528+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.077599+0000","last_change":"2023-10-16T14:27:32.071376+0000","last_active":"2023-10-16T14:27:32.077599+0000","last_peered":"2023-10-16T14:27:32.077599+0000","last_clean":"2023-10-16T14:27:32.077599+0000","last_became_active":"2023-10-16T14:27:32.071089+0000","last_became_peered":"2023-10-16T14:27:32.071089+0000","last_unstale":"2023-10-16T14:27:32.077599+0000","last_undegraded":"2023-10-16T14:27:32.077599+0000","last_fullsized":"2023-10-16T14:27:32.077599+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:10:55.109042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-10-16T14:27:31.039373+0000","last_change":"2023-10-16T14:27:31.039373+0000","last_active":"2023-10-16T14:27:31.026988+0000","last_peered":"2023-10-16T14:27:31.026988+0000","last_clean":"2023-10-16T14:27:31.026988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:31.039373+0000","last_undegraded":"2023-10-16T14:27:31.039373+0000","last_fullsized":"2023-10-16T14:27:31.039373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.057665+0000","last_change":"2023-10-16T14:27:32.057665+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.057665+0000","last_undegraded":"2023-10-16T14:27:32.057665+0000","last_fullsized":"2023-10-16T14:27:32.057665+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-10-16T14:27:31.044724+0000","last_change":"2023-10-16T14:27:31.044724+0000","last_active":"2023-10-16T14:27:31.026988+0000","last_peered":"2023-10-16T14:27:31.026988+0000","last_clean":"2023-10-16T14:27:31.026988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:31.044724+0000","last_undegraded":"2023-10-16T14:27:31.044724+0000","last_fullsized":"2023-10-16T14:27:31.044724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.067924+0000","last_change":"2023-10-16T14:27:32.064999+0000","last_active":"2023-10-16T14:27:32.067924+0000","last_peered":"2023-10-16T14:27:32.067924+0000","last_clean":"2023-10-16T14:27:32.067924+0000","last_became_active":"2023-10-16T14:27:32.064637+0000","last_became_peered":"2023-10-16T14:27:32.064637+0000","last_unstale":"2023-10-16T14:27:32.067924+0000","last_undegraded":"2023-10-16T14:27:32.067924+0000","last_fullsized":"2023-10-16T14:27:32.067924+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:14.761791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.077704+0000","last_change":"2023-10-16T14:27:32.071705+0000","last_active":"2023-10-16T14:27:32.077704+0000","last_peered":"2023-10-16T14:27:32.077704+0000","last_clean":"2023-10-16T14:27:32.077704+0000","last_became_active":"2023-10-16T14:27:32.071328+0000","last_became_peered":"2023-10-16T14:27:32.071328+0000","last_unstale":"2023-10-16T14:27:32.077704+0000","last_undegraded":"2023-10-16T14:27:32.077704+0000","last_fullsized":"2023-10-16T14:27:32.077704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:06:38.741250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.056482+0000","last_change":"2023-10-16T14:27:32.056482+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.056482+0000","last_undegraded":"2023-10-16T14:27:32.056482+0000","last_fullsized":"2023-10-16T14:27:32.056482+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":3,"reported_epoch":38,"state":"creating+activating","last_fresh":"2023-10-16T14:27:32.059130+0000","last_change":"2023-10-16T14:27:32.059130+0000","last_active":"2023-10-16T14:27:31.026988+0000","last_peered":"2023-10-16T14:27:31.026988+0000","last_clean":"2023-10-16T14:27:31.026988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.059130+0000","last_undegraded":"2023-10-16T14:27:32.059130+0000","last_fullsized":"2023-10-16T14:27:32.059130+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:27:26.717754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.057879+0000","last_change":"2023-10-16T14:27:32.057879+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.057879+0000","last_undegraded":"2023-10-16T14:27:32.057879+0000","last_fullsized":"2023-10-16T14:27:32.057879+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-10-16T14:27:31.045224+0000","last_change":"2023-10-16T14:27:31.045224+0000","last_active":"2023-10-16T14:27:31.026988+0000","last_peered":"2023-10-16T14:27:31.026988+0000","last_clean":"2023-10-16T14:27:31.026988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:31.045224+0000","last_undegraded":"2023-10-16T14:27:31.045224+0000","last_fullsized":"2023-10-16T14:27:31.045224+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.081250+0000","last_change":"2023-10-16T14:27:32.076056+0000","last_active":"2023-10-16T14:27:32.081250+0000","last_peered":"2023-10-16T14:27:32.081250+0000","last_clean":"2023-10-16T14:27:32.081250+0000","last_became_active":"2023-10-16T14:27:32.075524+0000","last_became_peered":"2023-10-16T14:27:32.075524+0000","last_unstale":"2023-10-16T14:27:32.081250+0000","last_undegraded":"2023-10-16T14:27:32.081250+0000","last_fullsized":"2023-10-16T14:27:32.081250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:45:36.739538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-10-16T14:27:31.044897+0000","last_change":"2023-10-16T14:27:31.044897+0000","last_active":"2023-10-16T14:27:31.026988+0000","last_peered":"2023-10-16T14:27:31.026988+0000","last_clean":"2023-10-16T14:27:31.026988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:31.044897+0000","last_undegraded":"2023-10-16T14:27:31.044897+0000","last_fullsized":"2023-10-16T14:27:31.044897+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.050988+0000","last_change":"2023-10-16T14:27:32.050988+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.050988+0000","last_undegraded":"2023-10-16T14:27:32.050988+0000","last_fullsized":"2023-10-16T14:27:32.050988+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.075455+0000","last_change":"2023-10-16T14:27:32.071909+0000","last_active":"2023-10-16T14:27:32.075455+0000","last_peered":"2023-10-16T14:27:32.075455+0000","last_clean":"2023-10-16T14:27:32.075455+0000","last_became_active":"2023-10-16T14:27:32.071608+0000","last_became_peered":"2023-10-16T14:27:32.071608+0000","last_unstale":"2023-10-16T14:27:32.075455+0000","last_undegraded":"2023-10-16T14:27:32.075455+0000","last_fullsized":"2023-10-16T14:27:32.075455+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:41:55.949287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.082470+0000","last_change":"2023-10-16T14:27:32.079803+0000","last_active":"2023-10-16T14:27:32.082470+0000","last_peered":"2023-10-16T14:27:32.082470+0000","last_clean":"2023-10-16T14:27:32.082470+0000","last_became_active":"2023-10-16T14:27:32.079038+0000","last_became_peered":"2023-10-16T14:27:32.079038+0000","last_unstale":"2023-10-16T14:27:32.082470+0000","last_undegraded":"2023-10-16T14:27:32.082470+0000","last_fullsized":"2023-10-16T14:27:32.082470+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:50:30.681272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.063322+0000","last_change":"2023-10-16T14:27:32.063322+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.063322+0000","last_undegraded":"2023-10-16T14:27:32.063322+0000","last_fullsized":"2023-10-16T14:27:32.063322+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-10-16T14:27:31.044921+0000","last_change":"2023-10-16T14:27:31.044921+0000","last_active":"2023-10-16T14:27:31.026988+0000","last_peered":"2023-10-16T14:27:31.026988+0000","last_clean":"2023-10-16T14:27:31.026988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:31.044921+0000","last_undegraded":"2023-10-16T14:27:31.044921+0000","last_fullsized":"2023-10-16T14:27:31.044921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-10-16T14:27:31.047195+0000","last_change":"2023-10-16T14:27:31.047195+0000","last_active":"2023-10-16T14:27:31.026988+0000","last_peered":"2023-10-16T14:27:31.026988+0000","last_clean":"2023-10-16T14:27:31.026988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:31.047195+0000","last_undegraded":"2023-10-16T14:27:31.047195+0000","last_fullsized":"2023-10-16T14:27:31.047195+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-10-16T14:27:31.040601+0000","last_change":"2023-10-16T14:27:31.040601+0000","last_active":"2023-10-16T14:27:31.026988+0000","last_peered":"2023-10-16T14:27:31.026988+0000","last_clean":"2023-10-16T14:27:31.026988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:31.040601+0000","last_undegraded":"2023-10-16T14:27:31.040601+0000","last_fullsized":"2023-10-16T14:27:31.040601+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.054498+0000","last_change":"2023-10-16T14:27:32.054498+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.054498+0000","last_undegraded":"2023-10-16T14:27:32.054498+0000","last_fullsized":"2023-10-16T14:27:32.054498+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.075385+0000","last_change":"2023-10-16T14:27:32.070127+0000","last_active":"2023-10-16T14:27:32.075385+0000","last_peered":"2023-10-16T14:27:32.075385+0000","last_clean":"2023-10-16T14:27:32.075385+0000","last_became_active":"2023-10-16T14:27:32.069843+0000","last_became_peered":"2023-10-16T14:27:32.069843+0000","last_unstale":"2023-10-16T14:27:32.075385+0000","last_undegraded":"2023-10-16T14:27:32.075385+0000","last_fullsized":"2023-10-16T14:27:32.075385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:48:36.234753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.069751+0000","last_change":"2023-10-16T14:27:32.068015+0000","last_active":"2023-10-16T14:27:32.069751+0000","last_peered":"2023-10-16T14:27:32.069751+0000","last_clean":"2023-10-16T14:27:32.069751+0000","last_became_active":"2023-10-16T14:27:32.067716+0000","last_became_peered":"2023-10-16T14:27:32.067716+0000","last_unstale":"2023-10-16T14:27:32.069751+0000","last_undegraded":"2023-10-16T14:27:32.069751+0000","last_fullsized":"2023-10-16T14:27:32.069751+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:53:28.158889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.082514+0000","last_change":"2023-10-16T14:27:32.080631+0000","last_active":"2023-10-16T14:27:32.082514+0000","last_peered":"2023-10-16T14:27:32.082514+0000","last_clean":"2023-10-16T14:27:32.082514+0000","last_became_active":"2023-10-16T14:27:32.080216+0000","last_became_peered":"2023-10-16T14:27:32.080216+0000","last_unstale":"2023-10-16T14:27:32.082514+0000","last_undegraded":"2023-10-16T14:27:32.082514+0000","last_fullsized":"2023-10-16T14:27:32.082514+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:27:27.720899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.061593+0000","last_change":"2023-10-16T14:27:32.061593+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.061593+0000","last_undegraded":"2023-10-16T14:27:32.061593+0000","last_fullsized":"2023-10-16T14:27:32.061593+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.082483+0000","last_change":"2023-10-16T14:27:32.080000+0000","last_active":"2023-10-16T14:27:32.082483+0000","last_peered":"2023-10-16T14:27:32.082483+0000","last_clean":"2023-10-16T14:27:32.082483+0000","last_became_active":"2023-10-16T14:27:32.079018+0000","last_became_peered":"2023-10-16T14:27:32.079018+0000","last_unstale":"2023-10-16T14:27:32.082483+0000","last_undegraded":"2023-10-16T14:27:32.082483+0000","last_fullsized":"2023-10-16T14:27:32.082483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:37:57.036813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.060288+0000","last_change":"2023-10-16T14:27:32.060288+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.060288+0000","last_undegraded":"2023-10-16T14:27:32.060288+0000","last_fullsized":"2023-10-16T14:27:32.060288+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-10-16T14:27:31.055632+0000","last_change":"2023-10-16T14:27:31.055632+0000","last_active":"2023-10-16T14:27:31.026988+0000","last_peered":"2023-10-16T14:27:31.026988+0000","last_clean":"2023-10-16T14:27:31.026988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:31.055632+0000","last_undegraded":"2023-10-16T14:27:31.055632+0000","last_fullsized":"2023-10-16T14:27:31.055632+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.990799+0000","last_change":"2023-10-16T14:27:32.681041+0000","last_active":"2023-10-16T14:27:33.990799+0000","last_peered":"2023-10-16T14:27:33.990799+0000","last_clean":"2023-10-16T14:27:33.990799+0000","last_became_active":"2023-10-16T14:27:32.680710+0000","last_became_peered":"2023-10-16T14:27:32.680710+0000","last_unstale":"2023-10-16T14:27:33.990799+0000","last_undegraded":"2023-10-16T14:27:33.990799+0000","last_fullsized":"2023-10-16T14:27:33.990799+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:03:51.096787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.990467+0000","last_change":"2023-10-16T14:27:32.078427+0000","last_active":"2023-10-16T14:27:33.990467+0000","last_peered":"2023-10-16T14:27:33.990467+0000","last_clean":"2023-10-16T14:27:33.990467+0000","last_became_active":"2023-10-16T14:27:32.078140+0000","last_became_peered":"2023-10-16T14:27:32.078140+0000","last_unstale":"2023-10-16T14:27:33.990467+0000","last_undegraded":"2023-10-16T14:27:33.990467+0000","last_fullsized":"2023-10-16T14:27:33.990467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:36:22.447745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.053173+0000","last_change":"2023-10-16T14:27:32.053173+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.053173+0000","last_undegraded":"2023-10-16T14:27:32.053173+0000","last_fullsized":"2023-10-16T14:27:32.053173+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.990681+0000","last_change":"2023-10-16T14:27:32.077994+0000","last_active":"2023-10-16T14:27:33.990681+0000","last_peered":"2023-10-16T14:27:33.990681+0000","last_clean":"2023-10-16T14:27:33.990681+0000","last_became_active":"2023-10-16T14:27:32.077698+0000","last_became_peered":"2023-10-16T14:27:32.077698+0000","last_unstale":"2023-10-16T14:27:33.990681+0000","last_undegraded":"2023-10-16T14:27:33.990681+0000","last_fullsized":"2023-10-16T14:27:33.990681+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:07:31.457823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-10-16T14:27:31.039357+0000","last_change":"2023-10-16T14:27:31.039357+0000","last_active":"2023-10-16T14:27:31.026988+0000","last_peered":"2023-10-16T14:27:31.026988+0000","last_clean":"2023-10-16T14:27:31.026988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:31.039357+0000","last_undegraded":"2023-10-16T14:27:31.039357+0000","last_fullsized":"2023-10-16T14:27:31.039357+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.055065+0000","last_change":"2023-10-16T14:27:32.055065+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.055065+0000","last_undegraded":"2023-10-16T14:27:32.055065+0000","last_fullsized":"2023-10-16T14:27:32.055065+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.081289+0000","last_change":"2023-10-16T14:27:32.076548+0000","last_active":"2023-10-16T14:27:32.081289+0000","last_peered":"2023-10-16T14:27:32.081289+0000","last_clean":"2023-10-16T14:27:32.081289+0000","last_became_active":"2023-10-16T14:27:32.076214+0000","last_became_peered":"2023-10-16T14:27:32.076214+0000","last_unstale":"2023-10-16T14:27:32.081289+0000","last_undegraded":"2023-10-16T14:27:32.081289+0000","last_fullsized":"2023-10-16T14:27:32.081289+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:44:32.788076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-10-16T14:27:31.039080+0000","last_change":"2023-10-16T14:27:31.039080+0000","last_active":"2023-10-16T14:27:31.026988+0000","last_peered":"2023-10-16T14:27:31.026988+0000","last_clean":"2023-10-16T14:27:31.026988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:31.039080+0000","last_undegraded":"2023-10-16T14:27:31.039080+0000","last_fullsized":"2023-10-16T14:27:31.039080+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.082636+0000","last_change":"2023-10-16T14:27:32.077235+0000","last_active":"2023-10-16T14:27:32.082636+0000","last_peered":"2023-10-16T14:27:32.082636+0000","last_clean":"2023-10-16T14:27:32.082636+0000","last_became_active":"2023-10-16T14:27:32.076287+0000","last_became_peered":"2023-10-16T14:27:32.076287+0000","last_unstale":"2023-10-16T14:27:32.082636+0000","last_undegraded":"2023-10-16T14:27:32.082636+0000","last_fullsized":"2023-10-16T14:27:32.082636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:05:12.152698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.060481+0000","last_change":"2023-10-16T14:27:32.060481+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.060481+0000","last_undegraded":"2023-10-16T14:27:32.060481+0000","last_fullsized":"2023-10-16T14:27:32.060481+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-10-16T14:27:31.057158+0000","last_change":"2023-10-16T14:27:31.057158+0000","last_active":"2023-10-16T14:27:31.026988+0000","last_peered":"2023-10-16T14:27:31.026988+0000","last_clean":"2023-10-16T14:27:31.026988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:31.057158+0000","last_undegraded":"2023-10-16T14:27:31.057158+0000","last_fullsized":"2023-10-16T14:27:31.057158+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.990751+0000","last_change":"2023-10-16T14:27:32.678499+0000","last_active":"2023-10-16T14:27:33.990751+0000","last_peered":"2023-10-16T14:27:33.990751+0000","last_clean":"2023-10-16T14:27:33.990751+0000","last_became_active":"2023-10-16T14:27:32.678145+0000","last_became_peered":"2023-10-16T14:27:32.678145+0000","last_unstale":"2023-10-16T14:27:33.990751+0000","last_undegraded":"2023-10-16T14:27:33.990751+0000","last_fullsized":"2023-10-16T14:27:33.990751+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:40:12.321306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-10-16T14:27:31.054374+0000","last_change":"2023-10-16T14:27:31.054374+0000","last_active":"2023-10-16T14:27:31.026988+0000","last_peered":"2023-10-16T14:27:31.026988+0000","last_clean":"2023-10-16T14:27:31.026988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:31.054374+0000","last_undegraded":"2023-10-16T14:27:31.054374+0000","last_fullsized":"2023-10-16T14:27:31.054374+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-10-16T14:27:31.044908+0000","last_change":"2023-10-16T14:27:31.044908+0000","last_active":"2023-10-16T14:27:31.026988+0000","last_peered":"2023-10-16T14:27:31.026988+0000","last_clean":"2023-10-16T14:27:31.026988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:31.044908+0000","last_undegraded":"2023-10-16T14:27:31.044908+0000","last_fullsized":"2023-10-16T14:27:31.044908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-16T14:27:32.032720+0000","last_change":"2023-10-16T14:27:32.032720+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.032720+0000","last_undegraded":"2023-10-16T14:27:32.032720+0000","last_fullsized":"2023-10-16T14:27:32.032720+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.081043+0000","last_change":"2023-10-16T14:27:32.075755+0000","last_active":"2023-10-16T14:27:32.081043+0000","last_peered":"2023-10-16T14:27:32.081043+0000","last_clean":"2023-10-16T14:27:32.081043+0000","last_became_active":"2023-10-16T14:27:32.075374+0000","last_became_peered":"2023-10-16T14:27:32.075374+0000","last_unstale":"2023-10-16T14:27:32.081043+0000","last_undegraded":"2023-10-16T14:27:32.081043+0000","last_fullsized":"2023-10-16T14:27:32.081043+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:06:26.215822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.052850+0000","last_change":"2023-10-16T14:27:32.052850+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.052850+0000","last_undegraded":"2023-10-16T14:27:32.052850+0000","last_fullsized":"2023-10-16T14:27:32.052850+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.075407+0000","last_change":"2023-10-16T14:27:32.071923+0000","last_active":"2023-10-16T14:27:32.075407+0000","last_peered":"2023-10-16T14:27:32.075407+0000","last_clean":"2023-10-16T14:27:32.075407+0000","last_became_active":"2023-10-16T14:27:32.071701+0000","last_became_peered":"2023-10-16T14:27:32.071701+0000","last_unstale":"2023-10-16T14:27:32.075407+0000","last_undegraded":"2023-10-16T14:27:32.075407+0000","last_fullsized":"2023-10-16T14:27:32.075407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:16:27.813152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.055439+0000","last_change":"2023-10-16T14:27:32.055439+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.055439+0000","last_undegraded":"2023-10-16T14:27:32.055439+0000","last_fullsized":"2023-10-16T14:27:32.055439+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-10-16T14:27:31.044750+0000","last_change":"2023-10-16T14:27:31.044750+0000","last_active":"2023-10-16T14:27:31.026988+0000","last_peered":"2023-10-16T14:27:31.026988+0000","last_clean":"2023-10-16T14:27:31.026988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:31.044750+0000","last_undegraded":"2023-10-16T14:27:31.044750+0000","last_fullsized":"2023-10-16T14:27:31.044750+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2023-10-16T14:27:32.053534+0000","last_change":"2023-10-16T14:27:32.053534+0000","last_active":"2023-10-16T14:27:32.032720+0000","last_peered":"2023-10-16T14:27:32.032720+0000","last_clean":"2023-10-16T14:27:32.032720+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-16T14:27:32.053534+0000","last_undegraded":"2023-10-16T14:27:32.053534+0000","last_fullsized":"2023-10-16T14:27:32.053534+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.081163+0000","last_change":"2023-10-16T14:27:32.076537+0000","last_active":"2023-10-16T14:27:32.081163+0000","last_peered":"2023-10-16T14:27:32.081163+0000","last_clean":"2023-10-16T14:27:32.081163+0000","last_became_active":"2023-10-16T14:27:32.076107+0000","last_became_peered":"2023-10-16T14:27:32.076107+0000","last_unstale":"2023-10-16T14:27:32.081163+0000","last_undegraded":"2023-10-16T14:27:32.081163+0000","last_fullsized":"2023-10-16T14:27:32.081163+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:44:27.233555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-16T14:27:31.046948+0000","last_change":"2023-10-16T14:25:37.824419+0000","last_active":"2023-10-16T14:27:31.046948+0000","last_peered":"2023-10-16T14:27:31.046948+0000","last_clean":"2023-10-16T14:27:31.046948+0000","last_became_active":"2023-10-16T14:25:37.821909+0000","last_became_peered":"2023-10-16T14:25:37.821909+0000","last_unstale":"2023-10-16T14:27:31.046948+0000","last_undegraded":"2023-10-16T14:27:31.046948+0000","last_fullsized":"2023-10-16T14:27:31.046948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:36.449944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:36.449944+0000","last_clean_scrub_stamp":"2023-10-16T14:25:36.449944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:37:42.457821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":74,"acting":74,"num_store_stats":5},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476762,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":171711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 14:26:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":6.008,"5min":6.008,"15min":6.008},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":6.4059999999999997,"5min":6.4059999999999997,"15min":6.4059999999999997},"last":1.0209999999999999}]},{"osd":1,"last update":"Mon Oct 16 14:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.94899999999999995}]},{"osd":2,"last update":"Mon Oct 16 14:26:36 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":1.512}]},{"osd":4,"last update":"Mon Oct 16 14:26:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.4790000000000001}]},{"osd":5,"last update":"Mon Oct 16 14:26:36 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.3210000000000002,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.6619999999999999}]},{"osd":6,"last update":"Mon Oct 16 14:26:36 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":1.353}]},{"osd":7,"last update":"Mon Oct 16 14:26:36 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.7410000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.3620000000000001,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.611}]}]},{"osd":2,"up_from":16,"seq":68719476762,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":171711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":5.0869999999999997,"5min":5.0869999999999997,"15min":5.0869999999999997},"last":1.157}]},{"osd":1,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.234},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":5.1269999999999998,"5min":5.1269999999999998,"15min":5.1269999999999998},"last":1.268}]},{"osd":3,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.3979999999999999}]},{"osd":4,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":4.9980000000000002,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":1.452},{"interface":"front","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.6990000000000001}]},{"osd":5,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.665},{"interface":"front","average":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":5.0430000000000001,"5min":5.0430000000000001,"15min":5.0430000000000001},"last":1.357}]},{"osd":6,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.8719999999999999,"5min":2.8719999999999999,"15min":2.8719999999999999},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.625,"5min":1.625,"15min":1.625},"min":{"1min":1.117,"5min":1.117,"15min":1.117},"max":{"1min":2.6320000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.486}]},{"osd":7,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.772,"5min":1.772,"15min":1.772},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":4.9459999999999997,"5min":4.9459999999999997,"15min":4.9459999999999997},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.304}]}]},{"osd":1,"up_from":16,"seq":68719476763,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":762079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 14:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.198},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.254}]},{"osd":2,"last update":"Mon Oct 16 14:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.367,"5min":2.367,"15min":2.367},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.72399999999999998}]},{"osd":3,"last update":"Mon Oct 16 14:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":1.036},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.5449999999999999}]},{"osd":4,"last update":"Mon Oct 16 14:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":4.0759999999999996,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":1.177},{"interface":"front","average":{"1min":1.571,"5min":1.571,"15min":1.571},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":1.3260000000000001}]},{"osd":5,"last update":"Mon Oct 16 14:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":1.607},{"interface":"front","average":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":3.9430000000000001,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":1.085}]},{"osd":6,"last update":"Mon Oct 16 14:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.407},{"interface":"front","average":{"1min":1.776,"5min":1.776,"15min":1.776},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":3.8239999999999998,"5min":3.8239999999999998,"15min":3.8239999999999998},"last":1.2310000000000001}]},{"osd":7,"last update":"Mon Oct 16 14:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.726,"5min":1.726,"15min":1.726},"min":{"1min":1.093,"5min":1.093,"15min":1.093},"max":{"1min":3.0640000000000001,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":1.444},{"interface":"front","average":{"1min":1.669,"5min":1.669,"15min":1.669},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.847,"5min":2.847,"15min":2.847},"last":1.4890000000000001}]}]},{"osd":0,"up_from":16,"seq":68719476764,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":171711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.264}]},{"osd":2,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.92000000000000004}]},{"osd":3,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.1739999999999999}]},{"osd":4,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.4590000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.55}]},{"osd":5,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.2350000000000001}]},{"osd":6,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"min":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":1.3},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.5670000000000002,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":1.214}]},{"osd":7,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.135},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":2.21,"5min":2.21,"15min":2.21},"last":1.659}]}]},{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":165574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 14:26:41 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.026}]},{"osd":1,"last update":"Mon Oct 16 14:26:41 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.391},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.1679999999999999}]},{"osd":2,"last update":"Mon Oct 16 14:26:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.264},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":1.21}]},{"osd":3,"last update":"Mon Oct 16 14:26:41 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.367}]},{"osd":4,"last update":"Mon Oct 16 14:26:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.1160000000000001}]},{"osd":5,"last update":"Mon Oct 16 14:26:35 2023","interfaces":[{"interface":"back","average":{"1min":1.667,"5min":1.667,"15min":1.667},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.5529999999999999,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":1.298}]},{"osd":6,"last update":"Mon Oct 16 14:26:35 2023","interfaces":[{"interface":"back","average":{"1min":1.78,"5min":1.78,"15min":1.78},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.9729999999999999,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.653,"5min":1.653,"15min":1.653},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.548,"5min":2.548,"15min":2.548},"last":1.528}]}]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":165574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 14:26:42 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.302},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.056}]},{"osd":1,"last update":"Mon Oct 16 14:26:42 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":0.73099999999999998}]},{"osd":2,"last update":"Mon Oct 16 14:26:42 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":3.7170000000000001,"5min":3.7170000000000001,"15min":3.7170000000000001},"last":1.401}]},{"osd":3,"last update":"Mon Oct 16 14:26:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":3.944,"5min":3.944,"15min":3.944},"last":1.026}]},{"osd":4,"last update":"Mon Oct 16 14:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.5310000000000001,"5min":2.5310000000000001,"15min":2.5310000000000001},"last":1.4690000000000001}]},{"osd":5,"last update":"Mon Oct 16 14:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.587,"5min":1.587,"15min":1.587},"min":{"1min":1.097,"5min":1.097,"15min":1.097},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.3540000000000001}]},{"osd":7,"last update":"Mon Oct 16 14:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.589,"15min":1.589},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.4399999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":401408,"data_stored":165574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.006},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.92700000000000005}]},{"osd":1,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.228},{"interface":"front","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":1.7649999999999999}]},{"osd":2,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.079},{"interface":"front","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":1.6990000000000001}]},{"osd":3,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":1.3260000000000001}]},{"osd":5,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":3.1720000000000002,"5min":3.1720000000000002,"15min":3.1720000000000002},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.536}]},{"osd":6,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.4769999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.6339999999999999},{"interface":"front","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":1.833}]},{"osd":7,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.855,"5min":2.855,"15min":2.855},"last":1.893},{"interface":"front","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.8520000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":782971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.087},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.147}]},{"osd":1,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":1.2030000000000001}]},{"osd":2,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":1.3580000000000001}]},{"osd":3,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.288},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":1.542}]},{"osd":4,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.7010000000000001}]},{"osd":6,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":1.4139999999999999}]},{"osd":7,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.7569999999999999},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":1.6459999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T14:27:37.587 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T14:27:37.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.846+0000 7f25a639e640 1 Processor -- start 2023-10-16T14:27:37.850 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.847+0000 7f25a639e640 1 -- start start 2023-10-16T14:27:37.851 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.848+0000 7f25a639e640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25a00cd980 0x7f25a00cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:37.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.848+0000 7f25a639e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25a006bf30 0x7f25a006c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:37.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.848+0000 7f25a639e640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a0154110 con 0x7f25a0159c00 2023-10-16T14:27:37.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.848+0000 7f25a639e640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a006c900 con 0x7f25a00cd980 2023-10-16T14:27:37.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.848+0000 7f25a639e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a015d1f0 con 0x7f25a006bf30 2023-10-16T14:27:37.852 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.848+0000 7f25a539c640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25a00cd980 0x7f25a00cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:37.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.848+0000 7f25a4b9b640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f25a0159c00 0x7f25a015d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47712/0 (socket says 172.21.15.59:47712) 2023-10-16T14:27:37.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.848+0000 7f25a4b9b640 1 -- 172.21.15.59:0/2623495323 learned_addr learned my addr 172.21.15.59:0/2623495323 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:37.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.849+0000 7f2597fff640 1 -- 172.21.15.59:0/2623495323 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2250251255 0 0) 0x7f25a0154110 con 0x7f25a0159c00 2023-10-16T14:27:37.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.849+0000 7f25a539c640 1 -- 172.21.15.59:0/2623495323 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25a006bf30 msgr2=0x7f25a006c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:37.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.849+0000 7f25a5b9d640 1 --2- 172.21.15.59:0/2623495323 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25a006bf30 0x7f25a006c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:37.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.849+0000 7f25a539c640 1 --2- 172.21.15.59:0/2623495323 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25a006bf30 0x7f25a006c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.849+0000 7f25a539c640 1 -- 172.21.15.59:0/2623495323 >> v1:172.21.15.59:6789/0 conn(0x7f25a0159c00 legacy=0x7f25a015d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:37.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.849+0000 7f25a539c640 1 -- 172.21.15.59:0/2623495323 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a015e0c0 con 0x7f25a00cd980 2023-10-16T14:27:37.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.849+0000 7f25a5b9d640 1 --2- 172.21.15.59:0/2623495323 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25a006bf30 0x7f25a006c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:37.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.850+0000 7f25a539c640 1 --2- 172.21.15.59:0/2623495323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a00cd980 0x7f25a00cdd60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f259c009790 tx=0x7f259c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88665f5d50667f56 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:37.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.850+0000 7f2597fff640 1 -- 172.21.15.59:0/2623495323 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c02d040 con 0x7f25a00cd980 2023-10-16T14:27:37.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.851+0000 7f2597fff640 1 -- 172.21.15.59:0/2623495323 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c031810 con 0x7f25a00cd980 2023-10-16T14:27:37.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.851+0000 7f2597fff640 1 -- 172.21.15.59:0/2623495323 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c031ba0 con 0x7f25a00cd980 2023-10-16T14:27:37.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.851+0000 7f25a639e640 1 -- 172.21.15.59:0/2623495323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a00cd980 msgr2=0x7f25a00cdd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:37.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.851+0000 7f25a639e640 1 --2- 172.21.15.59:0/2623495323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a00cd980 0x7f25a00cdd60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f259c009790 tx=0x7f259c02b8b0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.851+0000 7f25a639e640 1 -- 172.21.15.59:0/2623495323 shutdown_connections 2023-10-16T14:27:37.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.851+0000 7f25a639e640 1 --2- 172.21.15.59:0/2623495323 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25a006bf30 0x7f25a006c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.851+0000 7f25a639e640 1 --2- 172.21.15.59:0/2623495323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a00cd980 0x7f25a00cdd60 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.851+0000 7f25a639e640 1 -- 172.21.15.59:0/2623495323 >> 172.21.15.59:0/2623495323 conn(0x7f25a006a470 msgr2=0x7f25a00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:37.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.851+0000 7f25a639e640 1 -- 172.21.15.59:0/2623495323 shutdown_connections 2023-10-16T14:27:37.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.851+0000 7f25a639e640 1 -- 172.21.15.59:0/2623495323 wait complete. 2023-10-16T14:27:37.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.853+0000 7f25a639e640 1 Processor -- start 2023-10-16T14:27:37.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.853+0000 7f25a639e640 1 -- start start 2023-10-16T14:27:37.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.854+0000 7f25a639e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a006bf30 0x7f25a0149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:37.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.854+0000 7f25a639e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25a00cd980 0x7f25a00cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:37.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.854+0000 7f25a639e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25a0159c00 0x7f25a0152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:37.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.854+0000 7f25a639e640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a00aeba0 con 0x7f25a006bf30 2023-10-16T14:27:37.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.854+0000 7f25a639e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a00cc1e0 con 0x7f25a00cd980 2023-10-16T14:27:37.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.854+0000 7f25a639e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a00aedf0 con 0x7f25a0159c00 2023-10-16T14:27:37.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.854+0000 7f25a539c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a006bf30 0x7f25a0149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:37.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.854+0000 7f25a539c640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a006bf30 0x7f25a0149d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43672/0 (socket says 172.21.15.59:43672) 2023-10-16T14:27:37.862 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.854+0000 7f25a539c640 1 -- 172.21.15.59:0/1172014541 learned_addr learned my addr 172.21.15.59:0/1172014541 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.855+0000 7f25a539c640 1 -- 172.21.15.59:0/1172014541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25a0159c00 msgr2=0x7f25a0152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.855+0000 7f25a539c640 1 --2- 172.21.15.59:0/1172014541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25a0159c00 0x7f25a0152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.855+0000 7f25a539c640 1 -- 172.21.15.59:0/1172014541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25a00cd980 msgr2=0x7f25a00cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.855+0000 7f25a539c640 1 --2- 172.21.15.59:0/1172014541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25a00cd980 0x7f25a00cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.855+0000 7f25a539c640 1 -- 172.21.15.59:0/1172014541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c0093a0 con 0x7f25a006bf30 2023-10-16T14:27:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.855+0000 7f25a539c640 1 --2- 172.21.15.59:0/1172014541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a006bf30 0x7f25a0149d10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f259c000c00 tx=0x7f259c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.855+0000 7f2595ffb640 1 -- 172.21.15.59:0/1172014541 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c03bae0 con 0x7f25a006bf30 2023-10-16T14:27:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.856+0000 7f2595ffb640 1 -- 172.21.15.59:0/1172014541 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c03bc60 con 0x7f25a006bf30 2023-10-16T14:27:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.856+0000 7f25a639e640 1 -- 172.21.15.59:0/1172014541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a00af0d0 con 0x7f25a006bf30 2023-10-16T14:27:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.856+0000 7f2595ffb640 1 -- 172.21.15.59:0/1172014541 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c004030 con 0x7f25a006bf30 2023-10-16T14:27:37.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.856+0000 7f25a639e640 1 -- 172.21.15.59:0/1172014541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a014a250 con 0x7f25a006bf30 2023-10-16T14:27:37.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.857+0000 7f25a639e640 1 -- 172.21.15.59:0/1172014541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a00af5f0 con 0x7f25a006bf30 2023-10-16T14:27:37.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.858+0000 7f2595ffb640 1 -- 172.21.15.59:0/1172014541 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f259c043070 con 0x7f25a006bf30 2023-10-16T14:27:37.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.859+0000 7f2595ffb640 1 --2- 172.21.15.59:0/1172014541 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f258406ae70 0x7f258406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:37.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.859+0000 7f2595ffb640 1 -- 172.21.15.59:0/1172014541 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f259c0ab9a0 con 0x7f25a006bf30 2023-10-16T14:27:37.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.859+0000 7f25a4b9b640 1 --2- 172.21.15.59:0/1172014541 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f258406ae70 0x7f258406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:37.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.860+0000 7f25a4b9b640 1 --2- 172.21.15.59:0/1172014541 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f258406ae70 0x7f258406d330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2590007fd0 tx=0x7f2590007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:37.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:37.864+0000 7f2595ffb640 1 -- 172.21.15.59:0/1172014541 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f25a00af5f0 con 0x7f25a006bf30 2023-10-16T14:27:38.061 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.057+0000 7f25a639e640 1 -- 172.21.15.59:0/1172014541 --> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25a015a7a0 con 0x7f258406ae70 2023-10-16T14:27:38.084 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.080+0000 7f2595ffb640 1 -- 172.21.15.59:0/1172014541 <== mgr.4100 v2:172.21.15.151:6800/518957627 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286239 (secure 0 0 0) 0x7f25900070d0 con 0x7f258406ae70 2023-10-16T14:27:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:38.089 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2023-10-16T14:27:38.090 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.085+0000 7f25a639e640 1 -- 172.21.15.59:0/1172014541 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f258406ae70 msgr2=0x7f258406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:38.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.085+0000 7f25a639e640 1 --2- 172.21.15.59:0/1172014541 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f258406ae70 0x7f258406d330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2590007fd0 tx=0x7f2590007920 comp rx=0 tx=0).stop 2023-10-16T14:27:38.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.085+0000 7f25a639e640 1 -- 172.21.15.59:0/1172014541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a006bf30 msgr2=0x7f25a0149d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:38.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.085+0000 7f25a639e640 1 --2- 172.21.15.59:0/1172014541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a006bf30 0x7f25a0149d10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f259c000c00 tx=0x7f259c0046c0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.091 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.086+0000 7f25a639e640 1 -- 172.21.15.59:0/1172014541 shutdown_connections 2023-10-16T14:27:38.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.086+0000 7f25a639e640 1 --2- 172.21.15.59:0/1172014541 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f258406ae70 0x7f258406d330 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.086+0000 7f25a639e640 1 --2- 172.21.15.59:0/1172014541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25a0159c00 0x7f25a0152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.086+0000 7f25a639e640 1 --2- 172.21.15.59:0/1172014541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25a00cd980 0x7f25a00cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.086+0000 7f25a639e640 1 --2- 172.21.15.59:0/1172014541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25a006bf30 0x7f25a0149d10 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.086+0000 7f25a639e640 1 -- 172.21.15.59:0/1172014541 >> 172.21.15.59:0/1172014541 conn(0x7f25a006a470 msgr2=0x7f25a0157800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:38.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.086+0000 7f25a639e640 1 -- 172.21.15.59:0/1172014541 shutdown_connections 2023-10-16T14:27:38.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.086+0000 7f25a639e640 1 -- 172.21.15.59:0/1172014541 wait complete. 2023-10-16T14:27:38.109 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-10-16T14:27:37.911225+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220924,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753796,"statfs":{"total":773094113280,"available":772867887104,"internally_reserved":0,"allocated":4857856,"data_stored":2721724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001979"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.657439+0000","last_change":"2023-10-16T14:27:32.688027+0000","last_active":"2023-10-16T14:27:33.657439+0000","last_peered":"2023-10-16T14:27:33.657439+0000","last_clean":"2023-10-16T14:27:33.657439+0000","last_became_active":"2023-10-16T14:27:32.687031+0000","last_became_peered":"2023-10-16T14:27:32.687031+0000","last_unstale":"2023-10-16T14:27:33.657439+0000","last_undegraded":"2023-10-16T14:27:33.657439+0000","last_fullsized":"2023-10-16T14:27:33.657439+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:29:56.036576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.054367+0000","last_change":"2023-10-16T14:27:32.687586+0000","last_active":"2023-10-16T14:27:34.054367+0000","last_peered":"2023-10-16T14:27:34.054367+0000","last_clean":"2023-10-16T14:27:34.054367+0000","last_became_active":"2023-10-16T14:27:32.687229+0000","last_became_peered":"2023-10-16T14:27:32.687229+0000","last_unstale":"2023-10-16T14:27:34.054367+0000","last_undegraded":"2023-10-16T14:27:34.054367+0000","last_fullsized":"2023-10-16T14:27:34.054367+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:24:46.501030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.658102+0000","last_change":"2023-10-16T14:27:32.684595+0000","last_active":"2023-10-16T14:27:33.658102+0000","last_peered":"2023-10-16T14:27:33.658102+0000","last_clean":"2023-10-16T14:27:33.658102+0000","last_became_active":"2023-10-16T14:27:32.684172+0000","last_became_peered":"2023-10-16T14:27:32.684172+0000","last_unstale":"2023-10-16T14:27:33.658102+0000","last_undegraded":"2023-10-16T14:27:33.658102+0000","last_fullsized":"2023-10-16T14:27:33.658102+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:34:58.897323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.658004+0000","last_change":"2023-10-16T14:27:32.691007+0000","last_active":"2023-10-16T14:27:33.658004+0000","last_peered":"2023-10-16T14:27:33.658004+0000","last_clean":"2023-10-16T14:27:33.658004+0000","last_became_active":"2023-10-16T14:27:32.690721+0000","last_became_peered":"2023-10-16T14:27:32.690721+0000","last_unstale":"2023-10-16T14:27:33.658004+0000","last_undegraded":"2023-10-16T14:27:33.658004+0000","last_fullsized":"2023-10-16T14:27:33.658004+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:18:40.856747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.054106+0000","last_change":"2023-10-16T14:27:32.684984+0000","last_active":"2023-10-16T14:27:34.054106+0000","last_peered":"2023-10-16T14:27:34.054106+0000","last_clean":"2023-10-16T14:27:34.054106+0000","last_became_active":"2023-10-16T14:27:32.684694+0000","last_became_peered":"2023-10-16T14:27:32.684694+0000","last_unstale":"2023-10-16T14:27:34.054106+0000","last_undegraded":"2023-10-16T14:27:34.054106+0000","last_fullsized":"2023-10-16T14:27:34.054106+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:44:27.822011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.052751+0000","last_change":"2023-10-16T14:27:32.679745+0000","last_active":"2023-10-16T14:27:34.052751+0000","last_peered":"2023-10-16T14:27:34.052751+0000","last_clean":"2023-10-16T14:27:34.052751+0000","last_became_active":"2023-10-16T14:27:32.679371+0000","last_became_peered":"2023-10-16T14:27:32.679371+0000","last_unstale":"2023-10-16T14:27:34.052751+0000","last_undegraded":"2023-10-16T14:27:34.052751+0000","last_fullsized":"2023-10-16T14:27:34.052751+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:39:21.623509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.051670+0000","last_change":"2023-10-16T14:27:32.683611+0000","last_active":"2023-10-16T14:27:34.051670+0000","last_peered":"2023-10-16T14:27:34.051670+0000","last_clean":"2023-10-16T14:27:34.051670+0000","last_became_active":"2023-10-16T14:27:32.682068+0000","last_became_peered":"2023-10-16T14:27:32.682068+0000","last_unstale":"2023-10-16T14:27:34.051670+0000","last_undegraded":"2023-10-16T14:27:34.051670+0000","last_fullsized":"2023-10-16T14:27:34.051670+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:10:56.114774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.656480+0000","last_change":"2023-10-16T14:27:32.683030+0000","last_active":"2023-10-16T14:27:33.656480+0000","last_peered":"2023-10-16T14:27:33.656480+0000","last_clean":"2023-10-16T14:27:33.656480+0000","last_became_active":"2023-10-16T14:27:32.682761+0000","last_became_peered":"2023-10-16T14:27:32.682761+0000","last_unstale":"2023-10-16T14:27:33.656480+0000","last_undegraded":"2023-10-16T14:27:33.656480+0000","last_fullsized":"2023-10-16T14:27:33.656480+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:07:23.643845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.055120+0000","last_change":"2023-10-16T14:27:32.691683+0000","last_active":"2023-10-16T14:27:34.055120+0000","last_peered":"2023-10-16T14:27:34.055120+0000","last_clean":"2023-10-16T14:27:34.055120+0000","last_became_active":"2023-10-16T14:27:32.691276+0000","last_became_peered":"2023-10-16T14:27:32.691276+0000","last_unstale":"2023-10-16T14:27:34.055120+0000","last_undegraded":"2023-10-16T14:27:34.055120+0000","last_fullsized":"2023-10-16T14:27:34.055120+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:22:23.168510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.052061+0000","last_change":"2023-10-16T14:27:32.685527+0000","last_active":"2023-10-16T14:27:34.052061+0000","last_peered":"2023-10-16T14:27:34.052061+0000","last_clean":"2023-10-16T14:27:34.052061+0000","last_became_active":"2023-10-16T14:27:32.685219+0000","last_became_peered":"2023-10-16T14:27:32.685219+0000","last_unstale":"2023-10-16T14:27:34.052061+0000","last_undegraded":"2023-10-16T14:27:34.052061+0000","last_fullsized":"2023-10-16T14:27:34.052061+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:38:12.065365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.053365+0000","last_change":"2023-10-16T14:27:32.687161+0000","last_active":"2023-10-16T14:27:34.053365+0000","last_peered":"2023-10-16T14:27:34.053365+0000","last_clean":"2023-10-16T14:27:34.053365+0000","last_became_active":"2023-10-16T14:27:32.686878+0000","last_became_peered":"2023-10-16T14:27:32.686878+0000","last_unstale":"2023-10-16T14:27:34.053365+0000","last_undegraded":"2023-10-16T14:27:34.053365+0000","last_fullsized":"2023-10-16T14:27:34.053365+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:41:56.955019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.054155+0000","last_change":"2023-10-16T14:27:32.691211+0000","last_active":"2023-10-16T14:27:34.054155+0000","last_peered":"2023-10-16T14:27:34.054155+0000","last_clean":"2023-10-16T14:27:34.054155+0000","last_became_active":"2023-10-16T14:27:32.690940+0000","last_became_peered":"2023-10-16T14:27:32.690940+0000","last_unstale":"2023-10-16T14:27:34.054155+0000","last_undegraded":"2023-10-16T14:27:34.054155+0000","last_fullsized":"2023-10-16T14:27:34.054155+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:45:16.211039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.053078+0000","last_change":"2023-10-16T14:27:32.692641+0000","last_active":"2023-10-16T14:27:34.053078+0000","last_peered":"2023-10-16T14:27:34.053078+0000","last_clean":"2023-10-16T14:27:34.053078+0000","last_became_active":"2023-10-16T14:27:32.690641+0000","last_became_peered":"2023-10-16T14:27:32.690641+0000","last_unstale":"2023-10-16T14:27:34.053078+0000","last_undegraded":"2023-10-16T14:27:34.053078+0000","last_fullsized":"2023-10-16T14:27:34.053078+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:44:27.822011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.053064+0000","last_change":"2023-10-16T14:27:32.682474+0000","last_active":"2023-10-16T14:27:34.053064+0000","last_peered":"2023-10-16T14:27:34.053064+0000","last_clean":"2023-10-16T14:27:34.053064+0000","last_became_active":"2023-10-16T14:27:32.682164+0000","last_became_peered":"2023-10-16T14:27:32.682164+0000","last_unstale":"2023-10-16T14:27:34.053064+0000","last_undegraded":"2023-10-16T14:27:34.053064+0000","last_fullsized":"2023-10-16T14:27:34.053064+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:31:17.182159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.655598+0000","last_change":"2023-10-16T14:27:32.679139+0000","last_active":"2023-10-16T14:27:33.655598+0000","last_peered":"2023-10-16T14:27:33.655598+0000","last_clean":"2023-10-16T14:27:33.655598+0000","last_became_active":"2023-10-16T14:27:32.677189+0000","last_became_peered":"2023-10-16T14:27:32.677189+0000","last_unstale":"2023-10-16T14:27:33.655598+0000","last_undegraded":"2023-10-16T14:27:33.655598+0000","last_fullsized":"2023-10-16T14:27:33.655598+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:20:09.098034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.051811+0000","last_change":"2023-10-16T14:27:32.689747+0000","last_active":"2023-10-16T14:27:34.051811+0000","last_peered":"2023-10-16T14:27:34.051811+0000","last_clean":"2023-10-16T14:27:34.051811+0000","last_became_active":"2023-10-16T14:27:32.689464+0000","last_became_peered":"2023-10-16T14:27:32.689464+0000","last_unstale":"2023-10-16T14:27:34.051811+0000","last_undegraded":"2023-10-16T14:27:34.051811+0000","last_fullsized":"2023-10-16T14:27:34.051811+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:06:39.746982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.656900+0000","last_change":"2023-10-16T14:27:32.681898+0000","last_active":"2023-10-16T14:27:33.656900+0000","last_peered":"2023-10-16T14:27:33.656900+0000","last_clean":"2023-10-16T14:27:33.656900+0000","last_became_active":"2023-10-16T14:27:32.681616+0000","last_became_peered":"2023-10-16T14:27:32.681616+0000","last_unstale":"2023-10-16T14:27:33.656900+0000","last_undegraded":"2023-10-16T14:27:33.656900+0000","last_fullsized":"2023-10-16T14:27:33.656900+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:56:33.472288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.656566+0000","last_change":"2023-10-16T14:27:32.685180+0000","last_active":"2023-10-16T14:27:33.656566+0000","last_peered":"2023-10-16T14:27:33.656566+0000","last_clean":"2023-10-16T14:27:33.656566+0000","last_became_active":"2023-10-16T14:27:32.684906+0000","last_became_peered":"2023-10-16T14:27:32.684906+0000","last_unstale":"2023-10-16T14:27:33.656566+0000","last_undegraded":"2023-10-16T14:27:33.656566+0000","last_fullsized":"2023-10-16T14:27:33.656566+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:46:14.392909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.990881+0000","last_change":"2023-10-16T14:27:32.687725+0000","last_active":"2023-10-16T14:27:33.990881+0000","last_peered":"2023-10-16T14:27:33.990881+0000","last_clean":"2023-10-16T14:27:33.990881+0000","last_became_active":"2023-10-16T14:27:32.687356+0000","last_became_peered":"2023-10-16T14:27:32.687356+0000","last_unstale":"2023-10-16T14:27:33.990881+0000","last_undegraded":"2023-10-16T14:27:33.990881+0000","last_fullsized":"2023-10-16T14:27:33.990881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:53:16.642399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.051373+0000","last_change":"2023-10-16T14:27:32.686410+0000","last_active":"2023-10-16T14:27:34.051373+0000","last_peered":"2023-10-16T14:27:34.051373+0000","last_clean":"2023-10-16T14:27:34.051373+0000","last_became_active":"2023-10-16T14:27:32.686045+0000","last_became_peered":"2023-10-16T14:27:32.686045+0000","last_unstale":"2023-10-16T14:27:34.051373+0000","last_undegraded":"2023-10-16T14:27:34.051373+0000","last_fullsized":"2023-10-16T14:27:34.051373+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:43:11.317790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.052567+0000","last_change":"2023-10-16T14:27:32.689762+0000","last_active":"2023-10-16T14:27:34.052567+0000","last_peered":"2023-10-16T14:27:34.052567+0000","last_clean":"2023-10-16T14:27:34.052567+0000","last_became_active":"2023-10-16T14:27:32.689126+0000","last_became_peered":"2023-10-16T14:27:32.689126+0000","last_unstale":"2023-10-16T14:27:34.052567+0000","last_undegraded":"2023-10-16T14:27:34.052567+0000","last_fullsized":"2023-10-16T14:27:34.052567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:50:31.687004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.051864+0000","last_change":"2023-10-16T14:27:32.688213+0000","last_active":"2023-10-16T14:27:34.051864+0000","last_peered":"2023-10-16T14:27:34.051864+0000","last_clean":"2023-10-16T14:27:34.051864+0000","last_became_active":"2023-10-16T14:27:32.687460+0000","last_became_peered":"2023-10-16T14:27:32.687460+0000","last_unstale":"2023-10-16T14:27:34.051864+0000","last_undegraded":"2023-10-16T14:27:34.051864+0000","last_fullsized":"2023-10-16T14:27:34.051864+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:20:24.399604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.655632+0000","last_change":"2023-10-16T14:27:32.676844+0000","last_active":"2023-10-16T14:27:33.655632+0000","last_peered":"2023-10-16T14:27:33.655632+0000","last_clean":"2023-10-16T14:27:33.655632+0000","last_became_active":"2023-10-16T14:27:32.674468+0000","last_became_peered":"2023-10-16T14:27:32.674468+0000","last_unstale":"2023-10-16T14:27:33.655632+0000","last_undegraded":"2023-10-16T14:27:33.655632+0000","last_fullsized":"2023-10-16T14:27:33.655632+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:06:19.072904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.656760+0000","last_change":"2023-10-16T14:27:32.682150+0000","last_active":"2023-10-16T14:27:33.656760+0000","last_peered":"2023-10-16T14:27:33.656760+0000","last_clean":"2023-10-16T14:27:33.656760+0000","last_became_active":"2023-10-16T14:27:32.681386+0000","last_became_peered":"2023-10-16T14:27:32.681386+0000","last_unstale":"2023-10-16T14:27:33.656760+0000","last_undegraded":"2023-10-16T14:27:33.656760+0000","last_fullsized":"2023-10-16T14:27:33.656760+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:36:00.518494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.053460+0000","last_change":"2023-10-16T14:27:32.674638+0000","last_active":"2023-10-16T14:27:34.053460+0000","last_peered":"2023-10-16T14:27:34.053460+0000","last_clean":"2023-10-16T14:27:34.053460+0000","last_became_active":"2023-10-16T14:27:32.674313+0000","last_became_peered":"2023-10-16T14:27:32.674313+0000","last_unstale":"2023-10-16T14:27:34.053460+0000","last_undegraded":"2023-10-16T14:27:34.053460+0000","last_fullsized":"2023-10-16T14:27:34.053460+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:21:15.290361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.658335+0000","last_change":"2023-10-16T14:27:32.686049+0000","last_active":"2023-10-16T14:27:33.658335+0000","last_peered":"2023-10-16T14:27:33.658335+0000","last_clean":"2023-10-16T14:27:33.658335+0000","last_became_active":"2023-10-16T14:27:32.685327+0000","last_became_peered":"2023-10-16T14:27:32.685327+0000","last_unstale":"2023-10-16T14:27:33.658335+0000","last_undegraded":"2023-10-16T14:27:33.658335+0000","last_fullsized":"2023-10-16T14:27:33.658335+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:40:31.718696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.053540+0000","last_change":"2023-10-16T14:27:32.691230+0000","last_active":"2023-10-16T14:27:34.053540+0000","last_peered":"2023-10-16T14:27:34.053540+0000","last_clean":"2023-10-16T14:27:34.053540+0000","last_became_active":"2023-10-16T14:27:32.689987+0000","last_became_peered":"2023-10-16T14:27:32.689987+0000","last_unstale":"2023-10-16T14:27:34.053540+0000","last_undegraded":"2023-10-16T14:27:34.053540+0000","last_fullsized":"2023-10-16T14:27:34.053540+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:16:28.818884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.053247+0000","last_change":"2023-10-16T14:27:32.689032+0000","last_active":"2023-10-16T14:27:34.053247+0000","last_peered":"2023-10-16T14:27:34.053247+0000","last_clean":"2023-10-16T14:27:34.053247+0000","last_became_active":"2023-10-16T14:27:32.688773+0000","last_became_peered":"2023-10-16T14:27:32.688773+0000","last_unstale":"2023-10-16T14:27:34.053247+0000","last_undegraded":"2023-10-16T14:27:34.053247+0000","last_fullsized":"2023-10-16T14:27:34.053247+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:06:27.221554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.655906+0000","last_change":"2023-10-16T14:27:32.678645+0000","last_active":"2023-10-16T14:27:33.655906+0000","last_peered":"2023-10-16T14:27:33.655906+0000","last_clean":"2023-10-16T14:27:33.655906+0000","last_became_active":"2023-10-16T14:27:32.678194+0000","last_became_peered":"2023-10-16T14:27:32.678194+0000","last_unstale":"2023-10-16T14:27:33.655906+0000","last_undegraded":"2023-10-16T14:27:33.655906+0000","last_fullsized":"2023-10-16T14:27:33.655906+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:35:48.383084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.656541+0000","last_change":"2023-10-16T14:27:32.674143+0000","last_active":"2023-10-16T14:27:33.656541+0000","last_peered":"2023-10-16T14:27:33.656541+0000","last_clean":"2023-10-16T14:27:33.656541+0000","last_became_active":"2023-10-16T14:27:32.673886+0000","last_became_peered":"2023-10-16T14:27:32.673886+0000","last_unstale":"2023-10-16T14:27:33.656541+0000","last_undegraded":"2023-10-16T14:27:33.656541+0000","last_fullsized":"2023-10-16T14:27:33.656541+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:26:37.610587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.051858+0000","last_change":"2023-10-16T14:27:32.674197+0000","last_active":"2023-10-16T14:27:34.051858+0000","last_peered":"2023-10-16T14:27:34.051858+0000","last_clean":"2023-10-16T14:27:34.051858+0000","last_became_active":"2023-10-16T14:27:32.673620+0000","last_became_peered":"2023-10-16T14:27:32.673620+0000","last_unstale":"2023-10-16T14:27:34.051858+0000","last_undegraded":"2023-10-16T14:27:34.051858+0000","last_fullsized":"2023-10-16T14:27:34.051858+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:46:18.436081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.656841+0000","last_change":"2023-10-16T14:27:32.681941+0000","last_active":"2023-10-16T14:27:33.656841+0000","last_peered":"2023-10-16T14:27:33.656841+0000","last_clean":"2023-10-16T14:27:33.656841+0000","last_became_active":"2023-10-16T14:27:32.681014+0000","last_became_peered":"2023-10-16T14:27:32.681014+0000","last_unstale":"2023-10-16T14:27:33.656841+0000","last_undegraded":"2023-10-16T14:27:33.656841+0000","last_fullsized":"2023-10-16T14:27:33.656841+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:24:19.433136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.656085+0000","last_change":"2023-10-16T14:27:32.677871+0000","last_active":"2023-10-16T14:27:33.656085+0000","last_peered":"2023-10-16T14:27:33.656085+0000","last_clean":"2023-10-16T14:27:33.656085+0000","last_became_active":"2023-10-16T14:27:32.677613+0000","last_became_peered":"2023-10-16T14:27:32.677613+0000","last_unstale":"2023-10-16T14:27:33.656085+0000","last_undegraded":"2023-10-16T14:27:33.656085+0000","last_fullsized":"2023-10-16T14:27:33.656085+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:44:37.031860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.106595+0000","last_change":"2023-10-16T14:27:32.071376+0000","last_active":"2023-10-16T14:27:33.106595+0000","last_peered":"2023-10-16T14:27:33.106595+0000","last_clean":"2023-10-16T14:27:33.106595+0000","last_became_active":"2023-10-16T14:27:32.071089+0000","last_became_peered":"2023-10-16T14:27:32.071089+0000","last_unstale":"2023-10-16T14:27:33.106595+0000","last_undegraded":"2023-10-16T14:27:33.106595+0000","last_fullsized":"2023-10-16T14:27:33.106595+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:06:26.215822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.054646+0000","last_change":"2023-10-16T14:27:32.683104+0000","last_active":"2023-10-16T14:27:34.054646+0000","last_peered":"2023-10-16T14:27:34.054646+0000","last_clean":"2023-10-16T14:27:34.054646+0000","last_became_active":"2023-10-16T14:27:32.681874+0000","last_became_peered":"2023-10-16T14:27:32.681874+0000","last_unstale":"2023-10-16T14:27:34.054646+0000","last_undegraded":"2023-10-16T14:27:34.054646+0000","last_fullsized":"2023-10-16T14:27:34.054646+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:58.113071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.107958+0000","last_change":"2023-10-16T14:27:32.073392+0000","last_active":"2023-10-16T14:27:33.107958+0000","last_peered":"2023-10-16T14:27:33.107958+0000","last_clean":"2023-10-16T14:27:33.107958+0000","last_became_active":"2023-10-16T14:27:32.072009+0000","last_became_peered":"2023-10-16T14:27:32.072009+0000","last_unstale":"2023-10-16T14:27:33.107958+0000","last_undegraded":"2023-10-16T14:27:33.107958+0000","last_fullsized":"2023-10-16T14:27:33.107958+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:06:26.215822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.657035+0000","last_change":"2023-10-16T14:27:32.680311+0000","last_active":"2023-10-16T14:27:33.657035+0000","last_peered":"2023-10-16T14:27:33.657035+0000","last_clean":"2023-10-16T14:27:33.657035+0000","last_became_active":"2023-10-16T14:27:32.679983+0000","last_became_peered":"2023-10-16T14:27:32.679983+0000","last_unstale":"2023-10-16T14:27:33.657035+0000","last_undegraded":"2023-10-16T14:27:33.657035+0000","last_fullsized":"2023-10-16T14:27:33.657035+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:25:23.944061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.107395+0000","last_change":"2023-10-16T14:27:32.078184+0000","last_active":"2023-10-16T14:27:33.107395+0000","last_peered":"2023-10-16T14:27:33.107395+0000","last_clean":"2023-10-16T14:27:33.107395+0000","last_became_active":"2023-10-16T14:27:32.077893+0000","last_became_peered":"2023-10-16T14:27:32.077893+0000","last_unstale":"2023-10-16T14:27:33.107395+0000","last_undegraded":"2023-10-16T14:27:33.107395+0000","last_fullsized":"2023-10-16T14:27:33.107395+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:05:12.152698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.054435+0000","last_change":"2023-10-16T14:27:32.681862+0000","last_active":"2023-10-16T14:27:34.054435+0000","last_peered":"2023-10-16T14:27:34.054435+0000","last_clean":"2023-10-16T14:27:34.054435+0000","last_became_active":"2023-10-16T14:27:32.679327+0000","last_became_peered":"2023-10-16T14:27:32.679327+0000","last_unstale":"2023-10-16T14:27:34.054435+0000","last_undegraded":"2023-10-16T14:27:34.054435+0000","last_fullsized":"2023-10-16T14:27:34.054435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:37:53.246172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.110177+0000","last_change":"2023-10-16T14:27:32.064999+0000","last_active":"2023-10-16T14:27:33.110177+0000","last_peered":"2023-10-16T14:27:33.110177+0000","last_clean":"2023-10-16T14:27:33.110177+0000","last_became_active":"2023-10-16T14:27:32.064637+0000","last_became_peered":"2023-10-16T14:27:32.064637+0000","last_unstale":"2023-10-16T14:27:33.110177+0000","last_undegraded":"2023-10-16T14:27:33.110177+0000","last_fullsized":"2023-10-16T14:27:33.110177+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:07:55.012356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.657140+0000","last_change":"2023-10-16T14:27:32.686571+0000","last_active":"2023-10-16T14:27:33.657140+0000","last_peered":"2023-10-16T14:27:33.657140+0000","last_clean":"2023-10-16T14:27:33.657140+0000","last_became_active":"2023-10-16T14:27:32.685893+0000","last_became_peered":"2023-10-16T14:27:32.685893+0000","last_unstale":"2023-10-16T14:27:33.657140+0000","last_undegraded":"2023-10-16T14:27:33.657140+0000","last_fullsized":"2023-10-16T14:27:33.657140+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:14:55.707307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.104511+0000","last_change":"2023-10-16T14:27:32.071705+0000","last_active":"2023-10-16T14:27:33.104511+0000","last_peered":"2023-10-16T14:27:33.104511+0000","last_clean":"2023-10-16T14:27:33.104511+0000","last_became_active":"2023-10-16T14:27:32.071328+0000","last_became_peered":"2023-10-16T14:27:32.071328+0000","last_unstale":"2023-10-16T14:27:33.104511+0000","last_undegraded":"2023-10-16T14:27:33.104511+0000","last_fullsized":"2023-10-16T14:27:33.104511+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:38:11.059633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.051348+0000","last_change":"2023-10-16T14:27:32.692594+0000","last_active":"2023-10-16T14:27:34.051348+0000","last_peered":"2023-10-16T14:27:34.051348+0000","last_clean":"2023-10-16T14:27:34.051348+0000","last_became_active":"2023-10-16T14:27:32.692322+0000","last_became_peered":"2023-10-16T14:27:32.692322+0000","last_unstale":"2023-10-16T14:27:34.051348+0000","last_undegraded":"2023-10-16T14:27:34.051348+0000","last_fullsized":"2023-10-16T14:27:34.051348+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:42:58.113071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.107708+0000","last_change":"2023-10-16T14:27:32.084317+0000","last_active":"2023-10-16T14:27:33.107708+0000","last_peered":"2023-10-16T14:27:33.107708+0000","last_clean":"2023-10-16T14:27:33.107708+0000","last_became_active":"2023-10-16T14:27:32.083968+0000","last_became_peered":"2023-10-16T14:27:32.083968+0000","last_unstale":"2023-10-16T14:27:33.107708+0000","last_undegraded":"2023-10-16T14:27:33.107708+0000","last_fullsized":"2023-10-16T14:27:33.107708+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:38.314388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.656567+0000","last_change":"2023-10-16T14:27:32.683045+0000","last_active":"2023-10-16T14:27:33.656567+0000","last_peered":"2023-10-16T14:27:33.656567+0000","last_clean":"2023-10-16T14:27:33.656567+0000","last_became_active":"2023-10-16T14:27:32.682744+0000","last_became_peered":"2023-10-16T14:27:32.682744+0000","last_unstale":"2023-10-16T14:27:33.656567+0000","last_undegraded":"2023-10-16T14:27:33.656567+0000","last_fullsized":"2023-10-16T14:27:33.656567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:07:36.686124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.681142+0000","last_change":"2023-10-16T14:27:32.065110+0000","last_active":"2023-10-16T14:27:32.681142+0000","last_peered":"2023-10-16T14:27:32.681142+0000","last_clean":"2023-10-16T14:27:32.681142+0000","last_became_active":"2023-10-16T14:27:32.064701+0000","last_became_peered":"2023-10-16T14:27:32.064701+0000","last_unstale":"2023-10-16T14:27:32.681142+0000","last_undegraded":"2023-10-16T14:27:32.681142+0000","last_fullsized":"2023-10-16T14:27:32.681142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:16:27.813152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.054415+0000","last_change":"2023-10-16T14:27:32.673013+0000","last_active":"2023-10-16T14:27:34.054415+0000","last_peered":"2023-10-16T14:27:34.054415+0000","last_clean":"2023-10-16T14:27:34.054415+0000","last_became_active":"2023-10-16T14:27:32.672661+0000","last_became_peered":"2023-10-16T14:27:32.672661+0000","last_unstale":"2023-10-16T14:27:34.054415+0000","last_undegraded":"2023-10-16T14:27:34.054415+0000","last_fullsized":"2023-10-16T14:27:34.054415+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:45:30.772918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.667128+0000","last_change":"2023-10-16T14:27:32.076056+0000","last_active":"2023-10-16T14:27:32.667128+0000","last_peered":"2023-10-16T14:27:32.667128+0000","last_clean":"2023-10-16T14:27:32.667128+0000","last_became_active":"2023-10-16T14:27:32.075524+0000","last_became_peered":"2023-10-16T14:27:32.075524+0000","last_unstale":"2023-10-16T14:27:32.667128+0000","last_undegraded":"2023-10-16T14:27:32.667128+0000","last_fullsized":"2023-10-16T14:27:32.667128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:32:23.484320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.658148+0000","last_change":"2023-10-16T14:27:32.692203+0000","last_active":"2023-10-16T14:27:33.658148+0000","last_peered":"2023-10-16T14:27:33.658148+0000","last_clean":"2023-10-16T14:27:33.658148+0000","last_became_active":"2023-10-16T14:27:32.690938+0000","last_became_peered":"2023-10-16T14:27:32.690938+0000","last_unstale":"2023-10-16T14:27:33.658148+0000","last_undegraded":"2023-10-16T14:27:33.658148+0000","last_fullsized":"2023-10-16T14:27:33.658148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:41:48.933454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.683555+0000","last_change":"2023-10-16T14:27:32.074826+0000","last_active":"2023-10-16T14:27:32.683555+0000","last_peered":"2023-10-16T14:27:32.683555+0000","last_clean":"2023-10-16T14:27:32.683555+0000","last_became_active":"2023-10-16T14:27:32.073522+0000","last_became_peered":"2023-10-16T14:27:32.073522+0000","last_unstale":"2023-10-16T14:27:32.683555+0000","last_undegraded":"2023-10-16T14:27:32.683555+0000","last_fullsized":"2023-10-16T14:27:32.683555+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:55:35.527414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.052952+0000","last_change":"2023-10-16T14:27:32.684304+0000","last_active":"2023-10-16T14:27:34.052952+0000","last_peered":"2023-10-16T14:27:34.052952+0000","last_clean":"2023-10-16T14:27:34.052952+0000","last_became_active":"2023-10-16T14:27:32.683951+0000","last_became_peered":"2023-10-16T14:27:32.683951+0000","last_unstale":"2023-10-16T14:27:34.052952+0000","last_undegraded":"2023-10-16T14:27:34.052952+0000","last_fullsized":"2023-10-16T14:27:34.052952+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:22:23.168510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.666761+0000","last_change":"2023-10-16T14:27:32.071909+0000","last_active":"2023-10-16T14:27:32.666761+0000","last_peered":"2023-10-16T14:27:32.666761+0000","last_clean":"2023-10-16T14:27:32.666761+0000","last_became_active":"2023-10-16T14:27:32.071608+0000","last_became_peered":"2023-10-16T14:27:32.071608+0000","last_unstale":"2023-10-16T14:27:32.666761+0000","last_undegraded":"2023-10-16T14:27:32.666761+0000","last_fullsized":"2023-10-16T14:27:32.666761+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T17:02:09.352084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.658452+0000","last_change":"2023-10-16T14:27:32.685636+0000","last_active":"2023-10-16T14:27:33.658452+0000","last_peered":"2023-10-16T14:27:33.658452+0000","last_clean":"2023-10-16T14:27:33.658452+0000","last_became_active":"2023-10-16T14:27:32.683350+0000","last_became_peered":"2023-10-16T14:27:32.683350+0000","last_unstale":"2023-10-16T14:27:33.658452+0000","last_undegraded":"2023-10-16T14:27:33.658452+0000","last_fullsized":"2023-10-16T14:27:33.658452+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:37.845731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.109755+0000","last_change":"2023-10-16T14:27:32.079803+0000","last_active":"2023-10-16T14:27:33.109755+0000","last_peered":"2023-10-16T14:27:33.109755+0000","last_clean":"2023-10-16T14:27:33.109755+0000","last_became_active":"2023-10-16T14:27:32.079038+0000","last_became_peered":"2023-10-16T14:27:32.079038+0000","last_unstale":"2023-10-16T14:27:33.109755+0000","last_undegraded":"2023-10-16T14:27:33.109755+0000","last_fullsized":"2023-10-16T14:27:33.109755+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:53:37.518531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.051677+0000","last_change":"2023-10-16T14:27:32.685157+0000","last_active":"2023-10-16T14:27:34.051677+0000","last_peered":"2023-10-16T14:27:34.051677+0000","last_clean":"2023-10-16T14:27:34.051677+0000","last_became_active":"2023-10-16T14:27:32.684866+0000","last_became_peered":"2023-10-16T14:27:32.684866+0000","last_unstale":"2023-10-16T14:27:34.051677+0000","last_undegraded":"2023-10-16T14:27:34.051677+0000","last_fullsized":"2023-10-16T14:27:34.051677+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:52:15.767523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.112683+0000","last_change":"2023-10-16T14:27:32.066243+0000","last_active":"2023-10-16T14:27:33.112683+0000","last_peered":"2023-10-16T14:27:33.112683+0000","last_clean":"2023-10-16T14:27:33.112683+0000","last_became_active":"2023-10-16T14:27:32.065947+0000","last_became_peered":"2023-10-16T14:27:32.065947+0000","last_unstale":"2023-10-16T14:27:33.112683+0000","last_undegraded":"2023-10-16T14:27:33.112683+0000","last_fullsized":"2023-10-16T14:27:33.112683+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:50:30.681272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.657188+0000","last_change":"2023-10-16T14:27:32.686050+0000","last_active":"2023-10-16T14:27:33.657188+0000","last_peered":"2023-10-16T14:27:33.657188+0000","last_clean":"2023-10-16T14:27:33.657188+0000","last_became_active":"2023-10-16T14:27:32.685282+0000","last_became_peered":"2023-10-16T14:27:32.685282+0000","last_unstale":"2023-10-16T14:27:33.657188+0000","last_undegraded":"2023-10-16T14:27:33.657188+0000","last_fullsized":"2023-10-16T14:27:33.657188+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:41:15.639703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.109459+0000","last_change":"2023-10-16T14:27:32.079331+0000","last_active":"2023-10-16T14:27:33.109459+0000","last_peered":"2023-10-16T14:27:33.109459+0000","last_clean":"2023-10-16T14:27:33.109459+0000","last_became_active":"2023-10-16T14:27:32.078943+0000","last_became_peered":"2023-10-16T14:27:32.078943+0000","last_unstale":"2023-10-16T14:27:33.109459+0000","last_undegraded":"2023-10-16T14:27:33.109459+0000","last_fullsized":"2023-10-16T14:27:33.109459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:41:55.949287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.052686+0000","last_change":"2023-10-16T14:27:32.676235+0000","last_active":"2023-10-16T14:27:34.052686+0000","last_peered":"2023-10-16T14:27:34.052686+0000","last_clean":"2023-10-16T14:27:34.052686+0000","last_became_active":"2023-10-16T14:27:32.675818+0000","last_became_peered":"2023-10-16T14:27:32.675818+0000","last_unstale":"2023-10-16T14:27:34.052686+0000","last_undegraded":"2023-10-16T14:27:34.052686+0000","last_fullsized":"2023-10-16T14:27:34.052686+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:21:10.981147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.657602+0000","last_change":"2023-10-16T14:27:32.079988+0000","last_active":"2023-10-16T14:27:32.657602+0000","last_peered":"2023-10-16T14:27:32.657602+0000","last_clean":"2023-10-16T14:27:32.657602+0000","last_became_active":"2023-10-16T14:27:32.079734+0000","last_became_peered":"2023-10-16T14:27:32.079734+0000","last_unstale":"2023-10-16T14:27:32.657602+0000","last_undegraded":"2023-10-16T14:27:32.657602+0000","last_fullsized":"2023-10-16T14:27:32.657602+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:44:27.233555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.052228+0000","last_change":"2023-10-16T14:27:32.685167+0000","last_active":"2023-10-16T14:27:34.052228+0000","last_peered":"2023-10-16T14:27:34.052228+0000","last_clean":"2023-10-16T14:27:34.052228+0000","last_became_active":"2023-10-16T14:27:32.684712+0000","last_became_peered":"2023-10-16T14:27:32.684712+0000","last_unstale":"2023-10-16T14:27:34.052228+0000","last_undegraded":"2023-10-16T14:27:34.052228+0000","last_fullsized":"2023-10-16T14:27:34.052228+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:37:58.042545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.660213+0000","last_change":"2023-10-16T14:27:32.070127+0000","last_active":"2023-10-16T14:27:32.660213+0000","last_peered":"2023-10-16T14:27:32.660213+0000","last_clean":"2023-10-16T14:27:32.660213+0000","last_became_active":"2023-10-16T14:27:32.069843+0000","last_became_peered":"2023-10-16T14:27:32.069843+0000","last_unstale":"2023-10-16T14:27:32.660213+0000","last_undegraded":"2023-10-16T14:27:32.660213+0000","last_fullsized":"2023-10-16T14:27:32.660213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:29:55.030844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.054652+0000","last_change":"2023-10-16T14:27:32.688805+0000","last_active":"2023-10-16T14:27:34.054652+0000","last_peered":"2023-10-16T14:27:34.054652+0000","last_clean":"2023-10-16T14:27:34.054652+0000","last_became_active":"2023-10-16T14:27:32.687077+0000","last_became_peered":"2023-10-16T14:27:32.687077+0000","last_unstale":"2023-10-16T14:27:34.054652+0000","last_undegraded":"2023-10-16T14:27:34.054652+0000","last_fullsized":"2023-10-16T14:27:34.054652+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:44:28.239287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.103074+0000","last_change":"2023-10-16T14:27:32.068015+0000","last_active":"2023-10-16T14:27:33.103074+0000","last_peered":"2023-10-16T14:27:33.103074+0000","last_clean":"2023-10-16T14:27:33.103074+0000","last_became_active":"2023-10-16T14:27:32.067716+0000","last_became_peered":"2023-10-16T14:27:32.067716+0000","last_unstale":"2023-10-16T14:27:33.103074+0000","last_undegraded":"2023-10-16T14:27:33.103074+0000","last_fullsized":"2023-10-16T14:27:33.103074+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:46:17.430349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.053520+0000","last_change":"2023-10-16T14:27:32.676932+0000","last_active":"2023-10-16T14:27:34.053520+0000","last_peered":"2023-10-16T14:27:34.053520+0000","last_clean":"2023-10-16T14:27:34.053520+0000","last_became_active":"2023-10-16T14:27:32.676311+0000","last_became_peered":"2023-10-16T14:27:32.676311+0000","last_unstale":"2023-10-16T14:27:34.053520+0000","last_undegraded":"2023-10-16T14:27:34.053520+0000","last_fullsized":"2023-10-16T14:27:34.053520+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:40:17.638514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.098234+0000","last_change":"2023-10-16T14:27:32.080631+0000","last_active":"2023-10-16T14:27:33.098234+0000","last_peered":"2023-10-16T14:27:33.098234+0000","last_clean":"2023-10-16T14:27:33.098234+0000","last_became_active":"2023-10-16T14:27:32.080216+0000","last_became_peered":"2023-10-16T14:27:32.080216+0000","last_unstale":"2023-10-16T14:27:33.098234+0000","last_undegraded":"2023-10-16T14:27:33.098234+0000","last_fullsized":"2023-10-16T14:27:33.098234+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:31:29.939482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.053617+0000","last_change":"2023-10-16T14:27:32.687429+0000","last_active":"2023-10-16T14:27:34.053617+0000","last_peered":"2023-10-16T14:27:34.053617+0000","last_clean":"2023-10-16T14:27:34.053617+0000","last_became_active":"2023-10-16T14:27:32.682591+0000","last_became_peered":"2023-10-16T14:27:32.682591+0000","last_unstale":"2023-10-16T14:27:34.053617+0000","last_undegraded":"2023-10-16T14:27:34.053617+0000","last_fullsized":"2023-10-16T14:27:34.053617+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:45:16.211039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.109806+0000","last_change":"2023-10-16T14:27:32.080000+0000","last_active":"2023-10-16T14:27:33.109806+0000","last_peered":"2023-10-16T14:27:33.109806+0000","last_clean":"2023-10-16T14:27:33.109806+0000","last_became_active":"2023-10-16T14:27:32.079018+0000","last_became_peered":"2023-10-16T14:27:32.079018+0000","last_unstale":"2023-10-16T14:27:33.109806+0000","last_undegraded":"2023-10-16T14:27:33.109806+0000","last_fullsized":"2023-10-16T14:27:33.109806+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:41:22.445812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.052231+0000","last_change":"2023-10-16T14:27:32.690661+0000","last_active":"2023-10-16T14:27:34.052231+0000","last_peered":"2023-10-16T14:27:34.052231+0000","last_clean":"2023-10-16T14:27:34.052231+0000","last_became_active":"2023-10-16T14:27:32.688129+0000","last_became_peered":"2023-10-16T14:27:32.688129+0000","last_unstale":"2023-10-16T14:27:34.052231+0000","last_undegraded":"2023-10-16T14:27:34.052231+0000","last_fullsized":"2023-10-16T14:27:34.052231+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:07:56.018088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.101919+0000","last_change":"2023-10-16T14:27:32.075960+0000","last_active":"2023-10-16T14:27:33.101919+0000","last_peered":"2023-10-16T14:27:33.101919+0000","last_clean":"2023-10-16T14:27:33.101919+0000","last_became_active":"2023-10-16T14:27:32.075467+0000","last_became_peered":"2023-10-16T14:27:32.075467+0000","last_unstale":"2023-10-16T14:27:33.101919+0000","last_undegraded":"2023-10-16T14:27:33.101919+0000","last_fullsized":"2023-10-16T14:27:33.101919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:10:55.109042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.990799+0000","last_change":"2023-10-16T14:27:32.681041+0000","last_active":"2023-10-16T14:27:33.990799+0000","last_peered":"2023-10-16T14:27:33.990799+0000","last_clean":"2023-10-16T14:27:33.990799+0000","last_became_active":"2023-10-16T14:27:32.680710+0000","last_became_peered":"2023-10-16T14:27:32.680710+0000","last_unstale":"2023-10-16T14:27:33.990799+0000","last_undegraded":"2023-10-16T14:27:33.990799+0000","last_fullsized":"2023-10-16T14:27:33.990799+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:03:51.096787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.990467+0000","last_change":"2023-10-16T14:27:32.078427+0000","last_active":"2023-10-16T14:27:33.990467+0000","last_peered":"2023-10-16T14:27:33.990467+0000","last_clean":"2023-10-16T14:27:33.990467+0000","last_became_active":"2023-10-16T14:27:32.078140+0000","last_became_peered":"2023-10-16T14:27:32.078140+0000","last_unstale":"2023-10-16T14:27:33.990467+0000","last_undegraded":"2023-10-16T14:27:33.990467+0000","last_fullsized":"2023-10-16T14:27:33.990467+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:36:22.447745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.655598+0000","last_change":"2023-10-16T14:27:32.678294+0000","last_active":"2023-10-16T14:27:33.655598+0000","last_peered":"2023-10-16T14:27:33.655598+0000","last_clean":"2023-10-16T14:27:33.655598+0000","last_became_active":"2023-10-16T14:27:32.676208+0000","last_became_peered":"2023-10-16T14:27:32.676208+0000","last_unstale":"2023-10-16T14:27:33.655598+0000","last_undegraded":"2023-10-16T14:27:33.655598+0000","last_fullsized":"2023-10-16T14:27:33.655598+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:51:44.664976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.990681+0000","last_change":"2023-10-16T14:27:32.077994+0000","last_active":"2023-10-16T14:27:33.990681+0000","last_peered":"2023-10-16T14:27:33.990681+0000","last_clean":"2023-10-16T14:27:33.990681+0000","last_became_active":"2023-10-16T14:27:32.077698+0000","last_became_peered":"2023-10-16T14:27:32.077698+0000","last_unstale":"2023-10-16T14:27:33.990681+0000","last_undegraded":"2023-10-16T14:27:33.990681+0000","last_fullsized":"2023-10-16T14:27:33.990681+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T15:07:31.457823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.656495+0000","last_change":"2023-10-16T14:27:32.679113+0000","last_active":"2023-10-16T14:27:33.656495+0000","last_peered":"2023-10-16T14:27:33.656495+0000","last_clean":"2023-10-16T14:27:33.656495+0000","last_became_active":"2023-10-16T14:27:32.678689+0000","last_became_peered":"2023-10-16T14:27:32.678689+0000","last_unstale":"2023-10-16T14:27:33.656495+0000","last_undegraded":"2023-10-16T14:27:33.656495+0000","last_fullsized":"2023-10-16T14:27:33.656495+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:17:20.722467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.657756+0000","last_change":"2023-10-16T14:27:32.081438+0000","last_active":"2023-10-16T14:27:32.657756+0000","last_peered":"2023-10-16T14:27:32.657756+0000","last_clean":"2023-10-16T14:27:32.657756+0000","last_became_active":"2023-10-16T14:27:32.081166+0000","last_became_peered":"2023-10-16T14:27:32.081166+0000","last_unstale":"2023-10-16T14:27:32.657756+0000","last_undegraded":"2023-10-16T14:27:32.657756+0000","last_fullsized":"2023-10-16T14:27:32.657756+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T16:22:22.162778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.052048+0000","last_change":"2023-10-16T14:27:32.688425+0000","last_active":"2023-10-16T14:27:34.052048+0000","last_peered":"2023-10-16T14:27:34.052048+0000","last_clean":"2023-10-16T14:27:34.052048+0000","last_became_active":"2023-10-16T14:27:32.687954+0000","last_became_peered":"2023-10-16T14:27:32.687954+0000","last_unstale":"2023-10-16T14:27:34.052048+0000","last_undegraded":"2023-10-16T14:27:34.052048+0000","last_fullsized":"2023-10-16T14:27:34.052048+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:47:50.570403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.667777+0000","last_change":"2023-10-16T14:27:32.076548+0000","last_active":"2023-10-16T14:27:32.667777+0000","last_peered":"2023-10-16T14:27:32.667777+0000","last_clean":"2023-10-16T14:27:32.667777+0000","last_became_active":"2023-10-16T14:27:32.076214+0000","last_became_peered":"2023-10-16T14:27:32.076214+0000","last_unstale":"2023-10-16T14:27:32.667777+0000","last_undegraded":"2023-10-16T14:27:32.667777+0000","last_fullsized":"2023-10-16T14:27:32.667777+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:22:17.751743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.656886+0000","last_change":"2023-10-16T14:27:32.680003+0000","last_active":"2023-10-16T14:27:33.656886+0000","last_peered":"2023-10-16T14:27:33.656886+0000","last_clean":"2023-10-16T14:27:33.656886+0000","last_became_active":"2023-10-16T14:27:32.679621+0000","last_became_peered":"2023-10-16T14:27:32.679621+0000","last_unstale":"2023-10-16T14:27:33.656886+0000","last_undegraded":"2023-10-16T14:27:33.656886+0000","last_fullsized":"2023-10-16T14:27:33.656886+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:35:04.900786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.656551+0000","last_change":"2023-10-16T14:27:32.086906+0000","last_active":"2023-10-16T14:27:32.656551+0000","last_peered":"2023-10-16T14:27:32.656551+0000","last_clean":"2023-10-16T14:27:32.656551+0000","last_became_active":"2023-10-16T14:27:32.086590+0000","last_became_peered":"2023-10-16T14:27:32.086590+0000","last_unstale":"2023-10-16T14:27:32.656551+0000","last_undegraded":"2023-10-16T14:27:32.656551+0000","last_fullsized":"2023-10-16T14:27:32.656551+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:38:11.059633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.054536+0000","last_change":"2023-10-16T14:27:32.689383+0000","last_active":"2023-10-16T14:27:34.054536+0000","last_peered":"2023-10-16T14:27:34.054536+0000","last_clean":"2023-10-16T14:27:34.054536+0000","last_became_active":"2023-10-16T14:27:32.688849+0000","last_became_peered":"2023-10-16T14:27:32.688849+0000","last_unstale":"2023-10-16T14:27:34.054536+0000","last_undegraded":"2023-10-16T14:27:34.054536+0000","last_fullsized":"2023-10-16T14:27:34.054536+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:06:27.221554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.108174+0000","last_change":"2023-10-16T14:27:32.077235+0000","last_active":"2023-10-16T14:27:33.108174+0000","last_peered":"2023-10-16T14:27:33.108174+0000","last_clean":"2023-10-16T14:27:33.108174+0000","last_became_active":"2023-10-16T14:27:32.076287+0000","last_became_peered":"2023-10-16T14:27:32.076287+0000","last_unstale":"2023-10-16T14:27:33.108174+0000","last_undegraded":"2023-10-16T14:27:33.108174+0000","last_fullsized":"2023-10-16T14:27:33.108174+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T20:28:36.839999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.053702+0000","last_change":"2023-10-16T14:27:32.682984+0000","last_active":"2023-10-16T14:27:34.053702+0000","last_peered":"2023-10-16T14:27:34.053702+0000","last_clean":"2023-10-16T14:27:34.053702+0000","last_became_active":"2023-10-16T14:27:32.682712+0000","last_became_peered":"2023-10-16T14:27:32.682712+0000","last_unstale":"2023-10-16T14:27:34.053702+0000","last_undegraded":"2023-10-16T14:27:34.053702+0000","last_fullsized":"2023-10-16T14:27:34.053702+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:48:37.240485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.054081+0000","last_change":"2023-10-16T14:27:32.078763+0000","last_active":"2023-10-16T14:27:34.054081+0000","last_peered":"2023-10-16T14:27:34.054081+0000","last_clean":"2023-10-16T14:27:34.054081+0000","last_became_active":"2023-10-16T14:27:32.075595+0000","last_became_peered":"2023-10-16T14:27:32.075595+0000","last_unstale":"2023-10-16T14:27:34.054081+0000","last_undegraded":"2023-10-16T14:27:34.054081+0000","last_fullsized":"2023-10-16T14:27:34.054081+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T21:57:38.314388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.990751+0000","last_change":"2023-10-16T14:27:32.678499+0000","last_active":"2023-10-16T14:27:33.990751+0000","last_peered":"2023-10-16T14:27:33.990751+0000","last_clean":"2023-10-16T14:27:33.990751+0000","last_became_active":"2023-10-16T14:27:32.678145+0000","last_became_peered":"2023-10-16T14:27:32.678145+0000","last_unstale":"2023-10-16T14:27:33.990751+0000","last_undegraded":"2023-10-16T14:27:33.990751+0000","last_fullsized":"2023-10-16T14:27:33.990751+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:40:12.321306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.674909+0000","last_change":"2023-10-16T14:27:32.079620+0000","last_active":"2023-10-16T14:27:32.674909+0000","last_peered":"2023-10-16T14:27:32.674909+0000","last_clean":"2023-10-16T14:27:32.674909+0000","last_became_active":"2023-10-16T14:27:32.079017+0000","last_became_peered":"2023-10-16T14:27:32.079017+0000","last_unstale":"2023-10-16T14:27:32.674909+0000","last_undegraded":"2023-10-16T14:27:32.674909+0000","last_fullsized":"2023-10-16T14:27:32.674909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:06:38.741250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.053567+0000","last_change":"2023-10-16T14:27:32.691172+0000","last_active":"2023-10-16T14:27:34.053567+0000","last_peered":"2023-10-16T14:27:34.053567+0000","last_clean":"2023-10-16T14:27:34.053567+0000","last_became_active":"2023-10-16T14:27:32.690660+0000","last_became_peered":"2023-10-16T14:27:32.690660+0000","last_unstale":"2023-10-16T14:27:34.053567+0000","last_undegraded":"2023-10-16T14:27:34.053567+0000","last_fullsized":"2023-10-16T14:27:34.053567+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T01:07:56.018088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.682305+0000","last_change":"2023-10-16T14:27:32.078369+0000","last_active":"2023-10-16T14:27:32.682305+0000","last_peered":"2023-10-16T14:27:32.682305+0000","last_clean":"2023-10-16T14:27:32.682305+0000","last_became_active":"2023-10-16T14:27:32.078043+0000","last_became_peered":"2023-10-16T14:27:32.078043+0000","last_unstale":"2023-10-16T14:27:32.682305+0000","last_undegraded":"2023-10-16T14:27:32.682305+0000","last_fullsized":"2023-10-16T14:27:32.682305+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:06:39.684110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.052876+0000","last_change":"2023-10-16T14:27:32.684941+0000","last_active":"2023-10-16T14:27:34.052876+0000","last_peered":"2023-10-16T14:27:34.052876+0000","last_clean":"2023-10-16T14:27:34.052876+0000","last_became_active":"2023-10-16T14:27:32.684621+0000","last_became_peered":"2023-10-16T14:27:32.684621+0000","last_unstale":"2023-10-16T14:27:34.052876+0000","last_undegraded":"2023-10-16T14:27:34.052876+0000","last_fullsized":"2023-10-16T14:27:34.052876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T23:49:10.671860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.674447+0000","last_change":"2023-10-16T14:27:32.075755+0000","last_active":"2023-10-16T14:27:32.674447+0000","last_peered":"2023-10-16T14:27:32.674447+0000","last_clean":"2023-10-16T14:27:32.674447+0000","last_became_active":"2023-10-16T14:27:32.075374+0000","last_became_peered":"2023-10-16T14:27:32.075374+0000","last_unstale":"2023-10-16T14:27:32.674447+0000","last_undegraded":"2023-10-16T14:27:32.674447+0000","last_fullsized":"2023-10-16T14:27:32.674447+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:45:29.767186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.656721+0000","last_change":"2023-10-16T14:27:32.688165+0000","last_active":"2023-10-16T14:27:33.656721+0000","last_peered":"2023-10-16T14:27:33.656721+0000","last_clean":"2023-10-16T14:27:33.656721+0000","last_became_active":"2023-10-16T14:27:32.687840+0000","last_became_peered":"2023-10-16T14:27:32.687840+0000","last_unstale":"2023-10-16T14:27:33.656721+0000","last_undegraded":"2023-10-16T14:27:33.656721+0000","last_fullsized":"2023-10-16T14:27:33.656721+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:04:18.736297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.660594+0000","last_change":"2023-10-16T14:27:32.071923+0000","last_active":"2023-10-16T14:27:32.660594+0000","last_peered":"2023-10-16T14:27:32.660594+0000","last_clean":"2023-10-16T14:27:32.660594+0000","last_became_active":"2023-10-16T14:27:32.071701+0000","last_became_peered":"2023-10-16T14:27:32.071701+0000","last_unstale":"2023-10-16T14:27:32.660594+0000","last_undegraded":"2023-10-16T14:27:32.660594+0000","last_fullsized":"2023-10-16T14:27:32.660594+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:18:39.851015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.052758+0000","last_change":"2023-10-16T14:27:32.689946+0000","last_active":"2023-10-16T14:27:34.052758+0000","last_peered":"2023-10-16T14:27:34.052758+0000","last_clean":"2023-10-16T14:27:34.052758+0000","last_became_active":"2023-10-16T14:27:32.689490+0000","last_became_peered":"2023-10-16T14:27:32.689490+0000","last_unstale":"2023-10-16T14:27:34.052758+0000","last_undegraded":"2023-10-16T14:27:34.052758+0000","last_fullsized":"2023-10-16T14:27:34.052758+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:05:13.158430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.681809+0000","last_change":"2023-10-16T14:27:32.071036+0000","last_active":"2023-10-16T14:27:32.681809+0000","last_peered":"2023-10-16T14:27:32.681809+0000","last_clean":"2023-10-16T14:27:32.681809+0000","last_became_active":"2023-10-16T14:27:32.070216+0000","last_became_peered":"2023-10-16T14:27:32.070216+0000","last_unstale":"2023-10-16T14:27:32.681809+0000","last_undegraded":"2023-10-16T14:27:32.681809+0000","last_fullsized":"2023-10-16T14:27:32.681809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T19:48:36.234753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:33.656786+0000","last_change":"2023-10-16T14:27:32.676622+0000","last_active":"2023-10-16T14:27:33.656786+0000","last_peered":"2023-10-16T14:27:33.656786+0000","last_clean":"2023-10-16T14:27:33.656786+0000","last_became_active":"2023-10-16T14:27:32.676281+0000","last_became_peered":"2023-10-16T14:27:32.676281+0000","last_unstale":"2023-10-16T14:27:33.656786+0000","last_undegraded":"2023-10-16T14:27:33.656786+0000","last_fullsized":"2023-10-16T14:27:33.656786+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:32.032720+0000","last_clean_scrub_stamp":"2023-10-16T14:27:32.032720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T18:00:39.315188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-16T14:27:32.675527+0000","last_change":"2023-10-16T14:27:32.076537+0000","last_active":"2023-10-16T14:27:32.675527+0000","last_peered":"2023-10-16T14:27:32.675527+0000","last_clean":"2023-10-16T14:27:32.675527+0000","last_became_active":"2023-10-16T14:27:32.076107+0000","last_became_peered":"2023-10-16T14:27:32.076107+0000","last_unstale":"2023-10-16T14:27:32.675527+0000","last_undegraded":"2023-10-16T14:27:32.675527+0000","last_fullsized":"2023-10-16T14:27:32.675527+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:27:31.026988+0000","last_clean_scrub_stamp":"2023-10-16T14:27:31.026988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-18T00:37:52.240440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-16T14:27:34.052106+0000","last_change":"2023-10-16T14:25:37.824419+0000","last_active":"2023-10-16T14:27:34.052106+0000","last_peered":"2023-10-16T14:27:34.052106+0000","last_clean":"2023-10-16T14:27:34.052106+0000","last_became_active":"2023-10-16T14:25:37.821909+0000","last_became_peered":"2023-10-16T14:25:37.821909+0000","last_unstale":"2023-10-16T14:27:34.052106+0000","last_undegraded":"2023-10-16T14:27:34.052106+0000","last_fullsized":"2023-10-16T14:27:34.052106+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-16T14:25:36.449944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-16T14:25:36.449944+0000","last_clean_scrub_stamp":"2023-10-16T14:25:36.449944+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-17T22:37:42.457821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476763,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":192111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 14:26:36 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":6.008,"5min":6.008,"15min":6.008},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":6.4059999999999997,"5min":6.4059999999999997,"15min":6.4059999999999997},"last":0.78700000000000003}]},{"osd":1,"last update":"Mon Oct 16 14:26:36 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.151}]},{"osd":2,"last update":"Mon Oct 16 14:26:36 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":1.0369999999999999}]},{"osd":4,"last update":"Mon Oct 16 14:26:36 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.288},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":1.3380000000000001}]},{"osd":5,"last update":"Mon Oct 16 14:26:36 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.411,"15min":1.411},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.367},{"interface":"front","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.3210000000000002,"5min":2.3210000000000002,"15min":2.3210000000000002},"last":1.6279999999999999}]},{"osd":6,"last update":"Mon Oct 16 14:26:36 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":1.6599999999999999}]},{"osd":7,"last update":"Mon Oct 16 14:26:36 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.542},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.3620000000000001,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.488}]}]},{"osd":2,"up_from":16,"seq":68719476763,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":194215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":5.0869999999999997,"5min":5.0869999999999997,"15min":5.0869999999999997},"last":0.85199999999999998}]},{"osd":1,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.323},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":5.1269999999999998,"5min":5.1269999999999998,"15min":5.1269999999999998},"last":0.89600000000000002}]},{"osd":3,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.6599999999999999,"5min":1.6599999999999999,"15min":1.6599999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.21}]},{"osd":4,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":4.9980000000000002,"5min":4.9980000000000002,"15min":4.9980000000000002},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.113}]},{"osd":5,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":2.4060000000000001,"5min":2.4060000000000001,"15min":2.4060000000000001},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":5.0430000000000001,"5min":5.0430000000000001,"15min":5.0430000000000001},"last":1.181}]},{"osd":6,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.8719999999999999,"5min":2.8719999999999999,"15min":2.8719999999999999},"last":1.02},{"interface":"front","average":{"1min":1.625,"5min":1.625,"15min":1.625},"min":{"1min":1.117,"5min":1.117,"15min":1.117},"max":{"1min":2.6320000000000001,"5min":2.6320000000000001,"15min":2.6320000000000001},"last":1.385}]},{"osd":7,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.772,"5min":1.772,"15min":1.772},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":4.9459999999999997,"5min":4.9459999999999997,"15min":4.9459999999999997},"last":1.448},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.1579999999999999}]}]},{"osd":1,"up_from":16,"seq":68719476764,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":782411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 14:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.1990000000000001}]},{"osd":2,"last update":"Mon Oct 16 14:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.367,"5min":2.367,"15min":2.367},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":1.395}]},{"osd":3,"last update":"Mon Oct 16 14:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.2839999999999998,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.0149999999999999}]},{"osd":4,"last update":"Mon Oct 16 14:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":4.0759999999999996,"5min":4.0759999999999996,"15min":4.0759999999999996},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.571,"5min":1.571,"15min":1.571},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":1.5509999999999999}]},{"osd":5,"last update":"Mon Oct 16 14:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":1.365},{"interface":"front","average":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":3.9430000000000001,"5min":3.9430000000000001,"15min":3.9430000000000001},"last":1.6060000000000001}]},{"osd":6,"last update":"Mon Oct 16 14:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":1.3},{"interface":"front","average":{"1min":1.776,"5min":1.776,"15min":1.776},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":3.8239999999999998,"5min":3.8239999999999998,"15min":3.8239999999999998},"last":1.7110000000000001}]},{"osd":7,"last update":"Mon Oct 16 14:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.726,"5min":1.726,"15min":1.726},"min":{"1min":1.093,"5min":1.093,"15min":1.093},"max":{"1min":3.0640000000000001,"5min":3.0640000000000001,"15min":3.0640000000000001},"last":1.772},{"interface":"front","average":{"1min":1.669,"5min":1.669,"15min":1.669},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.847,"5min":2.847,"15min":2.847},"last":1.514}]}]},{"osd":0,"up_from":16,"seq":68719476765,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":192113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":1.26}]},{"osd":2,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.1200000000000001}]},{"osd":3,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.56000000000000005},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.226}]},{"osd":4,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.4590000000000001,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.3069999999999999}]},{"osd":5,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":1.8620000000000001,"5min":1.8620000000000001,"15min":1.8620000000000001},"last":1.006},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":1.4199999999999999}]},{"osd":6,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"min":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"max":{"1min":2.496,"5min":2.496,"15min":2.496},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.5670000000000002,"5min":2.5670000000000002,"15min":2.5670000000000002},"last":1.3700000000000001}]},{"osd":7,"last update":"Mon Oct 16 14:26:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":2.21,"5min":2.21,"15min":2.21},"last":1.1850000000000001}]}]},{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":192091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 14:26:41 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":1.498},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.98399999999999999}]},{"osd":1,"last update":"Mon Oct 16 14:26:41 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.246},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.296}]},{"osd":2,"last update":"Mon Oct 16 14:26:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":1.153}]},{"osd":3,"last update":"Mon Oct 16 14:26:41 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":1.077},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":1.7}]},{"osd":4,"last update":"Mon Oct 16 14:26:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.379},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.4910000000000001,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.339}]},{"osd":5,"last update":"Mon Oct 16 14:26:35 2023","interfaces":[{"interface":"back","average":{"1min":1.667,"5min":1.667,"15min":1.667},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.5529999999999999,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":1.4630000000000001}]},{"osd":6,"last update":"Mon Oct 16 14:26:35 2023","interfaces":[{"interface":"back","average":{"1min":1.78,"5min":1.78,"15min":1.78},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.9729999999999999,"5min":2.9729999999999999,"15min":2.9729999999999999},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.653,"5min":1.653,"15min":1.653},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.548,"5min":2.548,"15min":2.548},"last":1.905}]}]},{"osd":6,"up_from":15,"seq":64424509466,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":192055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 14:26:42 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.79700000000000004}]},{"osd":1,"last update":"Mon Oct 16 14:26:42 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.21,"15min":1.21},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":1.083},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.2110000000000001}]},{"osd":2,"last update":"Mon Oct 16 14:26:42 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":3.7170000000000001,"5min":3.7170000000000001,"15min":3.7170000000000001},"last":1.3420000000000001}]},{"osd":3,"last update":"Mon Oct 16 14:26:42 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":3.944,"5min":3.944,"15min":3.944},"last":1.6180000000000001}]},{"osd":4,"last update":"Mon Oct 16 14:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":1.397},{"interface":"front","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.5310000000000001,"5min":2.5310000000000001,"15min":2.5310000000000001},"last":1.514}]},{"osd":5,"last update":"Mon Oct 16 14:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.1779999999999999,"5min":2.1779999999999999,"15min":2.1779999999999999},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.587,"5min":1.587,"15min":1.587},"min":{"1min":1.097,"5min":1.097,"15min":1.097},"max":{"1min":2.4449999999999998,"5min":2.4449999999999998,"15min":2.4449999999999998},"last":1.2829999999999999}]},{"osd":7,"last update":"Mon Oct 16 14:26:37 2023","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.589,"15min":1.589},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.74},{"interface":"front","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.704}]}]},{"osd":4,"up_from":15,"seq":64424509468,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":471040,"data_stored":193757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.69299999999999995}]},{"osd":1,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.81499999999999995}]},{"osd":2,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":2.0179999999999998},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":1.159}]},{"osd":3,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":1.288}]},{"osd":5,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":3.1720000000000002,"5min":3.1720000000000002,"15min":3.1720000000000002},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.1910000000000001}]},{"osd":6,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.4769999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.621,"5min":1.621,"15min":1.621},"min":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":1.413}]},{"osd":7,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.855,"5min":2.855,"15min":2.855},"last":1.464},{"interface":"front","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":1.3839999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":782971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":2.2919999999999998,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.087},{"interface":"front","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.147}]},{"osd":1,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":1.2030000000000001}]},{"osd":2,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.024,"5min":2.024,"15min":2.024},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":1.3580000000000001}]},{"osd":3,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.288},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":1.542}]},{"osd":4,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":1.7010000000000001}]},{"osd":6,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.863,"5min":1.863,"15min":1.863},"last":1.4139999999999999}]},{"osd":7,"last update":"Mon Oct 16 14:26:39 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.7569999999999999},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":1.6459999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-16T14:27:38.115 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-16T14:27:38.116 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-16T14:27:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.389+0000 7f0eebe90640 1 Processor -- start 2023-10-16T14:27:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.390+0000 7f0eebe90640 1 -- start start 2023-10-16T14:27:38.394 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.391+0000 7f0eebe90640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0ee40b4b30 0x7f0ee40b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.391+0000 7f0eebe90640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee40b7070 con 0x7f0ee415cd20 2023-10-16T14:27:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.391+0000 7f0eebe90640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee40b7350 con 0x7f0ee40d1ad0 2023-10-16T14:27:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.391+0000 7f0eebe90640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee40b89d0 con 0x7f0ee40b4b30 2023-10-16T14:27:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.391+0000 7f0ee9c2c640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0ee415cd20 0x7f0ee40b82c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47720/0 (socket says 172.21.15.59:47720) 2023-10-16T14:27:38.396 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.391+0000 7f0ee9c2c640 1 -- 172.21.15.59:0/3523141820 learned_addr learned my addr 172.21.15.59:0/3523141820 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:38.397 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.392+0000 7f0ee8c2a640 1 -- 172.21.15.59:0/3523141820 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848171072 0 0) 0x7f0ee40b7070 con 0x7f0ee415cd20 2023-10-16T14:27:38.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.392+0000 7f0ee8c2a640 1 -- 172.21.15.59:0/3523141820 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ed4003520 con 0x7f0ee415cd20 2023-10-16T14:27:38.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.392+0000 7f0eea42d640 1 --2- 172.21.15.59:0/3523141820 >> v2:172.21.15.151:3300/0 conn(0x7f0ee40b4b30 0x7f0ee40b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:38.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.392+0000 7f0ee8c2a640 1 -- 172.21.15.59:0/3523141820 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 828519360 0 0) 0x7f0ed4003520 con 0x7f0ee415cd20 2023-10-16T14:27:38.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.392+0000 7f0ee8c2a640 1 -- 172.21.15.59:0/3523141820 >> v2:172.21.15.151:3300/0 conn(0x7f0ee40b4b30 msgr2=0x7f0ee40b6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:38.398 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.392+0000 7f0ee8c2a640 1 --2- 172.21.15.59:0/3523141820 >> v2:172.21.15.151:3300/0 conn(0x7f0ee40b4b30 0x7f0ee40b6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.392+0000 7f0ee8c2a640 1 -- 172.21.15.59:0/3523141820 >> v1:172.21.15.151:6789/0 conn(0x7f0ee40d1ad0 legacy=0x7f0ee40b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.392+0000 7f0ee8c2a640 1 -- 172.21.15.59:0/3523141820 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee40b7630 con 0x7f0ee415cd20 2023-10-16T14:27:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.392+0000 7f0ee8c2a640 1 -- 172.21.15.59:0/3523141820 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f0ed80019f0 con 0x7f0ee415cd20 2023-10-16T14:27:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.393+0000 7f0ee8c2a640 1 -- 172.21.15.59:0/3523141820 >> v1:172.21.15.59:6789/0 conn(0x7f0ee415cd20 legacy=0x7f0ee40b82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.393+0000 7f0ee8c2a640 1 --2- 172.21.15.59:0/3523141820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ed40039c0 0x7f0ed4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.393+0000 7f0ee8c2a640 1 --2- 172.21.15.59:0/3523141820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ed40047c0 0x7f0ed4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.393+0000 7f0ee8c2a640 1 --2- 172.21.15.59:0/3523141820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ed40051d0 0x7f0ed400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.393+0000 7f0ee8c2a640 1 -- 172.21.15.59:0/3523141820 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40b89d0 con 0x7f0ed40051d0 2023-10-16T14:27:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.393+0000 7f0ee8c2a640 1 -- 172.21.15.59:0/3523141820 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed400c110 con 0x7f0ed40039c0 2023-10-16T14:27:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.393+0000 7f0ee8c2a640 1 -- 172.21.15.59:0/3523141820 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed400c2d0 con 0x7f0ed40047c0 2023-10-16T14:27:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.393+0000 7f0eea42d640 1 --2- 172.21.15.59:0/3523141820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ed40051d0 0x7f0ed400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.393+0000 7f0ee9c2c640 1 --2- 172.21.15.59:0/3523141820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ed40039c0 0x7f0ed4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.393+0000 7f0eea42d640 1 -- 172.21.15.59:0/3523141820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ed40047c0 msgr2=0x7f0ed4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.393+0000 7f0ee942b640 1 --2- 172.21.15.59:0/3523141820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ed40047c0 0x7f0ed4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.393+0000 7f0eea42d640 1 --2- 172.21.15.59:0/3523141820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ed40047c0 0x7f0ed4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.393+0000 7f0eea42d640 1 -- 172.21.15.59:0/3523141820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ed40039c0 msgr2=0x7f0ed4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.393+0000 7f0eea42d640 1 --2- 172.21.15.59:0/3523141820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ed40039c0 0x7f0ed4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.393+0000 7f0eea42d640 1 -- 172.21.15.59:0/3523141820 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed4003520 con 0x7f0ed40051d0 2023-10-16T14:27:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.394+0000 7f0ee942b640 1 --2- 172.21.15.59:0/3523141820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ed40047c0 0x7f0ed4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.394+0000 7f0ee9c2c640 1 --2- 172.21.15.59:0/3523141820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ed40039c0 0x7f0ed4003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.395+0000 7f0eea42d640 1 -- 172.21.15.59:0/3523141820 reap_dead start 2023-10-16T14:27:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.395+0000 7f0eea42d640 1 --2- 172.21.15.59:0/3523141820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ed40051d0 0x7f0ed400b980 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00ba00 tx=0x7f0ed40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef7913c82e44f2e server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:38.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.395+0000 7f0ee8c2a640 1 -- 172.21.15.59:0/3523141820 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc004020 con 0x7f0ed40051d0 2023-10-16T14:27:38.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.395+0000 7f0ee8c2a640 1 -- 172.21.15.59:0/3523141820 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc004180 con 0x7f0ed40051d0 2023-10-16T14:27:38.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.395+0000 7f0ee8c2a640 1 -- 172.21.15.59:0/3523141820 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc003610 con 0x7f0ed40051d0 2023-10-16T14:27:38.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.396+0000 7f0eebe90640 1 -- 172.21.15.59:0/3523141820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ed40051d0 msgr2=0x7f0ed400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:38.406 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.396+0000 7f0eebe90640 1 --2- 172.21.15.59:0/3523141820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ed40051d0 0x7f0ed400b980 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0edc00ba00 tx=0x7f0ed40057f0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.396+0000 7f0eebe90640 1 -- 172.21.15.59:0/3523141820 shutdown_connections 2023-10-16T14:27:38.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.396+0000 7f0eebe90640 1 --2- 172.21.15.59:0/3523141820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ed40051d0 0x7f0ed400b980 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.396+0000 7f0eebe90640 1 -- 172.21.15.59:0/3523141820 >> 172.21.15.59:0/3523141820 conn(0x7f0ee4071900 msgr2=0x7f0ee4071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:38.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.396+0000 7f0eebe90640 1 -- 172.21.15.59:0/3523141820 shutdown_connections 2023-10-16T14:27:38.407 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.396+0000 7f0eebe90640 1 -- 172.21.15.59:0/3523141820 wait complete. 2023-10-16T14:27:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.398+0000 7f0eebe90640 1 Processor -- start 2023-10-16T14:27:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.398+0000 7f0eebe90640 1 -- start start 2023-10-16T14:27:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.399+0000 7f0eebe90640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ed40051d0 0x7f0ee40c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.399+0000 7f0eebe90640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ee40cb4f0 0x7f0ee40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:38.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.399+0000 7f0eebe90640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ee40cd3d0 0x7f0ee40cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.399+0000 7f0eebe90640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40cbeb0 con 0x7f0ee40cd3d0 2023-10-16T14:27:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.399+0000 7f0eebe90640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40cdd90 con 0x7f0ed40051d0 2023-10-16T14:27:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.399+0000 7f0eebe90640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40cc950 con 0x7f0ee40cb4f0 2023-10-16T14:27:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.399+0000 7f0eea42d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ee40cd3d0 0x7f0ee40cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.400+0000 7f0eea42d640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ee40cd3d0 0x7f0ee40cd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43694/0 (socket says 172.21.15.59:43694) 2023-10-16T14:27:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.400+0000 7f0eea42d640 1 -- 172.21.15.59:0/990362331 learned_addr learned my addr 172.21.15.59:0/990362331 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.400+0000 7f0eea42d640 1 -- 172.21.15.59:0/990362331 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ee40cb4f0 msgr2=0x7f0ee40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.400+0000 7f0eea42d640 1 --2- 172.21.15.59:0/990362331 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ee40cb4f0 0x7f0ee40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.400+0000 7f0eea42d640 1 -- 172.21.15.59:0/990362331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ed40051d0 msgr2=0x7f0ee40c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.400+0000 7f0ee9c2c640 1 --2- 172.21.15.59:0/990362331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ed40051d0 0x7f0ee40c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:38.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.400+0000 7f0eea42d640 1 --2- 172.21.15.59:0/990362331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ed40051d0 0x7f0ee40c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.400+0000 7f0eea42d640 1 -- 172.21.15.59:0/990362331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee40cc0b0 con 0x7f0ee40cd3d0 2023-10-16T14:27:38.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.400+0000 7f0ee9c2c640 1 --2- 172.21.15.59:0/990362331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ed40051d0 0x7f0ee40c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:38.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.400+0000 7f0eea42d640 1 --2- 172.21.15.59:0/990362331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ee40cd3d0 0x7f0ee40cd850 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0edc02bfb0 tx=0x7f0edc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:38.411 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.401+0000 7f0ee27fc640 1 -- 172.21.15.59:0/990362331 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc004020 con 0x7f0ee40cd3d0 2023-10-16T14:27:38.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.401+0000 7f0ee27fc640 1 -- 172.21.15.59:0/990362331 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc032460 con 0x7f0ee40cd3d0 2023-10-16T14:27:38.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.401+0000 7f0eebe90640 1 -- 172.21.15.59:0/990362331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee40cc390 con 0x7f0ee40cd3d0 2023-10-16T14:27:38.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.401+0000 7f0ee27fc640 1 -- 172.21.15.59:0/990362331 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc004500 con 0x7f0ee40cd3d0 2023-10-16T14:27:38.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.401+0000 7f0eebe90640 1 -- 172.21.15.59:0/990362331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee41f3360 con 0x7f0ee40cd3d0 2023-10-16T14:27:38.412 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.402+0000 7f0eebe90640 1 -- 172.21.15.59:0/990362331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee41f3580 con 0x7f0ee40cd3d0 2023-10-16T14:27:38.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.403+0000 7f0ee27fc640 1 -- 172.21.15.59:0/990362331 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0edc032610 con 0x7f0ee40cd3d0 2023-10-16T14:27:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.404+0000 7f0ee27fc640 1 --2- 172.21.15.59:0/990362331 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0ec806aea0 0x7f0ec806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.404+0000 7f0ee27fc640 1 -- 172.21.15.59:0/990362331 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0edc0ab610 con 0x7f0ee40cd3d0 2023-10-16T14:27:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.405+0000 7f0ee9c2c640 1 --2- 172.21.15.59:0/990362331 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0ec806aea0 0x7f0ec806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.406+0000 7f0ee9c2c640 1 --2- 172.21.15.59:0/990362331 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0ec806aea0 0x7f0ec806d360 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8001580 tx=0x7f0ed8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.409+0000 7f0ee27fc640 1 -- 172.21.15.59:0/990362331 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0edc076620 con 0x7f0ee40cd3d0 2023-10-16T14:27:38.676 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.672+0000 7f0eebe90640 1 -- 172.21.15.59:0/990362331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0ee4073ef0 con 0x7f0ee40cd3d0 2023-10-16T14:27:38.681 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.678+0000 7f0ee27fc640 1 -- 172.21.15.59:0/990362331 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0edc079c40 con 0x7f0ee40cd3d0 2023-10-16T14:27:38.681 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2023-10-16T14:27:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCkRy1l4wK6GRAAR5d+NsU5HztNqOlUy6gD+Q== 2023-10-16T14:27:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: caps mds = "allow" 2023-10-16T14:27:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: caps mon = "allow r" 2023-10-16T14:27:38.682 INFO:teuthology.orchestra.run.smithi059.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-16T14:27:38.683 INFO:teuthology.orchestra.run.smithi059.stderr:updated caps for client.0 2023-10-16T14:27:38.684 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.681+0000 7f0eebe90640 1 -- 172.21.15.59:0/990362331 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0ec806aea0 msgr2=0x7f0ec806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.681+0000 7f0eebe90640 1 --2- 172.21.15.59:0/990362331 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0ec806aea0 0x7f0ec806d360 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8001580 tx=0x7f0ed8009040 comp rx=0 tx=0).stop 2023-10-16T14:27:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.681+0000 7f0eebe90640 1 -- 172.21.15.59:0/990362331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ee40cd3d0 msgr2=0x7f0ee40cd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.681+0000 7f0eebe90640 1 --2- 172.21.15.59:0/990362331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ee40cd3d0 0x7f0ee40cd850 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0edc02bfb0 tx=0x7f0edc004730 comp rx=0 tx=0).stop 2023-10-16T14:27:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.681+0000 7f0eebe90640 1 -- 172.21.15.59:0/990362331 shutdown_connections 2023-10-16T14:27:38.685 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.681+0000 7f0eebe90640 1 --2- 172.21.15.59:0/990362331 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f0ec806aea0 0x7f0ec806d360 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.681+0000 7f0eebe90640 1 --2- 172.21.15.59:0/990362331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ee40cd3d0 0x7f0ee40cd850 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.681+0000 7f0eebe90640 1 --2- 172.21.15.59:0/990362331 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ee40cb4f0 0x7f0ee40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.681+0000 7f0eebe90640 1 --2- 172.21.15.59:0/990362331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ed40051d0 0x7f0ee40c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.681+0000 7f0eebe90640 1 -- 172.21.15.59:0/990362331 >> 172.21.15.59:0/990362331 conn(0x7f0ee4071900 msgr2=0x7f0ee40b5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:38.686 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.681+0000 7f0eebe90640 1 -- 172.21.15.59:0/990362331 shutdown_connections 2023-10-16T14:27:38.687 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.681+0000 7f0eebe90640 1 -- 172.21.15.59:0/990362331 wait complete. 2023-10-16T14:27:38.703 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-16T14:27:38.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.915+0000 7f139a84b640 1 Processor -- start 2023-10-16T14:27:38.919 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.916+0000 7f139a84b640 1 -- start start 2023-10-16T14:27:38.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.917+0000 7f139a84b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13940b0720 0x7f13940cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:38.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.917+0000 7f139a84b640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f139415ce60 0x7f13940cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:38.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.917+0000 7f139a84b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1394161620 con 0x7f139415ca80 2023-10-16T14:27:38.921 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.917+0000 7f139a84b640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13940cafa0 con 0x7f139415ce60 2023-10-16T14:27:38.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.917+0000 7f139a84b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13940cb280 con 0x7f13940b0720 2023-10-16T14:27:38.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.918+0000 7f1398de8640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f139415ce60 0x7f13940cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:38.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.918+0000 7f1398de8640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f139415ce60 0x7f13940cc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43702/0 (socket says 172.21.15.59:43702) 2023-10-16T14:27:38.922 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.918+0000 7f1398de8640 1 -- 172.21.15.59:0/278759254 learned_addr learned my addr 172.21.15.59:0/278759254 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:38.923 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.918+0000 7f138b7fe640 1 --2- 172.21.15.59:0/278759254 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13940b0720 0x7f13940cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.918+0000 7f1398de8640 1 -- 172.21.15.59:0/278759254 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13940b0720 msgr2=0x7f13940cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.918+0000 7f1398de8640 1 --2- 172.21.15.59:0/278759254 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13940b0720 0x7f13940cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.918+0000 7f1398de8640 1 -- 172.21.15.59:0/278759254 >> v1:172.21.15.151:6789/0 conn(0x7f139415ca80 legacy=0x7f13940b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:38.924 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.918+0000 7f1398de8640 1 -- 172.21.15.59:0/278759254 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13940cb560 con 0x7f139415ce60 2023-10-16T14:27:38.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.919+0000 7f1398de8640 1 --2- 172.21.15.59:0/278759254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f139415ce60 0x7f13940cc4f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f138c009870 tx=0x7f138c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9ddaa52c8660f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:38.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.920+0000 7f13937fe640 1 -- 172.21.15.59:0/278759254 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c031640 con 0x7f139415ce60 2023-10-16T14:27:38.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.920+0000 7f13937fe640 1 -- 172.21.15.59:0/278759254 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138c0317a0 con 0x7f139415ce60 2023-10-16T14:27:38.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.920+0000 7f13937fe640 1 -- 172.21.15.59:0/278759254 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c031b30 con 0x7f139415ce60 2023-10-16T14:27:38.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.920+0000 7f139a84b640 1 -- 172.21.15.59:0/278759254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f139415ce60 msgr2=0x7f13940cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:38.925 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.920+0000 7f139a84b640 1 --2- 172.21.15.59:0/278759254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f139415ce60 0x7f13940cc4f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f138c009870 tx=0x7f138c02b8f0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.926 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.921+0000 7f139a84b640 1 -- 172.21.15.59:0/278759254 shutdown_connections 2023-10-16T14:27:38.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.921+0000 7f139a84b640 1 --2- 172.21.15.59:0/278759254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f139415ce60 0x7f13940cc4f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.921+0000 7f139a84b640 1 --2- 172.21.15.59:0/278759254 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13940b0720 0x7f13940cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.921+0000 7f139a84b640 1 -- 172.21.15.59:0/278759254 >> 172.21.15.59:0/278759254 conn(0x7f139406c1c0 msgr2=0x7f139406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:38.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.921+0000 7f139a84b640 1 -- 172.21.15.59:0/278759254 shutdown_connections 2023-10-16T14:27:38.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.921+0000 7f139a84b640 1 -- 172.21.15.59:0/278759254 wait complete. 2023-10-16T14:27:38.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.923+0000 7f139a84b640 1 Processor -- start 2023-10-16T14:27:38.928 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.923+0000 7f139a84b640 1 -- start start 2023-10-16T14:27:38.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.924+0000 7f139a84b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13940b0720 0x7f13941533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:38.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.924+0000 7f139a84b640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f139415ca80 0x7f13940c2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:38.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.924+0000 7f139a84b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f139415ce60 0x7f13940c3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:38.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.924+0000 7f139a84b640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13940b1e20 con 0x7f139415ca80 2023-10-16T14:27:38.930 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.924+0000 7f139a84b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13940b1250 con 0x7f139415ce60 2023-10-16T14:27:38.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.924+0000 7f139a84b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13940b14f0 con 0x7f13940b0720 2023-10-16T14:27:38.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.925+0000 7f138b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f139415ca80 0x7f13940c2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:38.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.925+0000 7f138b7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f139415ca80 0x7f13940c2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43712/0 (socket says 172.21.15.59:43712) 2023-10-16T14:27:38.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.925+0000 7f138b7fe640 1 -- 172.21.15.59:0/3054379881 learned_addr learned my addr 172.21.15.59:0/3054379881 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:38.931 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.925+0000 7f1398de8640 1 --2- 172.21.15.59:0/3054379881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f139415ce60 0x7f13940c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:38.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.925+0000 7f1393fff640 1 --2- 172.21.15.59:0/3054379881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13940b0720 0x7f13941533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:38.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.925+0000 7f138b7fe640 1 -- 172.21.15.59:0/3054379881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13940b0720 msgr2=0x7f13941533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:38.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.925+0000 7f138b7fe640 1 --2- 172.21.15.59:0/3054379881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13940b0720 0x7f13941533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.925+0000 7f138b7fe640 1 -- 172.21.15.59:0/3054379881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f139415ce60 msgr2=0x7f13940c3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:38.932 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.925+0000 7f138b7fe640 1 --2- 172.21.15.59:0/3054379881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f139415ce60 0x7f13940c3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:38.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.925+0000 7f138b7fe640 1 -- 172.21.15.59:0/3054379881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c0094d0 con 0x7f139415ca80 2023-10-16T14:27:38.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.926+0000 7f138b7fe640 1 --2- 172.21.15.59:0/3054379881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f139415ca80 0x7f13940c2ad0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f137c00d5f0 tx=0x7f137c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:38.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.926+0000 7f13917fa640 1 -- 172.21.15.59:0/3054379881 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c0125f0 con 0x7f139415ca80 2023-10-16T14:27:38.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.926+0000 7f13917fa640 1 -- 172.21.15.59:0/3054379881 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c012750 con 0x7f139415ca80 2023-10-16T14:27:38.933 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.926+0000 7f13917fa640 1 -- 172.21.15.59:0/3054379881 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c012b00 con 0x7f139415ca80 2023-10-16T14:27:38.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.926+0000 7f139a84b640 1 -- 172.21.15.59:0/3054379881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13940b17d0 con 0x7f139415ca80 2023-10-16T14:27:38.934 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.926+0000 7f139a84b640 1 -- 172.21.15.59:0/3054379881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1394153ef0 con 0x7f139415ca80 2023-10-16T14:27:38.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.928+0000 7f139a84b640 1 -- 172.21.15.59:0/3054379881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13940b1f90 con 0x7f139415ca80 2023-10-16T14:27:38.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.928+0000 7f13917fa640 1 -- 172.21.15.59:0/3054379881 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f137c012c60 con 0x7f139415ca80 2023-10-16T14:27:38.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.930+0000 7f13917fa640 1 --2- 172.21.15.59:0/3054379881 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f137406ae70 0x7f137406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:38.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.930+0000 7f13917fa640 1 -- 172.21.15.59:0/3054379881 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f137c089c30 con 0x7f139415ca80 2023-10-16T14:27:38.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.931+0000 7f1393fff640 1 --2- 172.21.15.59:0/3054379881 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f137406ae70 0x7f137406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:38.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.932+0000 7f1393fff640 1 --2- 172.21.15.59:0/3054379881 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f137406ae70 0x7f137406d330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1384009f20 tx=0x7f13840094d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:38.938 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:38.935+0000 7f13917fa640 1 -- 172.21.15.59:0/3054379881 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f137c054b90 con 0x7f139415ca80 2023-10-16T14:27:39.170 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.167+0000 7f139a84b640 1 -- 172.21.15.59:0/3054379881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1394073ef0 con 0x7f139415ca80 2023-10-16T14:27:39.171 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.168+0000 7f13917fa640 1 -- 172.21.15.59:0/3054379881 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4919 (secure 0 0 0) 0x7f137c0581b0 con 0x7f139415ca80 2023-10-16T14:27:39.171 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:39.172 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2783803543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":2783803543},{"type":"v1","addr":"172.21.15.59:6835","nonce":2783803543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5071,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/1792159151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1792159151},{"type":"v1","addr":"172.21.15.151:6836","nonce":1792159151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/2122504326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":2122504326},{"type":"v1","addr":"172.21.15.151:6837","nonce":2122504326}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-16T14:27:32.522877+0000","modified":"2023-10-16T14:27:35.615208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5418},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5418":{"gid":5418,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6833/1364699887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1364699887},{"type":"v1","addr":"172.21.15.59:6833","nonce":1364699887}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-16T14:27:39.172 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 18 2023-10-16T14:27:39.173 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.170+0000 7f139a84b640 1 -- 172.21.15.59:0/3054379881 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f137406ae70 msgr2=0x7f137406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.170+0000 7f139a84b640 1 --2- 172.21.15.59:0/3054379881 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f137406ae70 0x7f137406d330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1384009f20 tx=0x7f13840094d0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.170+0000 7f139a84b640 1 -- 172.21.15.59:0/3054379881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f139415ca80 msgr2=0x7f13940c2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.170+0000 7f139a84b640 1 --2- 172.21.15.59:0/3054379881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f139415ca80 0x7f13940c2ad0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f137c00d5f0 tx=0x7f137c00dab0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.170+0000 7f139a84b640 1 -- 172.21.15.59:0/3054379881 shutdown_connections 2023-10-16T14:27:39.174 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.170+0000 7f139a84b640 1 --2- 172.21.15.59:0/3054379881 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f137406ae70 0x7f137406d330 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.170+0000 7f139a84b640 1 --2- 172.21.15.59:0/3054379881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f139415ce60 0x7f13940c3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.170+0000 7f139a84b640 1 --2- 172.21.15.59:0/3054379881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f139415ca80 0x7f13940c2ad0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.170+0000 7f139a84b640 1 --2- 172.21.15.59:0/3054379881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13940b0720 0x7f13941533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.170+0000 7f139a84b640 1 -- 172.21.15.59:0/3054379881 >> 172.21.15.59:0/3054379881 conn(0x7f139406c1c0 msgr2=0x7f13940ab8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:39.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.170+0000 7f139a84b640 1 -- 172.21.15.59:0/3054379881 shutdown_connections 2023-10-16T14:27:39.176 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.170+0000 7f139a84b640 1 -- 172.21.15.59:0/3054379881 wait complete. 2023-10-16T14:27:39.595 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-16T14:27:32.522877+0000', 'modified': '2023-10-16T14:27:35.615208+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5418}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5418': {'gid': 5418, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.59:6833/1364699887', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 1364699887}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 1364699887}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-16T14:27:39.595 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-16T14:27:39.596 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-16T14:27:39.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.829+0000 7f7a622da640 1 Processor -- start 2023-10-16T14:27:39.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.830+0000 7f7a622da640 1 -- start start 2023-10-16T14:27:39.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.831+0000 7f7a622da640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a5c0d27d0 0x7f7a5c0d2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.831+0000 7f7a622da640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a5c0ce0d0 0x7f7a5c0d0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.835 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.831+0000 7f7a622da640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7a5c0ce530 0x7f7a5c0d0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.831+0000 7f7a622da640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5c0cd3e0 con 0x7f7a5c0ce0d0 2023-10-16T14:27:39.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.831+0000 7f7a622da640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5c0d0e90 con 0x7f7a5c0ce530 2023-10-16T14:27:39.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.831+0000 7f7a622da640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c0cdc40 con 0x7f7a5c0d27d0 2023-10-16T14:27:39.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.832+0000 7f7a60ad7640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a5c0ce0d0 0x7f7a5c0d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:39.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.832+0000 7f7a60ad7640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a5c0ce0d0 0x7f7a5c0d0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43720/0 (socket says 172.21.15.59:43720) 2023-10-16T14:27:39.836 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.832+0000 7f7a60ad7640 1 -- 172.21.15.59:0/2793456327 learned_addr learned my addr 172.21.15.59:0/2793456327 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:39.837 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.832+0000 7f7a612d8640 1 --2- 172.21.15.59:0/2793456327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a5c0d27d0 0x7f7a5c0d2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:39.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.832+0000 7f7a61ad9640 1 --2- 172.21.15.59:0/2793456327 >> v2:172.21.15.151:3300/0 conn(0x7f7a5c0ce530 0x7f7a5c0d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:39.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.832+0000 7f7a60ad7640 1 -- 172.21.15.59:0/2793456327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a5c0d27d0 msgr2=0x7f7a5c0d2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:39.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.833+0000 7f7a60ad7640 1 --2- 172.21.15.59:0/2793456327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a5c0d27d0 0x7f7a5c0d2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.833+0000 7f7a60ad7640 1 -- 172.21.15.59:0/2793456327 >> v2:172.21.15.151:3300/0 conn(0x7f7a5c0ce530 msgr2=0x7f7a5c0d0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:39.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.833+0000 7f7a60ad7640 1 --2- 172.21.15.59:0/2793456327 >> v2:172.21.15.151:3300/0 conn(0x7f7a5c0ce530 0x7f7a5c0d0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.833+0000 7f7a60ad7640 1 -- 172.21.15.59:0/2793456327 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c0d00c0 con 0x7f7a5c0ce0d0 2023-10-16T14:27:39.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.833+0000 7f7a61ad9640 1 --2- 172.21.15.59:0/2793456327 >> v2:172.21.15.151:3300/0 conn(0x7f7a5c0ce530 0x7f7a5c0d0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:39.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.834+0000 7f7a60ad7640 1 --2- 172.21.15.59:0/2793456327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5c0ce0d0 0x7f7a5c0d0410 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0b1f00 tx=0x7f7a4c02b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876ac93849d828a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:39.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.835+0000 7f7a53fff640 1 -- 172.21.15.59:0/2793456327 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c031880 con 0x7f7a5c0ce0d0 2023-10-16T14:27:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.835+0000 7f7a53fff640 1 -- 172.21.15.59:0/2793456327 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c0319e0 con 0x7f7a5c0ce0d0 2023-10-16T14:27:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.835+0000 7f7a53fff640 1 -- 172.21.15.59:0/2793456327 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c031d70 con 0x7f7a5c0ce0d0 2023-10-16T14:27:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.835+0000 7f7a622da640 1 -- 172.21.15.59:0/2793456327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5c0ce0d0 msgr2=0x7f7a5c0d0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.835+0000 7f7a622da640 1 --2- 172.21.15.59:0/2793456327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5c0ce0d0 0x7f7a5c0d0410 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0b1f00 tx=0x7f7a4c02b920 comp rx=0 tx=0).stop 2023-10-16T14:27:39.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.835+0000 7f7a622da640 1 -- 172.21.15.59:0/2793456327 shutdown_connections 2023-10-16T14:27:39.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.835+0000 7f7a622da640 1 --2- 172.21.15.59:0/2793456327 >> v2:172.21.15.151:3300/0 conn(0x7f7a5c0ce530 0x7f7a5c0d0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.835+0000 7f7a622da640 1 --2- 172.21.15.59:0/2793456327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5c0ce0d0 0x7f7a5c0d0410 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.835+0000 7f7a622da640 1 --2- 172.21.15.59:0/2793456327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a5c0d27d0 0x7f7a5c0d2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.835+0000 7f7a622da640 1 -- 172.21.15.59:0/2793456327 >> 172.21.15.59:0/2793456327 conn(0x7f7a5c09bbc0 msgr2=0x7f7a5c089f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:39.842 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.835+0000 7f7a622da640 1 -- 172.21.15.59:0/2793456327 shutdown_connections 2023-10-16T14:27:39.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.835+0000 7f7a622da640 1 -- 172.21.15.59:0/2793456327 wait complete. 2023-10-16T14:27:39.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.837+0000 7f7a622da640 1 Processor -- start 2023-10-16T14:27:39.843 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.837+0000 7f7a622da640 1 -- start start 2023-10-16T14:27:39.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.838+0000 7f7a622da640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a5c0ce0d0 0x7f7a5c0cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.838+0000 7f7a622da640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a5c0ce530 0x7f7a5c0c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.845 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.838+0000 7f7a622da640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5c0d27d0 0x7f7a5c15aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.838+0000 7f7a622da640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c0ca6b0 con 0x7f7a5c0d27d0 2023-10-16T14:27:39.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.838+0000 7f7a622da640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c0c6370 con 0x7f7a5c0ce530 2023-10-16T14:27:39.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.838+0000 7f7a622da640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c0cc850 con 0x7f7a5c0ce0d0 2023-10-16T14:27:39.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.839+0000 7f7a61ad9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5c0d27d0 0x7f7a5c15aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:39.846 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.839+0000 7f7a61ad9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5c0d27d0 0x7f7a5c15aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43736/0 (socket says 172.21.15.59:43736) 2023-10-16T14:27:39.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.839+0000 7f7a61ad9640 1 -- 172.21.15.59:0/3102117179 learned_addr learned my addr 172.21.15.59:0/3102117179 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:39.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.839+0000 7f7a612d8640 1 --2- 172.21.15.59:0/3102117179 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a5c0ce0d0 0x7f7a5c0cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:39.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.839+0000 7f7a60ad7640 1 --2- 172.21.15.59:0/3102117179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a5c0ce530 0x7f7a5c0c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:39.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.839+0000 7f7a61ad9640 1 -- 172.21.15.59:0/3102117179 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a5c0ce0d0 msgr2=0x7f7a5c0cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:39.847 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.839+0000 7f7a61ad9640 1 --2- 172.21.15.59:0/3102117179 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a5c0ce0d0 0x7f7a5c0cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.839+0000 7f7a61ad9640 1 -- 172.21.15.59:0/3102117179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a5c0ce530 msgr2=0x7f7a5c0c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:39.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.839+0000 7f7a61ad9640 1 --2- 172.21.15.59:0/3102117179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a5c0ce530 0x7f7a5c0c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.839+0000 7f7a61ad9640 1 -- 172.21.15.59:0/3102117179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c0094d0 con 0x7f7a5c0d27d0 2023-10-16T14:27:39.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.839+0000 7f7a60ad7640 1 --2- 172.21.15.59:0/3102117179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a5c0ce530 0x7f7a5c0c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:39.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.839+0000 7f7a612d8640 1 --2- 172.21.15.59:0/3102117179 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a5c0ce0d0 0x7f7a5c0cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:39.848 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.839+0000 7f7a61ad9640 1 --2- 172.21.15.59:0/3102117179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5c0d27d0 0x7f7a5c15aed0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400cdf0 tx=0x7f7a5400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:39.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.840+0000 7f7a51ffb640 1 -- 172.21.15.59:0/3102117179 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a54003b90 con 0x7f7a5c0d27d0 2023-10-16T14:27:39.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.840+0000 7f7a51ffb640 1 -- 172.21.15.59:0/3102117179 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a54003d10 con 0x7f7a5c0d27d0 2023-10-16T14:27:39.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.840+0000 7f7a51ffb640 1 -- 172.21.15.59:0/3102117179 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a54004260 con 0x7f7a5c0d27d0 2023-10-16T14:27:39.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.840+0000 7f7a622da640 1 -- 172.21.15.59:0/3102117179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5c0c9e10 con 0x7f7a5c0d27d0 2023-10-16T14:27:39.849 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.840+0000 7f7a622da640 1 -- 172.21.15.59:0/3102117179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5c0ca3d0 con 0x7f7a5c0d27d0 2023-10-16T14:27:39.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.842+0000 7f7a51ffb640 1 -- 172.21.15.59:0/3102117179 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7a540043c0 con 0x7f7a5c0d27d0 2023-10-16T14:27:39.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.843+0000 7f7a51ffb640 1 --2- 172.21.15.59:0/3102117179 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7a4006ae70 0x7f7a4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.843+0000 7f7a51ffb640 1 -- 172.21.15.59:0/3102117179 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7a54089fb0 con 0x7f7a5c0d27d0 2023-10-16T14:27:39.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.844+0000 7f7a661ab740 1 Processor -- start 2023-10-16T14:27:39.853 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.844+0000 7f7a612d8640 1 --2- 172.21.15.59:0/3102117179 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7a4006ae70 0x7f7a4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:39.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.844+0000 7f7a661ab740 1 -- start start 2023-10-16T14:27:39.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.845+0000 7f7a661ab740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555f466ce170 0x555f466a1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.845+0000 7f7a661ab740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce550 0x555f466d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.845+0000 7f7a661ab740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466a15b0 0x555f466d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.854 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.845+0000 7f7a661ab740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f465c17a0 con 0x555f466ce550 2023-10-16T14:27:39.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.845+0000 7f7a661ab740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f46613740 con 0x555f466a15b0 2023-10-16T14:27:39.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.845+0000 7f7a661ab740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f46610e30 con 0x555f466ce170 2023-10-16T14:27:39.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.845+0000 7f7a612d8640 1 --2- 172.21.15.59:0/3102117179 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7a4006ae70 0x7f7a4006d330 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7a58009780 tx=0x7f7a58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:39.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.845+0000 7f7a60ad7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce550 0x555f466d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:39.855 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.845+0000 7f7a60ad7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce550 0x555f466d0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43742/0 (socket says 172.21.15.59:43742) 2023-10-16T14:27:39.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.845+0000 7f7a60ad7640 1 -- 172.21.15.59:0/2470507709 learned_addr learned my addr 172.21.15.59:0/2470507709 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:39.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.846+0000 7f7a61ad9640 1 --2- 172.21.15.59:0/2470507709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466a15b0 0x555f466d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:39.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.846+0000 7f7a612d8640 1 --2- 172.21.15.59:0/2470507709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555f466ce170 0x555f466a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:39.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.846+0000 7f7a60ad7640 1 -- 172.21.15.59:0/2470507709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555f466ce170 msgr2=0x555f466a1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:39.856 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.846+0000 7f7a60ad7640 1 --2- 172.21.15.59:0/2470507709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555f466ce170 0x555f466a1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.846+0000 7f7a60ad7640 1 -- 172.21.15.59:0/2470507709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466a15b0 msgr2=0x555f466d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:39.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.846+0000 7f7a60ad7640 1 --2- 172.21.15.59:0/2470507709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466a15b0 0x555f466d1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.846+0000 7f7a60ad7640 1 -- 172.21.15.59:0/2470507709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f465d0910 con 0x555f466ce550 2023-10-16T14:27:39.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.846+0000 7f7a61ad9640 1 --2- 172.21.15.59:0/2470507709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466a15b0 0x555f466d1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:39.857 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.846+0000 7f7a60ad7640 1 --2- 172.21.15.59:0/2470507709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce550 0x555f466d0f00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009960 tx=0x7f7a4c008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782e4f586ffefc9a server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:39.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.846+0000 7f7a3effd640 1 -- 172.21.15.59:0/2470507709 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c031b50 con 0x555f466ce550 2023-10-16T14:27:39.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.847+0000 7f7a3effd640 1 -- 172.21.15.59:0/2470507709 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c031cb0 con 0x555f466ce550 2023-10-16T14:27:39.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.847+0000 7f7a3effd640 1 -- 172.21.15.59:0/2470507709 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c03a620 con 0x555f466ce550 2023-10-16T14:27:39.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.847+0000 7f7a661ab740 1 -- 172.21.15.59:0/2470507709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce550 msgr2=0x555f466d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:39.858 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.847+0000 7f7a661ab740 1 --2- 172.21.15.59:0/2470507709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce550 0x555f466d0f00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009960 tx=0x7f7a4c008030 comp rx=0 tx=0).stop 2023-10-16T14:27:39.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.847+0000 7f7a661ab740 1 -- 172.21.15.59:0/2470507709 shutdown_connections 2023-10-16T14:27:39.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.847+0000 7f7a661ab740 1 --2- 172.21.15.59:0/2470507709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466a15b0 0x555f466d1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.847+0000 7f7a661ab740 1 --2- 172.21.15.59:0/2470507709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce550 0x555f466d0f00 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.847+0000 7f7a661ab740 1 --2- 172.21.15.59:0/2470507709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555f466ce170 0x555f466a1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.847+0000 7f7a661ab740 1 -- 172.21.15.59:0/2470507709 >> 172.21.15.59:0/2470507709 conn(0x555f466a3380 msgr2=0x555f466ebf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:39.859 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.847+0000 7f7a661ab740 1 -- 172.21.15.59:0/2470507709 shutdown_connections 2023-10-16T14:27:39.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.847+0000 7f7a661ab740 1 -- 172.21.15.59:0/2470507709 wait complete. 2023-10-16T14:27:39.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.848+0000 7f7a661ab740 1 -- start start 2023-10-16T14:27:39.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.848+0000 7f7a661ab740 1 Processor -- start 2023-10-16T14:27:39.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.849+0000 7f7a661ab740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555f466ce170 0x555f466c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.860 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.849+0000 7f7a661ab740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466ce550 0x555f466c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.849+0000 7f7a661ab740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466c96e0 0x555f466c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.849+0000 7f7a661ab740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f4660c720 con 0x555f466c96e0 2023-10-16T14:27:39.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.849+0000 7f7a661ab740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f465aa970 con 0x555f466ce550 2023-10-16T14:27:39.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.849+0000 7f7a661ab740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f465aa610 con 0x555f466ce170 2023-10-16T14:27:39.861 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.850+0000 7f7a661ab740 10 client.0 _ll_register_callbacks cb 0x555f465cc9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T14:27:39.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.850+0000 7f7a61ad9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466c96e0 0x555f466c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:39.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.850+0000 7f7a61ad9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466c96e0 0x555f466c6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43754/0 (socket says 172.21.15.59:43754) 2023-10-16T14:27:39.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.850+0000 7f7a61ad9640 1 -- 172.21.15.59:0/1493622261 learned_addr learned my addr 172.21.15.59:0/1493622261 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:39.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.850+0000 7f7a60ad7640 1 --2- 172.21.15.59:0/1493622261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466ce550 0x555f466c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:39.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.850+0000 7f7a612d8640 1 --2- 172.21.15.59:0/1493622261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555f466ce170 0x555f466c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:39.865 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.850+0000 7f7a61ad9640 1 -- 172.21.15.59:0/1493622261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555f466ce170 msgr2=0x555f466c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:39.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.850+0000 7f7a61ad9640 1 --2- 172.21.15.59:0/1493622261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555f466ce170 0x555f466c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.850+0000 7f7a61ad9640 1 -- 172.21.15.59:0/1493622261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466ce550 msgr2=0x555f466c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:39.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.850+0000 7f7a61ad9640 1 --2- 172.21.15.59:0/1493622261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466ce550 0x555f466c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.850+0000 7f7a61ad9640 1 -- 172.21.15.59:0/1493622261 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5c0d00c0 con 0x555f466c96e0 2023-10-16T14:27:39.866 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.850+0000 7f7a60ad7640 1 --2- 172.21.15.59:0/1493622261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466ce550 0x555f466c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:39.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.851+0000 7f7a61ad9640 1 --2- 172.21.15.59:0/1493622261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466c96e0 0x555f466c6e50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7a54058b60 tx=0x7f7a5405cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3269eec6c8af2f server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:39.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.851+0000 7f7a37fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-16T14:27:39.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.851+0000 7f7a37fff640 1 -- 172.21.15.59:0/1493622261 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a54070070 con 0x555f466c96e0 2023-10-16T14:27:39.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.851+0000 7f7a661ab740 1 -- 172.21.15.59:0/1493622261 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f46633160 con 0x555f466c96e0 2023-10-16T14:27:39.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.851+0000 7f7a37fff640 1 -- 172.21.15.59:0/1493622261 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7a54057030 con 0x555f466c96e0 2023-10-16T14:27:39.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.851+0000 7f7a37fff640 1 -- 172.21.15.59:0/1493622261 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a54004870 con 0x555f466c96e0 2023-10-16T14:27:39.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.851+0000 7f7a661ab740 10 client.5607 fetch_fsmap learned FSMap version 18 2023-10-16T14:27:39.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.851+0000 7f7a661ab740 1 -- 172.21.15.59:0/1493622261 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x555f4660ada0 con 0x555f466c96e0 2023-10-16T14:27:39.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.851+0000 7f7a37fff640 1 -- 172.21.15.59:0/1493622261 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f46633160 con 0x555f466c96e0 2023-10-16T14:27:39.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.851+0000 7f7a37fff640 1 -- 172.21.15.59:0/1493622261 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7a54083060 con 0x555f466c96e0 2023-10-16T14:27:39.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.852+0000 7f7a661ab740 10 client.5607 fetch_fsmap finished waiting for FSMap version 18 2023-10-16T14:27:39.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.852+0000 7f7a661ab740 10 client.5607 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T14:27:39.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.852+0000 7f7a661ab740 20 client.5607 populate_metadata read hostname 'smithi059' 2023-10-16T14:27:39.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.852+0000 7f7a661ab740 1 --2- 172.21.15.59:0/1493622261 >> [v2:172.21.15.59:6832/1364699887,v1:172.21.15.59:6833/1364699887] conn(0x555f466ffd70 0x555f466d31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.852+0000 7f7a661ab740 4 client.5607 mds_command: new command op to 5418 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-16T14:27:39.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.852+0000 7f7a661ab740 1 -- 172.21.15.59:0/1493622261 --> [v2:172.21.15.59:6832/1364699887,v1:172.21.15.59:6833/1364699887] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f465decc0 con 0x555f466ffd70 2023-10-16T14:27:39.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.852+0000 7f7a612d8640 1 --2- 172.21.15.59:0/1493622261 >> [v2:172.21.15.59:6832/1364699887,v1:172.21.15.59:6833/1364699887] conn(0x555f466ffd70 0x555f466d31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:39.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.853+0000 7f7a612d8640 1 --2- 172.21.15.59:0/1493622261 >> [v2:172.21.15.59:6832/1364699887,v1:172.21.15.59:6833/1364699887] conn(0x555f466ffd70 0x555f466d31c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94a57ea4a7a72d11 server_cookie=c169c5f688e3b3a3 in_seq=0 out_seq=0 2023-10-16T14:27:39.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.853+0000 7f7a37fff640 10 client.5607 ms_handle_connect on v2:172.21.15.59:6832/1364699887 2023-10-16T14:27:39.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.853+0000 7f7a37fff640 1 -- 172.21.15.59:0/1493622261 <== mds.0 v2:172.21.15.59:6832/1364699887 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555f465decc0 con 0x555f466ffd70 2023-10-16T14:27:39.870 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.853+0000 7f7a37fff640 10 client.5607 handle_command_reply: tid=0 2023-10-16T14:27:39.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.853+0000 7f7a661ab740 1 client.5607 shutdown 2023-10-16T14:27:39.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.854+0000 7f7a661ab740 1 -- 172.21.15.59:0/1493622261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466c96e0 msgr2=0x555f466c6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:39.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.854+0000 7f7a661ab740 1 --2- 172.21.15.59:0/1493622261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466c96e0 0x555f466c6e50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7a54058b60 tx=0x7f7a5405cde0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.854+0000 7f7a661ab740 1 -- 172.21.15.59:0/1493622261 shutdown_connections 2023-10-16T14:27:39.871 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.854+0000 7f7a661ab740 1 --2- 172.21.15.59:0/1493622261 >> [v2:172.21.15.59:6832/1364699887,v1:172.21.15.59:6833/1364699887] conn(0x555f466ffd70 0x555f466d31c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.854+0000 7f7a661ab740 1 --2- 172.21.15.59:0/1493622261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466c96e0 0x555f466c6e50 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.854+0000 7f7a661ab740 1 --2- 172.21.15.59:0/1493622261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466ce550 0x555f466c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.854+0000 7f7a661ab740 1 --2- 172.21.15.59:0/1493622261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555f466ce170 0x555f466c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.854+0000 7f7a661ab740 1 -- 172.21.15.59:0/1493622261 >> 172.21.15.59:0/1493622261 conn(0x555f466a15b0 msgr2=0x555f466a4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:39.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.854+0000 7f7a37fff640 0 client.5607 ms_handle_reset on v2:172.21.15.59:6832/1364699887 2023-10-16T14:27:39.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.854+0000 7f7a661ab740 1 -- 172.21.15.59:0/1493622261 shutdown_connections 2023-10-16T14:27:39.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.854+0000 7f7a661ab740 1 -- 172.21.15.59:0/1493622261 wait complete. 2023-10-16T14:27:39.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.854+0000 7f7a661ab740 20 client.5607 trim_cache size 0 max 16384 2023-10-16T14:27:39.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.871+0000 7f7a661ab740 1 Processor -- start 2023-10-16T14:27:39.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.871+0000 7f7a661ab740 1 -- start start 2023-10-16T14:27:39.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.872+0000 7f7a661ab740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466c96e0 0x555f466c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.875 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.872+0000 7f7a661ab740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555f466ce170 0x555f466ec2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.872+0000 7f7a661ab740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce550 0x555f466ec810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.872+0000 7f7a661ab740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f46370f20 con 0x555f466ce550 2023-10-16T14:27:39.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.872+0000 7f7a661ab740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f466fef00 con 0x555f466c96e0 2023-10-16T14:27:39.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.872+0000 7f7a661ab740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f466c9470 con 0x555f466ce170 2023-10-16T14:27:39.876 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.872+0000 7f7a61ad9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce550 0x555f466ec810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:39.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.872+0000 7f7a61ad9640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce550 0x555f466ec810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43764/0 (socket says 172.21.15.59:43764) 2023-10-16T14:27:39.877 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.872+0000 7f7a61ad9640 1 -- 172.21.15.59:0/915900017 learned_addr learned my addr 172.21.15.59:0/915900017 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:39.878 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.872+0000 7f7a61ad9640 1 -- 172.21.15.59:0/915900017 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555f466ce170 msgr2=0x555f466ec2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:39.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.872+0000 7f7a61ad9640 1 --2- 172.21.15.59:0/915900017 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555f466ce170 0x555f466ec2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.872+0000 7f7a61ad9640 1 -- 172.21.15.59:0/915900017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466c96e0 msgr2=0x555f466c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:39.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.872+0000 7f7a61ad9640 1 --2- 172.21.15.59:0/915900017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466c96e0 0x555f466c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.873+0000 7f7a61ad9640 1 -- 172.21.15.59:0/915900017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f465a9b80 con 0x555f466ce550 2023-10-16T14:27:39.879 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.873+0000 7f7a61ad9640 1 --2- 172.21.15.59:0/915900017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce550 0x555f466ec810 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7a54056f20 tx=0x7f7a5405a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed77f5810752850 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:39.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.873+0000 7f7a3f7fe640 1 -- 172.21.15.59:0/915900017 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a54070040 con 0x555f466ce550 2023-10-16T14:27:39.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.873+0000 7f7a3f7fe640 1 -- 172.21.15.59:0/915900017 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a54057030 con 0x555f466ce550 2023-10-16T14:27:39.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.873+0000 7f7a3f7fe640 1 -- 172.21.15.59:0/915900017 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a54077350 con 0x555f466ce550 2023-10-16T14:27:39.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.874+0000 7f7a661ab740 1 -- 172.21.15.59:0/915900017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce550 msgr2=0x555f466ec810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:39.880 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.874+0000 7f7a661ab740 1 --2- 172.21.15.59:0/915900017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce550 0x555f466ec810 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7a54056f20 tx=0x7f7a5405a000 comp rx=0 tx=0).stop 2023-10-16T14:27:39.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.874+0000 7f7a661ab740 1 -- 172.21.15.59:0/915900017 shutdown_connections 2023-10-16T14:27:39.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.874+0000 7f7a661ab740 1 --2- 172.21.15.59:0/915900017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce550 0x555f466ec810 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.874+0000 7f7a661ab740 1 --2- 172.21.15.59:0/915900017 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555f466ce170 0x555f466ec2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.874+0000 7f7a661ab740 1 --2- 172.21.15.59:0/915900017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466c96e0 0x555f466c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.874+0000 7f7a661ab740 1 -- 172.21.15.59:0/915900017 >> 172.21.15.59:0/915900017 conn(0x555f466a15b0 msgr2=0x555f4669c810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:39.881 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.874+0000 7f7a661ab740 1 -- 172.21.15.59:0/915900017 shutdown_connections 2023-10-16T14:27:39.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.874+0000 7f7a661ab740 1 -- 172.21.15.59:0/915900017 wait complete. 2023-10-16T14:27:39.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.874+0000 7f7a661ab740 1 -- start start 2023-10-16T14:27:39.882 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.875+0000 7f7a661ab740 1 Processor -- start 2023-10-16T14:27:39.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.876+0000 7f7a661ab740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466c96e0 0x555f466d3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.876+0000 7f7a661ab740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce170 0x555f4675bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.876+0000 7f7a661ab740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555f466ce550 0x555f466fef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.876+0000 7f7a661ab740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f466d4be0 con 0x555f466ce170 2023-10-16T14:27:39.886 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.876+0000 7f7a661ab740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f466a6bf0 con 0x555f466c96e0 2023-10-16T14:27:39.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.876+0000 7f7a661ab740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f466eeb20 con 0x555f466ce550 2023-10-16T14:27:39.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.876+0000 7f7a661ab740 10 client.0 _ll_register_callbacks cb 0x7f7a540589a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-16T14:27:39.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.876+0000 7f7a60ad7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce170 0x555f4675bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:39.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.876+0000 7f7a60ad7640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce170 0x555f4675bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43780/0 (socket says 172.21.15.59:43780) 2023-10-16T14:27:39.887 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.876+0000 7f7a60ad7640 1 -- 172.21.15.59:0/2446011017 learned_addr learned my addr 172.21.15.59:0/2446011017 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.876+0000 7f7a612d8640 1 --2- 172.21.15.59:0/2446011017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466c96e0 0x555f466d3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.876+0000 7f7a61ad9640 1 --2- 172.21.15.59:0/2446011017 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555f466ce550 0x555f466fef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.876+0000 7f7a60ad7640 1 -- 172.21.15.59:0/2446011017 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555f466ce550 msgr2=0x555f466fef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.876+0000 7f7a60ad7640 1 --2- 172.21.15.59:0/2446011017 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555f466ce550 0x555f466fef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.876+0000 7f7a60ad7640 1 -- 172.21.15.59:0/2446011017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466c96e0 msgr2=0x555f466d3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.876+0000 7f7a60ad7640 1 --2- 172.21.15.59:0/2446011017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466c96e0 0x555f466d3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.876+0000 7f7a60ad7640 1 -- 172.21.15.59:0/2446011017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f4660ada0 con 0x555f466ce170 2023-10-16T14:27:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.877+0000 7f7a60ad7640 1 --2- 172.21.15.59:0/2446011017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce170 0x555f4675bfe0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c047040 tx=0x7f7a4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eba18d5dc817380 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.877+0000 7f7a37fff640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2023-10-16T14:27:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.877+0000 7f7a37fff640 1 -- 172.21.15.59:0/2446011017 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c003a20 con 0x555f466ce170 2023-10-16T14:27:39.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.877+0000 7f7a37fff640 1 -- 172.21.15.59:0/2446011017 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7a4c003b80 con 0x555f466ce170 2023-10-16T14:27:39.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.877+0000 7f7a661ab740 1 -- 172.21.15.59:0/2446011017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7a4c031cb0 con 0x555f466ce170 2023-10-16T14:27:39.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.877+0000 7f7a37fff640 1 -- 172.21.15.59:0/2446011017 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a4c02bfa0 con 0x555f466ce170 2023-10-16T14:27:39.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.877+0000 7f7a661ab740 10 client.5613 fetch_fsmap learned FSMap version 18 2023-10-16T14:27:39.890 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.877+0000 7f7a661ab740 1 -- 172.21.15.59:0/2446011017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x555f465cf170 con 0x555f466ce170 2023-10-16T14:27:39.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.878+0000 7f7a37fff640 1 -- 172.21.15.59:0/2446011017 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c031cb0 con 0x555f466ce170 2023-10-16T14:27:39.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.878+0000 7f7a37fff640 1 -- 172.21.15.59:0/2446011017 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7a4c02f050 con 0x555f466ce170 2023-10-16T14:27:39.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.878+0000 7f7a661ab740 10 client.5613 fetch_fsmap finished waiting for FSMap version 18 2023-10-16T14:27:39.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.878+0000 7f7a661ab740 10 client.5613 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-16T14:27:39.891 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.878+0000 7f7a661ab740 20 client.5613 populate_metadata read hostname 'smithi059' 2023-10-16T14:27:39.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.878+0000 7f7a661ab740 1 --2- 172.21.15.59:0/2446011017 >> [v2:172.21.15.59:6832/1364699887,v1:172.21.15.59:6833/1364699887] conn(0x555f466ec230 0x555f466ec610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:39.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.878+0000 7f7a661ab740 4 client.5613 mds_command: new command op to 5418 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-16T14:27:39.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.878+0000 7f7a661ab740 1 -- 172.21.15.59:0/2446011017 --> [v2:172.21.15.59:6832/1364699887,v1:172.21.15.59:6833/1364699887] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555f46605700 con 0x555f466ec230 2023-10-16T14:27:39.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.878+0000 7f7a612d8640 1 --2- 172.21.15.59:0/2446011017 >> [v2:172.21.15.59:6832/1364699887,v1:172.21.15.59:6833/1364699887] conn(0x555f466ec230 0x555f466ec610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:39.892 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.879+0000 7f7a612d8640 1 --2- 172.21.15.59:0/2446011017 >> [v2:172.21.15.59:6832/1364699887,v1:172.21.15.59:6833/1364699887] conn(0x555f466ec230 0x555f466ec610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abcaa8b6dced274e server_cookie=ac9b2b0f4be5dd93 in_seq=0 out_seq=0 2023-10-16T14:27:39.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.879+0000 7f7a37fff640 10 client.5613 ms_handle_connect on v2:172.21.15.59:6832/1364699887 2023-10-16T14:27:39.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.879+0000 7f7a37fff640 1 -- 172.21.15.59:0/2446011017 <== mds.0 v2:172.21.15.59:6832/1364699887 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x555f46605700 con 0x555f466ec230 2023-10-16T14:27:39.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.879+0000 7f7a37fff640 10 client.5613 handle_command_reply: tid=0 2023-10-16T14:27:39.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.879+0000 7f7a661ab740 1 client.5613 shutdown 2023-10-16T14:27:39.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.879+0000 7f7a661ab740 1 -- 172.21.15.59:0/2446011017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce170 msgr2=0x555f4675bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:39.893 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.879+0000 7f7a661ab740 1 --2- 172.21.15.59:0/2446011017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce170 0x555f4675bfe0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c047040 tx=0x7f7a4c0046c0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.879+0000 7f7a661ab740 1 -- 172.21.15.59:0/2446011017 shutdown_connections 2023-10-16T14:27:39.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.879+0000 7f7a661ab740 1 --2- 172.21.15.59:0/2446011017 >> [v2:172.21.15.59:6832/1364699887,v1:172.21.15.59:6833/1364699887] conn(0x555f466ec230 0x555f466ec610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.879+0000 7f7a661ab740 1 --2- 172.21.15.59:0/2446011017 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555f466ce550 0x555f466fef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.879+0000 7f7a661ab740 1 --2- 172.21.15.59:0/2446011017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555f466ce170 0x555f4675bfe0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.894 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.879+0000 7f7a661ab740 1 --2- 172.21.15.59:0/2446011017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f466c96e0 0x555f466d3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.879+0000 7f7a37fff640 0 client.5613 ms_handle_reset on v2:172.21.15.59:6832/1364699887 2023-10-16T14:27:39.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.879+0000 7f7a661ab740 1 -- 172.21.15.59:0/2446011017 >> 172.21.15.59:0/2446011017 conn(0x555f466a15b0 msgr2=0x555f4669c810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:39.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.880+0000 7f7a661ab740 1 -- 172.21.15.59:0/2446011017 shutdown_connections 2023-10-16T14:27:39.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.880+0000 7f7a661ab740 1 -- 172.21.15.59:0/2446011017 wait complete. 2023-10-16T14:27:39.895 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.880+0000 7f7a661ab740 20 client.5613 trim_cache size 0 max 16384 2023-10-16T14:27:39.896 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-16T14:27:39.896 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "c3201022-15a8-4479-95cd-5e66eaaa456b", 2023-10-16T14:27:39.896 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2023-10-16T14:27:39.896 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 5418, 2023-10-16T14:27:39.896 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2023-10-16T14:27:39.897 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2023-10-16T14:27:39.897 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2023-10-16T14:27:39.897 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 6.7977748870000001, 2023-10-16T14:27:39.897 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 18, 2023-10-16T14:27:39.897 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 40, 2023-10-16T14:27:39.898 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 40, 2023-10-16T14:27:39.898 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 15.640777065 2023-10-16T14:27:39.898 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-16T14:27:39.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.880+0000 7f7a622da640 1 -- 172.21.15.59:0/3102117179 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7a4006ae70 msgr2=0x7f7a4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:39.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.880+0000 7f7a622da640 1 --2- 172.21.15.59:0/3102117179 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7a4006ae70 0x7f7a4006d330 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7a58009780 tx=0x7f7a58008040 comp rx=0 tx=0).stop 2023-10-16T14:27:39.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.880+0000 7f7a622da640 1 -- 172.21.15.59:0/3102117179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5c0d27d0 msgr2=0x7f7a5c15aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:39.899 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.880+0000 7f7a622da640 1 --2- 172.21.15.59:0/3102117179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5c0d27d0 0x7f7a5c15aed0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400cdf0 tx=0x7f7a5400a710 comp rx=0 tx=0).stop 2023-10-16T14:27:39.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.880+0000 7f7a622da640 1 -- 172.21.15.59:0/3102117179 shutdown_connections 2023-10-16T14:27:39.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.880+0000 7f7a622da640 1 --2- 172.21.15.59:0/3102117179 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f7a4006ae70 0x7f7a4006d330 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.880+0000 7f7a622da640 1 --2- 172.21.15.59:0/3102117179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a5c0d27d0 0x7f7a5c15aed0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.880+0000 7f7a622da640 1 --2- 172.21.15.59:0/3102117179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a5c0ce530 0x7f7a5c0c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.900 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.880+0000 7f7a622da640 1 --2- 172.21.15.59:0/3102117179 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a5c0ce0d0 0x7f7a5c0cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:39.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.880+0000 7f7a622da640 1 -- 172.21.15.59:0/3102117179 >> 172.21.15.59:0/3102117179 conn(0x7f7a5c09bbc0 msgr2=0x7f7a5c0b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:39.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.881+0000 7f7a622da640 1 -- 172.21.15.59:0/3102117179 shutdown_connections 2023-10-16T14:27:39.901 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:39.881+0000 7f7a622da640 1 -- 172.21.15.59:0/3102117179 wait complete. 2023-10-16T14:27:39.902 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-16T14:27:40.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.119+0000 7f274cafc640 1 Processor -- start 2023-10-16T14:27:40.123 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.119+0000 7f274cafc640 1 -- start start 2023-10-16T14:27:40.124 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.121+0000 7f274cafc640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f27480cdc20 0x7f27480cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:40.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.121+0000 7f274cafc640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27480cc1e0 con 0x7f27480cacf0 2023-10-16T14:27:40.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.121+0000 7f274cafc640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27480ccac0 con 0x7f274815cb80 2023-10-16T14:27:40.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.121+0000 7f274cafc640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2748070170 con 0x7f27480cdc20 2023-10-16T14:27:40.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.121+0000 7f27477fe640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f27480cacf0 0x7f27480cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47734/0 (socket says 172.21.15.59:47734) 2023-10-16T14:27:40.125 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.121+0000 7f27477fe640 1 -- 172.21.15.59:0/1475345844 learned_addr learned my addr 172.21.15.59:0/1475345844 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:27:40.127 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.122+0000 7f27467fc640 1 -- 172.21.15.59:0/1475345844 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414078103 0 0) 0x7f27480cc1e0 con 0x7f27480cacf0 2023-10-16T14:27:40.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.122+0000 7f27467fc640 1 -- 172.21.15.59:0/1475345844 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2730003520 con 0x7f27480cacf0 2023-10-16T14:27:40.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.122+0000 7f2747fff640 1 --2- 172.21.15.59:0/1475345844 >> v2:172.21.15.151:3300/0 conn(0x7f27480cdc20 0x7f27480cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:40.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.122+0000 7f27467fc640 1 -- 172.21.15.59:0/1475345844 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 746307563 0 0) 0x7f2730003520 con 0x7f27480cacf0 2023-10-16T14:27:40.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.122+0000 7f27467fc640 1 -- 172.21.15.59:0/1475345844 >> v2:172.21.15.151:3300/0 conn(0x7f27480cdc20 msgr2=0x7f27480cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:40.128 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.122+0000 7f27467fc640 1 --2- 172.21.15.59:0/1475345844 >> v2:172.21.15.151:3300/0 conn(0x7f27480cdc20 0x7f27480cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:40.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.122+0000 7f27467fc640 1 -- 172.21.15.59:0/1475345844 >> v1:172.21.15.151:6789/0 conn(0x7f274815cb80 legacy=0x7f2748070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:40.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.122+0000 7f27467fc640 1 -- 172.21.15.59:0/1475345844 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27480ccda0 con 0x7f27480cacf0 2023-10-16T14:27:40.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.122+0000 7f27467fc640 1 -- 172.21.15.59:0/1475345844 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2332902821 0 0) 0x7f2738001670 con 0x7f27480cacf0 2023-10-16T14:27:40.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.122+0000 7f2747fff640 1 --2- 172.21.15.59:0/1475345844 >> v2:172.21.15.151:3300/0 conn(0x7f27480cdc20 0x7f27480cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-16T14:27:40.129 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.122+0000 7f27467fc640 1 -- 172.21.15.59:0/1475345844 >> v1:172.21.15.59:6789/0 conn(0x7f27480cacf0 legacy=0x7f27480cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:40.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.122+0000 7f27467fc640 1 --2- 172.21.15.59:0/1475345844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2730003aa0 0x7f2730003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:40.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.122+0000 7f27467fc640 1 --2- 172.21.15.59:0/1475345844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27300047c0 0x7f2730004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:40.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.122+0000 7f27467fc640 1 --2- 172.21.15.59:0/1475345844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2730005380 0x7f273000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:40.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.122+0000 7f27467fc640 1 -- 172.21.15.59:0/1475345844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2748070170 con 0x7f27300047c0 2023-10-16T14:27:40.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.122+0000 7f27467fc640 1 -- 172.21.15.59:0/1475345844 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273000c1f0 con 0x7f2730005380 2023-10-16T14:27:40.130 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.122+0000 7f27467fc640 1 -- 172.21.15.59:0/1475345844 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273000c3b0 con 0x7f2730003aa0 2023-10-16T14:27:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.123+0000 7f2746ffd640 1 --2- 172.21.15.59:0/1475345844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27300047c0 0x7f2730004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.123+0000 7f27477fe640 1 --2- 172.21.15.59:0/1475345844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2730003aa0 0x7f2730003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.123+0000 7f2747fff640 1 --2- 172.21.15.59:0/1475345844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2730005380 0x7f273000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.123+0000 7f2746ffd640 1 -- 172.21.15.59:0/1475345844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2730003aa0 msgr2=0x7f2730003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:40.131 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.123+0000 7f2746ffd640 1 --2- 172.21.15.59:0/1475345844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2730003aa0 0x7f2730003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.123+0000 7f2746ffd640 1 -- 172.21.15.59:0/1475345844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2730005380 msgr2=0x7f273000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:27:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.123+0000 7f2746ffd640 1 --2- 172.21.15.59:0/1475345844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2730005380 0x7f273000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.123+0000 7f2746ffd640 1 -- 172.21.15.59:0/1475345844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2730003520 con 0x7f27300047c0 2023-10-16T14:27:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.123+0000 7f27477fe640 1 --2- 172.21.15.59:0/1475345844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2730003aa0 0x7f2730003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:40.132 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.123+0000 7f2747fff640 1 --2- 172.21.15.59:0/1475345844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2730005380 0x7f273000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:27:40.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.123+0000 7f2747fff640 1 -- 172.21.15.59:0/1475345844 reap_dead start 2023-10-16T14:27:40.133 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.124+0000 7f2746ffd640 1 --2- 172.21.15.59:0/1475345844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27300047c0 0x7f2730004c40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f273c001720 tx=0x7f27300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8934033f46b4857d server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:40.135 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.124+0000 7f27467fc640 1 -- 172.21.15.59:0/1475345844 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c0052d0 con 0x7f27300047c0 2023-10-16T14:27:40.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.125+0000 7f27467fc640 1 -- 172.21.15.59:0/1475345844 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c02e050 con 0x7f27300047c0 2023-10-16T14:27:40.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.125+0000 7f27467fc640 1 -- 172.21.15.59:0/1475345844 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c003830 con 0x7f27300047c0 2023-10-16T14:27:40.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.125+0000 7f274cafc640 1 -- 172.21.15.59:0/1475345844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27300047c0 msgr2=0x7f2730004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:40.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.125+0000 7f274cafc640 1 --2- 172.21.15.59:0/1475345844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27300047c0 0x7f2730004c40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f273c001720 tx=0x7f27300057f0 comp rx=0 tx=0).stop 2023-10-16T14:27:40.136 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.125+0000 7f274cafc640 1 -- 172.21.15.59:0/1475345844 shutdown_connections 2023-10-16T14:27:40.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.125+0000 7f274cafc640 1 --2- 172.21.15.59:0/1475345844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27300047c0 0x7f2730004c40 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:40.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.125+0000 7f274cafc640 1 -- 172.21.15.59:0/1475345844 >> 172.21.15.59:0/1475345844 conn(0x7f274806a470 msgr2=0x7f27480afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:40.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.125+0000 7f274cafc640 1 -- 172.21.15.59:0/1475345844 shutdown_connections 2023-10-16T14:27:40.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.125+0000 7f274cafc640 1 -- 172.21.15.59:0/1475345844 wait complete. 2023-10-16T14:27:40.137 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.127+0000 7f274cafc640 1 Processor -- start 2023-10-16T14:27:40.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.127+0000 7f274cafc640 1 -- start start 2023-10-16T14:27:40.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.128+0000 7f274cafc640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27300047c0 0x7f27480b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:40.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.128+0000 7f274cafc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27480b36f0 0x7f274815e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:40.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.128+0000 7f274cafc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27481580d0 0x7f2748158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:40.138 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.128+0000 7f274cafc640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27480c2770 con 0x7f27300047c0 2023-10-16T14:27:40.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.128+0000 7f274cafc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27480c1eb0 con 0x7f27481580d0 2023-10-16T14:27:40.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.128+0000 7f274cafc640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2748158ac0 con 0x7f27480b36f0 2023-10-16T14:27:40.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.128+0000 7f27477fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27300047c0 0x7f27480b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:40.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.128+0000 7f27477fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27300047c0 0x7f27480b0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43802/0 (socket says 172.21.15.59:43802) 2023-10-16T14:27:40.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.128+0000 7f27477fe640 1 -- 172.21.15.59:0/485865437 learned_addr learned my addr 172.21.15.59:0/485865437 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:27:40.139 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.129+0000 7f27477fe640 1 -- 172.21.15.59:0/485865437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27480b36f0 msgr2=0x7f274815e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.129+0000 7f27477fe640 1 --2- 172.21.15.59:0/485865437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27480b36f0 0x7f274815e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.129+0000 7f27477fe640 1 -- 172.21.15.59:0/485865437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27481580d0 msgr2=0x7f2748158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.129+0000 7f27477fe640 1 --2- 172.21.15.59:0/485865437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27481580d0 0x7f2748158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.129+0000 7f27477fe640 1 -- 172.21.15.59:0/485865437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27480c2120 con 0x7f27300047c0 2023-10-16T14:27:40.140 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.129+0000 7f27477fe640 1 --2- 172.21.15.59:0/485865437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27300047c0 0x7f27480b0f20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f273800d770 tx=0x7f273800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.129+0000 7f272ffff640 1 -- 172.21.15.59:0/485865437 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27380072d0 con 0x7f27300047c0 2023-10-16T14:27:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.130+0000 7f272ffff640 1 -- 172.21.15.59:0/485865437 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2738007430 con 0x7f27300047c0 2023-10-16T14:27:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.130+0000 7f274cafc640 1 -- 172.21.15.59:0/485865437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27480c2400 con 0x7f27300047c0 2023-10-16T14:27:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.130+0000 7f272ffff640 1 -- 172.21.15.59:0/485865437 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27380047e0 con 0x7f27300047c0 2023-10-16T14:27:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.130+0000 7f274cafc640 1 -- 172.21.15.59:0/485865437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27480b1500 con 0x7f27300047c0 2023-10-16T14:27:40.141 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.131+0000 7f274cafc640 1 -- 172.21.15.59:0/485865437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f274804e9b0 con 0x7f27300047c0 2023-10-16T14:27:40.142 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.132+0000 7f272ffff640 1 -- 172.21.15.59:0/485865437 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2738004940 con 0x7f27300047c0 2023-10-16T14:27:40.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.133+0000 7f272ffff640 1 --2- 172.21.15.59:0/485865437 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f273406aea0 0x7f273406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:27:40.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.133+0000 7f272ffff640 1 -- 172.21.15.59:0/485865437 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f27380891c0 con 0x7f27300047c0 2023-10-16T14:27:40.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.134+0000 7f2746ffd640 1 --2- 172.21.15.59:0/485865437 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f273406aea0 0x7f273406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:27:40.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.135+0000 7f2746ffd640 1 --2- 172.21.15.59:0/485865437 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f273406aea0 0x7f273406d360 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f273c033000 tx=0x7f273c02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:27:40.143 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.137+0000 7f272ffff640 1 -- 172.21.15.59:0/485865437 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f27380541d0 con 0x7f27300047c0 2023-10-16T14:27:40.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.371+0000 7f274cafc640 1 -- 172.21.15.59:0/485865437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2748072980 con 0x7f27300047c0 2023-10-16T14:27:40.375 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.372+0000 7f272ffff640 1 -- 172.21.15.59:0/485865437 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f27380577f0 con 0x7f27300047c0 2023-10-16T14:27:40.376 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-16T14:27:40.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.374+0000 7f274cafc640 1 -- 172.21.15.59:0/485865437 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f273406aea0 msgr2=0x7f273406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:40.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.374+0000 7f274cafc640 1 --2- 172.21.15.59:0/485865437 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f273406aea0 0x7f273406d360 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f273c033000 tx=0x7f273c02f000 comp rx=0 tx=0).stop 2023-10-16T14:27:40.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.374+0000 7f274cafc640 1 -- 172.21.15.59:0/485865437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27300047c0 msgr2=0x7f27480b0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:27:40.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.374+0000 7f274cafc640 1 --2- 172.21.15.59:0/485865437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27300047c0 0x7f27480b0f20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f273800d770 tx=0x7f273800dc30 comp rx=0 tx=0).stop 2023-10-16T14:27:40.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.375+0000 7f274cafc640 1 -- 172.21.15.59:0/485865437 shutdown_connections 2023-10-16T14:27:40.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.375+0000 7f274cafc640 1 --2- 172.21.15.59:0/485865437 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f273406aea0 0x7f273406d360 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:40.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.375+0000 7f274cafc640 1 --2- 172.21.15.59:0/485865437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27481580d0 0x7f2748158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:40.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.375+0000 7f274cafc640 1 --2- 172.21.15.59:0/485865437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27480b36f0 0x7f274815e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:40.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.375+0000 7f274cafc640 1 --2- 172.21.15.59:0/485865437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27300047c0 0x7f27480b0f20 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:27:40.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.375+0000 7f274cafc640 1 -- 172.21.15.59:0/485865437 >> 172.21.15.59:0/485865437 conn(0x7f274806a470 msgr2=0x7f27480af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:27:40.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.375+0000 7f274cafc640 1 -- 172.21.15.59:0/485865437 shutdown_connections 2023-10-16T14:27:40.380 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:40.375+0000 7f274cafc640 1 -- 172.21.15.59:0/485865437 wait complete. 2023-10-16T14:27:40.397 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-16T14:27:40.398 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-16T14:27:40.398 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-10-16T14:27:40.398 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-16T14:27:40.399 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-16T14:27:40.399 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-16T14:27:40.399 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-16T14:27:40.399 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-16T14:27:40.400 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T14:27:40.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:40.401 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-10-16T14:27:40.453 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-16T14:27:40.453 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-16T14:27:40.454 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-16T14:27:40.454 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:27:40.454 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-16T14:27:40.454 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:27:40.454 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T14:27:40.455 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-10-16T14:27:40.455 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2023-10-16T14:27:40.455 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T14:27:40.455 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-10-16T14:27:40.455 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2023-10-16T14:27:40.455 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-16T14:27:40.456 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-10-16T14:27:40.456 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2023-10-16T14:27:40.456 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-16T14:27:40.456 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42230sec preferred_lft 42230sec 2023-10-16T14:27:40.456 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link noprefixroute 2023-10-16T14:27:40.457 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:27:40.457 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-16T14:27:40.457 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-10-16T14:27:40.457 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2023-10-16T14:27:40.457 INFO:teuthology.orchestra.run.smithi059.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-16T14:27:40.457 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 42:e4:88:d9:5f:1f brd ff:ff:ff:ff:ff:ff 2023-10-16T14:27:40.458 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-16T14:27:40.458 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:27:40.458 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::503c:deff:fe31:98c7/64 scope link 2023-10-16T14:27:40.458 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:27:40.458 INFO:teuthology.orchestra.run.smithi059.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T14:27:40.459 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 42:e4:88:d9:5f:1f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T14:27:40.459 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::40e4:88ff:fed9:5f1f/64 scope link 2023-10-16T14:27:40.459 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:27:40.459 INFO:teuthology.orchestra.run.smithi059.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-16T14:27:40.459 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether f2:db:2d:47:a5:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T14:27:40.459 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::f0db:2dff:fe47:a5d4/64 scope link 2023-10-16T14:27:40.460 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-16T14:27:40.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:40.461 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-16T14:27:40.558 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-16T14:27:40.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:40.563 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-10-16T14:27:40.623 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-10-16T14:27:40.624 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-16T14:27:40.624 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-16T14:27:40.624 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-16T14:27:40.624 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-16T14:27:40.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:40.625 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-16T14:27:40.626 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-16T14:27:40.626 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-16T14:27:40.626 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-16T14:27:40.627 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-16T14:27:40.627 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-16T14:27:40.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:40.824 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-16T14:27:40.877 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-16T14:27:40.877 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-16T14:27:40.878 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-16T14:27:40.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:40.879 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2023-10-16T14:27:40.983 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-16T14:27:40.984 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T14:27:40.984 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-16T14:27:41.045 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-16T14:27:41.045 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-16T14:27:41.046 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-16T14:27:41.101 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2023-10-16T14:27:41.210 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T14:27:41.273 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2023-10-16T14:27:41.273 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2023-10-16T14:27:41.273 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2023-10-16T14:27:41.274 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2023-10-16T14:27:41.274 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2023-10-16T14:27:41.274 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2023-10-16T14:27:41.274 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2023-10-16T14:27:41.274 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2023-10-16T14:27:41.275 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2023-10-16T14:27:41.275 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2023-10-16T14:27:41.275 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/selinux 2023-10-16T14:27:41.275 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T14:27:41.275 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2023-10-16T14:27:41.276 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2023-10-16T14:27:41.276 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2023-10-16T14:27:41.276 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2023-10-16T14:27:41.276 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2023-10-16T14:27:41.276 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T14:27:41.276 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T14:27:41.277 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2023-10-16T14:27:41.277 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T14:27:41.277 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T14:27:41.277 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2023-10-16T14:27:41.277 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2023-10-16T14:27:41.278 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T14:27:41.278 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T14:27:41.278 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T14:27:41.278 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T14:27:41.278 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2023-10-16T14:27:41.279 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T14:27:41.279 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T14:27:41.279 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T14:27:41.279 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T14:27:41.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:41.281 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2023-10-16T14:27:41.343 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-16T14:27:41.344 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-16T14:27:41.350 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2023-10-16T14:27:41.431 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2023-10-16T14:27:41.474 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2023-10-16T14:27:41.474 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2023-10-16T14:27:41.474 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2023-10-16T14:27:41.475 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2023-10-16T14:27:41.475 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2023-10-16T14:27:41.475 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2023-10-16T14:27:41.475 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2023-10-16T14:27:41.475 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2023-10-16T14:27:41.476 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2023-10-16T14:27:41.476 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2023-10-16T14:27:41.476 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/selinux 2023-10-16T14:27:41.476 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2023-10-16T14:27:41.476 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2023-10-16T14:27:41.477 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2023-10-16T14:27:41.477 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2023-10-16T14:27:41.477 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2023-10-16T14:27:41.477 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2023-10-16T14:27:41.477 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysctl.service 2023-10-16T14:27:41.478 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-16T14:27:41.478 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2023-10-16T14:27:41.478 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-16T14:27:41.478 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/nfs/rpc_pipefs 2023-10-16T14:27:41.478 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2023-10-16T14:27:41.479 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2023-10-16T14:27:41.479 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2023-10-16T14:27:41.479 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2023-10-16T14:27:41.479 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2023-10-16T14:27:41.479 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2023-10-16T14:27:41.480 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2023-10-16T14:27:41.480 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T14:27:41.480 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-16T14:27:41.480 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T14:27:41.480 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-16T14:27:41.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:41.482 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2023-10-16T14:27:41.542 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:2023-10-16T14:27:41.538+0000 7fd08283f480 -1 init, newargv = 0x5639a2ed5b10 newargc=15 2023-10-16T14:27:41.543 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[103208]: starting ceph client 2023-10-16T14:27:41.551 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[103208]: starting fuse 2023-10-16T14:27:41.569 INFO:teuthology.orchestra.run.smithi059.stdout:41 2023-10-16T14:27:41.569 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-10-16T14:27:41.570 DEBUG:teuthology.orchestra.run.smithi059:> sudo stdin-killer -- python3 -c ' 2023-10-16T14:27:41.571 DEBUG:teuthology.orchestra.run.smithi059:> import glob 2023-10-16T14:27:41.571 DEBUG:teuthology.orchestra.run.smithi059:> import re 2023-10-16T14:27:41.571 DEBUG:teuthology.orchestra.run.smithi059:> import os 2023-10-16T14:27:41.572 DEBUG:teuthology.orchestra.run.smithi059:> import subprocess 2023-10-16T14:27:41.572 DEBUG:teuthology.orchestra.run.smithi059:> 2023-10-16T14:27:41.573 DEBUG:teuthology.orchestra.run.smithi059:> def _find_admin_socket(client_name): 2023-10-16T14:27:41.573 DEBUG:teuthology.orchestra.run.smithi059:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-16T14:27:41.574 DEBUG:teuthology.orchestra.run.smithi059:> files = glob.glob(asok_path) 2023-10-16T14:27:41.574 DEBUG:teuthology.orchestra.run.smithi059:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-16T14:27:41.574 DEBUG:teuthology.orchestra.run.smithi059:> 2023-10-16T14:27:41.575 DEBUG:teuthology.orchestra.run.smithi059:> # Given a non-glob path, it better be there 2023-10-16T14:27:41.575 DEBUG:teuthology.orchestra.run.smithi059:> if "*" not in asok_path: 2023-10-16T14:27:41.576 DEBUG:teuthology.orchestra.run.smithi059:> assert(len(files) == 1) 2023-10-16T14:27:41.576 DEBUG:teuthology.orchestra.run.smithi059:> return files[0] 2023-10-16T14:27:41.576 DEBUG:teuthology.orchestra.run.smithi059:> 2023-10-16T14:27:41.577 DEBUG:teuthology.orchestra.run.smithi059:> for f in files: 2023-10-16T14:27:41.577 DEBUG:teuthology.orchestra.run.smithi059:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-16T14:27:41.577 DEBUG:teuthology.orchestra.run.smithi059:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-16T14:27:41.578 DEBUG:teuthology.orchestra.run.smithi059:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-16T14:27:41.578 DEBUG:teuthology.orchestra.run.smithi059:> contents = proc_f.read() 2023-10-16T14:27:41.579 DEBUG:teuthology.orchestra.run.smithi059:> if mountpoint in contents: 2023-10-16T14:27:41.579 DEBUG:teuthology.orchestra.run.smithi059:> return f 2023-10-16T14:27:41.580 DEBUG:teuthology.orchestra.run.smithi059:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-16T14:27:41.580 DEBUG:teuthology.orchestra.run.smithi059:> 2023-10-16T14:27:41.580 DEBUG:teuthology.orchestra.run.smithi059:> print(_find_admin_socket("client.0")) 2023-10-16T14:27:41.581 DEBUG:teuthology.orchestra.run.smithi059:> ' 2023-10-16T14:27:41.778 INFO:teuthology.orchestra.run.smithi059.stdout:/var/run/ceph/ceph-client.0.103208.asok 2023-10-16T14:27:41.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:27:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-16T14:27:41.796 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.103208.asok 2023-10-16T14:27:41.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:41.797 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.103208.asok status 2023-10-16T14:27:42.051 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2023-10-16T14:27:42.051 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": { 2023-10-16T14:27:42.051 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-16T14:27:42.051 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-16T14:27:42.052 INFO:teuthology.orchestra.run.smithi059.stdout: "entity_id": "0", 2023-10-16T14:27:42.052 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": "smithi059", 2023-10-16T14:27:42.052 INFO:teuthology.orchestra.run.smithi059.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-16T14:27:42.052 INFO:teuthology.orchestra.run.smithi059.stdout: "pid": "103208", 2023-10-16T14:27:42.052 INFO:teuthology.orchestra.run.smithi059.stdout: "root": "/" 2023-10-16T14:27:42.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:42.053 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_count": 0, 2023-10-16T14:27:42.053 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_pinned_count": 0, 2023-10-16T14:27:42.053 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 5625, 2023-10-16T14:27:42.053 INFO:teuthology.orchestra.run.smithi059.stdout: "inst": { 2023-10-16T14:27:42.053 INFO:teuthology.orchestra.run.smithi059.stdout: "name": { 2023-10-16T14:27:42.054 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "client", 2023-10-16T14:27:42.054 INFO:teuthology.orchestra.run.smithi059.stdout: "num": 5625 2023-10-16T14:27:42.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:42.054 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2023-10-16T14:27:42.054 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-16T14:27:42.055 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2023-10-16T14:27:42.055 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1639897098 2023-10-16T14:27:42.055 INFO:teuthology.orchestra.run.smithi059.stdout: } 2023-10-16T14:27:42.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:42.055 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2023-10-16T14:27:42.056 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2023-10-16T14:27:42.056 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2023-10-16T14:27:42.056 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 1639897098 2023-10-16T14:27:42.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2023-10-16T14:27:42.056 INFO:teuthology.orchestra.run.smithi059.stdout: "inst_str": "client.5625 192.168.0.1:0/1639897098", 2023-10-16T14:27:42.056 INFO:teuthology.orchestra.run.smithi059.stdout: "addr_str": "192.168.0.1:0/1639897098", 2023-10-16T14:27:42.057 INFO:teuthology.orchestra.run.smithi059.stdout: "inode_count": 1, 2023-10-16T14:27:42.057 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_epoch": 18, 2023-10-16T14:27:42.057 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch": 40, 2023-10-16T14:27:42.057 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch_barrier": 0, 2023-10-16T14:27:42.057 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklisted": false, 2023-10-16T14:27:42.057 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs" 2023-10-16T14:27:42.058 INFO:teuthology.orchestra.run.smithi059.stdout:} 2023-10-16T14:27:42.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:42.066 DEBUG:teuthology.orchestra.run.smithi059:> stat --file-system '--printf=%T 2023-10-16T14:27:42.066 DEBUG:teuthology.orchestra.run.smithi059:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-16T14:27:42.123 INFO:teuthology.orchestra.run.smithi059.stdout:fuseblk 2023-10-16T14:27:42.123 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-16T14:27:42.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:42.124 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-16T14:27:42.218 DEBUG:teuthology.orchestra.run.smithi059:> mktemp -d --suffix=xfstests-dev 2023-10-16T14:27:42.279 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.AzguH69EDZxfstests-dev 2023-10-16T14:27:42.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:42.280 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.AzguH69EDZxfstests-dev) 2023-10-16T14:27:42.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:42.387 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.AzguH69EDZxfstests-dev) 2023-10-16T14:27:42.459 INFO:teuthology.orchestra.run.smithi059.stderr:Cloning into '/tmp/tmp.AzguH69EDZxfstests-dev'... 2023-10-16T14:27:43.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:43.558 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-10-16T14:27:43.631 DEBUG:teuthology.orchestra.run.smithi059:> mktemp -d --suffix=test 2023-10-16T14:27:43.692 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.WAE0cdes5xtest 2023-10-16T14:27:43.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:27:43.693 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-10-16T14:27:43.756 DEBUG:teuthology.orchestra.run.smithi059:> mktemp -d --suffix=scratch 2023-10-16T14:27:43.815 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.yP8BgwiO5Hscratch 2023-10-16T14:27:43.816 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2023-10-16T14:27:43.816 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite xfsprogs-qa-devel 2023-10-16T14:27:44.688 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:04:46 ago on Mon 16 Oct 2023 02:22:58 PM UTC. 2023-10-16T14:27:44.786 INFO:teuthology.orchestra.run.smithi059.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2023-10-16T14:27:44.787 INFO:teuthology.orchestra.run.smithi059.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2023-10-16T14:27:44.788 INFO:teuthology.orchestra.run.smithi059.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2023-10-16T14:27:44.789 INFO:teuthology.orchestra.run.smithi059.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2023-10-16T14:27:44.790 INFO:teuthology.orchestra.run.smithi059.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2023-10-16T14:27:44.792 INFO:teuthology.orchestra.run.smithi059.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2023-10-16T14:27:44.794 INFO:teuthology.orchestra.run.smithi059.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2023-10-16T14:27:44.795 INFO:teuthology.orchestra.run.smithi059.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2023-10-16T14:27:44.797 INFO:teuthology.orchestra.run.smithi059.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2023-10-16T14:27:44.798 INFO:teuthology.orchestra.run.smithi059.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2023-10-16T14:27:44.800 INFO:teuthology.orchestra.run.smithi059.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2023-10-16T14:27:44.801 INFO:teuthology.orchestra.run.smithi059.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2023-10-16T14:27:44.802 INFO:teuthology.orchestra.run.smithi059.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2023-10-16T14:27:44.803 INFO:teuthology.orchestra.run.smithi059.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2023-10-16T14:27:44.804 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2023-10-16T14:27:44.805 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-16T14:27:44.806 INFO:teuthology.orchestra.run.smithi059.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2023-10-16T14:27:44.807 INFO:teuthology.orchestra.run.smithi059.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-10-16T14:27:44.808 INFO:teuthology.orchestra.run.smithi059.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2023-10-16T14:27:44.809 INFO:teuthology.orchestra.run.smithi059.stdout:Package libuuid-devel-2.37.4-15.el9.x86_64 is already installed. 2023-10-16T14:27:44.810 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsprogs-devel-5.19.0-4.el9.x86_64 is already installed. 2023-10-16T14:27:44.812 INFO:teuthology.orchestra.run.smithi059.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2023-10-16T14:27:44.816 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-16T14:27:44.875 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2023-10-16T14:27:44.877 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2023-10-16T14:27:44.877 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2023-10-16T14:27:44.877 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2023-10-16T14:27:44.878 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2023-10-16T14:27:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2023-10-16T14:27:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: fio x86_64 3.35-1.el9 appstream 6.2 M 2023-10-16T14:27:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: indent x86_64 2.2.13-4.el9 epel 179 k 2023-10-16T14:27:44.878 INFO:teuthology.orchestra.run.smithi059.stdout: sqlite x86_64 3.34.1-6.el9 CentOS-AppStream 747 k 2023-10-16T14:27:44.879 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2023-10-16T14:27:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: cpp x86_64 11.4.1-2.3.el9 CentOS-AppStream 11 M 2023-10-16T14:27:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: gcc x86_64 11.4.1-2.3.el9 CentOS-AppStream 32 M 2023-10-16T14:27:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: gcc-c++ x86_64 11.4.1-2.3.el9 CentOS-AppStream 13 M 2023-10-16T14:27:44.879 INFO:teuthology.orchestra.run.smithi059.stdout: gcc-plugin-annobin x86_64 11.4.1-2.3.el9 CentOS-AppStream 47 k 2023-10-16T14:27:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: libgcc x86_64 11.4.1-2.3.el9 CentOS-BaseOS 92 k 2023-10-16T14:27:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: libgomp x86_64 11.4.1-2.3.el9 CentOS-BaseOS 268 k 2023-10-16T14:27:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: libstdc++ x86_64 11.4.1-2.3.el9 CentOS-BaseOS 735 k 2023-10-16T14:27:44.880 INFO:teuthology.orchestra.run.smithi059.stdout: libstdc++-devel x86_64 11.4.1-2.3.el9 CentOS-AppStream 2.2 M 2023-10-16T14:27:44.880 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2023-10-16T14:27:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: libnbd x86_64 1.16.0-1.el9 appstream 161 k 2023-10-16T14:27:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2023-10-16T14:27:44.881 INFO:teuthology.orchestra.run.smithi059.stdout:Installing weak dependencies: 2023-10-16T14:27:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: fio-engine-http x86_64 3.35-1.el9 appstream 18 k 2023-10-16T14:27:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: fio-engine-libaio x86_64 3.35-1.el9 appstream 16 k 2023-10-16T14:27:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: fio-engine-nbd x86_64 3.35-1.el9 appstream 15 k 2023-10-16T14:27:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: fio-engine-rados x86_64 3.35-1.el9 appstream 16 k 2023-10-16T14:27:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: fio-engine-rbd x86_64 3.35-1.el9 appstream 16 k 2023-10-16T14:27:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: fio-engine-rdma x86_64 3.35-1.el9 appstream 21 k 2023-10-16T14:27:44.882 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:44.883 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2023-10-16T14:27:44.883 INFO:teuthology.orchestra.run.smithi059.stdout:================================================================================ 2023-10-16T14:27:44.883 INFO:teuthology.orchestra.run.smithi059.stdout:Install 12 Packages 2023-10-16T14:27:44.883 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 8 Packages 2023-10-16T14:27:44.883 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:44.884 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 66 M 2023-10-16T14:27:44.884 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2023-10-16T14:27:45.628 INFO:teuthology.orchestra.run.smithi059.stdout:(1/20): rmt-1.6-6.el9.x86_64.rpm 197 kB/s | 45 kB 00:00 2023-10-16T14:27:45.694 INFO:teuthology.orchestra.run.smithi059.stdout:(2/20): sqlite-3.34.1-6.el9.x86_64.rpm 2.5 MB/s | 747 kB 00:00 2023-10-16T14:27:45.786 INFO:teuthology.orchestra.run.smithi059.stdout:(3/20): fio-engine-http-3.35-1.el9.x86_64.rpm 119 kB/s | 18 kB 00:00 2023-10-16T14:27:45.811 INFO:teuthology.orchestra.run.smithi059.stdout:(4/20): fio-engine-libaio-3.35-1.el9.x86_64.rpm 135 kB/s | 16 kB 00:00 2023-10-16T14:27:45.836 INFO:teuthology.orchestra.run.smithi059.stdout:(5/20): fio-engine-nbd-3.35-1.el9.x86_64.rpm 295 kB/s | 15 kB 00:00 2023-10-16T14:27:45.869 INFO:teuthology.orchestra.run.smithi059.stdout:(6/20): fio-engine-rados-3.35-1.el9.x86_64.rpm 272 kB/s | 16 kB 00:00 2023-10-16T14:27:45.903 INFO:teuthology.orchestra.run.smithi059.stdout:(7/20): fio-engine-rbd-3.35-1.el9.x86_64.rpm 245 kB/s | 16 kB 00:00 2023-10-16T14:27:45.920 INFO:teuthology.orchestra.run.smithi059.stdout:(8/20): fio-engine-rdma-3.35-1.el9.x86_64.rpm 414 kB/s | 21 kB 00:00 2023-10-16T14:27:46.042 INFO:teuthology.orchestra.run.smithi059.stdout:(9/20): libnbd-1.16.0-1.el9.x86_64.rpm 1.2 MB/s | 161 kB 00:00 2023-10-16T14:27:46.130 INFO:teuthology.orchestra.run.smithi059.stdout:(10/20): dump-0.4-0.51.b47.el9.x86_64.rpm 422 kB/s | 88 kB 00:00 2023-10-16T14:27:46.280 INFO:teuthology.orchestra.run.smithi059.stdout:(11/20): indent-2.2.13-4.el9.x86_64.rpm 759 kB/s | 179 kB 00:00 2023-10-16T14:27:46.430 INFO:teuthology.orchestra.run.smithi059.stdout:(12/20): fio-3.35-1.el9.x86_64.rpm 6.1 MB/s | 6.2 MB 00:01 2023-10-16T14:27:46.838 INFO:teuthology.orchestra.run.smithi059.stdout:(13/20): cpp-11.4.1-2.3.el9.x86_64.rpm 15 MB/s | 11 MB 00:00 2023-10-16T14:27:47.073 INFO:teuthology.orchestra.run.smithi059.stdout:(14/20): gcc-plugin-annobin-11.4.1-2.3.el9.x86_ 202 kB/s | 47 kB 00:00 2023-10-16T14:27:47.491 INFO:teuthology.orchestra.run.smithi059.stdout:(15/20): gcc-c++-11.4.1-2.3.el9.x86_64.rpm 14 MB/s | 13 MB 00:00 2023-10-16T14:27:47.522 INFO:teuthology.orchestra.run.smithi059.stdout:(16/20): libstdc++-devel-11.4.1-2.3.el9.x86_64. 5.0 MB/s | 2.2 MB 00:00 2023-10-16T14:27:47.890 INFO:teuthology.orchestra.run.smithi059.stdout:(17/20): gcc-11.4.1-2.3.el9.x86_64.rpm 20 MB/s | 32 MB 00:01 2023-10-16T14:27:47.915 INFO:teuthology.orchestra.run.smithi059.stdout:(18/20): libgcc-11.4.1-2.3.el9.x86_64.rpm 162 kB/s | 92 kB 00:00 2023-10-16T14:27:47.965 INFO:teuthology.orchestra.run.smithi059.stdout:(19/20): libgomp-11.4.1-2.3.el9.x86_64.rpm 624 kB/s | 268 kB 00:00 2023-10-16T14:27:48.032 INFO:teuthology.orchestra.run.smithi059.stdout:(20/20): libstdc++-11.4.1-2.3.el9.x86_64.rpm 11 MB/s | 735 kB 00:00 2023-10-16T14:27:48.035 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2023-10-16T14:27:48.036 INFO:teuthology.orchestra.run.smithi059.stdout:Total 21 MB/s | 66 MB 00:03 2023-10-16T14:27:48.386 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2023-10-16T14:27:48.569 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2023-10-16T14:27:48.569 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2023-10-16T14:27:49.207 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2023-10-16T14:27:49.211 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2023-10-16T14:27:50.660 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2023-10-16T14:27:50.725 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libgcc-11.4.1-2.3.el9.x86_64 1/28 2023-10-16T14:27:50.850 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libgcc-11.4.1-2.3.el9.x86_64 1/28 2023-10-16T14:27:51.637 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libstdc++-11.4.1-2.3.el9.x86_64 2/28 2023-10-16T14:27:51.753 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libstdc++-devel-11.4.1-2.3.el9.x86_64 3/28 2023-10-16T14:27:52.080 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : libgomp-11.4.1-2.3.el9.x86_64 4/28 2023-10-16T14:27:53.311 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : cpp-11.4.1-2.3.el9.x86_64 5/28 2023-10-16T14:27:53.512 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : gcc-11.4.1-2.3.el9.x86_64 6/28 2023-10-16T14:27:53.603 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: gcc-11.4.1-2.3.el9.x86_64 6/28 2023-10-16T14:27:53.639 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libnbd-1.16.0-1.el9.x86_64 7/28 2023-10-16T14:27:53.672 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 8/28 2023-10-16T14:27:53.706 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 9/28 2023-10-16T14:27:53.741 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 10/28 2023-10-16T14:27:53.775 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 11/28 2023-10-16T14:27:53.809 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 12/28 2023-10-16T14:27:54.077 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 13/28 2023-10-16T14:27:54.129 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fio-3.35-1.el9.x86_64 14/28 2023-10-16T14:27:54.166 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rmt-2:1.6-6.el9.x86_64 15/28 2023-10-16T14:27:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 16/28 2023-10-16T14:27:54.696 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : gcc-c++-11.4.1-2.3.el9.x86_64 17/28 2023-10-16T14:27:54.726 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 18/28 2023-10-16T14:27:54.838 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 18/28 2023-10-16T14:27:54.900 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : indent-2.2.13-4.el9.x86_64 19/28 2023-10-16T14:27:54.933 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : sqlite-3.34.1-6.el9.x86_64 20/28 2023-10-16T14:27:54.963 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 21/28 2023-10-16T14:27:54.964 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 22/28 2023-10-16T14:27:55.085 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 22/28 2023-10-16T14:27:55.140 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 23/28 2023-10-16T14:27:55.185 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 24/28 2023-10-16T14:27:55.233 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 25/28 2023-10-16T14:27:55.266 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 26/28 2023-10-16T14:27:55.266 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 27/28 2023-10-16T14:27:55.393 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 27/28 2023-10-16T14:27:55.511 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 28/28 2023-10-16T14:27:57.312 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libgomp-11.4.1-2.1.el9.x86_64 28/28 2023-10-16T14:27:57.312 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : sqlite-3.34.1-6.el9.x86_64 1/28 2023-10-16T14:27:57.312 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 2/28 2023-10-16T14:27:57.312 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fio-3.35-1.el9.x86_64 3/28 2023-10-16T14:27:57.313 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 4/28 2023-10-16T14:27:57.313 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 5/28 2023-10-16T14:27:57.313 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 6/28 2023-10-16T14:27:57.313 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 7/28 2023-10-16T14:27:57.313 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 8/28 2023-10-16T14:27:57.313 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 9/28 2023-10-16T14:27:57.314 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libnbd-1.16.0-1.el9.x86_64 10/28 2023-10-16T14:27:57.314 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 11/28 2023-10-16T14:27:57.314 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : indent-2.2.13-4.el9.x86_64 12/28 2023-10-16T14:27:57.314 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cpp-11.4.1-2.3.el9.x86_64 13/28 2023-10-16T14:27:57.315 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 14/28 2023-10-16T14:27:57.315 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gcc-11.4.1-2.3.el9.x86_64 15/28 2023-10-16T14:27:57.315 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 16/28 2023-10-16T14:27:57.315 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gcc-c++-11.4.1-2.3.el9.x86_64 17/28 2023-10-16T14:27:57.315 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 18/28 2023-10-16T14:27:57.316 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 19/28 2023-10-16T14:27:57.316 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 20/28 2023-10-16T14:27:57.316 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libstdc++-devel-11.4.1-2.3.el9.x86_64 21/28 2023-10-16T14:27:57.316 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 22/28 2023-10-16T14:27:57.316 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libgcc-11.4.1-2.3.el9.x86_64 23/28 2023-10-16T14:27:57.317 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 24/28 2023-10-16T14:27:57.317 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libgomp-11.4.1-2.3.el9.x86_64 25/28 2023-10-16T14:27:57.317 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 26/28 2023-10-16T14:27:57.317 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libstdc++-11.4.1-2.3.el9.x86_64 27/28 2023-10-16T14:27:57.914 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 28/28 2023-10-16T14:27:57.915 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:57.915 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2023-10-16T14:27:57.915 INFO:teuthology.orchestra.run.smithi059.stdout: cpp-11.4.1-2.3.el9.x86_64 gcc-11.4.1-2.3.el9.x86_64 2023-10-16T14:27:57.915 INFO:teuthology.orchestra.run.smithi059.stdout: gcc-c++-11.4.1-2.3.el9.x86_64 gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 2023-10-16T14:27:57.916 INFO:teuthology.orchestra.run.smithi059.stdout: libgcc-11.4.1-2.3.el9.x86_64 libgomp-11.4.1-2.3.el9.x86_64 2023-10-16T14:27:57.916 INFO:teuthology.orchestra.run.smithi059.stdout: libstdc++-11.4.1-2.3.el9.x86_64 libstdc++-devel-11.4.1-2.3.el9.x86_64 2023-10-16T14:27:57.916 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2023-10-16T14:27:57.916 INFO:teuthology.orchestra.run.smithi059.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2023-10-16T14:27:57.916 INFO:teuthology.orchestra.run.smithi059.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2023-10-16T14:27:57.916 INFO:teuthology.orchestra.run.smithi059.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2023-10-16T14:27:57.917 INFO:teuthology.orchestra.run.smithi059.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2023-10-16T14:27:57.917 INFO:teuthology.orchestra.run.smithi059.stdout: indent-2.2.13-4.el9.x86_64 libnbd-1.16.0-1.el9.x86_64 2023-10-16T14:27:57.917 INFO:teuthology.orchestra.run.smithi059.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-6.el9.x86_64 2023-10-16T14:27:57.917 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:27:57.917 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2023-10-16T14:27:58.504 DEBUG:teuthology.orchestra.run.smithi059:> sudo useradd -m fsgqa 2023-10-16T14:27:58.610 INFO:teuthology.orchestra.run.smithi059.stderr:useradd: user 'fsgqa' already exists 2023-10-16T14:27:58.614 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-10-16T14:27:58.615 DEBUG:teuthology.orchestra.run.smithi059:> sudo groupadd fsgqa 2023-10-16T14:27:58.714 INFO:teuthology.orchestra.run.smithi059.stderr:groupadd: group 'fsgqa' already exists 2023-10-16T14:27:58.718 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-10-16T14:27:58.719 DEBUG:teuthology.orchestra.run.smithi059:> sudo useradd fsgqa2 2023-10-16T14:27:59.737 DEBUG:teuthology.orchestra.run.smithi059:> sudo useradd 123456-fsgqa 2023-10-16T14:28:00.492 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-10-16T14:28:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.724+0000 7fc02b2c2640 1 Processor -- start 2023-10-16T14:28:00.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.724+0000 7fc02b2c2640 1 -- start start 2023-10-16T14:28:00.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.726+0000 7fc02b2c2640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc024071cd0 0x7fc0240700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:28:00.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.726+0000 7fc02b2c2640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0240cbdf0 con 0x7fc0240c17a0 2023-10-16T14:28:00.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.726+0000 7fc02b2c2640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0240cb1e0 con 0x7fc0240b0720 2023-10-16T14:28:00.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.726+0000 7fc02b2c2640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc024070630 con 0x7fc024071cd0 2023-10-16T14:28:00.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.726+0000 7fc02885d640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc024071cd0 0x7fc0240700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:28:00.730 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.726+0000 7fc02905e640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc0240c17a0 0x7fc0240b0010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59322/0 (socket says 172.21.15.59:59322) 2023-10-16T14:28:00.731 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.726+0000 7fc02905e640 1 -- 172.21.15.59:0/2839179571 learned_addr learned my addr 172.21.15.59:0/2839179571 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:28:00.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.727+0000 7fc02885d640 1 -- 172.21.15.59:0/2839179571 >> v1:172.21.15.151:6789/0 conn(0x7fc0240b0720 legacy=0x7fc0240cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:28:00.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.727+0000 7fc02885d640 1 -- 172.21.15.59:0/2839179571 >> v1:172.21.15.59:6789/0 conn(0x7fc0240c17a0 legacy=0x7fc0240b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:28:00.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.727+0000 7fc02885d640 1 -- 172.21.15.59:0/2839179571 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0240cb4c0 con 0x7fc024071cd0 2023-10-16T14:28:00.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.727+0000 7fc01bfff640 1 -- 172.21.15.59:0/2839179571 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762360526 0 0) 0x7fc0240cbdf0 con 0x7fc0240c17a0 2023-10-16T14:28:00.733 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.728+0000 7fc02885d640 1 --2- 172.21.15.59:0/2839179571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc024071cd0 0x7fc0240700f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc0140097a0 tx=0x7fc01402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93099204667ee52b server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:28:00.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.728+0000 7fc01bfff640 1 -- 172.21.15.59:0/2839179571 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc014030610 con 0x7fc024071cd0 2023-10-16T14:28:00.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.728+0000 7fc01bfff640 1 -- 172.21.15.59:0/2839179571 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc014030770 con 0x7fc024071cd0 2023-10-16T14:28:00.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.728+0000 7fc01bfff640 1 -- 172.21.15.59:0/2839179571 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc014030b00 con 0x7fc024071cd0 2023-10-16T14:28:00.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.729+0000 7fc02b2c2640 1 -- 172.21.15.59:0/2839179571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc024071cd0 msgr2=0x7fc0240700f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:28:00.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.729+0000 7fc02b2c2640 1 --2- 172.21.15.59:0/2839179571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc024071cd0 0x7fc0240700f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc0140097a0 tx=0x7fc01402b960 comp rx=0 tx=0).stop 2023-10-16T14:28:00.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.729+0000 7fc02b2c2640 1 -- 172.21.15.59:0/2839179571 shutdown_connections 2023-10-16T14:28:00.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.729+0000 7fc02b2c2640 1 --2- 172.21.15.59:0/2839179571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc024071cd0 0x7fc0240700f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:28:00.735 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.729+0000 7fc02b2c2640 1 -- 172.21.15.59:0/2839179571 >> 172.21.15.59:0/2839179571 conn(0x7fc02406c1c0 msgr2=0x7fc02406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:28:00.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.729+0000 7fc02b2c2640 1 -- 172.21.15.59:0/2839179571 shutdown_connections 2023-10-16T14:28:00.736 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.729+0000 7fc02b2c2640 1 -- 172.21.15.59:0/2839179571 wait complete. 2023-10-16T14:28:00.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.731+0000 7fc02b2c2640 1 Processor -- start 2023-10-16T14:28:00.738 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.731+0000 7fc02b2c2640 1 -- start start 2023-10-16T14:28:00.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.732+0000 7fc02b2c2640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc024071cd0 0x7fc0240c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:28:00.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.732+0000 7fc02b2c2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0240b0720 0x7fc02414dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:28:00.739 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.732+0000 7fc02b2c2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0240c17a0 0x7fc02415e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:28:00.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.732+0000 7fc02b2c2640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02415cd00 con 0x7fc024071cd0 2023-10-16T14:28:00.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.732+0000 7fc02b2c2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0240c3180 con 0x7fc0240b0720 2023-10-16T14:28:00.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.732+0000 7fc02b2c2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0240c3460 con 0x7fc0240c17a0 2023-10-16T14:28:00.740 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.732+0000 7fc02905e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc024071cd0 0x7fc0240c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:28:00.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.732+0000 7fc02905e640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc024071cd0 0x7fc0240c1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46722/0 (socket says 172.21.15.59:46722) 2023-10-16T14:28:00.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.732+0000 7fc02905e640 1 -- 172.21.15.59:0/2107495972 learned_addr learned my addr 172.21.15.59:0/2107495972 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:28:00.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.733+0000 7fc02885d640 1 --2- 172.21.15.59:0/2107495972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0240b0720 0x7fc02414dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:28:00.741 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.733+0000 7fc02905e640 1 -- 172.21.15.59:0/2107495972 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0240c17a0 msgr2=0x7fc02415e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:28:00.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.733+0000 7fc02905e640 1 --2- 172.21.15.59:0/2107495972 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0240c17a0 0x7fc02415e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:28:00.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.733+0000 7fc02905e640 1 -- 172.21.15.59:0/2107495972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0240b0720 msgr2=0x7fc02414dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:28:00.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.733+0000 7fc02905e640 1 --2- 172.21.15.59:0/2107495972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0240b0720 0x7fc02414dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:28:00.742 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.733+0000 7fc02905e640 1 -- 172.21.15.59:0/2107495972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc014009400 con 0x7fc024071cd0 2023-10-16T14:28:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.733+0000 7fc02885d640 1 --2- 172.21.15.59:0/2107495972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0240b0720 0x7fc02414dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-16T14:28:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.733+0000 7fc02905e640 1 --2- 172.21.15.59:0/2107495972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc024071cd0 0x7fc0240c1b80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc02000c500 tx=0x7fc02000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:28:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.733+0000 7fc019ffb640 1 -- 172.21.15.59:0/2107495972 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc020007560 con 0x7fc024071cd0 2023-10-16T14:28:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.733+0000 7fc019ffb640 1 -- 172.21.15.59:0/2107495972 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0200047e0 con 0x7fc024071cd0 2023-10-16T14:28:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.733+0000 7fc019ffb640 1 -- 172.21.15.59:0/2107495972 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc020004b90 con 0x7fc024071cd0 2023-10-16T14:28:00.743 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.733+0000 7fc02b2c2640 1 -- 172.21.15.59:0/2107495972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0240c23d0 con 0x7fc024071cd0 2023-10-16T14:28:00.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.734+0000 7fc02b2c2640 1 -- 172.21.15.59:0/2107495972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0240c2990 con 0x7fc024071cd0 2023-10-16T14:28:00.744 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.735+0000 7fc02b2c2640 1 -- 172.21.15.59:0/2107495972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0240c2120 con 0x7fc024071cd0 2023-10-16T14:28:00.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.736+0000 7fc019ffb640 1 -- 172.21.15.59:0/2107495972 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc020004cf0 con 0x7fc024071cd0 2023-10-16T14:28:00.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.737+0000 7fc019ffb640 1 --2- 172.21.15.59:0/2107495972 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc00806ae70 0x7fc00806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:28:00.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.737+0000 7fc019ffb640 1 -- 172.21.15.59:0/2107495972 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc020088940 con 0x7fc024071cd0 2023-10-16T14:28:00.745 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.738+0000 7fc02885d640 1 --2- 172.21.15.59:0/2107495972 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc00806ae70 0x7fc00806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:28:00.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.739+0000 7fc02885d640 1 --2- 172.21.15.59:0/2107495972 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc00806ae70 0x7fc00806d330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc014036000 tx=0x7fc014008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:28:00.746 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:00.742+0000 7fc019ffb640 1 -- 172.21.15.59:0/2107495972 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc0200538a0 con 0x7fc024071cd0 2023-10-16T14:28:01.008 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.005+0000 7fc02b2c2640 1 -- 172.21.15.59:0/2107495972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc024073ef0 con 0x7fc024071cd0 2023-10-16T14:28:01.009 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.006+0000 7fc019ffb640 1 -- 172.21.15.59:0/2107495972 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7fc020018020 con 0x7fc024071cd0 2023-10-16T14:28:01.010 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:28:01.010 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":1,"fsid":"c3201022-15a8-4479-95cd-5e66eaaa456b","modified":"2023-10-16T14:24:33.528625Z","created":"2023-10-16T14:24:33.528625Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:3300","nonce":0},{"type":"v1","addr":"172.21.15.59:6789","nonce":0}]},"addr":"172.21.15.59:6789/0","public_addr":"172.21.15.59:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3300","nonce":0},{"type":"v1","addr":"172.21.15.151:6789","nonce":0}]},"addr":"172.21.15.151:6789/0","public_addr":"172.21.15.151:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3301","nonce":0},{"type":"v1","addr":"172.21.15.151:6790","nonce":0}]},"addr":"172.21.15.151:6790/0","public_addr":"172.21.15.151:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-10-16T14:28:01.011 INFO:teuthology.orchestra.run.smithi059.stderr:dumped monmap epoch 1 2023-10-16T14:28:01.011 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.008+0000 7fc02b2c2640 1 -- 172.21.15.59:0/2107495972 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc00806ae70 msgr2=0x7fc00806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:28:01.012 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.008+0000 7fc02b2c2640 1 --2- 172.21.15.59:0/2107495972 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc00806ae70 0x7fc00806d330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc014036000 tx=0x7fc014008030 comp rx=0 tx=0).stop 2023-10-16T14:28:01.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.008+0000 7fc02b2c2640 1 -- 172.21.15.59:0/2107495972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc024071cd0 msgr2=0x7fc0240c1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:28:01.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.008+0000 7fc02b2c2640 1 --2- 172.21.15.59:0/2107495972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc024071cd0 0x7fc0240c1b80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc02000c500 tx=0x7fc02000c9c0 comp rx=0 tx=0).stop 2023-10-16T14:28:01.013 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.008+0000 7fc02b2c2640 1 -- 172.21.15.59:0/2107495972 shutdown_connections 2023-10-16T14:28:01.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.008+0000 7fc02b2c2640 1 --2- 172.21.15.59:0/2107495972 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7fc00806ae70 0x7fc00806d330 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:28:01.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.008+0000 7fc02b2c2640 1 --2- 172.21.15.59:0/2107495972 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0240c17a0 0x7fc02415e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:28:01.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.008+0000 7fc02b2c2640 1 --2- 172.21.15.59:0/2107495972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0240b0720 0x7fc02414dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:28:01.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.008+0000 7fc02b2c2640 1 --2- 172.21.15.59:0/2107495972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc024071cd0 0x7fc0240c1b80 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:28:01.014 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.008+0000 7fc02b2c2640 1 -- 172.21.15.59:0/2107495972 >> 172.21.15.59:0/2107495972 conn(0x7fc02406c1c0 msgr2=0x7fc024161c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:28:01.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.008+0000 7fc02b2c2640 1 -- 172.21.15.59:0/2107495972 shutdown_connections 2023-10-16T14:28:01.015 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.009+0000 7fc02b2c2640 1 -- 172.21.15.59:0/2107495972 wait complete. 2023-10-16T14:28:01.032 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-10-16T14:28:01.264 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.261+0000 7f4df5fae640 1 Processor -- start 2023-10-16T14:28:01.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.261+0000 7f4df5fae640 1 -- start start 2023-10-16T14:28:01.265 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.262+0000 7f4df5fae640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4df00b2dd0 0x7f4df006d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:28:01.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.262+0000 7f4df5fae640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4df00ced10 0x7f4df00ab180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:28:01.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.262+0000 7f4df5fae640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df015f0d0 con 0x7f4df006dc20 2023-10-16T14:28:01.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.262+0000 7f4df5fae640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df015e2b0 con 0x7f4df00b2dd0 2023-10-16T14:28:01.266 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.262+0000 7f4df5fae640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df015ab50 con 0x7f4df00ced10 2023-10-16T14:28:01.267 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.263+0000 7f4deffff640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4df006dc20 0x7f4df00ce600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:59330/0 (socket says 172.21.15.59:59330) 2023-10-16T14:28:01.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.263+0000 7f4deffff640 1 -- 172.21.15.59:0/718210731 learned_addr learned my addr 172.21.15.59:0/718210731 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-16T14:28:01.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.263+0000 7f4df4fac640 1 --2- 172.21.15.59:0/718210731 >> v2:172.21.15.59:3300/0 conn(0x7f4df00b2dd0 0x7f4df006d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:28:01.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.263+0000 7f4df57ad640 1 --2- 172.21.15.59:0/718210731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4df00ced10 0x7f4df00ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:28:01.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.263+0000 7f4def7fe640 1 -- 172.21.15.59:0/718210731 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218399540 0 0) 0x7f4df015f0d0 con 0x7f4df006dc20 2023-10-16T14:28:01.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.263+0000 7f4def7fe640 1 -- 172.21.15.59:0/718210731 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dd8003520 con 0x7f4df006dc20 2023-10-16T14:28:01.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.263+0000 7f4df4fac640 1 -- 172.21.15.59:0/718210731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4df00ced10 msgr2=0x7f4df00ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-16T14:28:01.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.263+0000 7f4df4fac640 1 --2- 172.21.15.59:0/718210731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4df00ced10 0x7f4df00ab180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:28:01.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.263+0000 7f4df4fac640 1 -- 172.21.15.59:0/718210731 >> v1:172.21.15.59:6789/0 conn(0x7f4df006dc20 legacy=0x7f4df00ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:28:01.269 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.263+0000 7f4df4fac640 1 -- 172.21.15.59:0/718210731 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df006d3a0 con 0x7f4df00b2dd0 2023-10-16T14:28:01.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.265+0000 7f4df4fac640 1 --2- 172.21.15.59:0/718210731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df00b2dd0 0x7f4df006d6e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009de0 tx=0x7f4de002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9027bf06029929 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:28:01.271 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.265+0000 7f4def7fe640 1 -- 172.21.15.59:0/718210731 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de002cc90 con 0x7f4df00b2dd0 2023-10-16T14:28:01.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.265+0000 7f4def7fe640 1 -- 172.21.15.59:0/718210731 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de002cdf0 con 0x7f4df00b2dd0 2023-10-16T14:28:01.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.265+0000 7f4def7fe640 1 -- 172.21.15.59:0/718210731 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de0034660 con 0x7f4df00b2dd0 2023-10-16T14:28:01.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.265+0000 7f4df5fae640 1 -- 172.21.15.59:0/718210731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df00b2dd0 msgr2=0x7f4df006d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:28:01.272 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.265+0000 7f4df5fae640 1 --2- 172.21.15.59:0/718210731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df00b2dd0 0x7f4df006d6e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009de0 tx=0x7f4de002bee0 comp rx=0 tx=0).stop 2023-10-16T14:28:01.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.266+0000 7f4df5fae640 1 -- 172.21.15.59:0/718210731 shutdown_connections 2023-10-16T14:28:01.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.266+0000 7f4df5fae640 1 --2- 172.21.15.59:0/718210731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4df00ced10 0x7f4df00ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:28:01.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.266+0000 7f4df5fae640 1 --2- 172.21.15.59:0/718210731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df00b2dd0 0x7f4df006d6e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:28:01.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.266+0000 7f4df5fae640 1 -- 172.21.15.59:0/718210731 >> 172.21.15.59:0/718210731 conn(0x7f4df0069fc0 msgr2=0x7f4df006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:28:01.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.266+0000 7f4df5fae640 1 -- 172.21.15.59:0/718210731 shutdown_connections 2023-10-16T14:28:01.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.266+0000 7f4df5fae640 1 -- 172.21.15.59:0/718210731 wait complete. 2023-10-16T14:28:01.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.267+0000 7f4df5fae640 1 Processor -- start 2023-10-16T14:28:01.274 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.268+0000 7f4df5fae640 1 -- start start 2023-10-16T14:28:01.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.268+0000 7f4df5fae640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4df006dc20 0x7f4df0097a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:28:01.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.268+0000 7f4df5fae640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df00b2dd0 0x7f4df00caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:28:01.276 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.269+0000 7f4df5fae640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4df00ced10 0x7f4df015ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:28:01.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.269+0000 7f4df5fae640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df00cbce0 con 0x7f4df00b2dd0 2023-10-16T14:28:01.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.269+0000 7f4df5fae640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df0150cb0 con 0x7f4df00ced10 2023-10-16T14:28:01.277 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.269+0000 7f4df5fae640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df00cb160 con 0x7f4df006dc20 2023-10-16T14:28:01.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.269+0000 7f4deffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df00b2dd0 0x7f4df00caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:28:01.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.269+0000 7f4deffff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df00b2dd0 0x7f4df00caa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46750/0 (socket says 172.21.15.59:46750) 2023-10-16T14:28:01.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.269+0000 7f4deffff640 1 -- 172.21.15.59:0/622715927 learned_addr learned my addr 172.21.15.59:0/622715927 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-16T14:28:01.278 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.269+0000 7f4df4fac640 1 --2- 172.21.15.59:0/622715927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4df006dc20 0x7f4df0097a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:28:01.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.269+0000 7f4deffff640 1 -- 172.21.15.59:0/622715927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4df006dc20 msgr2=0x7f4df0097a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:28:01.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.269+0000 7f4deffff640 1 --2- 172.21.15.59:0/622715927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4df006dc20 0x7f4df0097a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:28:01.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.269+0000 7f4deffff640 1 -- 172.21.15.59:0/622715927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4df00ced10 msgr2=0x7f4df015ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:28:01.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.269+0000 7f4deffff640 1 --2- 172.21.15.59:0/622715927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4df00ced10 0x7f4df015ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:28:01.279 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.269+0000 7f4deffff640 1 -- 172.21.15.59:0/622715927 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de0009a70 con 0x7f4df00b2dd0 2023-10-16T14:28:01.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.270+0000 7f4deffff640 1 --2- 172.21.15.59:0/622715927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df00b2dd0 0x7f4df00caa60 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4de400c4d0 tx=0x7f4de400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:28:01.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.270+0000 7f4ded7fa640 1 -- 172.21.15.59:0/622715927 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4005ce0 con 0x7f4df00b2dd0 2023-10-16T14:28:01.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.270+0000 7f4ded7fa640 1 -- 172.21.15.59:0/622715927 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de4005e40 con 0x7f4df00b2dd0 2023-10-16T14:28:01.280 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.270+0000 7f4ded7fa640 1 -- 172.21.15.59:0/622715927 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4007270 con 0x7f4df00b2dd0 2023-10-16T14:28:01.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.270+0000 7f4df5fae640 1 -- 172.21.15.59:0/622715927 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df00cb440 con 0x7f4df00b2dd0 2023-10-16T14:28:01.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.270+0000 7f4df5fae640 1 -- 172.21.15.59:0/622715927 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df00cba00 con 0x7f4df00b2dd0 2023-10-16T14:28:01.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.271+0000 7f4df5fae640 1 -- 172.21.15.59:0/622715927 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df004e9b0 con 0x7f4df00b2dd0 2023-10-16T14:28:01.281 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.272+0000 7f4ded7fa640 1 -- 172.21.15.59:0/622715927 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4de40073d0 con 0x7f4df00b2dd0 2023-10-16T14:28:01.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.273+0000 7f4ded7fa640 1 --2- 172.21.15.59:0/622715927 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4ddc06ae70 0x7f4ddc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-16T14:28:01.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.273+0000 7f4ded7fa640 1 -- 172.21.15.59:0/622715927 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4de4088d00 con 0x7f4df00b2dd0 2023-10-16T14:28:01.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.274+0000 7f4df4fac640 1 --2- 172.21.15.59:0/622715927 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4ddc06ae70 0x7f4ddc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-16T14:28:01.283 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.275+0000 7f4df4fac640 1 --2- 172.21.15.59:0/622715927 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4ddc06ae70 0x7f4ddc06d330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4de0036000 tx=0x7f4de0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-16T14:28:01.284 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.278+0000 7f4ded7fa640 1 -- 172.21.15.59:0/622715927 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4de4053bf0 con 0x7f4df00b2dd0 2023-10-16T14:28:01.550 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.547+0000 7f4df5fae640 1 -- 172.21.15.59:0/622715927 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f4df006c940 con 0x7f4df00b2dd0 2023-10-16T14:28:01.551 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.547+0000 7f4ded7fa640 1 -- 172.21.15.59:0/622715927 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v11) v1 ==== 82+0+151 (secure 0 0 0) 0x7f4de4057210 con 0x7f4df00b2dd0 2023-10-16T14:28:01.552 INFO:teuthology.orchestra.run.smithi059.stdout:[client.admin] 2023-10-16T14:28:01.552 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQChRy1lixAlOhAABCo098LXhMaDIe8aTj5D3w== 2023-10-16T14:28:01.552 INFO:teuthology.orchestra.run.smithi059.stdout: caps mds = "allow *" 2023-10-16T14:28:01.552 INFO:teuthology.orchestra.run.smithi059.stdout: caps mgr = "allow *" 2023-10-16T14:28:01.553 INFO:teuthology.orchestra.run.smithi059.stdout: caps mon = "allow *" 2023-10-16T14:28:01.553 INFO:teuthology.orchestra.run.smithi059.stdout: caps osd = "allow *" 2023-10-16T14:28:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.552+0000 7f4df5fae640 1 -- 172.21.15.59:0/622715927 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4ddc06ae70 msgr2=0x7f4ddc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:28:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.552+0000 7f4df5fae640 1 --2- 172.21.15.59:0/622715927 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4ddc06ae70 0x7f4ddc06d330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4de0036000 tx=0x7f4de0030000 comp rx=0 tx=0).stop 2023-10-16T14:28:01.556 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.552+0000 7f4df5fae640 1 -- 172.21.15.59:0/622715927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df00b2dd0 msgr2=0x7f4df00caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-16T14:28:01.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.552+0000 7f4df5fae640 1 --2- 172.21.15.59:0/622715927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df00b2dd0 0x7f4df00caa60 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4de400c4d0 tx=0x7f4de400c990 comp rx=0 tx=0).stop 2023-10-16T14:28:01.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.552+0000 7f4df5fae640 1 -- 172.21.15.59:0/622715927 shutdown_connections 2023-10-16T14:28:01.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.552+0000 7f4df5fae640 1 --2- 172.21.15.59:0/622715927 >> [v2:172.21.15.151:6800/518957627,v1:172.21.15.151:6801/518957627] conn(0x7f4ddc06ae70 0x7f4ddc06d330 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:28:01.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.552+0000 7f4df5fae640 1 --2- 172.21.15.59:0/622715927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4df00ced10 0x7f4df015ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:28:01.557 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.552+0000 7f4df5fae640 1 --2- 172.21.15.59:0/622715927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df00b2dd0 0x7f4df00caa60 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:28:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.552+0000 7f4df5fae640 1 --2- 172.21.15.59:0/622715927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4df006dc20 0x7f4df0097a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-16T14:28:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.552+0000 7f4df5fae640 1 -- 172.21.15.59:0/622715927 >> 172.21.15.59:0/622715927 conn(0x7f4df0069fc0 msgr2=0x7f4df00ce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-16T14:28:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.552+0000 7f4df5fae640 1 -- 172.21.15.59:0/622715927 shutdown_connections 2023-10-16T14:28:01.558 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-16T14:28:01.552+0000 7f4df5fae640 1 -- 172.21.15.59:0/622715927 wait complete. 2023-10-16T14:28:01.574 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2023-10-16T14:28:01.623 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.EQCGmDdKSP 2023-10-16T14:28:01.624 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:28:01.624 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/tmp/tmp.EQCGmDdKSP 2023-10-16T14:28:01.671 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:28:01.671 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/tmp/tmp.AzguH69EDZxfstests-dev/local.config 2023-10-16T14:28:01.811 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.WAE0cdes5xtest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.yP8BgwiO5Hscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.59:6789 -k /tmp/tmp.EQCGmDdKSP --client_mountpoint /test" 2023-10-16T14:28:01.812 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T14:28:01.812 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/tmp/tmp.AzguH69EDZxfstests-dev/ceph.exclude 2023-10-16T14:28:01.857 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:28:01.899 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:28:01.935 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo make) 2023-10-16T14:28:02.069 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize -cfi 2023-10-16T14:28:02.758 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: putting auxiliary files in '.'. 2023-10-16T14:28:02.758 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: copying file './config.guess' 2023-10-16T14:28:02.770 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: copying file './config.sub' 2023-10-16T14:28:02.782 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: copying file './install-sh' 2023-10-16T14:28:02.796 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: copying file './ltmain.sh' 2023-10-16T14:28:02.870 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-10-16T14:28:02.871 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-10-16T14:28:02.885 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-10-16T14:28:02.900 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-10-16T14:28:02.915 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-10-16T14:28:02.930 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-10-16T14:28:02.953 INFO:teuthology.orchestra.run.smithi059.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-10-16T14:28:02.958 INFO:teuthology.orchestra.run.smithi059.stdout:cp include/install-sh . 2023-10-16T14:28:02.961 INFO:teuthology.orchestra.run.smithi059.stdout:aclocal -I m4 2023-10-16T14:28:04.408 INFO:teuthology.orchestra.run.smithi059.stdout:autoheader 2023-10-16T14:28:04.842 INFO:teuthology.orchestra.run.smithi059.stdout:autoconf 2023-10-16T14:28:05.117 INFO:teuthology.orchestra.run.smithi059.stdout:./configure \ 2023-10-16T14:28:05.117 INFO:teuthology.orchestra.run.smithi059.stdout: --libexecdir=/usr/lib \ 2023-10-16T14:28:05.117 INFO:teuthology.orchestra.run.smithi059.stdout: --exec_prefix=/var/lib 2023-10-16T14:28:05.659 INFO:teuthology.orchestra.run.smithi059.stdout:checking build system type... x86_64-pc-linux-gnu 2023-10-16T14:28:05.659 INFO:teuthology.orchestra.run.smithi059.stdout:checking host system type... x86_64-pc-linux-gnu 2023-10-16T14:28:05.665 INFO:teuthology.orchestra.run.smithi059.stdout:checking how to print strings... printf 2023-10-16T14:28:05.666 INFO:teuthology.orchestra.run.smithi059.stdout:checking for gcc... gcc 2023-10-16T14:28:05.824 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether the C compiler works... yes 2023-10-16T14:28:05.825 INFO:teuthology.orchestra.run.smithi059.stdout:checking for C compiler default output file name... a.out 2023-10-16T14:28:05.904 INFO:teuthology.orchestra.run.smithi059.stdout:checking for suffix of executables... 2023-10-16T14:28:06.022 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether we are cross compiling... no 2023-10-16T14:28:06.078 INFO:teuthology.orchestra.run.smithi059.stdout:checking for suffix of object files... o 2023-10-16T14:28:06.128 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether we are using the GNU C compiler... yes 2023-10-16T14:28:06.176 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether gcc accepts -g... yes 2023-10-16T14:28:06.246 INFO:teuthology.orchestra.run.smithi059.stdout:checking for gcc option to accept ISO C89... none needed 2023-10-16T14:28:06.259 INFO:teuthology.orchestra.run.smithi059.stdout:checking for a sed that does not truncate output... /bin/sed 2023-10-16T14:28:06.269 INFO:teuthology.orchestra.run.smithi059.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-10-16T14:28:06.275 INFO:teuthology.orchestra.run.smithi059.stdout:checking for egrep... /bin/grep -E 2023-10-16T14:28:06.281 INFO:teuthology.orchestra.run.smithi059.stdout:checking for fgrep... /bin/grep -F 2023-10-16T14:28:06.296 INFO:teuthology.orchestra.run.smithi059.stdout:checking for ld used by gcc... /bin/ld 2023-10-16T14:28:06.303 INFO:teuthology.orchestra.run.smithi059.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-10-16T14:28:06.319 INFO:teuthology.orchestra.run.smithi059.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-10-16T14:28:07.488 INFO:teuthology.orchestra.run.smithi059.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-10-16T14:28:07.488 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether ln -s works... yes 2023-10-16T14:28:07.513 INFO:teuthology.orchestra.run.smithi059.stdout:checking the maximum length of command line arguments... 1572864 2023-10-16T14:28:07.523 INFO:teuthology.orchestra.run.smithi059.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-10-16T14:28:07.524 INFO:teuthology.orchestra.run.smithi059.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-10-16T14:28:07.524 INFO:teuthology.orchestra.run.smithi059.stdout:checking for /bin/ld option to reload object files... -r 2023-10-16T14:28:07.525 INFO:teuthology.orchestra.run.smithi059.stdout:checking for objdump... objdump 2023-10-16T14:28:07.526 INFO:teuthology.orchestra.run.smithi059.stdout:checking how to recognize dependent libraries... pass_all 2023-10-16T14:28:07.527 INFO:teuthology.orchestra.run.smithi059.stdout:checking for dlltool... no 2023-10-16T14:28:07.528 INFO:teuthology.orchestra.run.smithi059.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-10-16T14:28:07.528 INFO:teuthology.orchestra.run.smithi059.stdout:checking for ar... ar 2023-10-16T14:28:07.663 INFO:teuthology.orchestra.run.smithi059.stdout:checking for archiver @FILE support... @ 2023-10-16T14:28:07.664 INFO:teuthology.orchestra.run.smithi059.stdout:checking for strip... strip 2023-10-16T14:28:07.665 INFO:teuthology.orchestra.run.smithi059.stdout:checking for ranlib... ranlib 2023-10-16T14:28:07.666 INFO:teuthology.orchestra.run.smithi059.stdout:checking for gawk... gawk 2023-10-16T14:28:07.859 INFO:teuthology.orchestra.run.smithi059.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-10-16T14:28:07.864 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sysroot... no 2023-10-16T14:28:07.876 INFO:teuthology.orchestra.run.smithi059.stdout:checking for a working dd... /bin/dd 2023-10-16T14:28:07.890 INFO:teuthology.orchestra.run.smithi059.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-10-16T14:28:07.936 INFO:teuthology.orchestra.run.smithi059.stdout:checking for mt... no 2023-10-16T14:28:07.946 INFO:teuthology.orchestra.run.smithi059.stdout:checking if : is a manifest tool... no 2023-10-16T14:28:08.057 INFO:teuthology.orchestra.run.smithi059.stdout:checking how to run the C preprocessor... gcc -E 2023-10-16T14:28:08.417 INFO:teuthology.orchestra.run.smithi059.stdout:checking for ANSI C header files... yes 2023-10-16T14:28:08.483 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/types.h... yes 2023-10-16T14:28:08.575 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/stat.h... yes 2023-10-16T14:28:08.646 INFO:teuthology.orchestra.run.smithi059.stdout:checking for stdlib.h... yes 2023-10-16T14:28:08.723 INFO:teuthology.orchestra.run.smithi059.stdout:checking for string.h... yes 2023-10-16T14:28:08.798 INFO:teuthology.orchestra.run.smithi059.stdout:checking for memory.h... yes 2023-10-16T14:28:08.865 INFO:teuthology.orchestra.run.smithi059.stdout:checking for strings.h... yes 2023-10-16T14:28:08.958 INFO:teuthology.orchestra.run.smithi059.stdout:checking for inttypes.h... yes 2023-10-16T14:28:09.034 INFO:teuthology.orchestra.run.smithi059.stdout:checking for stdint.h... yes 2023-10-16T14:28:09.122 INFO:teuthology.orchestra.run.smithi059.stdout:checking for unistd.h... yes 2023-10-16T14:28:09.208 INFO:teuthology.orchestra.run.smithi059.stdout:checking for dlfcn.h... yes 2023-10-16T14:28:09.220 INFO:teuthology.orchestra.run.smithi059.stdout:checking for objdir... .libs 2023-10-16T14:28:09.412 INFO:teuthology.orchestra.run.smithi059.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-10-16T14:28:09.413 INFO:teuthology.orchestra.run.smithi059.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-10-16T14:28:09.469 INFO:teuthology.orchestra.run.smithi059.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-10-16T14:28:09.525 INFO:teuthology.orchestra.run.smithi059.stdout:checking if gcc static flag -static works... no 2023-10-16T14:28:09.605 INFO:teuthology.orchestra.run.smithi059.stdout:checking if gcc supports -c -o file.o... yes 2023-10-16T14:28:09.605 INFO:teuthology.orchestra.run.smithi059.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-10-16T14:28:09.630 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-10-16T14:28:09.706 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether -lc should be explicitly linked in... no 2023-10-16T14:28:09.868 INFO:teuthology.orchestra.run.smithi059.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-10-16T14:28:09.868 INFO:teuthology.orchestra.run.smithi059.stdout:checking how to hardcode library paths into programs... immediate 2023-10-16T14:28:09.873 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether stripping libraries is possible... yes 2023-10-16T14:28:09.873 INFO:teuthology.orchestra.run.smithi059.stdout:checking if libtool supports shared libraries... yes 2023-10-16T14:28:09.873 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether to build shared libraries... yes 2023-10-16T14:28:09.873 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether to build static libraries... yes 2023-10-16T14:28:09.897 INFO:teuthology.orchestra.run.smithi059.stdout:checking for gcc... (cached) gcc 2023-10-16T14:28:09.955 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-10-16T14:28:09.955 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether gcc accepts -g... (cached) yes 2023-10-16T14:28:09.956 INFO:teuthology.orchestra.run.smithi059.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-10-16T14:28:09.956 INFO:teuthology.orchestra.run.smithi059.stdout:checking for gmake... /usr/bin/gmake 2023-10-16T14:28:09.957 INFO:teuthology.orchestra.run.smithi059.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2023-10-16T14:28:09.957 INFO:teuthology.orchestra.run.smithi059.stdout:checking for tar... /bin/tar 2023-10-16T14:28:09.958 INFO:teuthology.orchestra.run.smithi059.stdout:checking for gzip... /bin/gzip 2023-10-16T14:28:09.985 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether gcc -MM is supported... yes 2023-10-16T14:28:09.986 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sort... /bin/sort 2023-10-16T14:28:09.986 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether ln -s works... yes 2023-10-16T14:28:09.986 INFO:teuthology.orchestra.run.smithi059.stdout:checking for rpm... /bin/rpm 2023-10-16T14:28:09.998 INFO:teuthology.orchestra.run.smithi059.stdout:checking for rpmbuild... no 2023-10-16T14:28:10.070 INFO:teuthology.orchestra.run.smithi059.stdout:checking assert.h usability... yes 2023-10-16T14:28:10.102 INFO:teuthology.orchestra.run.smithi059.stdout:checking assert.h presence... yes 2023-10-16T14:28:10.103 INFO:teuthology.orchestra.run.smithi059.stdout:checking for assert.h... yes 2023-10-16T14:28:10.194 INFO:teuthology.orchestra.run.smithi059.stdout:checking bstring.h usability... no 2023-10-16T14:28:10.240 INFO:teuthology.orchestra.run.smithi059.stdout:checking bstring.h presence... no 2023-10-16T14:28:10.241 INFO:teuthology.orchestra.run.smithi059.stdout:checking for bstring.h... no 2023-10-16T14:28:10.315 INFO:teuthology.orchestra.run.smithi059.stdout:checking libgen.h usability... yes 2023-10-16T14:28:10.342 INFO:teuthology.orchestra.run.smithi059.stdout:checking libgen.h presence... yes 2023-10-16T14:28:10.342 INFO:teuthology.orchestra.run.smithi059.stdout:checking for libgen.h... yes 2023-10-16T14:28:10.440 INFO:teuthology.orchestra.run.smithi059.stdout:checking dirent.h usability... yes 2023-10-16T14:28:10.467 INFO:teuthology.orchestra.run.smithi059.stdout:checking dirent.h presence... yes 2023-10-16T14:28:10.467 INFO:teuthology.orchestra.run.smithi059.stdout:checking for dirent.h... yes 2023-10-16T14:28:10.578 INFO:teuthology.orchestra.run.smithi059.stdout:checking errno.h usability... yes 2023-10-16T14:28:10.609 INFO:teuthology.orchestra.run.smithi059.stdout:checking errno.h presence... yes 2023-10-16T14:28:10.609 INFO:teuthology.orchestra.run.smithi059.stdout:checking for errno.h... yes 2023-10-16T14:28:10.699 INFO:teuthology.orchestra.run.smithi059.stdout:checking malloc.h usability... yes 2023-10-16T14:28:10.730 INFO:teuthology.orchestra.run.smithi059.stdout:checking malloc.h presence... yes 2023-10-16T14:28:10.731 INFO:teuthology.orchestra.run.smithi059.stdout:checking for malloc.h... yes 2023-10-16T14:28:10.815 INFO:teuthology.orchestra.run.smithi059.stdout:checking uuid.h usability... no 2023-10-16T14:28:10.858 INFO:teuthology.orchestra.run.smithi059.stdout:checking uuid.h presence... no 2023-10-16T14:28:10.858 INFO:teuthology.orchestra.run.smithi059.stdout:checking for uuid.h... no 2023-10-16T14:28:10.940 INFO:teuthology.orchestra.run.smithi059.stdout:checking uuid/uuid.h usability... yes 2023-10-16T14:28:10.974 INFO:teuthology.orchestra.run.smithi059.stdout:checking uuid/uuid.h presence... yes 2023-10-16T14:28:10.975 INFO:teuthology.orchestra.run.smithi059.stdout:checking for uuid/uuid.h... yes 2023-10-16T14:28:11.063 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/uuid.h usability... no 2023-10-16T14:28:11.109 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/uuid.h presence... no 2023-10-16T14:28:11.109 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/uuid.h... no 2023-10-16T14:28:11.191 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/file.h usability... yes 2023-10-16T14:28:11.220 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/file.h presence... yes 2023-10-16T14:28:11.220 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/file.h... yes 2023-10-16T14:28:11.307 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/fcntl.h usability... yes 2023-10-16T14:28:11.335 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/fcntl.h presence... yes 2023-10-16T14:28:11.336 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/fcntl.h... yes 2023-10-16T14:28:11.422 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/syssgi.h usability... no 2023-10-16T14:28:11.468 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/syssgi.h presence... no 2023-10-16T14:28:11.468 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/syssgi.h... no 2023-10-16T14:28:11.572 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/param.h usability... yes 2023-10-16T14:28:11.610 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/param.h presence... yes 2023-10-16T14:28:11.610 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/param.h... yes 2023-10-16T14:28:11.631 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/stat.h... (cached) yes 2023-10-16T14:28:11.723 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/statvfs.h usability... yes 2023-10-16T14:28:11.751 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/statvfs.h presence... yes 2023-10-16T14:28:11.751 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/statvfs.h... yes 2023-10-16T14:28:11.835 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/time.h usability... yes 2023-10-16T14:28:11.865 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/time.h presence... yes 2023-10-16T14:28:11.866 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/time.h... yes 2023-10-16T14:28:11.957 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/ioctl.h usability... yes 2023-10-16T14:28:11.987 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/ioctl.h presence... yes 2023-10-16T14:28:11.988 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/ioctl.h... yes 2023-10-16T14:28:12.076 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/wait.h usability... yes 2023-10-16T14:28:12.109 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/wait.h presence... yes 2023-10-16T14:28:12.110 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/wait.h... yes 2023-10-16T14:28:12.130 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/types.h... (cached) yes 2023-10-16T14:28:12.150 INFO:teuthology.orchestra.run.smithi059.stdout:checking for strings.h... (cached) yes 2023-10-16T14:28:12.242 INFO:teuthology.orchestra.run.smithi059.stdout:checking err.h usability... yes 2023-10-16T14:28:12.272 INFO:teuthology.orchestra.run.smithi059.stdout:checking err.h presence... yes 2023-10-16T14:28:12.272 INFO:teuthology.orchestra.run.smithi059.stdout:checking for err.h... yes 2023-10-16T14:28:12.358 INFO:teuthology.orchestra.run.smithi059.stdout:checking linux/falloc.h usability... yes 2023-10-16T14:28:12.385 INFO:teuthology.orchestra.run.smithi059.stdout:checking linux/falloc.h presence... yes 2023-10-16T14:28:12.386 INFO:teuthology.orchestra.run.smithi059.stdout:checking for linux/falloc.h... yes 2023-10-16T14:28:12.471 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-10-16T14:28:12.515 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-10-16T14:28:12.515 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/fs/xfs_fsops.h... no 2023-10-16T14:28:12.596 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/fs/xfs_itable.h usability... no 2023-10-16T14:28:12.643 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/fs/xfs_itable.h presence... no 2023-10-16T14:28:12.643 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/fs/xfs_itable.h... no 2023-10-16T14:28:12.725 INFO:teuthology.orchestra.run.smithi059.stdout:checking xfs/platform_defs.h usability... no 2023-10-16T14:28:12.767 INFO:teuthology.orchestra.run.smithi059.stdout:checking xfs/platform_defs.h presence... no 2023-10-16T14:28:12.768 INFO:teuthology.orchestra.run.smithi059.stdout:checking for xfs/platform_defs.h... no 2023-10-16T14:28:12.844 INFO:teuthology.orchestra.run.smithi059.stdout:checking btrfs/ioctl.h usability... no 2023-10-16T14:28:12.890 INFO:teuthology.orchestra.run.smithi059.stdout:checking btrfs/ioctl.h presence... no 2023-10-16T14:28:12.890 INFO:teuthology.orchestra.run.smithi059.stdout:checking for btrfs/ioctl.h... no 2023-10-16T14:28:12.965 INFO:teuthology.orchestra.run.smithi059.stdout:checking cifs/ioctl.h usability... no 2023-10-16T14:28:13.006 INFO:teuthology.orchestra.run.smithi059.stdout:checking cifs/ioctl.h presence... no 2023-10-16T14:28:13.006 INFO:teuthology.orchestra.run.smithi059.stdout:checking for cifs/ioctl.h... no 2023-10-16T14:28:13.078 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/mman.h usability... yes 2023-10-16T14:28:13.106 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/mman.h presence... yes 2023-10-16T14:28:13.107 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/mman.h... yes 2023-10-16T14:28:13.152 INFO:teuthology.orchestra.run.smithi059.stdout:checking for xfs/xfs_log_format.h... no 2023-10-16T14:28:13.254 INFO:teuthology.orchestra.run.smithi059.stdout:checking for uuid_compare... no 2023-10-16T14:28:13.342 INFO:teuthology.orchestra.run.smithi059.stdout:checking for uuid_compare in -luuid... yes 2023-10-16T14:28:13.458 INFO:teuthology.orchestra.run.smithi059.stdout:checking for xfs/xfs.h... yes 2023-10-16T14:28:13.512 INFO:teuthology.orchestra.run.smithi059.stdout:checking for xfs/libxfs.h... no 2023-10-16T14:28:13.574 INFO:teuthology.orchestra.run.smithi059.stdout:checking whether xlog_assign_lsn is declared... no 2023-10-16T14:28:13.653 INFO:teuthology.orchestra.run.smithi059.stdout:checking for xfs/xqm.h... yes 2023-10-16T14:28:13.772 INFO:teuthology.orchestra.run.smithi059.stdout:checking xfsctl from xfs/xfs.h... ok 2023-10-16T14:28:13.835 INFO:teuthology.orchestra.run.smithi059.stdout:checking xfs/handle.h usability... yes 2023-10-16T14:28:13.864 INFO:teuthology.orchestra.run.smithi059.stdout:checking xfs/handle.h presence... yes 2023-10-16T14:28:13.864 INFO:teuthology.orchestra.run.smithi059.stdout:checking for xfs/handle.h... yes 2023-10-16T14:28:13.986 INFO:teuthology.orchestra.run.smithi059.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-10-16T14:28:14.057 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/acl.h usability... yes 2023-10-16T14:28:14.089 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/acl.h presence... yes 2023-10-16T14:28:14.089 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/acl.h... yes 2023-10-16T14:28:14.161 INFO:teuthology.orchestra.run.smithi059.stdout:checking acl/libacl.h usability... yes 2023-10-16T14:28:14.194 INFO:teuthology.orchestra.run.smithi059.stdout:checking acl/libacl.h presence... yes 2023-10-16T14:28:14.195 INFO:teuthology.orchestra.run.smithi059.stdout:checking for acl/libacl.h... yes 2023-10-16T14:28:14.286 INFO:teuthology.orchestra.run.smithi059.stdout:checking for acl_init in -lacl... yes 2023-10-16T14:28:14.352 INFO:teuthology.orchestra.run.smithi059.stdout:checking gdbm-ndbm.h usability... no 2023-10-16T14:28:14.397 INFO:teuthology.orchestra.run.smithi059.stdout:checking gdbm-ndbm.h presence... no 2023-10-16T14:28:14.397 INFO:teuthology.orchestra.run.smithi059.stdout:checking for gdbm-ndbm.h... no 2023-10-16T14:28:14.465 INFO:teuthology.orchestra.run.smithi059.stdout:checking gdbm/ndbm.h usability... no 2023-10-16T14:28:14.507 INFO:teuthology.orchestra.run.smithi059.stdout:checking gdbm/ndbm.h presence... no 2023-10-16T14:28:14.507 INFO:teuthology.orchestra.run.smithi059.stdout:checking for gdbm/ndbm.h... no 2023-10-16T14:28:14.573 INFO:teuthology.orchestra.run.smithi059.stdout:checking ndbm.h usability... no 2023-10-16T14:28:14.619 INFO:teuthology.orchestra.run.smithi059.stdout:checking ndbm.h presence... no 2023-10-16T14:28:14.619 INFO:teuthology.orchestra.run.smithi059.stdout:checking for ndbm.h... no 2023-10-16T14:28:14.688 INFO:teuthology.orchestra.run.smithi059.stdout:checking libaio.h usability... yes 2023-10-16T14:28:14.724 INFO:teuthology.orchestra.run.smithi059.stdout:checking libaio.h presence... yes 2023-10-16T14:28:14.725 INFO:teuthology.orchestra.run.smithi059.stdout:checking for libaio.h... yes 2023-10-16T14:28:14.796 INFO:teuthology.orchestra.run.smithi059.stdout:checking liburing.h usability... no 2023-10-16T14:28:14.839 INFO:teuthology.orchestra.run.smithi059.stdout:checking liburing.h presence... no 2023-10-16T14:28:14.839 INFO:teuthology.orchestra.run.smithi059.stdout:checking for liburing.h... no 2023-10-16T14:28:14.907 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/capability.h usability... no 2023-10-16T14:28:14.950 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/capability.h presence... no 2023-10-16T14:28:14.950 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/capability.h... no 2023-10-16T14:28:15.018 INFO:teuthology.orchestra.run.smithi059.stdout:checking linux/fiemap.h usability... yes 2023-10-16T14:28:15.046 INFO:teuthology.orchestra.run.smithi059.stdout:checking linux/fiemap.h presence... yes 2023-10-16T14:28:15.047 INFO:teuthology.orchestra.run.smithi059.stdout:checking for linux/fiemap.h... yes 2023-10-16T14:28:15.135 INFO:teuthology.orchestra.run.smithi059.stdout:checking for fallocate... yes 2023-10-16T14:28:15.223 INFO:teuthology.orchestra.run.smithi059.stdout:checking for open_by_handle_at... yes 2023-10-16T14:28:15.301 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/prctl.h usability... yes 2023-10-16T14:28:15.333 INFO:teuthology.orchestra.run.smithi059.stdout:checking sys/prctl.h presence... yes 2023-10-16T14:28:15.333 INFO:teuthology.orchestra.run.smithi059.stdout:checking for sys/prctl.h... yes 2023-10-16T14:28:15.404 INFO:teuthology.orchestra.run.smithi059.stdout:checking linux/fs.h usability... yes 2023-10-16T14:28:15.428 INFO:teuthology.orchestra.run.smithi059.stdout:checking linux/fs.h presence... yes 2023-10-16T14:28:15.428 INFO:teuthology.orchestra.run.smithi059.stdout:checking for linux/fs.h... yes 2023-10-16T14:28:15.489 INFO:teuthology.orchestra.run.smithi059.stdout:checking btrfsutil.h usability... no 2023-10-16T14:28:15.534 INFO:teuthology.orchestra.run.smithi059.stdout:checking btrfsutil.h presence... no 2023-10-16T14:28:15.534 INFO:teuthology.orchestra.run.smithi059.stdout:checking for btrfsutil.h... no 2023-10-16T14:28:15.634 INFO:teuthology.orchestra.run.smithi059.stdout:checking for copy_file_range... yes 2023-10-16T14:28:15.730 INFO:teuthology.orchestra.run.smithi059.stdout:checking for SEEK_DATA... yes 2023-10-16T14:28:15.838 INFO:teuthology.orchestra.run.smithi059.stdout:checking for BMV_OF_SHARED... yes 2023-10-16T14:28:15.935 INFO:teuthology.orchestra.run.smithi059.stdout:checking for nftw... yes 2023-10-16T14:28:16.032 INFO:teuthology.orchestra.run.smithi059.stdout:checking for RLIMIT_NOFILE... yes 2023-10-16T14:28:16.089 INFO:teuthology.orchestra.run.smithi059.stdout:checking for FIEXCHANGE_RANGE... no 2023-10-16T14:28:16.173 INFO:teuthology.orchestra.run.smithi059.stdout:checking for renameat2... yes 2023-10-16T14:28:16.265 INFO:teuthology.orchestra.run.smithi059.stdout:checking for reallocarray... yes 2023-10-16T14:28:16.372 INFO:teuthology.orchestra.run.smithi059.stdout:checking for struct mount_attr... yes 2023-10-16T14:28:16.490 INFO:teuthology.orchestra.run.smithi059.stdout:checking for struct btrfs_qgroup_limit... yes 2023-10-16T14:28:16.604 INFO:teuthology.orchestra.run.smithi059.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-10-16T14:28:16.714 INFO:teuthology.orchestra.run.smithi059.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-10-16T14:28:16.824 INFO:teuthology.orchestra.run.smithi059.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-10-16T14:28:16.943 INFO:teuthology.orchestra.run.smithi059.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-10-16T14:28:17.069 INFO:teuthology.orchestra.run.smithi059.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-10-16T14:28:17.184 INFO:teuthology.orchestra.run.smithi059.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-10-16T14:28:17.264 INFO:teuthology.orchestra.run.smithi059.stdout:checking linux/btrfs.h usability... yes 2023-10-16T14:28:17.294 INFO:teuthology.orchestra.run.smithi059.stdout:checking linux/btrfs.h presence... yes 2023-10-16T14:28:17.295 INFO:teuthology.orchestra.run.smithi059.stdout:checking for linux/btrfs.h... yes 2023-10-16T14:28:17.401 INFO:teuthology.orchestra.run.smithi059.stdout:checking linux/btrfs_tree.h usability... yes 2023-10-16T14:28:17.431 INFO:teuthology.orchestra.run.smithi059.stdout:checking linux/btrfs_tree.h presence... yes 2023-10-16T14:28:17.431 INFO:teuthology.orchestra.run.smithi059.stdout:checking for linux/btrfs_tree.h... yes 2023-10-16T14:28:17.502 INFO:teuthology.orchestra.run.smithi059.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-10-16T14:28:17.547 INFO:teuthology.orchestra.run.smithi059.stdout:configure: creating ./config.status 2023-10-16T14:28:18.934 INFO:teuthology.orchestra.run.smithi059.stdout:config.status: creating include/builddefs 2023-10-16T14:28:18.979 INFO:teuthology.orchestra.run.smithi059.stdout:config.status: creating include/config.h 2023-10-16T14:28:19.012 INFO:teuthology.orchestra.run.smithi059.stdout:config.status: executing libtool commands 2023-10-16T14:28:19.123 INFO:teuthology.orchestra.run.smithi059.stdout:Building include 2023-10-16T14:28:19.134 INFO:teuthology.orchestra.run.smithi059.stdout:Building lib 2023-10-16T14:28:19.146 INFO:teuthology.orchestra.run.smithi059.stdout: [LTDEP] 2023-10-16T14:28:19.496 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] dataascii.lo 2023-10-16T14:28:19.795 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] databin.lo 2023-10-16T14:28:20.117 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] datapid.lo 2023-10-16T14:28:20.390 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] file_lock.lo 2023-10-16T14:28:20.731 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] forker.lo 2023-10-16T14:28:21.023 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] pattern.lo 2023-10-16T14:28:21.310 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] open_flags.lo 2023-10-16T14:28:21.633 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] random_range.lo 2023-10-16T14:28:22.039 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] string_to_tokens.lo 2023-10-16T14:28:22.296 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] str_to_bytes.lo 2023-10-16T14:28:22.607 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] tlibio.lo 2023-10-16T14:28:23.010 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] write_log.lo 2023-10-16T14:28:23.449 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] random.lo 2023-10-16T14:28:23.723 INFO:teuthology.orchestra.run.smithi059.stdout: [LD] 2023-10-16T14:28:23.957 INFO:teuthology.orchestra.run.smithi059.stdout:Building ltp 2023-10-16T14:28:23.967 INFO:teuthology.orchestra.run.smithi059.stdout: [DEP] 2023-10-16T14:28:24.260 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] doio 2023-10-16T14:28:25.239 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fsstress 2023-10-16T14:28:26.989 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fsx 2023-10-16T14:28:27.977 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] growfiles 2023-10-16T14:28:28.723 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] iogen 2023-10-16T14:28:29.308 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-stress 2023-10-16T14:28:29.987 INFO:teuthology.orchestra.run.smithi059.stdout:Building src 2023-10-16T14:28:30.001 INFO:teuthology.orchestra.run.smithi059.stdout: [DEP] 2023-10-16T14:28:32.039 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:28:32.048 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:28:34.015 INFO:teuthology.orchestra.run.smithi059.stdout: [DEP] 2023-10-16T14:28:34.089 INFO:teuthology.orchestra.run.smithi059.stdout: [DEP] 2023-10-16T14:28:34.115 INFO:teuthology.orchestra.run.smithi059.stdout: [DEP] 2023-10-16T14:28:34.643 INFO:teuthology.orchestra.run.smithi059.stdout: [DEP] 2023-10-16T14:28:34.703 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] dirstress 2023-10-16T14:28:35.213 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fill 2023-10-16T14:28:35.569 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fill2 2023-10-16T14:28:36.006 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] getpagesize 2023-10-16T14:28:36.364 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] holes 2023-10-16T14:28:36.778 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] lstat64 2023-10-16T14:28:37.175 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] nametest 2023-10-16T14:28:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] permname 2023-10-16T14:28:38.029 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] randholes 2023-10-16T14:28:38.483 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] runas 2023-10-16T14:28:38.853 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] truncfile 2023-10-16T14:28:39.269 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] usemem 2023-10-16T14:28:39.596 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] mmapcat 2023-10-16T14:28:39.974 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] append_reader 2023-10-16T14:28:40.323 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] append_writer 2023-10-16T14:28:40.690 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] dirperf 2023-10-16T14:28:41.134 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] metaperf 2023-10-16T14:28:41.625 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] devzero 2023-10-16T14:28:42.029 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] feature 2023-10-16T14:28:42.476 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] alloc 2023-10-16T14:28:42.899 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fault 2023-10-16T14:28:43.274 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fstest 2023-10-16T14:28:43.750 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_access_root 2023-10-16T14:28:44.138 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] godown 2023-10-16T14:28:44.515 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] resvtest 2023-10-16T14:28:44.937 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] writemod 2023-10-16T14:28:45.286 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] writev_on_pagefault 2023-10-16T14:28:45.662 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] makeextents 2023-10-16T14:28:46.084 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] itrash 2023-10-16T14:28:46.440 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] rename 2023-10-16T14:28:46.790 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] multi_open_unlink 2023-10-16T14:28:47.184 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] unwritten_sync 2023-10-16T14:28:47.603 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] genhashnames 2023-10-16T14:28:48.003 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_holes 2023-10-16T14:28:48.351 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_mmap_writev 2023-10-16T14:28:48.693 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_truncate_cmtime 2023-10-16T14:28:49.093 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] dirhash_collide 2023-10-16T14:28:49.509 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_rename_overwrite 2023-10-16T14:28:49.859 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] holetest 2023-10-16T14:28:50.313 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_truncate_self 2023-10-16T14:28:50.655 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] af_unix 2023-10-16T14:28:51.056 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_mmap_stale_pmd 2023-10-16T14:28:51.427 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_mmap_cow_race 2023-10-16T14:28:51.825 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_mmap_fallocate 2023-10-16T14:28:52.195 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fsync-err 2023-10-16T14:28:52.588 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_mmap_write_ro 2023-10-16T14:28:52.972 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_ext4_dax_journal_corruption 2023-10-16T14:28:53.307 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_ext4_dax_inline_corruption 2023-10-16T14:28:53.682 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_ofd_locks 2023-10-16T14:28:54.097 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_mmap_collision 2023-10-16T14:28:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] mmap-write-concurrent 2023-10-16T14:28:54.943 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_get_file_time 2023-10-16T14:28:55.305 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_create_short_dirs 2023-10-16T14:28:55.686 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_create_long_dirs 2023-10-16T14:28:56.089 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_enospc 2023-10-16T14:28:56.495 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_mmap_writev_overlap 2023-10-16T14:28:56.872 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] checkpoint_journal 2023-10-16T14:28:57.266 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] mmap-rw-fault 2023-10-16T14:28:57.691 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] allocstale 2023-10-16T14:28:58.066 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_mmap_cow_memory_failure 2023-10-16T14:28:58.415 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fake-dump-rootino 2023-10-16T14:28:58.779 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] dio-buf-fault 2023-10-16T14:28:59.135 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] rewinddir-test 2023-10-16T14:28:59.531 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] xfsctl 2023-10-16T14:28:59.929 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] bstat 2023-10-16T14:29:00.381 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_mtab 2023-10-16T14:29:00.793 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] getdevicesize 2023-10-16T14:29:01.125 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] preallo_rw_pattern_reader 2023-10-16T14:29:01.489 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] preallo_rw_pattern_writer 2023-10-16T14:29:01.849 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] ftrunc 2023-10-16T14:29:02.178 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:29:02.188 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:29:02.198 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] trunc 2023-10-16T14:29:02.513 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fs_perms 2023-10-16T14:29:02.877 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] testx 2023-10-16T14:29:03.188 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] looptest 2023-10-16T14:29:03.607 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] locktest 2023-10-16T14:29:04.150 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] unwritten_mmap 2023-10-16T14:29:04.507 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] bulkstat_unlink_test 2023-10-16T14:29:04.897 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] deduperace 2023-10-16T14:29:05.306 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] bulkstat_unlink_test_modified 2023-10-16T14:29:05.717 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_dir_offset 2023-10-16T14:29:06.060 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_futimens 2023-10-16T14:29:06.399 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_immutable 2023-10-16T14:29:07.299 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] stale_handle 2023-10-16T14:29:07.700 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] pwrite_mmap_blocked 2023-10-16T14:29:08.061 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_dir_offset2 2023-10-16T14:29:08.503 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] seek_sanity_test 2023-10-16T14:29:09.192 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] seek_copy_test 2023-10-16T14:29:09.578 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_readdir_1 2023-10-16T14:29:09.952 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_readdir_2 2023-10-16T14:29:10.285 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fsync-tester 2023-10-16T14:29:10.766 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] nsexec 2023-10-16T14:29:11.159 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] cloner 2023-10-16T14:29:11.557 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] renameat2 2023-10-16T14:29:11.931 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_getcwd 2023-10-16T14:29:12.338 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] e4compact 2023-10-16T14:29:12.764 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] test-nextquota 2023-10-16T14:29:13.145 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] punch-alternating 2023-10-16T14:29:13.535 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] attr-list-by-handle-cursor-test 2023-10-16T14:29:13.925 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] listxattr 2023-10-16T14:29:14.310 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] dio-interleaved 2023-10-16T14:29:14.684 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_dir_type 2023-10-16T14:29:15.077 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] dio-invalidate-cache 2023-10-16T14:29:15.499 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] stat_test 2023-10-16T14:29:15.988 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_encrypted_d_revalidate 2023-10-16T14:29:16.323 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] attr_replace_test 2023-10-16T14:29:16.670 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] swapon 2023-10-16T14:29:17.032 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] mkswap 2023-10-16T14:29:17.418 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_attr_corruption 2023-10-16T14:29:17.804 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_open_tmpfiles 2023-10-16T14:29:18.205 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fscrypt-crypt-util 2023-10-16T14:29:19.136 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] bulkstat_null_ocount 2023-10-16T14:29:19.536 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] splice-test 2023-10-16T14:29:19.964 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] chprojid_fail 2023-10-16T14:29:20.374 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] detached_mounts_propagation 2023-10-16T14:29:20.790 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] ext4_resize 2023-10-16T14:29:21.146 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_readdir_3 2023-10-16T14:29:21.581 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] splice2pipe 2023-10-16T14:29:21.948 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] uuid_ioctl 2023-10-16T14:29:22.304 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fiemap-tester 2023-10-16T14:29:22.808 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_stripealign 2023-10-16T14:29:23.136 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] open_by_handle 2023-10-16T14:29:23.656 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] t_mmap_dio 2023-10-16T14:29:24.019 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] xfsfind 2023-10-16T14:29:24.461 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] fssum 2023-10-16T14:29:25.182 INFO:teuthology.orchestra.run.smithi059.stdout:Building log-writes 2023-10-16T14:29:25.197 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] replay-log 2023-10-16T14:29:25.736 INFO:teuthology.orchestra.run.smithi059.stdout:Building perf 2023-10-16T14:29:25.746 INFO:teuthology.orchestra.run.smithi059.stdout:Building aio-dio-regress 2023-10-16T14:29:25.765 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aiocp 2023-10-16T14:29:26.218 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-append-write-fallocate-race 2023-10-16T14:29:26.596 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-append-write-read-race 2023-10-16T14:29:26.974 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-cow-race 2023-10-16T14:29:27.337 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-cycle-write 2023-10-16T14:29:27.738 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-eof-race 2023-10-16T14:29:28.137 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-extend-stat 2023-10-16T14:29:28.508 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-fcntl-race 2023-10-16T14:29:28.891 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-hole-filling-race 2023-10-16T14:29:29.229 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-invalidate-failure 2023-10-16T14:29:29.598 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-invalidate-readahead 2023-10-16T14:29:29.975 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aiodio_sparse2 2023-10-16T14:29:30.413 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-subblock-eof-read 2023-10-16T14:29:30.751 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-dio-write-verify 2023-10-16T14:29:31.166 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-10-16T14:29:31.533 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-10-16T14:29:31.882 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] aio-last-ref-held-by-io 2023-10-16T14:29:32.253 INFO:teuthology.orchestra.run.smithi059.stdout:Building vfs 2023-10-16T14:29:32.270 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] vfstest 2023-10-16T14:29:32.342 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:29:32.348 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:29:34.726 INFO:teuthology.orchestra.run.smithi059.stdout: [CC] mount-idmapped 2023-10-16T14:29:35.363 INFO:teuthology.orchestra.run.smithi059.stdout:Building m4 2023-10-16T14:29:35.375 INFO:teuthology.orchestra.run.smithi059.stdout:Building common 2023-10-16T14:29:35.386 INFO:teuthology.orchestra.run.smithi059.stdout:Building tests 2023-10-16T14:29:35.404 INFO:teuthology.orchestra.run.smithi059.stdout:Building btrfs 2023-10-16T14:29:35.420 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/btrfs/group.list 2023-10-16T14:29:35.666 INFO:teuthology.orchestra.run.smithi059.stdout:Building ceph 2023-10-16T14:29:35.680 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/ceph/group.list 2023-10-16T14:29:35.740 INFO:teuthology.orchestra.run.smithi059.stdout:Building cifs 2023-10-16T14:29:35.755 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/cifs/group.list 2023-10-16T14:29:35.805 INFO:teuthology.orchestra.run.smithi059.stdout:Building ext4 2023-10-16T14:29:35.821 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/ext4/group.list 2023-10-16T14:29:35.979 INFO:teuthology.orchestra.run.smithi059.stdout:Building f2fs 2023-10-16T14:29:35.995 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/f2fs/group.list 2023-10-16T14:29:36.068 INFO:teuthology.orchestra.run.smithi059.stdout:Building generic 2023-10-16T14:29:36.087 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/generic/group.list 2023-10-16T14:29:36.526 INFO:teuthology.orchestra.run.smithi059.stdout:Building nfs 2023-10-16T14:29:36.542 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/nfs/group.list 2023-10-16T14:29:36.601 INFO:teuthology.orchestra.run.smithi059.stdout:Building ocfs2 2023-10-16T14:29:36.617 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/ocfs2/group.list 2023-10-16T14:29:36.669 INFO:teuthology.orchestra.run.smithi059.stdout:Building overlay 2023-10-16T14:29:36.685 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/overlay/group.list 2023-10-16T14:29:36.858 INFO:teuthology.orchestra.run.smithi059.stdout:Building perf 2023-10-16T14:29:36.876 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/perf/group.list 2023-10-16T14:29:36.923 INFO:teuthology.orchestra.run.smithi059.stdout:Building selftest 2023-10-16T14:29:36.939 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/selftest/group.list 2023-10-16T14:29:36.990 INFO:teuthology.orchestra.run.smithi059.stdout:Building shared 2023-10-16T14:29:37.006 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/shared/group.list 2023-10-16T14:29:37.079 INFO:teuthology.orchestra.run.smithi059.stdout:Building tmpfs 2023-10-16T14:29:37.095 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/tmpfs/group.list 2023-10-16T14:29:37.151 INFO:teuthology.orchestra.run.smithi059.stdout:Building udf 2023-10-16T14:29:37.167 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/udf/group.list 2023-10-16T14:29:37.213 INFO:teuthology.orchestra.run.smithi059.stdout:Building xfs 2023-10-16T14:29:37.232 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/xfs/group.list 2023-10-16T14:29:37.612 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo make install) 2023-10-16T14:29:37.752 INFO:teuthology.orchestra.run.smithi059.stdout:Building include 2023-10-16T14:29:37.762 INFO:teuthology.orchestra.run.smithi059.stdout:Building lib 2023-10-16T14:29:37.774 INFO:teuthology.orchestra.run.smithi059.stdout:Building ltp 2023-10-16T14:29:37.787 INFO:teuthology.orchestra.run.smithi059.stdout:Building src 2023-10-16T14:29:37.879 INFO:teuthology.orchestra.run.smithi059.stdout:Building log-writes 2023-10-16T14:29:37.891 INFO:teuthology.orchestra.run.smithi059.stdout:Building perf 2023-10-16T14:29:37.903 INFO:teuthology.orchestra.run.smithi059.stdout:Building aio-dio-regress 2023-10-16T14:29:37.915 INFO:teuthology.orchestra.run.smithi059.stdout:Building vfs 2023-10-16T14:29:37.929 INFO:teuthology.orchestra.run.smithi059.stdout:Building m4 2023-10-16T14:29:37.941 INFO:teuthology.orchestra.run.smithi059.stdout:Building common 2023-10-16T14:29:37.954 INFO:teuthology.orchestra.run.smithi059.stdout:Building tests 2023-10-16T14:29:37.970 INFO:teuthology.orchestra.run.smithi059.stdout:Building btrfs 2023-10-16T14:29:37.987 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/btrfs/group.list 2023-10-16T14:29:38.212 INFO:teuthology.orchestra.run.smithi059.stdout:Building ceph 2023-10-16T14:29:38.228 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/ceph/group.list 2023-10-16T14:29:38.287 INFO:teuthology.orchestra.run.smithi059.stdout:Building cifs 2023-10-16T14:29:38.303 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/cifs/group.list 2023-10-16T14:29:38.352 INFO:teuthology.orchestra.run.smithi059.stdout:Building ext4 2023-10-16T14:29:38.368 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/ext4/group.list 2023-10-16T14:29:38.524 INFO:teuthology.orchestra.run.smithi059.stdout:Building f2fs 2023-10-16T14:29:38.540 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/f2fs/group.list 2023-10-16T14:29:38.612 INFO:teuthology.orchestra.run.smithi059.stdout:Building generic 2023-10-16T14:29:38.630 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/generic/group.list 2023-10-16T14:29:39.022 INFO:teuthology.orchestra.run.smithi059.stdout:Building nfs 2023-10-16T14:29:39.037 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/nfs/group.list 2023-10-16T14:29:39.097 INFO:teuthology.orchestra.run.smithi059.stdout:Building ocfs2 2023-10-16T14:29:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/ocfs2/group.list 2023-10-16T14:29:39.166 INFO:teuthology.orchestra.run.smithi059.stdout:Building overlay 2023-10-16T14:29:39.181 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/overlay/group.list 2023-10-16T14:29:39.341 INFO:teuthology.orchestra.run.smithi059.stdout:Building perf 2023-10-16T14:29:39.356 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/perf/group.list 2023-10-16T14:29:39.401 INFO:teuthology.orchestra.run.smithi059.stdout:Building selftest 2023-10-16T14:29:39.417 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/selftest/group.list 2023-10-16T14:29:39.468 INFO:teuthology.orchestra.run.smithi059.stdout:Building shared 2023-10-16T14:29:39.484 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/shared/group.list 2023-10-16T14:29:39.556 INFO:teuthology.orchestra.run.smithi059.stdout:Building tmpfs 2023-10-16T14:29:39.572 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/tmpfs/group.list 2023-10-16T14:29:39.627 INFO:teuthology.orchestra.run.smithi059.stdout:Building udf 2023-10-16T14:29:39.643 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/udf/group.list 2023-10-16T14:29:39.689 INFO:teuthology.orchestra.run.smithi059.stdout:Building xfs 2023-10-16T14:29:39.708 INFO:teuthology.orchestra.run.smithi059.stdout: [GROUP] /tmp/tmp.AzguH69EDZxfstests-dev/tests/xfs/group.list 2023-10-16T14:29:40.089 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-10-16T14:29:40.093 INFO:teuthology.orchestra.run.smithi059.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-16T14:29:40.094 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-10-16T14:29:40.098 INFO:teuthology.orchestra.run.smithi059.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-16T14:29:40.099 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-10-16T14:29:40.104 INFO:teuthology.orchestra.run.smithi059.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-10-16T14:29:40.140 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-10-16T14:29:40.413 INFO:teuthology.orchestra.run.smithi059.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-10-16T14:29:40.451 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-10-16T14:29:40.501 INFO:teuthology.orchestra.run.smithi059.stdout:Building log-writes 2023-10-16T14:29:40.513 INFO:teuthology.orchestra.run.smithi059.stdout:Building perf 2023-10-16T14:29:40.525 INFO:teuthology.orchestra.run.smithi059.stdout:Building aio-dio-regress 2023-10-16T14:29:40.538 INFO:teuthology.orchestra.run.smithi059.stdout:Building vfs 2023-10-16T14:29:40.547 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake -C log-writes install 2023-10-16T14:29:40.551 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-10-16T14:29:40.584 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-10-16T14:29:40.615 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake -C perf install 2023-10-16T14:29:40.619 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-10-16T14:29:40.654 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-10-16T14:29:40.746 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-10-16T14:29:40.750 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-10-16T14:29:40.785 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-10-16T14:29:40.995 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake -C vfs install 2023-10-16T14:29:40.999 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-10-16T14:29:41.032 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-10-16T14:29:41.074 INFO:teuthology.orchestra.run.smithi059.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-10-16T14:29:41.110 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-10-16T14:29:45.875 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-10-16T14:29:46.257 INFO:teuthology.orchestra.run.smithi059.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-10-16T14:29:46.335 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-10-16T14:29:46.340 INFO:teuthology.orchestra.run.smithi059.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-16T14:29:46.340 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-10-16T14:29:46.344 INFO:teuthology.orchestra.run.smithi059.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-10-16T14:29:46.380 INFO:teuthology.orchestra.run.smithi059.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-10-16T14:29:46.998 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-10-16T14:29:47.003 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AzguH69EDZxfstests-dev/tests/btrfs/ install 2023-10-16T14:29:47.011 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-10-16T14:29:47.047 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 299 300 /var/lib/xfstests/tests/btrfs 2023-10-16T14:29:50.681 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-10-16T14:29:50.716 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 299.out 300.out /var/lib/xfstests/tests/btrfs 2023-10-16T14:29:54.218 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AzguH69EDZxfstests-dev/tests/ceph/ install 2023-10-16T14:29:54.222 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-10-16T14:29:54.258 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-10-16T14:29:54.337 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-10-16T14:29:54.374 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-10-16T14:29:54.456 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AzguH69EDZxfstests-dev/tests/cifs/ install 2023-10-16T14:29:54.461 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-10-16T14:29:54.497 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-10-16T14:29:54.533 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-10-16T14:29:54.571 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-10-16T14:29:54.608 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AzguH69EDZxfstests-dev/tests/ext4/ install 2023-10-16T14:29:54.613 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-10-16T14:29:54.650 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-10-16T14:29:55.548 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-10-16T14:29:55.588 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-10-16T14:29:56.508 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AzguH69EDZxfstests-dev/tests/f2fs/ install 2023-10-16T14:29:56.513 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-10-16T14:29:56.550 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-10-16T14:29:56.597 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-10-16T14:29:56.632 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-10-16T14:29:56.681 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AzguH69EDZxfstests-dev/tests/generic/ install 2023-10-16T14:29:56.696 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-10-16T14:29:56.732 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 /var/lib/xfstests/tests/generic 2023-10-16T14:30:02.485 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:30:02.492 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:30:05.288 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-10-16T14:30:05.322 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out /var/lib/xfstests/tests/generic 2023-10-16T14:30:14.444 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AzguH69EDZxfstests-dev/tests/nfs/ install 2023-10-16T14:30:14.448 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-10-16T14:30:14.485 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-10-16T14:30:14.521 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-10-16T14:30:14.556 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-10-16T14:30:14.595 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AzguH69EDZxfstests-dev/tests/ocfs2/ install 2023-10-16T14:30:14.599 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-10-16T14:30:14.636 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-10-16T14:30:14.672 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-10-16T14:30:14.707 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-10-16T14:30:14.744 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AzguH69EDZxfstests-dev/tests/overlay/ install 2023-10-16T14:30:14.749 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-10-16T14:30:14.785 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-10-16T14:30:15.890 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-10-16T14:30:15.924 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-10-16T14:30:17.199 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AzguH69EDZxfstests-dev/tests/perf/ install 2023-10-16T14:30:17.203 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-10-16T14:30:17.240 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-10-16T14:30:17.278 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-10-16T14:30:17.314 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-10-16T14:30:17.355 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AzguH69EDZxfstests-dev/tests/selftest/ install 2023-10-16T14:30:17.356 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-10-16T14:30:17.394 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-10-16T14:30:17.486 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-10-16T14:30:17.523 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-10-16T14:30:17.615 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AzguH69EDZxfstests-dev/tests/shared/ install 2023-10-16T14:30:17.619 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-10-16T14:30:17.655 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-10-16T14:30:17.717 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-10-16T14:30:17.752 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-10-16T14:30:17.811 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AzguH69EDZxfstests-dev/tests/tmpfs/ install 2023-10-16T14:30:17.816 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-10-16T14:30:17.851 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-10-16T14:30:17.888 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-10-16T14:30:17.925 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-10-16T14:30:17.962 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AzguH69EDZxfstests-dev/tests/udf/ install 2023-10-16T14:30:17.966 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-10-16T14:30:18.001 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-10-16T14:30:18.037 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-10-16T14:30:18.072 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-10-16T14:30:18.109 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.AzguH69EDZxfstests-dev/tests/xfs/ install 2023-10-16T14:30:18.119 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-10-16T14:30:18.155 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-10-16T14:30:27.047 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-10-16T14:30:27.086 INFO:teuthology.orchestra.run.smithi059.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-10-16T14:30:32.628 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:30:32.635 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:30:35.023 INFO:teuthology.orchestra.run.smithi059.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-10-16T14:30:35.058 INFO:teuthology.orchestra.run.smithi059.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-10-16T14:30:35.093 INFO:teuthology.orchestra.run.smithi059.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-10-16T14:30:35.129 INFO:teuthology.orchestra.run.smithi059.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-10-16T14:30:35.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T14:30:35.172 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec ls tests/generic) 2023-10-16T14:30:35.231 INFO:teuthology.orchestra.run.smithi059.stdout:001 2023-10-16T14:30:35.232 INFO:teuthology.orchestra.run.smithi059.stdout:001.out 2023-10-16T14:30:35.232 INFO:teuthology.orchestra.run.smithi059.stdout:002 2023-10-16T14:30:35.232 INFO:teuthology.orchestra.run.smithi059.stdout:002.out 2023-10-16T14:30:35.232 INFO:teuthology.orchestra.run.smithi059.stdout:003 2023-10-16T14:30:35.232 INFO:teuthology.orchestra.run.smithi059.stdout:003.out 2023-10-16T14:30:35.233 INFO:teuthology.orchestra.run.smithi059.stdout:004 2023-10-16T14:30:35.233 INFO:teuthology.orchestra.run.smithi059.stdout:004.out 2023-10-16T14:30:35.233 INFO:teuthology.orchestra.run.smithi059.stdout:005 2023-10-16T14:30:35.233 INFO:teuthology.orchestra.run.smithi059.stdout:005.out 2023-10-16T14:30:35.233 INFO:teuthology.orchestra.run.smithi059.stdout:006 2023-10-16T14:30:35.234 INFO:teuthology.orchestra.run.smithi059.stdout:006.out 2023-10-16T14:30:35.234 INFO:teuthology.orchestra.run.smithi059.stdout:007 2023-10-16T14:30:35.234 INFO:teuthology.orchestra.run.smithi059.stdout:007.out 2023-10-16T14:30:35.234 INFO:teuthology.orchestra.run.smithi059.stdout:008 2023-10-16T14:30:35.235 INFO:teuthology.orchestra.run.smithi059.stdout:008.out 2023-10-16T14:30:35.235 INFO:teuthology.orchestra.run.smithi059.stdout:009 2023-10-16T14:30:35.235 INFO:teuthology.orchestra.run.smithi059.stdout:009.out 2023-10-16T14:30:35.235 INFO:teuthology.orchestra.run.smithi059.stdout:010 2023-10-16T14:30:35.235 INFO:teuthology.orchestra.run.smithi059.stdout:010.out 2023-10-16T14:30:35.236 INFO:teuthology.orchestra.run.smithi059.stdout:011 2023-10-16T14:30:35.236 INFO:teuthology.orchestra.run.smithi059.stdout:011.out 2023-10-16T14:30:35.236 INFO:teuthology.orchestra.run.smithi059.stdout:012 2023-10-16T14:30:35.236 INFO:teuthology.orchestra.run.smithi059.stdout:012.out 2023-10-16T14:30:35.236 INFO:teuthology.orchestra.run.smithi059.stdout:013 2023-10-16T14:30:35.237 INFO:teuthology.orchestra.run.smithi059.stdout:013.out 2023-10-16T14:30:35.237 INFO:teuthology.orchestra.run.smithi059.stdout:014 2023-10-16T14:30:35.237 INFO:teuthology.orchestra.run.smithi059.stdout:014.out 2023-10-16T14:30:35.237 INFO:teuthology.orchestra.run.smithi059.stdout:015 2023-10-16T14:30:35.237 INFO:teuthology.orchestra.run.smithi059.stdout:015.out 2023-10-16T14:30:35.238 INFO:teuthology.orchestra.run.smithi059.stdout:016 2023-10-16T14:30:35.238 INFO:teuthology.orchestra.run.smithi059.stdout:016.out 2023-10-16T14:30:35.238 INFO:teuthology.orchestra.run.smithi059.stdout:017 2023-10-16T14:30:35.238 INFO:teuthology.orchestra.run.smithi059.stdout:017.out 2023-10-16T14:30:35.238 INFO:teuthology.orchestra.run.smithi059.stdout:018 2023-10-16T14:30:35.239 INFO:teuthology.orchestra.run.smithi059.stdout:018.out 2023-10-16T14:30:35.239 INFO:teuthology.orchestra.run.smithi059.stdout:019 2023-10-16T14:30:35.239 INFO:teuthology.orchestra.run.smithi059.stdout:019.out 2023-10-16T14:30:35.239 INFO:teuthology.orchestra.run.smithi059.stdout:020 2023-10-16T14:30:35.239 INFO:teuthology.orchestra.run.smithi059.stdout:020.out 2023-10-16T14:30:35.240 INFO:teuthology.orchestra.run.smithi059.stdout:021 2023-10-16T14:30:35.240 INFO:teuthology.orchestra.run.smithi059.stdout:021.out 2023-10-16T14:30:35.240 INFO:teuthology.orchestra.run.smithi059.stdout:022 2023-10-16T14:30:35.240 INFO:teuthology.orchestra.run.smithi059.stdout:022.out 2023-10-16T14:30:35.240 INFO:teuthology.orchestra.run.smithi059.stdout:023 2023-10-16T14:30:35.241 INFO:teuthology.orchestra.run.smithi059.stdout:023.out 2023-10-16T14:30:35.241 INFO:teuthology.orchestra.run.smithi059.stdout:024 2023-10-16T14:30:35.241 INFO:teuthology.orchestra.run.smithi059.stdout:024.out 2023-10-16T14:30:35.241 INFO:teuthology.orchestra.run.smithi059.stdout:025 2023-10-16T14:30:35.242 INFO:teuthology.orchestra.run.smithi059.stdout:025.out 2023-10-16T14:30:35.242 INFO:teuthology.orchestra.run.smithi059.stdout:026 2023-10-16T14:30:35.242 INFO:teuthology.orchestra.run.smithi059.stdout:026.out 2023-10-16T14:30:35.242 INFO:teuthology.orchestra.run.smithi059.stdout:027 2023-10-16T14:30:35.242 INFO:teuthology.orchestra.run.smithi059.stdout:027.out 2023-10-16T14:30:35.242 INFO:teuthology.orchestra.run.smithi059.stdout:028 2023-10-16T14:30:35.243 INFO:teuthology.orchestra.run.smithi059.stdout:028.out 2023-10-16T14:30:35.243 INFO:teuthology.orchestra.run.smithi059.stdout:029 2023-10-16T14:30:35.243 INFO:teuthology.orchestra.run.smithi059.stdout:029.out 2023-10-16T14:30:35.243 INFO:teuthology.orchestra.run.smithi059.stdout:030 2023-10-16T14:30:35.243 INFO:teuthology.orchestra.run.smithi059.stdout:030.out 2023-10-16T14:30:35.244 INFO:teuthology.orchestra.run.smithi059.stdout:031 2023-10-16T14:30:35.244 INFO:teuthology.orchestra.run.smithi059.stdout:031.out 2023-10-16T14:30:35.244 INFO:teuthology.orchestra.run.smithi059.stdout:032 2023-10-16T14:30:35.244 INFO:teuthology.orchestra.run.smithi059.stdout:032.out 2023-10-16T14:30:35.244 INFO:teuthology.orchestra.run.smithi059.stdout:033 2023-10-16T14:30:35.245 INFO:teuthology.orchestra.run.smithi059.stdout:033.out 2023-10-16T14:30:35.245 INFO:teuthology.orchestra.run.smithi059.stdout:034 2023-10-16T14:30:35.245 INFO:teuthology.orchestra.run.smithi059.stdout:034.out 2023-10-16T14:30:35.245 INFO:teuthology.orchestra.run.smithi059.stdout:035 2023-10-16T14:30:35.245 INFO:teuthology.orchestra.run.smithi059.stdout:035.cfg 2023-10-16T14:30:35.246 INFO:teuthology.orchestra.run.smithi059.stdout:035.out.default 2023-10-16T14:30:35.246 INFO:teuthology.orchestra.run.smithi059.stdout:035.out.nfs 2023-10-16T14:30:35.246 INFO:teuthology.orchestra.run.smithi059.stdout:036 2023-10-16T14:30:35.246 INFO:teuthology.orchestra.run.smithi059.stdout:036.out 2023-10-16T14:30:35.246 INFO:teuthology.orchestra.run.smithi059.stdout:037 2023-10-16T14:30:35.246 INFO:teuthology.orchestra.run.smithi059.stdout:037.out 2023-10-16T14:30:35.247 INFO:teuthology.orchestra.run.smithi059.stdout:038 2023-10-16T14:30:35.247 INFO:teuthology.orchestra.run.smithi059.stdout:038.out 2023-10-16T14:30:35.247 INFO:teuthology.orchestra.run.smithi059.stdout:039 2023-10-16T14:30:35.247 INFO:teuthology.orchestra.run.smithi059.stdout:039.out 2023-10-16T14:30:35.247 INFO:teuthology.orchestra.run.smithi059.stdout:040 2023-10-16T14:30:35.248 INFO:teuthology.orchestra.run.smithi059.stdout:040.out 2023-10-16T14:30:35.248 INFO:teuthology.orchestra.run.smithi059.stdout:041 2023-10-16T14:30:35.248 INFO:teuthology.orchestra.run.smithi059.stdout:041.out 2023-10-16T14:30:35.248 INFO:teuthology.orchestra.run.smithi059.stdout:042 2023-10-16T14:30:35.248 INFO:teuthology.orchestra.run.smithi059.stdout:042.out 2023-10-16T14:30:35.248 INFO:teuthology.orchestra.run.smithi059.stdout:043 2023-10-16T14:30:35.249 INFO:teuthology.orchestra.run.smithi059.stdout:043.out 2023-10-16T14:30:35.249 INFO:teuthology.orchestra.run.smithi059.stdout:044 2023-10-16T14:30:35.249 INFO:teuthology.orchestra.run.smithi059.stdout:044.out 2023-10-16T14:30:35.249 INFO:teuthology.orchestra.run.smithi059.stdout:045 2023-10-16T14:30:35.249 INFO:teuthology.orchestra.run.smithi059.stdout:045.out 2023-10-16T14:30:35.250 INFO:teuthology.orchestra.run.smithi059.stdout:046 2023-10-16T14:30:35.250 INFO:teuthology.orchestra.run.smithi059.stdout:046.out 2023-10-16T14:30:35.250 INFO:teuthology.orchestra.run.smithi059.stdout:047 2023-10-16T14:30:35.250 INFO:teuthology.orchestra.run.smithi059.stdout:047.out 2023-10-16T14:30:35.250 INFO:teuthology.orchestra.run.smithi059.stdout:048 2023-10-16T14:30:35.251 INFO:teuthology.orchestra.run.smithi059.stdout:048.out 2023-10-16T14:30:35.251 INFO:teuthology.orchestra.run.smithi059.stdout:049 2023-10-16T14:30:35.251 INFO:teuthology.orchestra.run.smithi059.stdout:049.out 2023-10-16T14:30:35.251 INFO:teuthology.orchestra.run.smithi059.stdout:050 2023-10-16T14:30:35.251 INFO:teuthology.orchestra.run.smithi059.stdout:050.cfg 2023-10-16T14:30:35.252 INFO:teuthology.orchestra.run.smithi059.stdout:050.out.default 2023-10-16T14:30:35.252 INFO:teuthology.orchestra.run.smithi059.stdout:050.out.nojournal 2023-10-16T14:30:35.252 INFO:teuthology.orchestra.run.smithi059.stdout:050.out.xfsquota 2023-10-16T14:30:35.252 INFO:teuthology.orchestra.run.smithi059.stdout:051 2023-10-16T14:30:35.252 INFO:teuthology.orchestra.run.smithi059.stdout:051.out 2023-10-16T14:30:35.252 INFO:teuthology.orchestra.run.smithi059.stdout:052 2023-10-16T14:30:35.253 INFO:teuthology.orchestra.run.smithi059.stdout:052.out 2023-10-16T14:30:35.253 INFO:teuthology.orchestra.run.smithi059.stdout:053 2023-10-16T14:30:35.253 INFO:teuthology.orchestra.run.smithi059.stdout:053.out 2023-10-16T14:30:35.253 INFO:teuthology.orchestra.run.smithi059.stdout:054 2023-10-16T14:30:35.253 INFO:teuthology.orchestra.run.smithi059.stdout:054.out 2023-10-16T14:30:35.254 INFO:teuthology.orchestra.run.smithi059.stdout:055 2023-10-16T14:30:35.254 INFO:teuthology.orchestra.run.smithi059.stdout:055.out 2023-10-16T14:30:35.254 INFO:teuthology.orchestra.run.smithi059.stdout:056 2023-10-16T14:30:35.254 INFO:teuthology.orchestra.run.smithi059.stdout:056.out 2023-10-16T14:30:35.254 INFO:teuthology.orchestra.run.smithi059.stdout:057 2023-10-16T14:30:35.255 INFO:teuthology.orchestra.run.smithi059.stdout:057.out 2023-10-16T14:30:35.255 INFO:teuthology.orchestra.run.smithi059.stdout:058 2023-10-16T14:30:35.255 INFO:teuthology.orchestra.run.smithi059.stdout:058.out 2023-10-16T14:30:35.255 INFO:teuthology.orchestra.run.smithi059.stdout:059 2023-10-16T14:30:35.255 INFO:teuthology.orchestra.run.smithi059.stdout:059.out 2023-10-16T14:30:35.256 INFO:teuthology.orchestra.run.smithi059.stdout:060 2023-10-16T14:30:35.256 INFO:teuthology.orchestra.run.smithi059.stdout:060.out 2023-10-16T14:30:35.256 INFO:teuthology.orchestra.run.smithi059.stdout:061 2023-10-16T14:30:35.256 INFO:teuthology.orchestra.run.smithi059.stdout:061.out 2023-10-16T14:30:35.256 INFO:teuthology.orchestra.run.smithi059.stdout:062 2023-10-16T14:30:35.256 INFO:teuthology.orchestra.run.smithi059.stdout:062.out 2023-10-16T14:30:35.257 INFO:teuthology.orchestra.run.smithi059.stdout:063 2023-10-16T14:30:35.257 INFO:teuthology.orchestra.run.smithi059.stdout:063.out 2023-10-16T14:30:35.257 INFO:teuthology.orchestra.run.smithi059.stdout:064 2023-10-16T14:30:35.257 INFO:teuthology.orchestra.run.smithi059.stdout:064.out 2023-10-16T14:30:35.257 INFO:teuthology.orchestra.run.smithi059.stdout:065 2023-10-16T14:30:35.258 INFO:teuthology.orchestra.run.smithi059.stdout:065.out 2023-10-16T14:30:35.258 INFO:teuthology.orchestra.run.smithi059.stdout:066 2023-10-16T14:30:35.258 INFO:teuthology.orchestra.run.smithi059.stdout:066.out 2023-10-16T14:30:35.258 INFO:teuthology.orchestra.run.smithi059.stdout:067 2023-10-16T14:30:35.258 INFO:teuthology.orchestra.run.smithi059.stdout:067.out 2023-10-16T14:30:35.259 INFO:teuthology.orchestra.run.smithi059.stdout:068 2023-10-16T14:30:35.259 INFO:teuthology.orchestra.run.smithi059.stdout:068.out 2023-10-16T14:30:35.259 INFO:teuthology.orchestra.run.smithi059.stdout:069 2023-10-16T14:30:35.259 INFO:teuthology.orchestra.run.smithi059.stdout:069.out 2023-10-16T14:30:35.259 INFO:teuthology.orchestra.run.smithi059.stdout:070 2023-10-16T14:30:35.259 INFO:teuthology.orchestra.run.smithi059.stdout:070.out 2023-10-16T14:30:35.260 INFO:teuthology.orchestra.run.smithi059.stdout:071 2023-10-16T14:30:35.260 INFO:teuthology.orchestra.run.smithi059.stdout:071.out 2023-10-16T14:30:35.260 INFO:teuthology.orchestra.run.smithi059.stdout:072 2023-10-16T14:30:35.260 INFO:teuthology.orchestra.run.smithi059.stdout:072.out 2023-10-16T14:30:35.260 INFO:teuthology.orchestra.run.smithi059.stdout:073 2023-10-16T14:30:35.261 INFO:teuthology.orchestra.run.smithi059.stdout:073.out 2023-10-16T14:30:35.261 INFO:teuthology.orchestra.run.smithi059.stdout:074 2023-10-16T14:30:35.261 INFO:teuthology.orchestra.run.smithi059.stdout:074.out 2023-10-16T14:30:35.261 INFO:teuthology.orchestra.run.smithi059.stdout:075 2023-10-16T14:30:35.261 INFO:teuthology.orchestra.run.smithi059.stdout:075.out 2023-10-16T14:30:35.261 INFO:teuthology.orchestra.run.smithi059.stdout:076 2023-10-16T14:30:35.262 INFO:teuthology.orchestra.run.smithi059.stdout:076.out 2023-10-16T14:30:35.262 INFO:teuthology.orchestra.run.smithi059.stdout:077 2023-10-16T14:30:35.262 INFO:teuthology.orchestra.run.smithi059.stdout:077.out 2023-10-16T14:30:35.262 INFO:teuthology.orchestra.run.smithi059.stdout:078 2023-10-16T14:30:35.262 INFO:teuthology.orchestra.run.smithi059.stdout:078.out 2023-10-16T14:30:35.263 INFO:teuthology.orchestra.run.smithi059.stdout:079 2023-10-16T14:30:35.263 INFO:teuthology.orchestra.run.smithi059.stdout:079.out 2023-10-16T14:30:35.263 INFO:teuthology.orchestra.run.smithi059.stdout:080 2023-10-16T14:30:35.263 INFO:teuthology.orchestra.run.smithi059.stdout:080.out 2023-10-16T14:30:35.263 INFO:teuthology.orchestra.run.smithi059.stdout:081 2023-10-16T14:30:35.263 INFO:teuthology.orchestra.run.smithi059.stdout:081.out 2023-10-16T14:30:35.264 INFO:teuthology.orchestra.run.smithi059.stdout:082 2023-10-16T14:30:35.264 INFO:teuthology.orchestra.run.smithi059.stdout:082.out 2023-10-16T14:30:35.264 INFO:teuthology.orchestra.run.smithi059.stdout:083 2023-10-16T14:30:35.264 INFO:teuthology.orchestra.run.smithi059.stdout:083.out 2023-10-16T14:30:35.264 INFO:teuthology.orchestra.run.smithi059.stdout:084 2023-10-16T14:30:35.265 INFO:teuthology.orchestra.run.smithi059.stdout:084.out 2023-10-16T14:30:35.265 INFO:teuthology.orchestra.run.smithi059.stdout:085 2023-10-16T14:30:35.265 INFO:teuthology.orchestra.run.smithi059.stdout:085.out 2023-10-16T14:30:35.265 INFO:teuthology.orchestra.run.smithi059.stdout:086 2023-10-16T14:30:35.265 INFO:teuthology.orchestra.run.smithi059.stdout:086.out 2023-10-16T14:30:35.265 INFO:teuthology.orchestra.run.smithi059.stdout:087 2023-10-16T14:30:35.266 INFO:teuthology.orchestra.run.smithi059.stdout:087.out 2023-10-16T14:30:35.266 INFO:teuthology.orchestra.run.smithi059.stdout:088 2023-10-16T14:30:35.266 INFO:teuthology.orchestra.run.smithi059.stdout:088.out 2023-10-16T14:30:35.266 INFO:teuthology.orchestra.run.smithi059.stdout:089 2023-10-16T14:30:35.266 INFO:teuthology.orchestra.run.smithi059.stdout:089.out 2023-10-16T14:30:35.267 INFO:teuthology.orchestra.run.smithi059.stdout:090 2023-10-16T14:30:35.267 INFO:teuthology.orchestra.run.smithi059.stdout:090.out 2023-10-16T14:30:35.267 INFO:teuthology.orchestra.run.smithi059.stdout:091 2023-10-16T14:30:35.267 INFO:teuthology.orchestra.run.smithi059.stdout:091.out 2023-10-16T14:30:35.267 INFO:teuthology.orchestra.run.smithi059.stdout:092 2023-10-16T14:30:35.267 INFO:teuthology.orchestra.run.smithi059.stdout:092.out 2023-10-16T14:30:35.268 INFO:teuthology.orchestra.run.smithi059.stdout:093 2023-10-16T14:30:35.268 INFO:teuthology.orchestra.run.smithi059.stdout:093.out 2023-10-16T14:30:35.268 INFO:teuthology.orchestra.run.smithi059.stdout:094 2023-10-16T14:30:35.268 INFO:teuthology.orchestra.run.smithi059.stdout:094.out 2023-10-16T14:30:35.268 INFO:teuthology.orchestra.run.smithi059.stdout:095 2023-10-16T14:30:35.269 INFO:teuthology.orchestra.run.smithi059.stdout:095.out 2023-10-16T14:30:35.269 INFO:teuthology.orchestra.run.smithi059.stdout:096 2023-10-16T14:30:35.269 INFO:teuthology.orchestra.run.smithi059.stdout:096.out 2023-10-16T14:30:35.269 INFO:teuthology.orchestra.run.smithi059.stdout:097 2023-10-16T14:30:35.269 INFO:teuthology.orchestra.run.smithi059.stdout:097.out 2023-10-16T14:30:35.270 INFO:teuthology.orchestra.run.smithi059.stdout:098 2023-10-16T14:30:35.270 INFO:teuthology.orchestra.run.smithi059.stdout:098.out 2023-10-16T14:30:35.270 INFO:teuthology.orchestra.run.smithi059.stdout:099 2023-10-16T14:30:35.270 INFO:teuthology.orchestra.run.smithi059.stdout:099.out 2023-10-16T14:30:35.270 INFO:teuthology.orchestra.run.smithi059.stdout:100 2023-10-16T14:30:35.271 INFO:teuthology.orchestra.run.smithi059.stdout:100.out 2023-10-16T14:30:35.271 INFO:teuthology.orchestra.run.smithi059.stdout:101 2023-10-16T14:30:35.271 INFO:teuthology.orchestra.run.smithi059.stdout:101.out 2023-10-16T14:30:35.271 INFO:teuthology.orchestra.run.smithi059.stdout:102 2023-10-16T14:30:35.271 INFO:teuthology.orchestra.run.smithi059.stdout:102.out 2023-10-16T14:30:35.272 INFO:teuthology.orchestra.run.smithi059.stdout:103 2023-10-16T14:30:35.272 INFO:teuthology.orchestra.run.smithi059.stdout:103.out 2023-10-16T14:30:35.272 INFO:teuthology.orchestra.run.smithi059.stdout:104 2023-10-16T14:30:35.272 INFO:teuthology.orchestra.run.smithi059.stdout:104.out 2023-10-16T14:30:35.272 INFO:teuthology.orchestra.run.smithi059.stdout:105 2023-10-16T14:30:35.272 INFO:teuthology.orchestra.run.smithi059.stdout:105.out 2023-10-16T14:30:35.273 INFO:teuthology.orchestra.run.smithi059.stdout:106 2023-10-16T14:30:35.273 INFO:teuthology.orchestra.run.smithi059.stdout:106.out 2023-10-16T14:30:35.273 INFO:teuthology.orchestra.run.smithi059.stdout:107 2023-10-16T14:30:35.273 INFO:teuthology.orchestra.run.smithi059.stdout:107.out 2023-10-16T14:30:35.273 INFO:teuthology.orchestra.run.smithi059.stdout:108 2023-10-16T14:30:35.274 INFO:teuthology.orchestra.run.smithi059.stdout:108.out 2023-10-16T14:30:35.274 INFO:teuthology.orchestra.run.smithi059.stdout:109 2023-10-16T14:30:35.274 INFO:teuthology.orchestra.run.smithi059.stdout:109.out 2023-10-16T14:30:35.274 INFO:teuthology.orchestra.run.smithi059.stdout:110 2023-10-16T14:30:35.274 INFO:teuthology.orchestra.run.smithi059.stdout:110.out 2023-10-16T14:30:35.275 INFO:teuthology.orchestra.run.smithi059.stdout:111 2023-10-16T14:30:35.275 INFO:teuthology.orchestra.run.smithi059.stdout:111.out 2023-10-16T14:30:35.275 INFO:teuthology.orchestra.run.smithi059.stdout:112 2023-10-16T14:30:35.275 INFO:teuthology.orchestra.run.smithi059.stdout:112.out 2023-10-16T14:30:35.275 INFO:teuthology.orchestra.run.smithi059.stdout:113 2023-10-16T14:30:35.275 INFO:teuthology.orchestra.run.smithi059.stdout:113.out 2023-10-16T14:30:35.276 INFO:teuthology.orchestra.run.smithi059.stdout:114 2023-10-16T14:30:35.276 INFO:teuthology.orchestra.run.smithi059.stdout:114.out 2023-10-16T14:30:35.276 INFO:teuthology.orchestra.run.smithi059.stdout:115 2023-10-16T14:30:35.276 INFO:teuthology.orchestra.run.smithi059.stdout:115.out 2023-10-16T14:30:35.276 INFO:teuthology.orchestra.run.smithi059.stdout:116 2023-10-16T14:30:35.276 INFO:teuthology.orchestra.run.smithi059.stdout:116.out 2023-10-16T14:30:35.277 INFO:teuthology.orchestra.run.smithi059.stdout:117 2023-10-16T14:30:35.277 INFO:teuthology.orchestra.run.smithi059.stdout:117.out 2023-10-16T14:30:35.277 INFO:teuthology.orchestra.run.smithi059.stdout:118 2023-10-16T14:30:35.277 INFO:teuthology.orchestra.run.smithi059.stdout:118.out 2023-10-16T14:30:35.277 INFO:teuthology.orchestra.run.smithi059.stdout:119 2023-10-16T14:30:35.278 INFO:teuthology.orchestra.run.smithi059.stdout:119.out 2023-10-16T14:30:35.278 INFO:teuthology.orchestra.run.smithi059.stdout:120 2023-10-16T14:30:35.278 INFO:teuthology.orchestra.run.smithi059.stdout:120.out 2023-10-16T14:30:35.278 INFO:teuthology.orchestra.run.smithi059.stdout:121 2023-10-16T14:30:35.278 INFO:teuthology.orchestra.run.smithi059.stdout:121.out 2023-10-16T14:30:35.279 INFO:teuthology.orchestra.run.smithi059.stdout:122 2023-10-16T14:30:35.279 INFO:teuthology.orchestra.run.smithi059.stdout:122.out 2023-10-16T14:30:35.279 INFO:teuthology.orchestra.run.smithi059.stdout:123 2023-10-16T14:30:35.279 INFO:teuthology.orchestra.run.smithi059.stdout:123.out 2023-10-16T14:30:35.279 INFO:teuthology.orchestra.run.smithi059.stdout:124 2023-10-16T14:30:35.279 INFO:teuthology.orchestra.run.smithi059.stdout:124.out 2023-10-16T14:30:35.280 INFO:teuthology.orchestra.run.smithi059.stdout:125 2023-10-16T14:30:35.280 INFO:teuthology.orchestra.run.smithi059.stdout:125.out 2023-10-16T14:30:35.280 INFO:teuthology.orchestra.run.smithi059.stdout:126 2023-10-16T14:30:35.280 INFO:teuthology.orchestra.run.smithi059.stdout:126.out 2023-10-16T14:30:35.280 INFO:teuthology.orchestra.run.smithi059.stdout:127 2023-10-16T14:30:35.281 INFO:teuthology.orchestra.run.smithi059.stdout:127.out 2023-10-16T14:30:35.281 INFO:teuthology.orchestra.run.smithi059.stdout:128 2023-10-16T14:30:35.281 INFO:teuthology.orchestra.run.smithi059.stdout:128.out 2023-10-16T14:30:35.281 INFO:teuthology.orchestra.run.smithi059.stdout:129 2023-10-16T14:30:35.281 INFO:teuthology.orchestra.run.smithi059.stdout:129.out 2023-10-16T14:30:35.282 INFO:teuthology.orchestra.run.smithi059.stdout:130 2023-10-16T14:30:35.282 INFO:teuthology.orchestra.run.smithi059.stdout:130.out 2023-10-16T14:30:35.282 INFO:teuthology.orchestra.run.smithi059.stdout:131 2023-10-16T14:30:35.282 INFO:teuthology.orchestra.run.smithi059.stdout:131.out 2023-10-16T14:30:35.282 INFO:teuthology.orchestra.run.smithi059.stdout:132 2023-10-16T14:30:35.283 INFO:teuthology.orchestra.run.smithi059.stdout:132.out 2023-10-16T14:30:35.283 INFO:teuthology.orchestra.run.smithi059.stdout:133 2023-10-16T14:30:35.283 INFO:teuthology.orchestra.run.smithi059.stdout:133.out 2023-10-16T14:30:35.283 INFO:teuthology.orchestra.run.smithi059.stdout:134 2023-10-16T14:30:35.283 INFO:teuthology.orchestra.run.smithi059.stdout:134.out 2023-10-16T14:30:35.284 INFO:teuthology.orchestra.run.smithi059.stdout:135 2023-10-16T14:30:35.284 INFO:teuthology.orchestra.run.smithi059.stdout:135.out 2023-10-16T14:30:35.284 INFO:teuthology.orchestra.run.smithi059.stdout:136 2023-10-16T14:30:35.284 INFO:teuthology.orchestra.run.smithi059.stdout:136.out 2023-10-16T14:30:35.284 INFO:teuthology.orchestra.run.smithi059.stdout:137 2023-10-16T14:30:35.284 INFO:teuthology.orchestra.run.smithi059.stdout:137.out 2023-10-16T14:30:35.285 INFO:teuthology.orchestra.run.smithi059.stdout:138 2023-10-16T14:30:35.285 INFO:teuthology.orchestra.run.smithi059.stdout:138.out 2023-10-16T14:30:35.285 INFO:teuthology.orchestra.run.smithi059.stdout:139 2023-10-16T14:30:35.285 INFO:teuthology.orchestra.run.smithi059.stdout:139.out 2023-10-16T14:30:35.285 INFO:teuthology.orchestra.run.smithi059.stdout:140 2023-10-16T14:30:35.285 INFO:teuthology.orchestra.run.smithi059.stdout:140.out 2023-10-16T14:30:35.286 INFO:teuthology.orchestra.run.smithi059.stdout:141 2023-10-16T14:30:35.286 INFO:teuthology.orchestra.run.smithi059.stdout:141.out 2023-10-16T14:30:35.286 INFO:teuthology.orchestra.run.smithi059.stdout:142 2023-10-16T14:30:35.286 INFO:teuthology.orchestra.run.smithi059.stdout:142.out 2023-10-16T14:30:35.286 INFO:teuthology.orchestra.run.smithi059.stdout:143 2023-10-16T14:30:35.287 INFO:teuthology.orchestra.run.smithi059.stdout:143.out 2023-10-16T14:30:35.287 INFO:teuthology.orchestra.run.smithi059.stdout:144 2023-10-16T14:30:35.287 INFO:teuthology.orchestra.run.smithi059.stdout:144.out 2023-10-16T14:30:35.287 INFO:teuthology.orchestra.run.smithi059.stdout:145 2023-10-16T14:30:35.287 INFO:teuthology.orchestra.run.smithi059.stdout:145.out 2023-10-16T14:30:35.287 INFO:teuthology.orchestra.run.smithi059.stdout:146 2023-10-16T14:30:35.288 INFO:teuthology.orchestra.run.smithi059.stdout:146.out 2023-10-16T14:30:35.288 INFO:teuthology.orchestra.run.smithi059.stdout:147 2023-10-16T14:30:35.288 INFO:teuthology.orchestra.run.smithi059.stdout:147.out 2023-10-16T14:30:35.288 INFO:teuthology.orchestra.run.smithi059.stdout:148 2023-10-16T14:30:35.288 INFO:teuthology.orchestra.run.smithi059.stdout:148.out 2023-10-16T14:30:35.289 INFO:teuthology.orchestra.run.smithi059.stdout:149 2023-10-16T14:30:35.289 INFO:teuthology.orchestra.run.smithi059.stdout:149.out 2023-10-16T14:30:35.289 INFO:teuthology.orchestra.run.smithi059.stdout:150 2023-10-16T14:30:35.289 INFO:teuthology.orchestra.run.smithi059.stdout:150.out 2023-10-16T14:30:35.289 INFO:teuthology.orchestra.run.smithi059.stdout:151 2023-10-16T14:30:35.290 INFO:teuthology.orchestra.run.smithi059.stdout:151.out 2023-10-16T14:30:35.290 INFO:teuthology.orchestra.run.smithi059.stdout:152 2023-10-16T14:30:35.290 INFO:teuthology.orchestra.run.smithi059.stdout:152.out 2023-10-16T14:30:35.290 INFO:teuthology.orchestra.run.smithi059.stdout:153 2023-10-16T14:30:35.290 INFO:teuthology.orchestra.run.smithi059.stdout:153.out 2023-10-16T14:30:35.291 INFO:teuthology.orchestra.run.smithi059.stdout:154 2023-10-16T14:30:35.291 INFO:teuthology.orchestra.run.smithi059.stdout:154.out 2023-10-16T14:30:35.291 INFO:teuthology.orchestra.run.smithi059.stdout:155 2023-10-16T14:30:35.291 INFO:teuthology.orchestra.run.smithi059.stdout:155.out 2023-10-16T14:30:35.291 INFO:teuthology.orchestra.run.smithi059.stdout:156 2023-10-16T14:30:35.291 INFO:teuthology.orchestra.run.smithi059.stdout:156.out 2023-10-16T14:30:35.292 INFO:teuthology.orchestra.run.smithi059.stdout:157 2023-10-16T14:30:35.292 INFO:teuthology.orchestra.run.smithi059.stdout:157.out 2023-10-16T14:30:35.292 INFO:teuthology.orchestra.run.smithi059.stdout:158 2023-10-16T14:30:35.292 INFO:teuthology.orchestra.run.smithi059.stdout:158.out 2023-10-16T14:30:35.292 INFO:teuthology.orchestra.run.smithi059.stdout:159 2023-10-16T14:30:35.293 INFO:teuthology.orchestra.run.smithi059.stdout:159.out 2023-10-16T14:30:35.293 INFO:teuthology.orchestra.run.smithi059.stdout:160 2023-10-16T14:30:35.293 INFO:teuthology.orchestra.run.smithi059.stdout:160.out 2023-10-16T14:30:35.293 INFO:teuthology.orchestra.run.smithi059.stdout:161 2023-10-16T14:30:35.293 INFO:teuthology.orchestra.run.smithi059.stdout:161.out 2023-10-16T14:30:35.293 INFO:teuthology.orchestra.run.smithi059.stdout:162 2023-10-16T14:30:35.294 INFO:teuthology.orchestra.run.smithi059.stdout:162.out 2023-10-16T14:30:35.294 INFO:teuthology.orchestra.run.smithi059.stdout:163 2023-10-16T14:30:35.294 INFO:teuthology.orchestra.run.smithi059.stdout:163.out 2023-10-16T14:30:35.294 INFO:teuthology.orchestra.run.smithi059.stdout:164 2023-10-16T14:30:35.294 INFO:teuthology.orchestra.run.smithi059.stdout:164.out 2023-10-16T14:30:35.295 INFO:teuthology.orchestra.run.smithi059.stdout:165 2023-10-16T14:30:35.295 INFO:teuthology.orchestra.run.smithi059.stdout:165.out 2023-10-16T14:30:35.295 INFO:teuthology.orchestra.run.smithi059.stdout:166 2023-10-16T14:30:35.295 INFO:teuthology.orchestra.run.smithi059.stdout:166.out 2023-10-16T14:30:35.295 INFO:teuthology.orchestra.run.smithi059.stdout:167 2023-10-16T14:30:35.296 INFO:teuthology.orchestra.run.smithi059.stdout:167.out 2023-10-16T14:30:35.296 INFO:teuthology.orchestra.run.smithi059.stdout:168 2023-10-16T14:30:35.296 INFO:teuthology.orchestra.run.smithi059.stdout:168.out 2023-10-16T14:30:35.296 INFO:teuthology.orchestra.run.smithi059.stdout:169 2023-10-16T14:30:35.296 INFO:teuthology.orchestra.run.smithi059.stdout:169.out 2023-10-16T14:30:35.296 INFO:teuthology.orchestra.run.smithi059.stdout:170 2023-10-16T14:30:35.297 INFO:teuthology.orchestra.run.smithi059.stdout:170.out 2023-10-16T14:30:35.297 INFO:teuthology.orchestra.run.smithi059.stdout:171 2023-10-16T14:30:35.297 INFO:teuthology.orchestra.run.smithi059.stdout:171.out 2023-10-16T14:30:35.297 INFO:teuthology.orchestra.run.smithi059.stdout:172 2023-10-16T14:30:35.297 INFO:teuthology.orchestra.run.smithi059.stdout:172.out 2023-10-16T14:30:35.298 INFO:teuthology.orchestra.run.smithi059.stdout:173 2023-10-16T14:30:35.298 INFO:teuthology.orchestra.run.smithi059.stdout:173.out 2023-10-16T14:30:35.298 INFO:teuthology.orchestra.run.smithi059.stdout:174 2023-10-16T14:30:35.298 INFO:teuthology.orchestra.run.smithi059.stdout:174.out 2023-10-16T14:30:35.298 INFO:teuthology.orchestra.run.smithi059.stdout:175 2023-10-16T14:30:35.299 INFO:teuthology.orchestra.run.smithi059.stdout:175.out 2023-10-16T14:30:35.299 INFO:teuthology.orchestra.run.smithi059.stdout:176 2023-10-16T14:30:35.299 INFO:teuthology.orchestra.run.smithi059.stdout:176.out 2023-10-16T14:30:35.299 INFO:teuthology.orchestra.run.smithi059.stdout:177 2023-10-16T14:30:35.299 INFO:teuthology.orchestra.run.smithi059.stdout:177.out 2023-10-16T14:30:35.299 INFO:teuthology.orchestra.run.smithi059.stdout:178 2023-10-16T14:30:35.300 INFO:teuthology.orchestra.run.smithi059.stdout:178.out 2023-10-16T14:30:35.300 INFO:teuthology.orchestra.run.smithi059.stdout:179 2023-10-16T14:30:35.300 INFO:teuthology.orchestra.run.smithi059.stdout:179.out 2023-10-16T14:30:35.300 INFO:teuthology.orchestra.run.smithi059.stdout:180 2023-10-16T14:30:35.300 INFO:teuthology.orchestra.run.smithi059.stdout:180.out 2023-10-16T14:30:35.301 INFO:teuthology.orchestra.run.smithi059.stdout:181 2023-10-16T14:30:35.301 INFO:teuthology.orchestra.run.smithi059.stdout:181.out 2023-10-16T14:30:35.301 INFO:teuthology.orchestra.run.smithi059.stdout:182 2023-10-16T14:30:35.301 INFO:teuthology.orchestra.run.smithi059.stdout:182.out 2023-10-16T14:30:35.301 INFO:teuthology.orchestra.run.smithi059.stdout:183 2023-10-16T14:30:35.302 INFO:teuthology.orchestra.run.smithi059.stdout:183.out 2023-10-16T14:30:35.302 INFO:teuthology.orchestra.run.smithi059.stdout:184 2023-10-16T14:30:35.302 INFO:teuthology.orchestra.run.smithi059.stdout:184.out 2023-10-16T14:30:35.302 INFO:teuthology.orchestra.run.smithi059.stdout:185 2023-10-16T14:30:35.302 INFO:teuthology.orchestra.run.smithi059.stdout:185.out 2023-10-16T14:30:35.303 INFO:teuthology.orchestra.run.smithi059.stdout:186 2023-10-16T14:30:35.303 INFO:teuthology.orchestra.run.smithi059.stdout:186.out 2023-10-16T14:30:35.303 INFO:teuthology.orchestra.run.smithi059.stdout:187 2023-10-16T14:30:35.303 INFO:teuthology.orchestra.run.smithi059.stdout:187.out 2023-10-16T14:30:35.303 INFO:teuthology.orchestra.run.smithi059.stdout:188 2023-10-16T14:30:35.303 INFO:teuthology.orchestra.run.smithi059.stdout:188.out 2023-10-16T14:30:35.304 INFO:teuthology.orchestra.run.smithi059.stdout:189 2023-10-16T14:30:35.304 INFO:teuthology.orchestra.run.smithi059.stdout:189.out 2023-10-16T14:30:35.304 INFO:teuthology.orchestra.run.smithi059.stdout:190 2023-10-16T14:30:35.304 INFO:teuthology.orchestra.run.smithi059.stdout:190.out 2023-10-16T14:30:35.304 INFO:teuthology.orchestra.run.smithi059.stdout:191 2023-10-16T14:30:35.305 INFO:teuthology.orchestra.run.smithi059.stdout:191.out 2023-10-16T14:30:35.305 INFO:teuthology.orchestra.run.smithi059.stdout:192 2023-10-16T14:30:35.305 INFO:teuthology.orchestra.run.smithi059.stdout:192.out 2023-10-16T14:30:35.305 INFO:teuthology.orchestra.run.smithi059.stdout:193 2023-10-16T14:30:35.305 INFO:teuthology.orchestra.run.smithi059.stdout:193.out 2023-10-16T14:30:35.305 INFO:teuthology.orchestra.run.smithi059.stdout:194 2023-10-16T14:30:35.306 INFO:teuthology.orchestra.run.smithi059.stdout:194.out 2023-10-16T14:30:35.306 INFO:teuthology.orchestra.run.smithi059.stdout:195 2023-10-16T14:30:35.306 INFO:teuthology.orchestra.run.smithi059.stdout:195.out 2023-10-16T14:30:35.306 INFO:teuthology.orchestra.run.smithi059.stdout:196 2023-10-16T14:30:35.306 INFO:teuthology.orchestra.run.smithi059.stdout:196.out 2023-10-16T14:30:35.307 INFO:teuthology.orchestra.run.smithi059.stdout:197 2023-10-16T14:30:35.307 INFO:teuthology.orchestra.run.smithi059.stdout:197.out 2023-10-16T14:30:35.307 INFO:teuthology.orchestra.run.smithi059.stdout:198 2023-10-16T14:30:35.307 INFO:teuthology.orchestra.run.smithi059.stdout:198.out 2023-10-16T14:30:35.307 INFO:teuthology.orchestra.run.smithi059.stdout:199 2023-10-16T14:30:35.308 INFO:teuthology.orchestra.run.smithi059.stdout:199.out 2023-10-16T14:30:35.308 INFO:teuthology.orchestra.run.smithi059.stdout:200 2023-10-16T14:30:35.308 INFO:teuthology.orchestra.run.smithi059.stdout:200.out 2023-10-16T14:30:35.308 INFO:teuthology.orchestra.run.smithi059.stdout:201 2023-10-16T14:30:35.308 INFO:teuthology.orchestra.run.smithi059.stdout:201.out 2023-10-16T14:30:35.309 INFO:teuthology.orchestra.run.smithi059.stdout:202 2023-10-16T14:30:35.309 INFO:teuthology.orchestra.run.smithi059.stdout:202.out 2023-10-16T14:30:35.309 INFO:teuthology.orchestra.run.smithi059.stdout:203 2023-10-16T14:30:35.309 INFO:teuthology.orchestra.run.smithi059.stdout:203.out 2023-10-16T14:30:35.309 INFO:teuthology.orchestra.run.smithi059.stdout:204 2023-10-16T14:30:35.309 INFO:teuthology.orchestra.run.smithi059.stdout:204.out 2023-10-16T14:30:35.310 INFO:teuthology.orchestra.run.smithi059.stdout:205 2023-10-16T14:30:35.310 INFO:teuthology.orchestra.run.smithi059.stdout:205.out 2023-10-16T14:30:35.310 INFO:teuthology.orchestra.run.smithi059.stdout:206 2023-10-16T14:30:35.310 INFO:teuthology.orchestra.run.smithi059.stdout:206.out 2023-10-16T14:30:35.310 INFO:teuthology.orchestra.run.smithi059.stdout:207 2023-10-16T14:30:35.311 INFO:teuthology.orchestra.run.smithi059.stdout:207.out 2023-10-16T14:30:35.311 INFO:teuthology.orchestra.run.smithi059.stdout:208 2023-10-16T14:30:35.311 INFO:teuthology.orchestra.run.smithi059.stdout:208.out 2023-10-16T14:30:35.313 INFO:teuthology.orchestra.run.smithi059.stdout:209 2023-10-16T14:30:35.313 INFO:teuthology.orchestra.run.smithi059.stdout:209.out 2023-10-16T14:30:35.313 INFO:teuthology.orchestra.run.smithi059.stdout:210 2023-10-16T14:30:35.314 INFO:teuthology.orchestra.run.smithi059.stdout:210.out 2023-10-16T14:30:35.314 INFO:teuthology.orchestra.run.smithi059.stdout:211 2023-10-16T14:30:35.314 INFO:teuthology.orchestra.run.smithi059.stdout:211.out 2023-10-16T14:30:35.314 INFO:teuthology.orchestra.run.smithi059.stdout:212 2023-10-16T14:30:35.314 INFO:teuthology.orchestra.run.smithi059.stdout:212.out 2023-10-16T14:30:35.315 INFO:teuthology.orchestra.run.smithi059.stdout:213 2023-10-16T14:30:35.315 INFO:teuthology.orchestra.run.smithi059.stdout:213.out 2023-10-16T14:30:35.315 INFO:teuthology.orchestra.run.smithi059.stdout:214 2023-10-16T14:30:35.315 INFO:teuthology.orchestra.run.smithi059.stdout:214.out 2023-10-16T14:30:35.315 INFO:teuthology.orchestra.run.smithi059.stdout:215 2023-10-16T14:30:35.316 INFO:teuthology.orchestra.run.smithi059.stdout:215.out 2023-10-16T14:30:35.316 INFO:teuthology.orchestra.run.smithi059.stdout:216 2023-10-16T14:30:35.316 INFO:teuthology.orchestra.run.smithi059.stdout:216.out 2023-10-16T14:30:35.316 INFO:teuthology.orchestra.run.smithi059.stdout:217 2023-10-16T14:30:35.316 INFO:teuthology.orchestra.run.smithi059.stdout:217.out 2023-10-16T14:30:35.317 INFO:teuthology.orchestra.run.smithi059.stdout:218 2023-10-16T14:30:35.317 INFO:teuthology.orchestra.run.smithi059.stdout:218.out 2023-10-16T14:30:35.317 INFO:teuthology.orchestra.run.smithi059.stdout:219 2023-10-16T14:30:35.317 INFO:teuthology.orchestra.run.smithi059.stdout:219.out 2023-10-16T14:30:35.317 INFO:teuthology.orchestra.run.smithi059.stdout:220 2023-10-16T14:30:35.317 INFO:teuthology.orchestra.run.smithi059.stdout:220.out 2023-10-16T14:30:35.318 INFO:teuthology.orchestra.run.smithi059.stdout:221 2023-10-16T14:30:35.318 INFO:teuthology.orchestra.run.smithi059.stdout:221.out 2023-10-16T14:30:35.318 INFO:teuthology.orchestra.run.smithi059.stdout:222 2023-10-16T14:30:35.318 INFO:teuthology.orchestra.run.smithi059.stdout:222.out 2023-10-16T14:30:35.318 INFO:teuthology.orchestra.run.smithi059.stdout:223 2023-10-16T14:30:35.319 INFO:teuthology.orchestra.run.smithi059.stdout:223.out 2023-10-16T14:30:35.319 INFO:teuthology.orchestra.run.smithi059.stdout:224 2023-10-16T14:30:35.319 INFO:teuthology.orchestra.run.smithi059.stdout:224.out 2023-10-16T14:30:35.319 INFO:teuthology.orchestra.run.smithi059.stdout:225 2023-10-16T14:30:35.319 INFO:teuthology.orchestra.run.smithi059.stdout:225.out 2023-10-16T14:30:35.320 INFO:teuthology.orchestra.run.smithi059.stdout:226 2023-10-16T14:30:35.320 INFO:teuthology.orchestra.run.smithi059.stdout:226.out 2023-10-16T14:30:35.320 INFO:teuthology.orchestra.run.smithi059.stdout:227 2023-10-16T14:30:35.320 INFO:teuthology.orchestra.run.smithi059.stdout:227.out 2023-10-16T14:30:35.320 INFO:teuthology.orchestra.run.smithi059.stdout:228 2023-10-16T14:30:35.321 INFO:teuthology.orchestra.run.smithi059.stdout:228.out 2023-10-16T14:30:35.321 INFO:teuthology.orchestra.run.smithi059.stdout:229 2023-10-16T14:30:35.321 INFO:teuthology.orchestra.run.smithi059.stdout:229.out 2023-10-16T14:30:35.321 INFO:teuthology.orchestra.run.smithi059.stdout:230 2023-10-16T14:30:35.321 INFO:teuthology.orchestra.run.smithi059.stdout:230.out 2023-10-16T14:30:35.322 INFO:teuthology.orchestra.run.smithi059.stdout:231 2023-10-16T14:30:35.322 INFO:teuthology.orchestra.run.smithi059.stdout:231.out 2023-10-16T14:30:35.322 INFO:teuthology.orchestra.run.smithi059.stdout:232 2023-10-16T14:30:35.322 INFO:teuthology.orchestra.run.smithi059.stdout:232.out 2023-10-16T14:30:35.322 INFO:teuthology.orchestra.run.smithi059.stdout:233 2023-10-16T14:30:35.323 INFO:teuthology.orchestra.run.smithi059.stdout:233.out 2023-10-16T14:30:35.323 INFO:teuthology.orchestra.run.smithi059.stdout:234 2023-10-16T14:30:35.323 INFO:teuthology.orchestra.run.smithi059.stdout:234.out 2023-10-16T14:30:35.323 INFO:teuthology.orchestra.run.smithi059.stdout:235 2023-10-16T14:30:35.323 INFO:teuthology.orchestra.run.smithi059.stdout:235.out 2023-10-16T14:30:35.323 INFO:teuthology.orchestra.run.smithi059.stdout:236 2023-10-16T14:30:35.324 INFO:teuthology.orchestra.run.smithi059.stdout:236.out 2023-10-16T14:30:35.324 INFO:teuthology.orchestra.run.smithi059.stdout:237 2023-10-16T14:30:35.324 INFO:teuthology.orchestra.run.smithi059.stdout:237.out 2023-10-16T14:30:35.324 INFO:teuthology.orchestra.run.smithi059.stdout:238 2023-10-16T14:30:35.324 INFO:teuthology.orchestra.run.smithi059.stdout:238.out 2023-10-16T14:30:35.325 INFO:teuthology.orchestra.run.smithi059.stdout:239 2023-10-16T14:30:35.325 INFO:teuthology.orchestra.run.smithi059.stdout:239.out 2023-10-16T14:30:35.325 INFO:teuthology.orchestra.run.smithi059.stdout:240 2023-10-16T14:30:35.325 INFO:teuthology.orchestra.run.smithi059.stdout:240.out 2023-10-16T14:30:35.325 INFO:teuthology.orchestra.run.smithi059.stdout:241 2023-10-16T14:30:35.325 INFO:teuthology.orchestra.run.smithi059.stdout:241.out 2023-10-16T14:30:35.326 INFO:teuthology.orchestra.run.smithi059.stdout:242 2023-10-16T14:30:35.326 INFO:teuthology.orchestra.run.smithi059.stdout:242.out 2023-10-16T14:30:35.326 INFO:teuthology.orchestra.run.smithi059.stdout:243 2023-10-16T14:30:35.326 INFO:teuthology.orchestra.run.smithi059.stdout:243.out 2023-10-16T14:30:35.326 INFO:teuthology.orchestra.run.smithi059.stdout:244 2023-10-16T14:30:35.327 INFO:teuthology.orchestra.run.smithi059.stdout:244.out 2023-10-16T14:30:35.327 INFO:teuthology.orchestra.run.smithi059.stdout:245 2023-10-16T14:30:35.327 INFO:teuthology.orchestra.run.smithi059.stdout:245.out 2023-10-16T14:30:35.327 INFO:teuthology.orchestra.run.smithi059.stdout:246 2023-10-16T14:30:35.327 INFO:teuthology.orchestra.run.smithi059.stdout:246.out 2023-10-16T14:30:35.327 INFO:teuthology.orchestra.run.smithi059.stdout:247 2023-10-16T14:30:35.328 INFO:teuthology.orchestra.run.smithi059.stdout:247.out 2023-10-16T14:30:35.328 INFO:teuthology.orchestra.run.smithi059.stdout:248 2023-10-16T14:30:35.328 INFO:teuthology.orchestra.run.smithi059.stdout:248.out 2023-10-16T14:30:35.328 INFO:teuthology.orchestra.run.smithi059.stdout:249 2023-10-16T14:30:35.328 INFO:teuthology.orchestra.run.smithi059.stdout:249.out 2023-10-16T14:30:35.329 INFO:teuthology.orchestra.run.smithi059.stdout:250 2023-10-16T14:30:35.329 INFO:teuthology.orchestra.run.smithi059.stdout:250.out 2023-10-16T14:30:35.329 INFO:teuthology.orchestra.run.smithi059.stdout:251 2023-10-16T14:30:35.329 INFO:teuthology.orchestra.run.smithi059.stdout:251.out 2023-10-16T14:30:35.329 INFO:teuthology.orchestra.run.smithi059.stdout:252 2023-10-16T14:30:35.329 INFO:teuthology.orchestra.run.smithi059.stdout:252.out 2023-10-16T14:30:35.330 INFO:teuthology.orchestra.run.smithi059.stdout:253 2023-10-16T14:30:35.330 INFO:teuthology.orchestra.run.smithi059.stdout:253.out 2023-10-16T14:30:35.330 INFO:teuthology.orchestra.run.smithi059.stdout:254 2023-10-16T14:30:35.330 INFO:teuthology.orchestra.run.smithi059.stdout:254.out 2023-10-16T14:30:35.330 INFO:teuthology.orchestra.run.smithi059.stdout:255 2023-10-16T14:30:35.330 INFO:teuthology.orchestra.run.smithi059.stdout:255.out 2023-10-16T14:30:35.331 INFO:teuthology.orchestra.run.smithi059.stdout:256 2023-10-16T14:30:35.331 INFO:teuthology.orchestra.run.smithi059.stdout:256.out 2023-10-16T14:30:35.331 INFO:teuthology.orchestra.run.smithi059.stdout:257 2023-10-16T14:30:35.331 INFO:teuthology.orchestra.run.smithi059.stdout:257.out 2023-10-16T14:30:35.331 INFO:teuthology.orchestra.run.smithi059.stdout:258 2023-10-16T14:30:35.332 INFO:teuthology.orchestra.run.smithi059.stdout:258.out 2023-10-16T14:30:35.332 INFO:teuthology.orchestra.run.smithi059.stdout:259 2023-10-16T14:30:35.332 INFO:teuthology.orchestra.run.smithi059.stdout:259.out 2023-10-16T14:30:35.332 INFO:teuthology.orchestra.run.smithi059.stdout:260 2023-10-16T14:30:35.332 INFO:teuthology.orchestra.run.smithi059.stdout:260.out 2023-10-16T14:30:35.332 INFO:teuthology.orchestra.run.smithi059.stdout:261 2023-10-16T14:30:35.333 INFO:teuthology.orchestra.run.smithi059.stdout:261.out 2023-10-16T14:30:35.333 INFO:teuthology.orchestra.run.smithi059.stdout:262 2023-10-16T14:30:35.333 INFO:teuthology.orchestra.run.smithi059.stdout:262.out 2023-10-16T14:30:35.333 INFO:teuthology.orchestra.run.smithi059.stdout:263 2023-10-16T14:30:35.333 INFO:teuthology.orchestra.run.smithi059.stdout:263.out 2023-10-16T14:30:35.334 INFO:teuthology.orchestra.run.smithi059.stdout:264 2023-10-16T14:30:35.334 INFO:teuthology.orchestra.run.smithi059.stdout:264.out 2023-10-16T14:30:35.334 INFO:teuthology.orchestra.run.smithi059.stdout:265 2023-10-16T14:30:35.334 INFO:teuthology.orchestra.run.smithi059.stdout:265.out 2023-10-16T14:30:35.334 INFO:teuthology.orchestra.run.smithi059.stdout:266 2023-10-16T14:30:35.335 INFO:teuthology.orchestra.run.smithi059.stdout:266.out 2023-10-16T14:30:35.335 INFO:teuthology.orchestra.run.smithi059.stdout:267 2023-10-16T14:30:35.335 INFO:teuthology.orchestra.run.smithi059.stdout:267.out 2023-10-16T14:30:35.335 INFO:teuthology.orchestra.run.smithi059.stdout:268 2023-10-16T14:30:35.335 INFO:teuthology.orchestra.run.smithi059.stdout:268.out 2023-10-16T14:30:35.335 INFO:teuthology.orchestra.run.smithi059.stdout:269 2023-10-16T14:30:35.336 INFO:teuthology.orchestra.run.smithi059.stdout:269.out 2023-10-16T14:30:35.336 INFO:teuthology.orchestra.run.smithi059.stdout:270 2023-10-16T14:30:35.336 INFO:teuthology.orchestra.run.smithi059.stdout:270.out 2023-10-16T14:30:35.336 INFO:teuthology.orchestra.run.smithi059.stdout:271 2023-10-16T14:30:35.336 INFO:teuthology.orchestra.run.smithi059.stdout:271.out 2023-10-16T14:30:35.337 INFO:teuthology.orchestra.run.smithi059.stdout:272 2023-10-16T14:30:35.337 INFO:teuthology.orchestra.run.smithi059.stdout:272.out 2023-10-16T14:30:35.337 INFO:teuthology.orchestra.run.smithi059.stdout:273 2023-10-16T14:30:35.337 INFO:teuthology.orchestra.run.smithi059.stdout:273.out 2023-10-16T14:30:35.337 INFO:teuthology.orchestra.run.smithi059.stdout:274 2023-10-16T14:30:35.338 INFO:teuthology.orchestra.run.smithi059.stdout:274.out 2023-10-16T14:30:35.338 INFO:teuthology.orchestra.run.smithi059.stdout:275 2023-10-16T14:30:35.338 INFO:teuthology.orchestra.run.smithi059.stdout:275.out 2023-10-16T14:30:35.338 INFO:teuthology.orchestra.run.smithi059.stdout:276 2023-10-16T14:30:35.338 INFO:teuthology.orchestra.run.smithi059.stdout:276.out 2023-10-16T14:30:35.338 INFO:teuthology.orchestra.run.smithi059.stdout:277 2023-10-16T14:30:35.339 INFO:teuthology.orchestra.run.smithi059.stdout:277.out 2023-10-16T14:30:35.339 INFO:teuthology.orchestra.run.smithi059.stdout:278 2023-10-16T14:30:35.339 INFO:teuthology.orchestra.run.smithi059.stdout:278.out 2023-10-16T14:30:35.339 INFO:teuthology.orchestra.run.smithi059.stdout:279 2023-10-16T14:30:35.339 INFO:teuthology.orchestra.run.smithi059.stdout:279.out 2023-10-16T14:30:35.340 INFO:teuthology.orchestra.run.smithi059.stdout:280 2023-10-16T14:30:35.340 INFO:teuthology.orchestra.run.smithi059.stdout:280.out 2023-10-16T14:30:35.340 INFO:teuthology.orchestra.run.smithi059.stdout:281 2023-10-16T14:30:35.340 INFO:teuthology.orchestra.run.smithi059.stdout:281.out 2023-10-16T14:30:35.340 INFO:teuthology.orchestra.run.smithi059.stdout:282 2023-10-16T14:30:35.340 INFO:teuthology.orchestra.run.smithi059.stdout:282.out 2023-10-16T14:30:35.341 INFO:teuthology.orchestra.run.smithi059.stdout:283 2023-10-16T14:30:35.341 INFO:teuthology.orchestra.run.smithi059.stdout:283.out 2023-10-16T14:30:35.341 INFO:teuthology.orchestra.run.smithi059.stdout:284 2023-10-16T14:30:35.341 INFO:teuthology.orchestra.run.smithi059.stdout:284.out 2023-10-16T14:30:35.341 INFO:teuthology.orchestra.run.smithi059.stdout:285 2023-10-16T14:30:35.341 INFO:teuthology.orchestra.run.smithi059.stdout:285.out 2023-10-16T14:30:35.342 INFO:teuthology.orchestra.run.smithi059.stdout:286 2023-10-16T14:30:35.342 INFO:teuthology.orchestra.run.smithi059.stdout:286.out 2023-10-16T14:30:35.342 INFO:teuthology.orchestra.run.smithi059.stdout:287 2023-10-16T14:30:35.342 INFO:teuthology.orchestra.run.smithi059.stdout:287.out 2023-10-16T14:30:35.342 INFO:teuthology.orchestra.run.smithi059.stdout:288 2023-10-16T14:30:35.343 INFO:teuthology.orchestra.run.smithi059.stdout:288.out 2023-10-16T14:30:35.343 INFO:teuthology.orchestra.run.smithi059.stdout:289 2023-10-16T14:30:35.343 INFO:teuthology.orchestra.run.smithi059.stdout:289.out 2023-10-16T14:30:35.343 INFO:teuthology.orchestra.run.smithi059.stdout:290 2023-10-16T14:30:35.343 INFO:teuthology.orchestra.run.smithi059.stdout:290.out 2023-10-16T14:30:35.343 INFO:teuthology.orchestra.run.smithi059.stdout:291 2023-10-16T14:30:35.344 INFO:teuthology.orchestra.run.smithi059.stdout:291.out 2023-10-16T14:30:35.344 INFO:teuthology.orchestra.run.smithi059.stdout:292 2023-10-16T14:30:35.344 INFO:teuthology.orchestra.run.smithi059.stdout:292.out 2023-10-16T14:30:35.344 INFO:teuthology.orchestra.run.smithi059.stdout:293 2023-10-16T14:30:35.344 INFO:teuthology.orchestra.run.smithi059.stdout:293.out 2023-10-16T14:30:35.345 INFO:teuthology.orchestra.run.smithi059.stdout:294 2023-10-16T14:30:35.345 INFO:teuthology.orchestra.run.smithi059.stdout:294.out 2023-10-16T14:30:35.345 INFO:teuthology.orchestra.run.smithi059.stdout:295 2023-10-16T14:30:35.345 INFO:teuthology.orchestra.run.smithi059.stdout:295.out 2023-10-16T14:30:35.345 INFO:teuthology.orchestra.run.smithi059.stdout:296 2023-10-16T14:30:35.346 INFO:teuthology.orchestra.run.smithi059.stdout:296.out 2023-10-16T14:30:35.346 INFO:teuthology.orchestra.run.smithi059.stdout:297 2023-10-16T14:30:35.346 INFO:teuthology.orchestra.run.smithi059.stdout:297.out 2023-10-16T14:30:35.346 INFO:teuthology.orchestra.run.smithi059.stdout:298 2023-10-16T14:30:35.346 INFO:teuthology.orchestra.run.smithi059.stdout:298.out 2023-10-16T14:30:35.347 INFO:teuthology.orchestra.run.smithi059.stdout:299 2023-10-16T14:30:35.347 INFO:teuthology.orchestra.run.smithi059.stdout:299.out 2023-10-16T14:30:35.347 INFO:teuthology.orchestra.run.smithi059.stdout:300 2023-10-16T14:30:35.347 INFO:teuthology.orchestra.run.smithi059.stdout:300.out 2023-10-16T14:30:35.347 INFO:teuthology.orchestra.run.smithi059.stdout:301 2023-10-16T14:30:35.348 INFO:teuthology.orchestra.run.smithi059.stdout:301.out 2023-10-16T14:30:35.348 INFO:teuthology.orchestra.run.smithi059.stdout:302 2023-10-16T14:30:35.348 INFO:teuthology.orchestra.run.smithi059.stdout:302.out 2023-10-16T14:30:35.348 INFO:teuthology.orchestra.run.smithi059.stdout:303 2023-10-16T14:30:35.348 INFO:teuthology.orchestra.run.smithi059.stdout:303.out 2023-10-16T14:30:35.348 INFO:teuthology.orchestra.run.smithi059.stdout:304 2023-10-16T14:30:35.349 INFO:teuthology.orchestra.run.smithi059.stdout:304.out 2023-10-16T14:30:35.349 INFO:teuthology.orchestra.run.smithi059.stdout:305 2023-10-16T14:30:35.349 INFO:teuthology.orchestra.run.smithi059.stdout:305.out 2023-10-16T14:30:35.349 INFO:teuthology.orchestra.run.smithi059.stdout:306 2023-10-16T14:30:35.349 INFO:teuthology.orchestra.run.smithi059.stdout:306.out 2023-10-16T14:30:35.349 INFO:teuthology.orchestra.run.smithi059.stdout:307 2023-10-16T14:30:35.350 INFO:teuthology.orchestra.run.smithi059.stdout:307.out 2023-10-16T14:30:35.350 INFO:teuthology.orchestra.run.smithi059.stdout:308 2023-10-16T14:30:35.350 INFO:teuthology.orchestra.run.smithi059.stdout:308.out 2023-10-16T14:30:35.350 INFO:teuthology.orchestra.run.smithi059.stdout:309 2023-10-16T14:30:35.350 INFO:teuthology.orchestra.run.smithi059.stdout:309.out 2023-10-16T14:30:35.351 INFO:teuthology.orchestra.run.smithi059.stdout:310 2023-10-16T14:30:35.351 INFO:teuthology.orchestra.run.smithi059.stdout:310.out 2023-10-16T14:30:35.351 INFO:teuthology.orchestra.run.smithi059.stdout:311 2023-10-16T14:30:35.351 INFO:teuthology.orchestra.run.smithi059.stdout:311.out 2023-10-16T14:30:35.351 INFO:teuthology.orchestra.run.smithi059.stdout:312 2023-10-16T14:30:35.352 INFO:teuthology.orchestra.run.smithi059.stdout:312.out 2023-10-16T14:30:35.352 INFO:teuthology.orchestra.run.smithi059.stdout:313 2023-10-16T14:30:35.352 INFO:teuthology.orchestra.run.smithi059.stdout:313.out 2023-10-16T14:30:35.352 INFO:teuthology.orchestra.run.smithi059.stdout:314 2023-10-16T14:30:35.353 INFO:teuthology.orchestra.run.smithi059.stdout:314.out 2023-10-16T14:30:35.353 INFO:teuthology.orchestra.run.smithi059.stdout:315 2023-10-16T14:30:35.353 INFO:teuthology.orchestra.run.smithi059.stdout:315.out 2023-10-16T14:30:35.353 INFO:teuthology.orchestra.run.smithi059.stdout:316 2023-10-16T14:30:35.353 INFO:teuthology.orchestra.run.smithi059.stdout:316.out 2023-10-16T14:30:35.353 INFO:teuthology.orchestra.run.smithi059.stdout:317 2023-10-16T14:30:35.354 INFO:teuthology.orchestra.run.smithi059.stdout:317.out 2023-10-16T14:30:35.354 INFO:teuthology.orchestra.run.smithi059.stdout:318 2023-10-16T14:30:35.354 INFO:teuthology.orchestra.run.smithi059.stdout:318.out 2023-10-16T14:30:35.354 INFO:teuthology.orchestra.run.smithi059.stdout:319 2023-10-16T14:30:35.354 INFO:teuthology.orchestra.run.smithi059.stdout:319.out 2023-10-16T14:30:35.355 INFO:teuthology.orchestra.run.smithi059.stdout:320 2023-10-16T14:30:35.355 INFO:teuthology.orchestra.run.smithi059.stdout:320.out 2023-10-16T14:30:35.355 INFO:teuthology.orchestra.run.smithi059.stdout:321 2023-10-16T14:30:35.355 INFO:teuthology.orchestra.run.smithi059.stdout:321.out 2023-10-16T14:30:35.355 INFO:teuthology.orchestra.run.smithi059.stdout:322 2023-10-16T14:30:35.356 INFO:teuthology.orchestra.run.smithi059.stdout:322.out 2023-10-16T14:30:35.356 INFO:teuthology.orchestra.run.smithi059.stdout:323 2023-10-16T14:30:35.356 INFO:teuthology.orchestra.run.smithi059.stdout:323.out 2023-10-16T14:30:35.356 INFO:teuthology.orchestra.run.smithi059.stdout:324 2023-10-16T14:30:35.356 INFO:teuthology.orchestra.run.smithi059.stdout:324.out 2023-10-16T14:30:35.357 INFO:teuthology.orchestra.run.smithi059.stdout:325 2023-10-16T14:30:35.357 INFO:teuthology.orchestra.run.smithi059.stdout:325.out 2023-10-16T14:30:35.357 INFO:teuthology.orchestra.run.smithi059.stdout:326 2023-10-16T14:30:35.357 INFO:teuthology.orchestra.run.smithi059.stdout:326.out 2023-10-16T14:30:35.357 INFO:teuthology.orchestra.run.smithi059.stdout:327 2023-10-16T14:30:35.357 INFO:teuthology.orchestra.run.smithi059.stdout:327.out 2023-10-16T14:30:35.358 INFO:teuthology.orchestra.run.smithi059.stdout:328 2023-10-16T14:30:35.358 INFO:teuthology.orchestra.run.smithi059.stdout:328.out 2023-10-16T14:30:35.358 INFO:teuthology.orchestra.run.smithi059.stdout:329 2023-10-16T14:30:35.358 INFO:teuthology.orchestra.run.smithi059.stdout:329.out 2023-10-16T14:30:35.358 INFO:teuthology.orchestra.run.smithi059.stdout:330 2023-10-16T14:30:35.359 INFO:teuthology.orchestra.run.smithi059.stdout:330.out 2023-10-16T14:30:35.359 INFO:teuthology.orchestra.run.smithi059.stdout:331 2023-10-16T14:30:35.359 INFO:teuthology.orchestra.run.smithi059.stdout:331.out 2023-10-16T14:30:35.359 INFO:teuthology.orchestra.run.smithi059.stdout:332 2023-10-16T14:30:35.359 INFO:teuthology.orchestra.run.smithi059.stdout:332.out 2023-10-16T14:30:35.359 INFO:teuthology.orchestra.run.smithi059.stdout:333 2023-10-16T14:30:35.360 INFO:teuthology.orchestra.run.smithi059.stdout:333.out 2023-10-16T14:30:35.360 INFO:teuthology.orchestra.run.smithi059.stdout:334 2023-10-16T14:30:35.360 INFO:teuthology.orchestra.run.smithi059.stdout:334.out 2023-10-16T14:30:35.360 INFO:teuthology.orchestra.run.smithi059.stdout:335 2023-10-16T14:30:35.360 INFO:teuthology.orchestra.run.smithi059.stdout:335.out 2023-10-16T14:30:35.361 INFO:teuthology.orchestra.run.smithi059.stdout:336 2023-10-16T14:30:35.361 INFO:teuthology.orchestra.run.smithi059.stdout:336.out 2023-10-16T14:30:35.361 INFO:teuthology.orchestra.run.smithi059.stdout:337 2023-10-16T14:30:35.361 INFO:teuthology.orchestra.run.smithi059.stdout:337.out 2023-10-16T14:30:35.361 INFO:teuthology.orchestra.run.smithi059.stdout:338 2023-10-16T14:30:35.361 INFO:teuthology.orchestra.run.smithi059.stdout:338.out 2023-10-16T14:30:35.362 INFO:teuthology.orchestra.run.smithi059.stdout:339 2023-10-16T14:30:35.362 INFO:teuthology.orchestra.run.smithi059.stdout:339.out 2023-10-16T14:30:35.362 INFO:teuthology.orchestra.run.smithi059.stdout:340 2023-10-16T14:30:35.362 INFO:teuthology.orchestra.run.smithi059.stdout:340.out 2023-10-16T14:30:35.362 INFO:teuthology.orchestra.run.smithi059.stdout:341 2023-10-16T14:30:35.363 INFO:teuthology.orchestra.run.smithi059.stdout:341.out 2023-10-16T14:30:35.363 INFO:teuthology.orchestra.run.smithi059.stdout:342 2023-10-16T14:30:35.363 INFO:teuthology.orchestra.run.smithi059.stdout:342.out 2023-10-16T14:30:35.363 INFO:teuthology.orchestra.run.smithi059.stdout:343 2023-10-16T14:30:35.363 INFO:teuthology.orchestra.run.smithi059.stdout:343.out 2023-10-16T14:30:35.363 INFO:teuthology.orchestra.run.smithi059.stdout:344 2023-10-16T14:30:35.364 INFO:teuthology.orchestra.run.smithi059.stdout:344.out 2023-10-16T14:30:35.364 INFO:teuthology.orchestra.run.smithi059.stdout:345 2023-10-16T14:30:35.364 INFO:teuthology.orchestra.run.smithi059.stdout:345.out 2023-10-16T14:30:35.364 INFO:teuthology.orchestra.run.smithi059.stdout:346 2023-10-16T14:30:35.364 INFO:teuthology.orchestra.run.smithi059.stdout:346.out 2023-10-16T14:30:35.365 INFO:teuthology.orchestra.run.smithi059.stdout:347 2023-10-16T14:30:35.365 INFO:teuthology.orchestra.run.smithi059.stdout:347.out 2023-10-16T14:30:35.365 INFO:teuthology.orchestra.run.smithi059.stdout:348 2023-10-16T14:30:35.365 INFO:teuthology.orchestra.run.smithi059.stdout:348.out 2023-10-16T14:30:35.365 INFO:teuthology.orchestra.run.smithi059.stdout:349 2023-10-16T14:30:35.365 INFO:teuthology.orchestra.run.smithi059.stdout:349.out 2023-10-16T14:30:35.366 INFO:teuthology.orchestra.run.smithi059.stdout:350 2023-10-16T14:30:35.366 INFO:teuthology.orchestra.run.smithi059.stdout:350.out 2023-10-16T14:30:35.366 INFO:teuthology.orchestra.run.smithi059.stdout:351 2023-10-16T14:30:35.366 INFO:teuthology.orchestra.run.smithi059.stdout:351.out 2023-10-16T14:30:35.366 INFO:teuthology.orchestra.run.smithi059.stdout:352 2023-10-16T14:30:35.366 INFO:teuthology.orchestra.run.smithi059.stdout:352.out 2023-10-16T14:30:35.367 INFO:teuthology.orchestra.run.smithi059.stdout:353 2023-10-16T14:30:35.367 INFO:teuthology.orchestra.run.smithi059.stdout:353.out 2023-10-16T14:30:35.367 INFO:teuthology.orchestra.run.smithi059.stdout:354 2023-10-16T14:30:35.367 INFO:teuthology.orchestra.run.smithi059.stdout:354.out 2023-10-16T14:30:35.367 INFO:teuthology.orchestra.run.smithi059.stdout:355 2023-10-16T14:30:35.368 INFO:teuthology.orchestra.run.smithi059.stdout:355.out 2023-10-16T14:30:35.368 INFO:teuthology.orchestra.run.smithi059.stdout:356 2023-10-16T14:30:35.368 INFO:teuthology.orchestra.run.smithi059.stdout:356.out 2023-10-16T14:30:35.368 INFO:teuthology.orchestra.run.smithi059.stdout:357 2023-10-16T14:30:35.368 INFO:teuthology.orchestra.run.smithi059.stdout:357.out 2023-10-16T14:30:35.368 INFO:teuthology.orchestra.run.smithi059.stdout:358 2023-10-16T14:30:35.369 INFO:teuthology.orchestra.run.smithi059.stdout:358.out 2023-10-16T14:30:35.369 INFO:teuthology.orchestra.run.smithi059.stdout:359 2023-10-16T14:30:35.369 INFO:teuthology.orchestra.run.smithi059.stdout:359.out 2023-10-16T14:30:35.369 INFO:teuthology.orchestra.run.smithi059.stdout:360 2023-10-16T14:30:35.369 INFO:teuthology.orchestra.run.smithi059.stdout:360.out 2023-10-16T14:30:35.370 INFO:teuthology.orchestra.run.smithi059.stdout:361 2023-10-16T14:30:35.370 INFO:teuthology.orchestra.run.smithi059.stdout:361.out 2023-10-16T14:30:35.370 INFO:teuthology.orchestra.run.smithi059.stdout:362 2023-10-16T14:30:35.370 INFO:teuthology.orchestra.run.smithi059.stdout:362.out 2023-10-16T14:30:35.370 INFO:teuthology.orchestra.run.smithi059.stdout:363 2023-10-16T14:30:35.370 INFO:teuthology.orchestra.run.smithi059.stdout:363.out 2023-10-16T14:30:35.371 INFO:teuthology.orchestra.run.smithi059.stdout:364 2023-10-16T14:30:35.371 INFO:teuthology.orchestra.run.smithi059.stdout:364.out 2023-10-16T14:30:35.371 INFO:teuthology.orchestra.run.smithi059.stdout:365 2023-10-16T14:30:35.371 INFO:teuthology.orchestra.run.smithi059.stdout:365.out 2023-10-16T14:30:35.371 INFO:teuthology.orchestra.run.smithi059.stdout:366 2023-10-16T14:30:35.372 INFO:teuthology.orchestra.run.smithi059.stdout:366.out 2023-10-16T14:30:35.372 INFO:teuthology.orchestra.run.smithi059.stdout:367 2023-10-16T14:30:35.372 INFO:teuthology.orchestra.run.smithi059.stdout:367.out 2023-10-16T14:30:35.372 INFO:teuthology.orchestra.run.smithi059.stdout:368 2023-10-16T14:30:35.372 INFO:teuthology.orchestra.run.smithi059.stdout:368.out 2023-10-16T14:30:35.372 INFO:teuthology.orchestra.run.smithi059.stdout:369 2023-10-16T14:30:35.373 INFO:teuthology.orchestra.run.smithi059.stdout:369.out 2023-10-16T14:30:35.373 INFO:teuthology.orchestra.run.smithi059.stdout:370 2023-10-16T14:30:35.373 INFO:teuthology.orchestra.run.smithi059.stdout:370.out 2023-10-16T14:30:35.373 INFO:teuthology.orchestra.run.smithi059.stdout:371 2023-10-16T14:30:35.373 INFO:teuthology.orchestra.run.smithi059.stdout:371.out 2023-10-16T14:30:35.374 INFO:teuthology.orchestra.run.smithi059.stdout:372 2023-10-16T14:30:35.374 INFO:teuthology.orchestra.run.smithi059.stdout:372.out 2023-10-16T14:30:35.374 INFO:teuthology.orchestra.run.smithi059.stdout:373 2023-10-16T14:30:35.374 INFO:teuthology.orchestra.run.smithi059.stdout:373.out 2023-10-16T14:30:35.374 INFO:teuthology.orchestra.run.smithi059.stdout:374 2023-10-16T14:30:35.374 INFO:teuthology.orchestra.run.smithi059.stdout:374.out 2023-10-16T14:30:35.375 INFO:teuthology.orchestra.run.smithi059.stdout:375 2023-10-16T14:30:35.375 INFO:teuthology.orchestra.run.smithi059.stdout:375.out 2023-10-16T14:30:35.375 INFO:teuthology.orchestra.run.smithi059.stdout:376 2023-10-16T14:30:35.375 INFO:teuthology.orchestra.run.smithi059.stdout:376.out 2023-10-16T14:30:35.375 INFO:teuthology.orchestra.run.smithi059.stdout:377 2023-10-16T14:30:35.376 INFO:teuthology.orchestra.run.smithi059.stdout:377.out 2023-10-16T14:30:35.376 INFO:teuthology.orchestra.run.smithi059.stdout:378 2023-10-16T14:30:35.376 INFO:teuthology.orchestra.run.smithi059.stdout:378.out 2023-10-16T14:30:35.376 INFO:teuthology.orchestra.run.smithi059.stdout:379 2023-10-16T14:30:35.376 INFO:teuthology.orchestra.run.smithi059.stdout:379.out 2023-10-16T14:30:35.376 INFO:teuthology.orchestra.run.smithi059.stdout:380 2023-10-16T14:30:35.377 INFO:teuthology.orchestra.run.smithi059.stdout:380.out 2023-10-16T14:30:35.377 INFO:teuthology.orchestra.run.smithi059.stdout:381 2023-10-16T14:30:35.377 INFO:teuthology.orchestra.run.smithi059.stdout:381.out 2023-10-16T14:30:35.377 INFO:teuthology.orchestra.run.smithi059.stdout:382 2023-10-16T14:30:35.377 INFO:teuthology.orchestra.run.smithi059.stdout:382.out 2023-10-16T14:30:35.377 INFO:teuthology.orchestra.run.smithi059.stdout:383 2023-10-16T14:30:35.378 INFO:teuthology.orchestra.run.smithi059.stdout:383.out 2023-10-16T14:30:35.378 INFO:teuthology.orchestra.run.smithi059.stdout:384 2023-10-16T14:30:35.378 INFO:teuthology.orchestra.run.smithi059.stdout:384.out 2023-10-16T14:30:35.378 INFO:teuthology.orchestra.run.smithi059.stdout:385 2023-10-16T14:30:35.378 INFO:teuthology.orchestra.run.smithi059.stdout:385.out 2023-10-16T14:30:35.379 INFO:teuthology.orchestra.run.smithi059.stdout:386 2023-10-16T14:30:35.379 INFO:teuthology.orchestra.run.smithi059.stdout:386.out 2023-10-16T14:30:35.379 INFO:teuthology.orchestra.run.smithi059.stdout:387 2023-10-16T14:30:35.379 INFO:teuthology.orchestra.run.smithi059.stdout:387.out 2023-10-16T14:30:35.379 INFO:teuthology.orchestra.run.smithi059.stdout:388 2023-10-16T14:30:35.379 INFO:teuthology.orchestra.run.smithi059.stdout:388.out 2023-10-16T14:30:35.380 INFO:teuthology.orchestra.run.smithi059.stdout:389 2023-10-16T14:30:35.380 INFO:teuthology.orchestra.run.smithi059.stdout:389.out 2023-10-16T14:30:35.380 INFO:teuthology.orchestra.run.smithi059.stdout:390 2023-10-16T14:30:35.380 INFO:teuthology.orchestra.run.smithi059.stdout:390.out 2023-10-16T14:30:35.380 INFO:teuthology.orchestra.run.smithi059.stdout:391 2023-10-16T14:30:35.381 INFO:teuthology.orchestra.run.smithi059.stdout:391.out 2023-10-16T14:30:35.381 INFO:teuthology.orchestra.run.smithi059.stdout:392 2023-10-16T14:30:35.381 INFO:teuthology.orchestra.run.smithi059.stdout:392.out 2023-10-16T14:30:35.381 INFO:teuthology.orchestra.run.smithi059.stdout:393 2023-10-16T14:30:35.381 INFO:teuthology.orchestra.run.smithi059.stdout:393.out 2023-10-16T14:30:35.381 INFO:teuthology.orchestra.run.smithi059.stdout:394 2023-10-16T14:30:35.382 INFO:teuthology.orchestra.run.smithi059.stdout:394.out 2023-10-16T14:30:35.382 INFO:teuthology.orchestra.run.smithi059.stdout:395 2023-10-16T14:30:35.382 INFO:teuthology.orchestra.run.smithi059.stdout:395.out 2023-10-16T14:30:35.382 INFO:teuthology.orchestra.run.smithi059.stdout:396 2023-10-16T14:30:35.382 INFO:teuthology.orchestra.run.smithi059.stdout:396.out 2023-10-16T14:30:35.383 INFO:teuthology.orchestra.run.smithi059.stdout:397 2023-10-16T14:30:35.383 INFO:teuthology.orchestra.run.smithi059.stdout:397.out 2023-10-16T14:30:35.383 INFO:teuthology.orchestra.run.smithi059.stdout:398 2023-10-16T14:30:35.383 INFO:teuthology.orchestra.run.smithi059.stdout:398.out 2023-10-16T14:30:35.383 INFO:teuthology.orchestra.run.smithi059.stdout:399 2023-10-16T14:30:35.383 INFO:teuthology.orchestra.run.smithi059.stdout:399.out 2023-10-16T14:30:35.384 INFO:teuthology.orchestra.run.smithi059.stdout:400 2023-10-16T14:30:35.384 INFO:teuthology.orchestra.run.smithi059.stdout:400.out 2023-10-16T14:30:35.384 INFO:teuthology.orchestra.run.smithi059.stdout:401 2023-10-16T14:30:35.384 INFO:teuthology.orchestra.run.smithi059.stdout:401.out 2023-10-16T14:30:35.384 INFO:teuthology.orchestra.run.smithi059.stdout:402 2023-10-16T14:30:35.385 INFO:teuthology.orchestra.run.smithi059.stdout:402.out 2023-10-16T14:30:35.385 INFO:teuthology.orchestra.run.smithi059.stdout:403 2023-10-16T14:30:35.385 INFO:teuthology.orchestra.run.smithi059.stdout:403.out 2023-10-16T14:30:35.385 INFO:teuthology.orchestra.run.smithi059.stdout:404 2023-10-16T14:30:35.385 INFO:teuthology.orchestra.run.smithi059.stdout:404.out 2023-10-16T14:30:35.385 INFO:teuthology.orchestra.run.smithi059.stdout:405 2023-10-16T14:30:35.386 INFO:teuthology.orchestra.run.smithi059.stdout:405.out 2023-10-16T14:30:35.386 INFO:teuthology.orchestra.run.smithi059.stdout:406 2023-10-16T14:30:35.386 INFO:teuthology.orchestra.run.smithi059.stdout:406.out 2023-10-16T14:30:35.386 INFO:teuthology.orchestra.run.smithi059.stdout:407 2023-10-16T14:30:35.387 INFO:teuthology.orchestra.run.smithi059.stdout:407.out 2023-10-16T14:30:35.387 INFO:teuthology.orchestra.run.smithi059.stdout:408 2023-10-16T14:30:35.387 INFO:teuthology.orchestra.run.smithi059.stdout:408.out 2023-10-16T14:30:35.387 INFO:teuthology.orchestra.run.smithi059.stdout:409 2023-10-16T14:30:35.387 INFO:teuthology.orchestra.run.smithi059.stdout:409.out 2023-10-16T14:30:35.387 INFO:teuthology.orchestra.run.smithi059.stdout:410 2023-10-16T14:30:35.388 INFO:teuthology.orchestra.run.smithi059.stdout:410.out 2023-10-16T14:30:35.388 INFO:teuthology.orchestra.run.smithi059.stdout:411 2023-10-16T14:30:35.388 INFO:teuthology.orchestra.run.smithi059.stdout:411.out 2023-10-16T14:30:35.388 INFO:teuthology.orchestra.run.smithi059.stdout:412 2023-10-16T14:30:35.388 INFO:teuthology.orchestra.run.smithi059.stdout:412.out 2023-10-16T14:30:35.388 INFO:teuthology.orchestra.run.smithi059.stdout:413 2023-10-16T14:30:35.389 INFO:teuthology.orchestra.run.smithi059.stdout:413.out 2023-10-16T14:30:35.389 INFO:teuthology.orchestra.run.smithi059.stdout:414 2023-10-16T14:30:35.389 INFO:teuthology.orchestra.run.smithi059.stdout:414.out 2023-10-16T14:30:35.389 INFO:teuthology.orchestra.run.smithi059.stdout:415 2023-10-16T14:30:35.389 INFO:teuthology.orchestra.run.smithi059.stdout:415.out 2023-10-16T14:30:35.390 INFO:teuthology.orchestra.run.smithi059.stdout:416 2023-10-16T14:30:35.390 INFO:teuthology.orchestra.run.smithi059.stdout:416.out 2023-10-16T14:30:35.390 INFO:teuthology.orchestra.run.smithi059.stdout:417 2023-10-16T14:30:35.390 INFO:teuthology.orchestra.run.smithi059.stdout:417.out 2023-10-16T14:30:35.390 INFO:teuthology.orchestra.run.smithi059.stdout:418 2023-10-16T14:30:35.391 INFO:teuthology.orchestra.run.smithi059.stdout:418.out 2023-10-16T14:30:35.391 INFO:teuthology.orchestra.run.smithi059.stdout:419 2023-10-16T14:30:35.391 INFO:teuthology.orchestra.run.smithi059.stdout:419.out 2023-10-16T14:30:35.391 INFO:teuthology.orchestra.run.smithi059.stdout:420 2023-10-16T14:30:35.391 INFO:teuthology.orchestra.run.smithi059.stdout:420.out 2023-10-16T14:30:35.391 INFO:teuthology.orchestra.run.smithi059.stdout:421 2023-10-16T14:30:35.392 INFO:teuthology.orchestra.run.smithi059.stdout:421.out 2023-10-16T14:30:35.392 INFO:teuthology.orchestra.run.smithi059.stdout:422 2023-10-16T14:30:35.392 INFO:teuthology.orchestra.run.smithi059.stdout:422.out 2023-10-16T14:30:35.392 INFO:teuthology.orchestra.run.smithi059.stdout:423 2023-10-16T14:30:35.392 INFO:teuthology.orchestra.run.smithi059.stdout:423.out 2023-10-16T14:30:35.393 INFO:teuthology.orchestra.run.smithi059.stdout:424 2023-10-16T14:30:35.393 INFO:teuthology.orchestra.run.smithi059.stdout:424.out 2023-10-16T14:30:35.393 INFO:teuthology.orchestra.run.smithi059.stdout:425 2023-10-16T14:30:35.393 INFO:teuthology.orchestra.run.smithi059.stdout:425.out 2023-10-16T14:30:35.393 INFO:teuthology.orchestra.run.smithi059.stdout:426 2023-10-16T14:30:35.393 INFO:teuthology.orchestra.run.smithi059.stdout:426.out 2023-10-16T14:30:35.394 INFO:teuthology.orchestra.run.smithi059.stdout:427 2023-10-16T14:30:35.394 INFO:teuthology.orchestra.run.smithi059.stdout:427.out 2023-10-16T14:30:35.394 INFO:teuthology.orchestra.run.smithi059.stdout:428 2023-10-16T14:30:35.394 INFO:teuthology.orchestra.run.smithi059.stdout:428.out 2023-10-16T14:30:35.394 INFO:teuthology.orchestra.run.smithi059.stdout:429 2023-10-16T14:30:35.394 INFO:teuthology.orchestra.run.smithi059.stdout:429.out 2023-10-16T14:30:35.395 INFO:teuthology.orchestra.run.smithi059.stdout:430 2023-10-16T14:30:35.395 INFO:teuthology.orchestra.run.smithi059.stdout:430.out 2023-10-16T14:30:35.395 INFO:teuthology.orchestra.run.smithi059.stdout:431 2023-10-16T14:30:35.395 INFO:teuthology.orchestra.run.smithi059.stdout:431.out 2023-10-16T14:30:35.395 INFO:teuthology.orchestra.run.smithi059.stdout:432 2023-10-16T14:30:35.395 INFO:teuthology.orchestra.run.smithi059.stdout:432.out 2023-10-16T14:30:35.396 INFO:teuthology.orchestra.run.smithi059.stdout:433 2023-10-16T14:30:35.396 INFO:teuthology.orchestra.run.smithi059.stdout:433.out 2023-10-16T14:30:35.396 INFO:teuthology.orchestra.run.smithi059.stdout:434 2023-10-16T14:30:35.396 INFO:teuthology.orchestra.run.smithi059.stdout:434.out 2023-10-16T14:30:35.396 INFO:teuthology.orchestra.run.smithi059.stdout:435 2023-10-16T14:30:35.396 INFO:teuthology.orchestra.run.smithi059.stdout:435.out 2023-10-16T14:30:35.397 INFO:teuthology.orchestra.run.smithi059.stdout:436 2023-10-16T14:30:35.397 INFO:teuthology.orchestra.run.smithi059.stdout:436.out 2023-10-16T14:30:35.397 INFO:teuthology.orchestra.run.smithi059.stdout:437 2023-10-16T14:30:35.397 INFO:teuthology.orchestra.run.smithi059.stdout:437.out 2023-10-16T14:30:35.397 INFO:teuthology.orchestra.run.smithi059.stdout:438 2023-10-16T14:30:35.398 INFO:teuthology.orchestra.run.smithi059.stdout:438.out 2023-10-16T14:30:35.398 INFO:teuthology.orchestra.run.smithi059.stdout:439 2023-10-16T14:30:35.398 INFO:teuthology.orchestra.run.smithi059.stdout:439.out 2023-10-16T14:30:35.398 INFO:teuthology.orchestra.run.smithi059.stdout:440 2023-10-16T14:30:35.398 INFO:teuthology.orchestra.run.smithi059.stdout:440.out 2023-10-16T14:30:35.399 INFO:teuthology.orchestra.run.smithi059.stdout:441 2023-10-16T14:30:35.399 INFO:teuthology.orchestra.run.smithi059.stdout:441.out 2023-10-16T14:30:35.399 INFO:teuthology.orchestra.run.smithi059.stdout:442 2023-10-16T14:30:35.399 INFO:teuthology.orchestra.run.smithi059.stdout:442.out 2023-10-16T14:30:35.399 INFO:teuthology.orchestra.run.smithi059.stdout:443 2023-10-16T14:30:35.399 INFO:teuthology.orchestra.run.smithi059.stdout:443.out 2023-10-16T14:30:35.400 INFO:teuthology.orchestra.run.smithi059.stdout:444 2023-10-16T14:30:35.400 INFO:teuthology.orchestra.run.smithi059.stdout:444.out 2023-10-16T14:30:35.400 INFO:teuthology.orchestra.run.smithi059.stdout:445 2023-10-16T14:30:35.400 INFO:teuthology.orchestra.run.smithi059.stdout:445.out 2023-10-16T14:30:35.400 INFO:teuthology.orchestra.run.smithi059.stdout:446 2023-10-16T14:30:35.401 INFO:teuthology.orchestra.run.smithi059.stdout:446.out 2023-10-16T14:30:35.401 INFO:teuthology.orchestra.run.smithi059.stdout:447 2023-10-16T14:30:35.401 INFO:teuthology.orchestra.run.smithi059.stdout:447.out 2023-10-16T14:30:35.401 INFO:teuthology.orchestra.run.smithi059.stdout:448 2023-10-16T14:30:35.401 INFO:teuthology.orchestra.run.smithi059.stdout:448.out 2023-10-16T14:30:35.401 INFO:teuthology.orchestra.run.smithi059.stdout:449 2023-10-16T14:30:35.402 INFO:teuthology.orchestra.run.smithi059.stdout:449.out 2023-10-16T14:30:35.402 INFO:teuthology.orchestra.run.smithi059.stdout:450 2023-10-16T14:30:35.402 INFO:teuthology.orchestra.run.smithi059.stdout:450.out 2023-10-16T14:30:35.402 INFO:teuthology.orchestra.run.smithi059.stdout:451 2023-10-16T14:30:35.402 INFO:teuthology.orchestra.run.smithi059.stdout:451.out 2023-10-16T14:30:35.402 INFO:teuthology.orchestra.run.smithi059.stdout:452 2023-10-16T14:30:35.403 INFO:teuthology.orchestra.run.smithi059.stdout:452.out 2023-10-16T14:30:35.403 INFO:teuthology.orchestra.run.smithi059.stdout:453 2023-10-16T14:30:35.403 INFO:teuthology.orchestra.run.smithi059.stdout:453.out 2023-10-16T14:30:35.403 INFO:teuthology.orchestra.run.smithi059.stdout:454 2023-10-16T14:30:35.403 INFO:teuthology.orchestra.run.smithi059.stdout:454.out 2023-10-16T14:30:35.404 INFO:teuthology.orchestra.run.smithi059.stdout:455 2023-10-16T14:30:35.404 INFO:teuthology.orchestra.run.smithi059.stdout:455.out 2023-10-16T14:30:35.404 INFO:teuthology.orchestra.run.smithi059.stdout:456 2023-10-16T14:30:35.404 INFO:teuthology.orchestra.run.smithi059.stdout:456.out 2023-10-16T14:30:35.404 INFO:teuthology.orchestra.run.smithi059.stdout:457 2023-10-16T14:30:35.405 INFO:teuthology.orchestra.run.smithi059.stdout:457.out 2023-10-16T14:30:35.405 INFO:teuthology.orchestra.run.smithi059.stdout:458 2023-10-16T14:30:35.405 INFO:teuthology.orchestra.run.smithi059.stdout:458.out 2023-10-16T14:30:35.405 INFO:teuthology.orchestra.run.smithi059.stdout:459 2023-10-16T14:30:35.405 INFO:teuthology.orchestra.run.smithi059.stdout:459.out 2023-10-16T14:30:35.405 INFO:teuthology.orchestra.run.smithi059.stdout:460 2023-10-16T14:30:35.406 INFO:teuthology.orchestra.run.smithi059.stdout:460.out 2023-10-16T14:30:35.406 INFO:teuthology.orchestra.run.smithi059.stdout:461 2023-10-16T14:30:35.406 INFO:teuthology.orchestra.run.smithi059.stdout:461.out 2023-10-16T14:30:35.406 INFO:teuthology.orchestra.run.smithi059.stdout:462 2023-10-16T14:30:35.406 INFO:teuthology.orchestra.run.smithi059.stdout:462.out 2023-10-16T14:30:35.407 INFO:teuthology.orchestra.run.smithi059.stdout:463 2023-10-16T14:30:35.407 INFO:teuthology.orchestra.run.smithi059.stdout:463.out 2023-10-16T14:30:35.407 INFO:teuthology.orchestra.run.smithi059.stdout:464 2023-10-16T14:30:35.407 INFO:teuthology.orchestra.run.smithi059.stdout:464.out 2023-10-16T14:30:35.407 INFO:teuthology.orchestra.run.smithi059.stdout:465 2023-10-16T14:30:35.407 INFO:teuthology.orchestra.run.smithi059.stdout:465.out 2023-10-16T14:30:35.408 INFO:teuthology.orchestra.run.smithi059.stdout:466 2023-10-16T14:30:35.408 INFO:teuthology.orchestra.run.smithi059.stdout:466.out 2023-10-16T14:30:35.408 INFO:teuthology.orchestra.run.smithi059.stdout:467 2023-10-16T14:30:35.408 INFO:teuthology.orchestra.run.smithi059.stdout:467.out 2023-10-16T14:30:35.408 INFO:teuthology.orchestra.run.smithi059.stdout:468 2023-10-16T14:30:35.409 INFO:teuthology.orchestra.run.smithi059.stdout:468.out 2023-10-16T14:30:35.409 INFO:teuthology.orchestra.run.smithi059.stdout:469 2023-10-16T14:30:35.409 INFO:teuthology.orchestra.run.smithi059.stdout:469.out 2023-10-16T14:30:35.409 INFO:teuthology.orchestra.run.smithi059.stdout:470 2023-10-16T14:30:35.409 INFO:teuthology.orchestra.run.smithi059.stdout:470.out 2023-10-16T14:30:35.409 INFO:teuthology.orchestra.run.smithi059.stdout:471 2023-10-16T14:30:35.410 INFO:teuthology.orchestra.run.smithi059.stdout:471.out 2023-10-16T14:30:35.410 INFO:teuthology.orchestra.run.smithi059.stdout:472 2023-10-16T14:30:35.410 INFO:teuthology.orchestra.run.smithi059.stdout:472.out 2023-10-16T14:30:35.410 INFO:teuthology.orchestra.run.smithi059.stdout:473 2023-10-16T14:30:35.410 INFO:teuthology.orchestra.run.smithi059.stdout:473.out 2023-10-16T14:30:35.411 INFO:teuthology.orchestra.run.smithi059.stdout:474 2023-10-16T14:30:35.411 INFO:teuthology.orchestra.run.smithi059.stdout:474.out 2023-10-16T14:30:35.411 INFO:teuthology.orchestra.run.smithi059.stdout:475 2023-10-16T14:30:35.411 INFO:teuthology.orchestra.run.smithi059.stdout:475.out 2023-10-16T14:30:35.411 INFO:teuthology.orchestra.run.smithi059.stdout:476 2023-10-16T14:30:35.412 INFO:teuthology.orchestra.run.smithi059.stdout:476.out 2023-10-16T14:30:35.412 INFO:teuthology.orchestra.run.smithi059.stdout:477 2023-10-16T14:30:35.412 INFO:teuthology.orchestra.run.smithi059.stdout:477.out 2023-10-16T14:30:35.412 INFO:teuthology.orchestra.run.smithi059.stdout:478 2023-10-16T14:30:35.412 INFO:teuthology.orchestra.run.smithi059.stdout:478.out 2023-10-16T14:30:35.412 INFO:teuthology.orchestra.run.smithi059.stdout:479 2023-10-16T14:30:35.413 INFO:teuthology.orchestra.run.smithi059.stdout:479.out 2023-10-16T14:30:35.413 INFO:teuthology.orchestra.run.smithi059.stdout:480 2023-10-16T14:30:35.413 INFO:teuthology.orchestra.run.smithi059.stdout:480.out 2023-10-16T14:30:35.413 INFO:teuthology.orchestra.run.smithi059.stdout:481 2023-10-16T14:30:35.413 INFO:teuthology.orchestra.run.smithi059.stdout:481.out 2023-10-16T14:30:35.414 INFO:teuthology.orchestra.run.smithi059.stdout:482 2023-10-16T14:30:35.414 INFO:teuthology.orchestra.run.smithi059.stdout:482.out 2023-10-16T14:30:35.414 INFO:teuthology.orchestra.run.smithi059.stdout:483 2023-10-16T14:30:35.414 INFO:teuthology.orchestra.run.smithi059.stdout:483.out 2023-10-16T14:30:35.414 INFO:teuthology.orchestra.run.smithi059.stdout:484 2023-10-16T14:30:35.415 INFO:teuthology.orchestra.run.smithi059.stdout:484.out 2023-10-16T14:30:35.415 INFO:teuthology.orchestra.run.smithi059.stdout:485 2023-10-16T14:30:35.415 INFO:teuthology.orchestra.run.smithi059.stdout:485.out 2023-10-16T14:30:35.415 INFO:teuthology.orchestra.run.smithi059.stdout:486 2023-10-16T14:30:35.415 INFO:teuthology.orchestra.run.smithi059.stdout:486.out 2023-10-16T14:30:35.416 INFO:teuthology.orchestra.run.smithi059.stdout:487 2023-10-16T14:30:35.416 INFO:teuthology.orchestra.run.smithi059.stdout:487.out 2023-10-16T14:30:35.416 INFO:teuthology.orchestra.run.smithi059.stdout:488 2023-10-16T14:30:35.416 INFO:teuthology.orchestra.run.smithi059.stdout:488.out 2023-10-16T14:30:35.416 INFO:teuthology.orchestra.run.smithi059.stdout:489 2023-10-16T14:30:35.416 INFO:teuthology.orchestra.run.smithi059.stdout:489.out 2023-10-16T14:30:35.417 INFO:teuthology.orchestra.run.smithi059.stdout:490 2023-10-16T14:30:35.417 INFO:teuthology.orchestra.run.smithi059.stdout:490.out 2023-10-16T14:30:35.417 INFO:teuthology.orchestra.run.smithi059.stdout:491 2023-10-16T14:30:35.417 INFO:teuthology.orchestra.run.smithi059.stdout:491.out 2023-10-16T14:30:35.417 INFO:teuthology.orchestra.run.smithi059.stdout:492 2023-10-16T14:30:35.418 INFO:teuthology.orchestra.run.smithi059.stdout:492.out 2023-10-16T14:30:35.418 INFO:teuthology.orchestra.run.smithi059.stdout:493 2023-10-16T14:30:35.418 INFO:teuthology.orchestra.run.smithi059.stdout:493.out 2023-10-16T14:30:35.418 INFO:teuthology.orchestra.run.smithi059.stdout:494 2023-10-16T14:30:35.418 INFO:teuthology.orchestra.run.smithi059.stdout:494.out 2023-10-16T14:30:35.419 INFO:teuthology.orchestra.run.smithi059.stdout:495 2023-10-16T14:30:35.419 INFO:teuthology.orchestra.run.smithi059.stdout:495.out 2023-10-16T14:30:35.419 INFO:teuthology.orchestra.run.smithi059.stdout:496 2023-10-16T14:30:35.419 INFO:teuthology.orchestra.run.smithi059.stdout:496.out 2023-10-16T14:30:35.419 INFO:teuthology.orchestra.run.smithi059.stdout:497 2023-10-16T14:30:35.419 INFO:teuthology.orchestra.run.smithi059.stdout:497.out 2023-10-16T14:30:35.420 INFO:teuthology.orchestra.run.smithi059.stdout:498 2023-10-16T14:30:35.420 INFO:teuthology.orchestra.run.smithi059.stdout:498.out 2023-10-16T14:30:35.420 INFO:teuthology.orchestra.run.smithi059.stdout:499 2023-10-16T14:30:35.420 INFO:teuthology.orchestra.run.smithi059.stdout:499.out 2023-10-16T14:30:35.420 INFO:teuthology.orchestra.run.smithi059.stdout:500 2023-10-16T14:30:35.421 INFO:teuthology.orchestra.run.smithi059.stdout:500.out 2023-10-16T14:30:35.421 INFO:teuthology.orchestra.run.smithi059.stdout:501 2023-10-16T14:30:35.421 INFO:teuthology.orchestra.run.smithi059.stdout:501.out 2023-10-16T14:30:35.421 INFO:teuthology.orchestra.run.smithi059.stdout:502 2023-10-16T14:30:35.421 INFO:teuthology.orchestra.run.smithi059.stdout:502.out 2023-10-16T14:30:35.422 INFO:teuthology.orchestra.run.smithi059.stdout:503 2023-10-16T14:30:35.422 INFO:teuthology.orchestra.run.smithi059.stdout:503.out 2023-10-16T14:30:35.422 INFO:teuthology.orchestra.run.smithi059.stdout:504 2023-10-16T14:30:35.422 INFO:teuthology.orchestra.run.smithi059.stdout:504.out 2023-10-16T14:30:35.422 INFO:teuthology.orchestra.run.smithi059.stdout:505 2023-10-16T14:30:35.423 INFO:teuthology.orchestra.run.smithi059.stdout:505.out 2023-10-16T14:30:35.423 INFO:teuthology.orchestra.run.smithi059.stdout:506 2023-10-16T14:30:35.423 INFO:teuthology.orchestra.run.smithi059.stdout:506.out 2023-10-16T14:30:35.423 INFO:teuthology.orchestra.run.smithi059.stdout:507 2023-10-16T14:30:35.423 INFO:teuthology.orchestra.run.smithi059.stdout:507.out 2023-10-16T14:30:35.423 INFO:teuthology.orchestra.run.smithi059.stdout:508 2023-10-16T14:30:35.424 INFO:teuthology.orchestra.run.smithi059.stdout:508.out 2023-10-16T14:30:35.424 INFO:teuthology.orchestra.run.smithi059.stdout:509 2023-10-16T14:30:35.424 INFO:teuthology.orchestra.run.smithi059.stdout:509.out 2023-10-16T14:30:35.424 INFO:teuthology.orchestra.run.smithi059.stdout:510 2023-10-16T14:30:35.424 INFO:teuthology.orchestra.run.smithi059.stdout:510.out 2023-10-16T14:30:35.424 INFO:teuthology.orchestra.run.smithi059.stdout:511 2023-10-16T14:30:35.425 INFO:teuthology.orchestra.run.smithi059.stdout:511.out 2023-10-16T14:30:35.425 INFO:teuthology.orchestra.run.smithi059.stdout:512 2023-10-16T14:30:35.425 INFO:teuthology.orchestra.run.smithi059.stdout:512.out 2023-10-16T14:30:35.425 INFO:teuthology.orchestra.run.smithi059.stdout:513 2023-10-16T14:30:35.425 INFO:teuthology.orchestra.run.smithi059.stdout:513.out 2023-10-16T14:30:35.425 INFO:teuthology.orchestra.run.smithi059.stdout:514 2023-10-16T14:30:35.426 INFO:teuthology.orchestra.run.smithi059.stdout:514.out 2023-10-16T14:30:35.426 INFO:teuthology.orchestra.run.smithi059.stdout:515 2023-10-16T14:30:35.426 INFO:teuthology.orchestra.run.smithi059.stdout:515.out 2023-10-16T14:30:35.426 INFO:teuthology.orchestra.run.smithi059.stdout:516 2023-10-16T14:30:35.426 INFO:teuthology.orchestra.run.smithi059.stdout:516.out 2023-10-16T14:30:35.427 INFO:teuthology.orchestra.run.smithi059.stdout:517 2023-10-16T14:30:35.427 INFO:teuthology.orchestra.run.smithi059.stdout:517.out 2023-10-16T14:30:35.427 INFO:teuthology.orchestra.run.smithi059.stdout:518 2023-10-16T14:30:35.427 INFO:teuthology.orchestra.run.smithi059.stdout:518.out 2023-10-16T14:30:35.427 INFO:teuthology.orchestra.run.smithi059.stdout:519 2023-10-16T14:30:35.427 INFO:teuthology.orchestra.run.smithi059.stdout:519.out 2023-10-16T14:30:35.428 INFO:teuthology.orchestra.run.smithi059.stdout:520 2023-10-16T14:30:35.428 INFO:teuthology.orchestra.run.smithi059.stdout:520.out 2023-10-16T14:30:35.428 INFO:teuthology.orchestra.run.smithi059.stdout:521 2023-10-16T14:30:35.428 INFO:teuthology.orchestra.run.smithi059.stdout:521.out 2023-10-16T14:30:35.428 INFO:teuthology.orchestra.run.smithi059.stdout:522 2023-10-16T14:30:35.428 INFO:teuthology.orchestra.run.smithi059.stdout:522.out 2023-10-16T14:30:35.428 INFO:teuthology.orchestra.run.smithi059.stdout:523 2023-10-16T14:30:35.429 INFO:teuthology.orchestra.run.smithi059.stdout:523.out 2023-10-16T14:30:35.429 INFO:teuthology.orchestra.run.smithi059.stdout:524 2023-10-16T14:30:35.429 INFO:teuthology.orchestra.run.smithi059.stdout:524.out 2023-10-16T14:30:35.429 INFO:teuthology.orchestra.run.smithi059.stdout:525 2023-10-16T14:30:35.429 INFO:teuthology.orchestra.run.smithi059.stdout:525.out 2023-10-16T14:30:35.430 INFO:teuthology.orchestra.run.smithi059.stdout:526 2023-10-16T14:30:35.430 INFO:teuthology.orchestra.run.smithi059.stdout:526.out 2023-10-16T14:30:35.430 INFO:teuthology.orchestra.run.smithi059.stdout:527 2023-10-16T14:30:35.430 INFO:teuthology.orchestra.run.smithi059.stdout:527.out 2023-10-16T14:30:35.430 INFO:teuthology.orchestra.run.smithi059.stdout:528 2023-10-16T14:30:35.431 INFO:teuthology.orchestra.run.smithi059.stdout:528.out 2023-10-16T14:30:35.431 INFO:teuthology.orchestra.run.smithi059.stdout:529 2023-10-16T14:30:35.431 INFO:teuthology.orchestra.run.smithi059.stdout:529.out 2023-10-16T14:30:35.431 INFO:teuthology.orchestra.run.smithi059.stdout:530 2023-10-16T14:30:35.431 INFO:teuthology.orchestra.run.smithi059.stdout:530.out 2023-10-16T14:30:35.431 INFO:teuthology.orchestra.run.smithi059.stdout:531 2023-10-16T14:30:35.432 INFO:teuthology.orchestra.run.smithi059.stdout:531.out 2023-10-16T14:30:35.432 INFO:teuthology.orchestra.run.smithi059.stdout:532 2023-10-16T14:30:35.432 INFO:teuthology.orchestra.run.smithi059.stdout:532.out 2023-10-16T14:30:35.432 INFO:teuthology.orchestra.run.smithi059.stdout:533 2023-10-16T14:30:35.432 INFO:teuthology.orchestra.run.smithi059.stdout:533.out 2023-10-16T14:30:35.433 INFO:teuthology.orchestra.run.smithi059.stdout:534 2023-10-16T14:30:35.433 INFO:teuthology.orchestra.run.smithi059.stdout:534.out 2023-10-16T14:30:35.433 INFO:teuthology.orchestra.run.smithi059.stdout:535 2023-10-16T14:30:35.433 INFO:teuthology.orchestra.run.smithi059.stdout:535.out 2023-10-16T14:30:35.433 INFO:teuthology.orchestra.run.smithi059.stdout:536 2023-10-16T14:30:35.433 INFO:teuthology.orchestra.run.smithi059.stdout:536.out 2023-10-16T14:30:35.434 INFO:teuthology.orchestra.run.smithi059.stdout:537 2023-10-16T14:30:35.434 INFO:teuthology.orchestra.run.smithi059.stdout:537.out 2023-10-16T14:30:35.434 INFO:teuthology.orchestra.run.smithi059.stdout:538 2023-10-16T14:30:35.434 INFO:teuthology.orchestra.run.smithi059.stdout:538.out 2023-10-16T14:30:35.434 INFO:teuthology.orchestra.run.smithi059.stdout:539 2023-10-16T14:30:35.435 INFO:teuthology.orchestra.run.smithi059.stdout:539.out 2023-10-16T14:30:35.435 INFO:teuthology.orchestra.run.smithi059.stdout:540 2023-10-16T14:30:35.435 INFO:teuthology.orchestra.run.smithi059.stdout:540.out 2023-10-16T14:30:35.435 INFO:teuthology.orchestra.run.smithi059.stdout:541 2023-10-16T14:30:35.435 INFO:teuthology.orchestra.run.smithi059.stdout:541.out 2023-10-16T14:30:35.435 INFO:teuthology.orchestra.run.smithi059.stdout:542 2023-10-16T14:30:35.436 INFO:teuthology.orchestra.run.smithi059.stdout:542.out 2023-10-16T14:30:35.436 INFO:teuthology.orchestra.run.smithi059.stdout:543 2023-10-16T14:30:35.436 INFO:teuthology.orchestra.run.smithi059.stdout:543.out 2023-10-16T14:30:35.436 INFO:teuthology.orchestra.run.smithi059.stdout:544 2023-10-16T14:30:35.436 INFO:teuthology.orchestra.run.smithi059.stdout:544.out 2023-10-16T14:30:35.436 INFO:teuthology.orchestra.run.smithi059.stdout:545 2023-10-16T14:30:35.437 INFO:teuthology.orchestra.run.smithi059.stdout:545.out 2023-10-16T14:30:35.437 INFO:teuthology.orchestra.run.smithi059.stdout:546 2023-10-16T14:30:35.437 INFO:teuthology.orchestra.run.smithi059.stdout:546.out 2023-10-16T14:30:35.437 INFO:teuthology.orchestra.run.smithi059.stdout:547 2023-10-16T14:30:35.437 INFO:teuthology.orchestra.run.smithi059.stdout:547.out 2023-10-16T14:30:35.438 INFO:teuthology.orchestra.run.smithi059.stdout:548 2023-10-16T14:30:35.438 INFO:teuthology.orchestra.run.smithi059.stdout:548.out 2023-10-16T14:30:35.438 INFO:teuthology.orchestra.run.smithi059.stdout:549 2023-10-16T14:30:35.438 INFO:teuthology.orchestra.run.smithi059.stdout:549.out 2023-10-16T14:30:35.438 INFO:teuthology.orchestra.run.smithi059.stdout:550 2023-10-16T14:30:35.438 INFO:teuthology.orchestra.run.smithi059.stdout:550.out 2023-10-16T14:30:35.439 INFO:teuthology.orchestra.run.smithi059.stdout:551 2023-10-16T14:30:35.439 INFO:teuthology.orchestra.run.smithi059.stdout:551.out 2023-10-16T14:30:35.439 INFO:teuthology.orchestra.run.smithi059.stdout:552 2023-10-16T14:30:35.439 INFO:teuthology.orchestra.run.smithi059.stdout:552.out 2023-10-16T14:30:35.439 INFO:teuthology.orchestra.run.smithi059.stdout:553 2023-10-16T14:30:35.440 INFO:teuthology.orchestra.run.smithi059.stdout:553.out 2023-10-16T14:30:35.440 INFO:teuthology.orchestra.run.smithi059.stdout:554 2023-10-16T14:30:35.440 INFO:teuthology.orchestra.run.smithi059.stdout:554.out 2023-10-16T14:30:35.440 INFO:teuthology.orchestra.run.smithi059.stdout:555 2023-10-16T14:30:35.440 INFO:teuthology.orchestra.run.smithi059.stdout:555.out 2023-10-16T14:30:35.440 INFO:teuthology.orchestra.run.smithi059.stdout:556 2023-10-16T14:30:35.441 INFO:teuthology.orchestra.run.smithi059.stdout:556.out 2023-10-16T14:30:35.441 INFO:teuthology.orchestra.run.smithi059.stdout:557 2023-10-16T14:30:35.441 INFO:teuthology.orchestra.run.smithi059.stdout:557.out 2023-10-16T14:30:35.441 INFO:teuthology.orchestra.run.smithi059.stdout:558 2023-10-16T14:30:35.441 INFO:teuthology.orchestra.run.smithi059.stdout:558.out 2023-10-16T14:30:35.442 INFO:teuthology.orchestra.run.smithi059.stdout:559 2023-10-16T14:30:35.442 INFO:teuthology.orchestra.run.smithi059.stdout:559.out 2023-10-16T14:30:35.442 INFO:teuthology.orchestra.run.smithi059.stdout:560 2023-10-16T14:30:35.442 INFO:teuthology.orchestra.run.smithi059.stdout:560.out 2023-10-16T14:30:35.442 INFO:teuthology.orchestra.run.smithi059.stdout:561 2023-10-16T14:30:35.443 INFO:teuthology.orchestra.run.smithi059.stdout:561.out 2023-10-16T14:30:35.443 INFO:teuthology.orchestra.run.smithi059.stdout:562 2023-10-16T14:30:35.443 INFO:teuthology.orchestra.run.smithi059.stdout:562.out 2023-10-16T14:30:35.443 INFO:teuthology.orchestra.run.smithi059.stdout:563 2023-10-16T14:30:35.443 INFO:teuthology.orchestra.run.smithi059.stdout:563.out 2023-10-16T14:30:35.444 INFO:teuthology.orchestra.run.smithi059.stdout:564 2023-10-16T14:30:35.444 INFO:teuthology.orchestra.run.smithi059.stdout:564.out 2023-10-16T14:30:35.444 INFO:teuthology.orchestra.run.smithi059.stdout:565 2023-10-16T14:30:35.444 INFO:teuthology.orchestra.run.smithi059.stdout:565.out 2023-10-16T14:30:35.444 INFO:teuthology.orchestra.run.smithi059.stdout:566 2023-10-16T14:30:35.445 INFO:teuthology.orchestra.run.smithi059.stdout:566.out 2023-10-16T14:30:35.445 INFO:teuthology.orchestra.run.smithi059.stdout:567 2023-10-16T14:30:35.445 INFO:teuthology.orchestra.run.smithi059.stdout:567.out 2023-10-16T14:30:35.445 INFO:teuthology.orchestra.run.smithi059.stdout:568 2023-10-16T14:30:35.445 INFO:teuthology.orchestra.run.smithi059.stdout:568.out 2023-10-16T14:30:35.446 INFO:teuthology.orchestra.run.smithi059.stdout:569 2023-10-16T14:30:35.446 INFO:teuthology.orchestra.run.smithi059.stdout:569.out 2023-10-16T14:30:35.446 INFO:teuthology.orchestra.run.smithi059.stdout:570 2023-10-16T14:30:35.446 INFO:teuthology.orchestra.run.smithi059.stdout:570.out 2023-10-16T14:30:35.446 INFO:teuthology.orchestra.run.smithi059.stdout:571 2023-10-16T14:30:35.446 INFO:teuthology.orchestra.run.smithi059.stdout:571.out 2023-10-16T14:30:35.447 INFO:teuthology.orchestra.run.smithi059.stdout:572 2023-10-16T14:30:35.447 INFO:teuthology.orchestra.run.smithi059.stdout:572.out 2023-10-16T14:30:35.447 INFO:teuthology.orchestra.run.smithi059.stdout:573 2023-10-16T14:30:35.447 INFO:teuthology.orchestra.run.smithi059.stdout:573.out 2023-10-16T14:30:35.447 INFO:teuthology.orchestra.run.smithi059.stdout:574 2023-10-16T14:30:35.448 INFO:teuthology.orchestra.run.smithi059.stdout:574.out 2023-10-16T14:30:35.448 INFO:teuthology.orchestra.run.smithi059.stdout:575 2023-10-16T14:30:35.448 INFO:teuthology.orchestra.run.smithi059.stdout:575.out 2023-10-16T14:30:35.448 INFO:teuthology.orchestra.run.smithi059.stdout:576 2023-10-16T14:30:35.448 INFO:teuthology.orchestra.run.smithi059.stdout:576.out 2023-10-16T14:30:35.449 INFO:teuthology.orchestra.run.smithi059.stdout:577 2023-10-16T14:30:35.449 INFO:teuthology.orchestra.run.smithi059.stdout:577.out 2023-10-16T14:30:35.449 INFO:teuthology.orchestra.run.smithi059.stdout:578 2023-10-16T14:30:35.449 INFO:teuthology.orchestra.run.smithi059.stdout:578.out 2023-10-16T14:30:35.449 INFO:teuthology.orchestra.run.smithi059.stdout:579 2023-10-16T14:30:35.450 INFO:teuthology.orchestra.run.smithi059.stdout:579.out 2023-10-16T14:30:35.450 INFO:teuthology.orchestra.run.smithi059.stdout:580 2023-10-16T14:30:35.450 INFO:teuthology.orchestra.run.smithi059.stdout:580.out 2023-10-16T14:30:35.450 INFO:teuthology.orchestra.run.smithi059.stdout:581 2023-10-16T14:30:35.450 INFO:teuthology.orchestra.run.smithi059.stdout:581.out 2023-10-16T14:30:35.451 INFO:teuthology.orchestra.run.smithi059.stdout:582 2023-10-16T14:30:35.451 INFO:teuthology.orchestra.run.smithi059.stdout:582.out 2023-10-16T14:30:35.451 INFO:teuthology.orchestra.run.smithi059.stdout:583 2023-10-16T14:30:35.451 INFO:teuthology.orchestra.run.smithi059.stdout:583.out 2023-10-16T14:30:35.451 INFO:teuthology.orchestra.run.smithi059.stdout:584 2023-10-16T14:30:35.451 INFO:teuthology.orchestra.run.smithi059.stdout:584.out 2023-10-16T14:30:35.452 INFO:teuthology.orchestra.run.smithi059.stdout:585 2023-10-16T14:30:35.452 INFO:teuthology.orchestra.run.smithi059.stdout:585.out 2023-10-16T14:30:35.452 INFO:teuthology.orchestra.run.smithi059.stdout:586 2023-10-16T14:30:35.452 INFO:teuthology.orchestra.run.smithi059.stdout:586.out 2023-10-16T14:30:35.452 INFO:teuthology.orchestra.run.smithi059.stdout:587 2023-10-16T14:30:35.453 INFO:teuthology.orchestra.run.smithi059.stdout:587.out 2023-10-16T14:30:35.453 INFO:teuthology.orchestra.run.smithi059.stdout:588 2023-10-16T14:30:35.453 INFO:teuthology.orchestra.run.smithi059.stdout:588.out 2023-10-16T14:30:35.453 INFO:teuthology.orchestra.run.smithi059.stdout:589 2023-10-16T14:30:35.453 INFO:teuthology.orchestra.run.smithi059.stdout:589.out 2023-10-16T14:30:35.454 INFO:teuthology.orchestra.run.smithi059.stdout:590 2023-10-16T14:30:35.454 INFO:teuthology.orchestra.run.smithi059.stdout:590.out 2023-10-16T14:30:35.454 INFO:teuthology.orchestra.run.smithi059.stdout:591 2023-10-16T14:30:35.454 INFO:teuthology.orchestra.run.smithi059.stdout:591.out 2023-10-16T14:30:35.454 INFO:teuthology.orchestra.run.smithi059.stdout:592 2023-10-16T14:30:35.454 INFO:teuthology.orchestra.run.smithi059.stdout:592.out 2023-10-16T14:30:35.455 INFO:teuthology.orchestra.run.smithi059.stdout:593 2023-10-16T14:30:35.455 INFO:teuthology.orchestra.run.smithi059.stdout:593.out 2023-10-16T14:30:35.455 INFO:teuthology.orchestra.run.smithi059.stdout:594 2023-10-16T14:30:35.455 INFO:teuthology.orchestra.run.smithi059.stdout:594.out 2023-10-16T14:30:35.455 INFO:teuthology.orchestra.run.smithi059.stdout:595 2023-10-16T14:30:35.456 INFO:teuthology.orchestra.run.smithi059.stdout:595.out 2023-10-16T14:30:35.456 INFO:teuthology.orchestra.run.smithi059.stdout:596 2023-10-16T14:30:35.456 INFO:teuthology.orchestra.run.smithi059.stdout:596.out 2023-10-16T14:30:35.456 INFO:teuthology.orchestra.run.smithi059.stdout:597 2023-10-16T14:30:35.456 INFO:teuthology.orchestra.run.smithi059.stdout:597.out 2023-10-16T14:30:35.457 INFO:teuthology.orchestra.run.smithi059.stdout:598 2023-10-16T14:30:35.457 INFO:teuthology.orchestra.run.smithi059.stdout:598.out 2023-10-16T14:30:35.457 INFO:teuthology.orchestra.run.smithi059.stdout:599 2023-10-16T14:30:35.457 INFO:teuthology.orchestra.run.smithi059.stdout:599.out 2023-10-16T14:30:35.457 INFO:teuthology.orchestra.run.smithi059.stdout:600 2023-10-16T14:30:35.457 INFO:teuthology.orchestra.run.smithi059.stdout:600.out 2023-10-16T14:30:35.458 INFO:teuthology.orchestra.run.smithi059.stdout:601 2023-10-16T14:30:35.458 INFO:teuthology.orchestra.run.smithi059.stdout:601.out 2023-10-16T14:30:35.458 INFO:teuthology.orchestra.run.smithi059.stdout:602 2023-10-16T14:30:35.458 INFO:teuthology.orchestra.run.smithi059.stdout:602.out 2023-10-16T14:30:35.458 INFO:teuthology.orchestra.run.smithi059.stdout:603 2023-10-16T14:30:35.459 INFO:teuthology.orchestra.run.smithi059.stdout:603.out 2023-10-16T14:30:35.459 INFO:teuthology.orchestra.run.smithi059.stdout:604 2023-10-16T14:30:35.459 INFO:teuthology.orchestra.run.smithi059.stdout:604.out 2023-10-16T14:30:35.459 INFO:teuthology.orchestra.run.smithi059.stdout:605 2023-10-16T14:30:35.459 INFO:teuthology.orchestra.run.smithi059.stdout:605.out 2023-10-16T14:30:35.460 INFO:teuthology.orchestra.run.smithi059.stdout:606 2023-10-16T14:30:35.460 INFO:teuthology.orchestra.run.smithi059.stdout:606.out 2023-10-16T14:30:35.460 INFO:teuthology.orchestra.run.smithi059.stdout:607 2023-10-16T14:30:35.460 INFO:teuthology.orchestra.run.smithi059.stdout:607.out 2023-10-16T14:30:35.461 INFO:teuthology.orchestra.run.smithi059.stdout:608 2023-10-16T14:30:35.461 INFO:teuthology.orchestra.run.smithi059.stdout:608.out 2023-10-16T14:30:35.461 INFO:teuthology.orchestra.run.smithi059.stdout:609 2023-10-16T14:30:35.461 INFO:teuthology.orchestra.run.smithi059.stdout:609.out 2023-10-16T14:30:35.462 INFO:teuthology.orchestra.run.smithi059.stdout:610 2023-10-16T14:30:35.462 INFO:teuthology.orchestra.run.smithi059.stdout:610.out 2023-10-16T14:30:35.462 INFO:teuthology.orchestra.run.smithi059.stdout:611 2023-10-16T14:30:35.462 INFO:teuthology.orchestra.run.smithi059.stdout:611.out 2023-10-16T14:30:35.462 INFO:teuthology.orchestra.run.smithi059.stdout:612 2023-10-16T14:30:35.463 INFO:teuthology.orchestra.run.smithi059.stdout:612.out 2023-10-16T14:30:35.463 INFO:teuthology.orchestra.run.smithi059.stdout:613 2023-10-16T14:30:35.463 INFO:teuthology.orchestra.run.smithi059.stdout:613.out 2023-10-16T14:30:35.463 INFO:teuthology.orchestra.run.smithi059.stdout:614 2023-10-16T14:30:35.463 INFO:teuthology.orchestra.run.smithi059.stdout:614.out 2023-10-16T14:30:35.464 INFO:teuthology.orchestra.run.smithi059.stdout:615 2023-10-16T14:30:35.464 INFO:teuthology.orchestra.run.smithi059.stdout:615.out 2023-10-16T14:30:35.464 INFO:teuthology.orchestra.run.smithi059.stdout:616 2023-10-16T14:30:35.464 INFO:teuthology.orchestra.run.smithi059.stdout:616.out 2023-10-16T14:30:35.465 INFO:teuthology.orchestra.run.smithi059.stdout:617 2023-10-16T14:30:35.465 INFO:teuthology.orchestra.run.smithi059.stdout:617.out 2023-10-16T14:30:35.465 INFO:teuthology.orchestra.run.smithi059.stdout:618 2023-10-16T14:30:35.465 INFO:teuthology.orchestra.run.smithi059.stdout:618.out 2023-10-16T14:30:35.465 INFO:teuthology.orchestra.run.smithi059.stdout:619 2023-10-16T14:30:35.466 INFO:teuthology.orchestra.run.smithi059.stdout:619.out 2023-10-16T14:30:35.466 INFO:teuthology.orchestra.run.smithi059.stdout:620 2023-10-16T14:30:35.466 INFO:teuthology.orchestra.run.smithi059.stdout:620.out 2023-10-16T14:30:35.466 INFO:teuthology.orchestra.run.smithi059.stdout:621 2023-10-16T14:30:35.466 INFO:teuthology.orchestra.run.smithi059.stdout:621.out 2023-10-16T14:30:35.467 INFO:teuthology.orchestra.run.smithi059.stdout:622 2023-10-16T14:30:35.467 INFO:teuthology.orchestra.run.smithi059.stdout:622.out 2023-10-16T14:30:35.467 INFO:teuthology.orchestra.run.smithi059.stdout:623 2023-10-16T14:30:35.467 INFO:teuthology.orchestra.run.smithi059.stdout:623.out 2023-10-16T14:30:35.467 INFO:teuthology.orchestra.run.smithi059.stdout:624 2023-10-16T14:30:35.468 INFO:teuthology.orchestra.run.smithi059.stdout:624.out 2023-10-16T14:30:35.468 INFO:teuthology.orchestra.run.smithi059.stdout:625 2023-10-16T14:30:35.468 INFO:teuthology.orchestra.run.smithi059.stdout:625.out 2023-10-16T14:30:35.468 INFO:teuthology.orchestra.run.smithi059.stdout:626 2023-10-16T14:30:35.468 INFO:teuthology.orchestra.run.smithi059.stdout:626.out 2023-10-16T14:30:35.468 INFO:teuthology.orchestra.run.smithi059.stdout:627 2023-10-16T14:30:35.469 INFO:teuthology.orchestra.run.smithi059.stdout:627.out 2023-10-16T14:30:35.469 INFO:teuthology.orchestra.run.smithi059.stdout:628 2023-10-16T14:30:35.469 INFO:teuthology.orchestra.run.smithi059.stdout:628.out 2023-10-16T14:30:35.469 INFO:teuthology.orchestra.run.smithi059.stdout:629 2023-10-16T14:30:35.469 INFO:teuthology.orchestra.run.smithi059.stdout:629.out 2023-10-16T14:30:35.470 INFO:teuthology.orchestra.run.smithi059.stdout:630 2023-10-16T14:30:35.470 INFO:teuthology.orchestra.run.smithi059.stdout:630.out 2023-10-16T14:30:35.470 INFO:teuthology.orchestra.run.smithi059.stdout:631 2023-10-16T14:30:35.470 INFO:teuthology.orchestra.run.smithi059.stdout:631.out 2023-10-16T14:30:35.470 INFO:teuthology.orchestra.run.smithi059.stdout:632 2023-10-16T14:30:35.471 INFO:teuthology.orchestra.run.smithi059.stdout:632.out 2023-10-16T14:30:35.471 INFO:teuthology.orchestra.run.smithi059.stdout:633 2023-10-16T14:30:35.471 INFO:teuthology.orchestra.run.smithi059.stdout:633.out 2023-10-16T14:30:35.471 INFO:teuthology.orchestra.run.smithi059.stdout:634 2023-10-16T14:30:35.471 INFO:teuthology.orchestra.run.smithi059.stdout:634.out 2023-10-16T14:30:35.471 INFO:teuthology.orchestra.run.smithi059.stdout:635 2023-10-16T14:30:35.472 INFO:teuthology.orchestra.run.smithi059.stdout:635.out 2023-10-16T14:30:35.472 INFO:teuthology.orchestra.run.smithi059.stdout:636 2023-10-16T14:30:35.472 INFO:teuthology.orchestra.run.smithi059.stdout:636.out 2023-10-16T14:30:35.472 INFO:teuthology.orchestra.run.smithi059.stdout:637 2023-10-16T14:30:35.472 INFO:teuthology.orchestra.run.smithi059.stdout:637.out 2023-10-16T14:30:35.473 INFO:teuthology.orchestra.run.smithi059.stdout:638 2023-10-16T14:30:35.473 INFO:teuthology.orchestra.run.smithi059.stdout:638.out 2023-10-16T14:30:35.473 INFO:teuthology.orchestra.run.smithi059.stdout:639 2023-10-16T14:30:35.473 INFO:teuthology.orchestra.run.smithi059.stdout:639.out 2023-10-16T14:30:35.473 INFO:teuthology.orchestra.run.smithi059.stdout:640 2023-10-16T14:30:35.474 INFO:teuthology.orchestra.run.smithi059.stdout:640.out 2023-10-16T14:30:35.474 INFO:teuthology.orchestra.run.smithi059.stdout:641 2023-10-16T14:30:35.474 INFO:teuthology.orchestra.run.smithi059.stdout:641.out 2023-10-16T14:30:35.474 INFO:teuthology.orchestra.run.smithi059.stdout:642 2023-10-16T14:30:35.474 INFO:teuthology.orchestra.run.smithi059.stdout:642.out 2023-10-16T14:30:35.475 INFO:teuthology.orchestra.run.smithi059.stdout:643 2023-10-16T14:30:35.475 INFO:teuthology.orchestra.run.smithi059.stdout:643.out 2023-10-16T14:30:35.475 INFO:teuthology.orchestra.run.smithi059.stdout:644 2023-10-16T14:30:35.475 INFO:teuthology.orchestra.run.smithi059.stdout:644.out 2023-10-16T14:30:35.475 INFO:teuthology.orchestra.run.smithi059.stdout:645 2023-10-16T14:30:35.475 INFO:teuthology.orchestra.run.smithi059.stdout:645.out 2023-10-16T14:30:35.476 INFO:teuthology.orchestra.run.smithi059.stdout:646 2023-10-16T14:30:35.476 INFO:teuthology.orchestra.run.smithi059.stdout:646.out 2023-10-16T14:30:35.476 INFO:teuthology.orchestra.run.smithi059.stdout:647 2023-10-16T14:30:35.476 INFO:teuthology.orchestra.run.smithi059.stdout:647.out 2023-10-16T14:30:35.476 INFO:teuthology.orchestra.run.smithi059.stdout:648 2023-10-16T14:30:35.476 INFO:teuthology.orchestra.run.smithi059.stdout:648.out 2023-10-16T14:30:35.477 INFO:teuthology.orchestra.run.smithi059.stdout:649 2023-10-16T14:30:35.477 INFO:teuthology.orchestra.run.smithi059.stdout:649.out 2023-10-16T14:30:35.477 INFO:teuthology.orchestra.run.smithi059.stdout:650 2023-10-16T14:30:35.477 INFO:teuthology.orchestra.run.smithi059.stdout:650.out 2023-10-16T14:30:35.478 INFO:teuthology.orchestra.run.smithi059.stdout:651 2023-10-16T14:30:35.478 INFO:teuthology.orchestra.run.smithi059.stdout:651.out 2023-10-16T14:30:35.478 INFO:teuthology.orchestra.run.smithi059.stdout:652 2023-10-16T14:30:35.478 INFO:teuthology.orchestra.run.smithi059.stdout:652.out 2023-10-16T14:30:35.479 INFO:teuthology.orchestra.run.smithi059.stdout:653 2023-10-16T14:30:35.479 INFO:teuthology.orchestra.run.smithi059.stdout:653.out 2023-10-16T14:30:35.479 INFO:teuthology.orchestra.run.smithi059.stdout:654 2023-10-16T14:30:35.479 INFO:teuthology.orchestra.run.smithi059.stdout:654.out 2023-10-16T14:30:35.479 INFO:teuthology.orchestra.run.smithi059.stdout:655 2023-10-16T14:30:35.480 INFO:teuthology.orchestra.run.smithi059.stdout:655.out 2023-10-16T14:30:35.480 INFO:teuthology.orchestra.run.smithi059.stdout:656 2023-10-16T14:30:35.480 INFO:teuthology.orchestra.run.smithi059.stdout:656.out 2023-10-16T14:30:35.480 INFO:teuthology.orchestra.run.smithi059.stdout:657 2023-10-16T14:30:35.480 INFO:teuthology.orchestra.run.smithi059.stdout:657.out 2023-10-16T14:30:35.481 INFO:teuthology.orchestra.run.smithi059.stdout:658 2023-10-16T14:30:35.481 INFO:teuthology.orchestra.run.smithi059.stdout:658.out 2023-10-16T14:30:35.481 INFO:teuthology.orchestra.run.smithi059.stdout:659 2023-10-16T14:30:35.481 INFO:teuthology.orchestra.run.smithi059.stdout:659.out 2023-10-16T14:30:35.481 INFO:teuthology.orchestra.run.smithi059.stdout:660 2023-10-16T14:30:35.481 INFO:teuthology.orchestra.run.smithi059.stdout:660.out 2023-10-16T14:30:35.482 INFO:teuthology.orchestra.run.smithi059.stdout:661 2023-10-16T14:30:35.482 INFO:teuthology.orchestra.run.smithi059.stdout:661.out 2023-10-16T14:30:35.482 INFO:teuthology.orchestra.run.smithi059.stdout:662 2023-10-16T14:30:35.482 INFO:teuthology.orchestra.run.smithi059.stdout:662.out 2023-10-16T14:30:35.482 INFO:teuthology.orchestra.run.smithi059.stdout:663 2023-10-16T14:30:35.483 INFO:teuthology.orchestra.run.smithi059.stdout:663.out 2023-10-16T14:30:35.483 INFO:teuthology.orchestra.run.smithi059.stdout:664 2023-10-16T14:30:35.483 INFO:teuthology.orchestra.run.smithi059.stdout:664.out 2023-10-16T14:30:35.483 INFO:teuthology.orchestra.run.smithi059.stdout:665 2023-10-16T14:30:35.483 INFO:teuthology.orchestra.run.smithi059.stdout:665.out 2023-10-16T14:30:35.483 INFO:teuthology.orchestra.run.smithi059.stdout:666 2023-10-16T14:30:35.484 INFO:teuthology.orchestra.run.smithi059.stdout:666.out 2023-10-16T14:30:35.484 INFO:teuthology.orchestra.run.smithi059.stdout:667 2023-10-16T14:30:35.484 INFO:teuthology.orchestra.run.smithi059.stdout:667.out 2023-10-16T14:30:35.484 INFO:teuthology.orchestra.run.smithi059.stdout:668 2023-10-16T14:30:35.484 INFO:teuthology.orchestra.run.smithi059.stdout:668.out 2023-10-16T14:30:35.485 INFO:teuthology.orchestra.run.smithi059.stdout:669 2023-10-16T14:30:35.485 INFO:teuthology.orchestra.run.smithi059.stdout:669.out 2023-10-16T14:30:35.485 INFO:teuthology.orchestra.run.smithi059.stdout:670 2023-10-16T14:30:35.485 INFO:teuthology.orchestra.run.smithi059.stdout:670.out 2023-10-16T14:30:35.485 INFO:teuthology.orchestra.run.smithi059.stdout:671 2023-10-16T14:30:35.485 INFO:teuthology.orchestra.run.smithi059.stdout:671.out 2023-10-16T14:30:35.486 INFO:teuthology.orchestra.run.smithi059.stdout:672 2023-10-16T14:30:35.486 INFO:teuthology.orchestra.run.smithi059.stdout:672.out 2023-10-16T14:30:35.486 INFO:teuthology.orchestra.run.smithi059.stdout:673 2023-10-16T14:30:35.486 INFO:teuthology.orchestra.run.smithi059.stdout:673.out 2023-10-16T14:30:35.486 INFO:teuthology.orchestra.run.smithi059.stdout:674 2023-10-16T14:30:35.487 INFO:teuthology.orchestra.run.smithi059.stdout:674.out 2023-10-16T14:30:35.487 INFO:teuthology.orchestra.run.smithi059.stdout:675 2023-10-16T14:30:35.487 INFO:teuthology.orchestra.run.smithi059.stdout:675.out 2023-10-16T14:30:35.487 INFO:teuthology.orchestra.run.smithi059.stdout:676 2023-10-16T14:30:35.487 INFO:teuthology.orchestra.run.smithi059.stdout:676.out 2023-10-16T14:30:35.488 INFO:teuthology.orchestra.run.smithi059.stdout:677 2023-10-16T14:30:35.488 INFO:teuthology.orchestra.run.smithi059.stdout:677.out 2023-10-16T14:30:35.488 INFO:teuthology.orchestra.run.smithi059.stdout:678 2023-10-16T14:30:35.488 INFO:teuthology.orchestra.run.smithi059.stdout:678.out 2023-10-16T14:30:35.488 INFO:teuthology.orchestra.run.smithi059.stdout:679 2023-10-16T14:30:35.488 INFO:teuthology.orchestra.run.smithi059.stdout:679.out 2023-10-16T14:30:35.489 INFO:teuthology.orchestra.run.smithi059.stdout:680 2023-10-16T14:30:35.489 INFO:teuthology.orchestra.run.smithi059.stdout:680.out 2023-10-16T14:30:35.489 INFO:teuthology.orchestra.run.smithi059.stdout:681 2023-10-16T14:30:35.489 INFO:teuthology.orchestra.run.smithi059.stdout:681.out 2023-10-16T14:30:35.489 INFO:teuthology.orchestra.run.smithi059.stdout:682 2023-10-16T14:30:35.490 INFO:teuthology.orchestra.run.smithi059.stdout:682.out 2023-10-16T14:30:35.490 INFO:teuthology.orchestra.run.smithi059.stdout:683 2023-10-16T14:30:35.490 INFO:teuthology.orchestra.run.smithi059.stdout:683.out 2023-10-16T14:30:35.490 INFO:teuthology.orchestra.run.smithi059.stdout:684 2023-10-16T14:30:35.491 INFO:teuthology.orchestra.run.smithi059.stdout:684.out 2023-10-16T14:30:35.491 INFO:teuthology.orchestra.run.smithi059.stdout:685 2023-10-16T14:30:35.491 INFO:teuthology.orchestra.run.smithi059.stdout:685.out 2023-10-16T14:30:35.491 INFO:teuthology.orchestra.run.smithi059.stdout:686 2023-10-16T14:30:35.492 INFO:teuthology.orchestra.run.smithi059.stdout:686.out 2023-10-16T14:30:35.492 INFO:teuthology.orchestra.run.smithi059.stdout:687 2023-10-16T14:30:35.492 INFO:teuthology.orchestra.run.smithi059.stdout:687.out 2023-10-16T14:30:35.492 INFO:teuthology.orchestra.run.smithi059.stdout:688 2023-10-16T14:30:35.492 INFO:teuthology.orchestra.run.smithi059.stdout:688.out 2023-10-16T14:30:35.493 INFO:teuthology.orchestra.run.smithi059.stdout:689 2023-10-16T14:30:35.493 INFO:teuthology.orchestra.run.smithi059.stdout:689.out 2023-10-16T14:30:35.493 INFO:teuthology.orchestra.run.smithi059.stdout:690 2023-10-16T14:30:35.493 INFO:teuthology.orchestra.run.smithi059.stdout:690.out 2023-10-16T14:30:35.494 INFO:teuthology.orchestra.run.smithi059.stdout:691 2023-10-16T14:30:35.494 INFO:teuthology.orchestra.run.smithi059.stdout:691.out 2023-10-16T14:30:35.494 INFO:teuthology.orchestra.run.smithi059.stdout:692 2023-10-16T14:30:35.494 INFO:teuthology.orchestra.run.smithi059.stdout:692.out 2023-10-16T14:30:35.495 INFO:teuthology.orchestra.run.smithi059.stdout:693 2023-10-16T14:30:35.495 INFO:teuthology.orchestra.run.smithi059.stdout:693.out 2023-10-16T14:30:35.495 INFO:teuthology.orchestra.run.smithi059.stdout:694 2023-10-16T14:30:35.495 INFO:teuthology.orchestra.run.smithi059.stdout:694.out 2023-10-16T14:30:35.495 INFO:teuthology.orchestra.run.smithi059.stdout:695 2023-10-16T14:30:35.495 INFO:teuthology.orchestra.run.smithi059.stdout:695.out 2023-10-16T14:30:35.496 INFO:teuthology.orchestra.run.smithi059.stdout:696 2023-10-16T14:30:35.496 INFO:teuthology.orchestra.run.smithi059.stdout:696.out 2023-10-16T14:30:35.496 INFO:teuthology.orchestra.run.smithi059.stdout:697 2023-10-16T14:30:35.496 INFO:teuthology.orchestra.run.smithi059.stdout:697.out 2023-10-16T14:30:35.496 INFO:teuthology.orchestra.run.smithi059.stdout:698 2023-10-16T14:30:35.497 INFO:teuthology.orchestra.run.smithi059.stdout:698.out 2023-10-16T14:30:35.497 INFO:teuthology.orchestra.run.smithi059.stdout:699 2023-10-16T14:30:35.497 INFO:teuthology.orchestra.run.smithi059.stdout:699.out 2023-10-16T14:30:35.497 INFO:teuthology.orchestra.run.smithi059.stdout:700 2023-10-16T14:30:35.497 INFO:teuthology.orchestra.run.smithi059.stdout:700.out 2023-10-16T14:30:35.497 INFO:teuthology.orchestra.run.smithi059.stdout:701 2023-10-16T14:30:35.498 INFO:teuthology.orchestra.run.smithi059.stdout:701.out 2023-10-16T14:30:35.498 INFO:teuthology.orchestra.run.smithi059.stdout:702 2023-10-16T14:30:35.498 INFO:teuthology.orchestra.run.smithi059.stdout:702.out 2023-10-16T14:30:35.498 INFO:teuthology.orchestra.run.smithi059.stdout:703 2023-10-16T14:30:35.498 INFO:teuthology.orchestra.run.smithi059.stdout:703.out 2023-10-16T14:30:35.499 INFO:teuthology.orchestra.run.smithi059.stdout:704 2023-10-16T14:30:35.499 INFO:teuthology.orchestra.run.smithi059.stdout:704.out 2023-10-16T14:30:35.499 INFO:teuthology.orchestra.run.smithi059.stdout:705 2023-10-16T14:30:35.499 INFO:teuthology.orchestra.run.smithi059.stdout:705.out 2023-10-16T14:30:35.499 INFO:teuthology.orchestra.run.smithi059.stdout:706 2023-10-16T14:30:35.499 INFO:teuthology.orchestra.run.smithi059.stdout:706.out 2023-10-16T14:30:35.500 INFO:teuthology.orchestra.run.smithi059.stdout:707 2023-10-16T14:30:35.500 INFO:teuthology.orchestra.run.smithi059.stdout:707.out 2023-10-16T14:30:35.500 INFO:teuthology.orchestra.run.smithi059.stdout:708 2023-10-16T14:30:35.500 INFO:teuthology.orchestra.run.smithi059.stdout:708.out 2023-10-16T14:30:35.500 INFO:teuthology.orchestra.run.smithi059.stdout:709 2023-10-16T14:30:35.501 INFO:teuthology.orchestra.run.smithi059.stdout:709.out 2023-10-16T14:30:35.501 INFO:teuthology.orchestra.run.smithi059.stdout:710 2023-10-16T14:30:35.501 INFO:teuthology.orchestra.run.smithi059.stdout:710.out 2023-10-16T14:30:35.501 INFO:teuthology.orchestra.run.smithi059.stdout:711 2023-10-16T14:30:35.501 INFO:teuthology.orchestra.run.smithi059.stdout:711.out 2023-10-16T14:30:35.501 INFO:teuthology.orchestra.run.smithi059.stdout:712 2023-10-16T14:30:35.502 INFO:teuthology.orchestra.run.smithi059.stdout:712.out 2023-10-16T14:30:35.502 INFO:teuthology.orchestra.run.smithi059.stdout:713 2023-10-16T14:30:35.502 INFO:teuthology.orchestra.run.smithi059.stdout:713.out 2023-10-16T14:30:35.502 INFO:teuthology.orchestra.run.smithi059.stdout:714 2023-10-16T14:30:35.502 INFO:teuthology.orchestra.run.smithi059.stdout:714.out 2023-10-16T14:30:35.502 INFO:teuthology.orchestra.run.smithi059.stdout:715 2023-10-16T14:30:35.503 INFO:teuthology.orchestra.run.smithi059.stdout:715.out 2023-10-16T14:30:35.503 INFO:teuthology.orchestra.run.smithi059.stdout:716 2023-10-16T14:30:35.503 INFO:teuthology.orchestra.run.smithi059.stdout:716.out 2023-10-16T14:30:35.503 INFO:teuthology.orchestra.run.smithi059.stdout:717 2023-10-16T14:30:35.503 INFO:teuthology.orchestra.run.smithi059.stdout:717.out 2023-10-16T14:30:35.504 INFO:teuthology.orchestra.run.smithi059.stdout:718 2023-10-16T14:30:35.504 INFO:teuthology.orchestra.run.smithi059.stdout:718.out 2023-10-16T14:30:35.504 INFO:teuthology.orchestra.run.smithi059.stdout:719 2023-10-16T14:30:35.504 INFO:teuthology.orchestra.run.smithi059.stdout:719.out 2023-10-16T14:30:35.504 INFO:teuthology.orchestra.run.smithi059.stdout:720 2023-10-16T14:30:35.505 INFO:teuthology.orchestra.run.smithi059.stdout:720.out 2023-10-16T14:30:35.505 INFO:teuthology.orchestra.run.smithi059.stdout:721 2023-10-16T14:30:35.505 INFO:teuthology.orchestra.run.smithi059.stdout:721.out 2023-10-16T14:30:35.505 INFO:teuthology.orchestra.run.smithi059.stdout:722 2023-10-16T14:30:35.505 INFO:teuthology.orchestra.run.smithi059.stdout:722.out 2023-10-16T14:30:35.505 INFO:teuthology.orchestra.run.smithi059.stdout:723 2023-10-16T14:30:35.506 INFO:teuthology.orchestra.run.smithi059.stdout:723.out 2023-10-16T14:30:35.506 INFO:teuthology.orchestra.run.smithi059.stdout:724 2023-10-16T14:30:35.506 INFO:teuthology.orchestra.run.smithi059.stdout:724.out 2023-10-16T14:30:35.506 INFO:teuthology.orchestra.run.smithi059.stdout:725 2023-10-16T14:30:35.506 INFO:teuthology.orchestra.run.smithi059.stdout:725.out 2023-10-16T14:30:35.507 INFO:teuthology.orchestra.run.smithi059.stdout:726 2023-10-16T14:30:35.507 INFO:teuthology.orchestra.run.smithi059.stdout:726.out 2023-10-16T14:30:35.507 INFO:teuthology.orchestra.run.smithi059.stdout:727 2023-10-16T14:30:35.507 INFO:teuthology.orchestra.run.smithi059.stdout:727.out 2023-10-16T14:30:35.508 INFO:teuthology.orchestra.run.smithi059.stdout:728 2023-10-16T14:30:35.508 INFO:teuthology.orchestra.run.smithi059.stdout:728.out 2023-10-16T14:30:35.508 INFO:teuthology.orchestra.run.smithi059.stdout:729 2023-10-16T14:30:35.508 INFO:teuthology.orchestra.run.smithi059.stdout:729.out 2023-10-16T14:30:35.508 INFO:teuthology.orchestra.run.smithi059.stdout:730 2023-10-16T14:30:35.509 INFO:teuthology.orchestra.run.smithi059.stdout:730.out 2023-10-16T14:30:35.509 INFO:teuthology.orchestra.run.smithi059.stdout:731 2023-10-16T14:30:35.509 INFO:teuthology.orchestra.run.smithi059.stdout:731.out 2023-10-16T14:30:35.509 INFO:teuthology.orchestra.run.smithi059.stdout:group.list 2023-10-16T14:30:35.509 INFO:teuthology.orchestra.run.smithi059.stdout:Makefile 2023-10-16T14:30:35.511 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-10-16T14:30:36.112 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:30:36.127 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:30:36.127 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:30:45.174 INFO:teuthology.orchestra.run.smithi059.stdout:generic/001 9s 2023-10-16T14:30:45.199 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/001 2023-10-16T14:30:45.200 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:30:45.212 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:30:45.218 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi059.stderr:ceph-fuse[103208]: fuse finished with error 0 and tester_r 0 2023-10-16T14:30:45.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:30:45.247 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-10-16T14:30:45.818 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:30:45.832 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:30:45.832 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:30:46.922 INFO:teuthology.orchestra.run.smithi059.stdout:generic/002 1s 2023-10-16T14:30:46.945 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/002 2023-10-16T14:30:46.945 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:30:46.957 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:30:46.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:30:46.993 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-10-16T14:30:47.525 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:30:47.539 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:30:47.539 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:30:47.971 INFO:teuthology.orchestra.run.smithi059.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:30:47.984 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/003 2023-10-16T14:30:47.984 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/003 2023-10-16T14:30:47.984 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:30:47.994 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:30:48.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:30:48.025 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-10-16T14:30:48.615 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:30:48.629 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:30:48.629 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:30:49.082 INFO:teuthology.orchestra.run.smithi059.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-10-16T14:30:49.095 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/004 2023-10-16T14:30:49.095 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/004 2023-10-16T14:30:49.095 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:30:49.105 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:30:49.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:30:49.137 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-10-16T14:30:49.714 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:30:49.728 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:30:49.728 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:30:51.924 INFO:teuthology.orchestra.run.smithi059.stdout:generic/005 2s 2023-10-16T14:30:51.941 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/005 2023-10-16T14:30:51.941 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:30:51.949 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:30:51.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:30:51.981 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-10-16T14:30:52.508 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:30:52.520 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:30:52.520 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:31:02.767 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:31:02.777 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:31:33.467 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:31:33.477 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:32:03.614 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:32:03.621 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:32:08.299 INFO:teuthology.orchestra.run.smithi059.stdout:generic/006 76s 2023-10-16T14:32:08.315 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/006 2023-10-16T14:32:08.315 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:32:08.323 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:32:08.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:32:08.349 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-10-16T14:32:08.886 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:32:08.901 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:32:08.901 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:32:34.522 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:32:34.532 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:33:04.675 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:33:04.682 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:33:34.814 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:33:34.820 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:34:04.960 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:34:04.966 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:34:35.088 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:34:35.097 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:34:55.451 INFO:teuthology.orchestra.run.smithi059.stdout:generic/007 167s 2023-10-16T14:34:55.467 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/007 2023-10-16T14:34:55.467 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:34:55.476 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:34:55.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:34:55.512 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-10-16T14:34:56.129 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:34:56.146 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:34:56.147 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:35:00.537 INFO:teuthology.orchestra.run.smithi059.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-16T14:35:00.554 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/008 2023-10-16T14:35:00.554 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/008 2023-10-16T14:35:00.554 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:35:00.566 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:35:00.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:35:00.601 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-10-16T14:35:01.172 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:35:01.185 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:35:01.186 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:35:05.573 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:35:05.583 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:35:05.653 INFO:teuthology.orchestra.run.smithi059.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-16T14:35:05.665 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/009 2023-10-16T14:35:05.665 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/009 2023-10-16T14:35:05.666 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:35:05.676 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:35:05.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:35:05.705 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-10-16T14:35:06.327 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:35:06.340 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:35:06.340 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:35:06.780 INFO:teuthology.orchestra.run.smithi059.stdout:generic/010 [not run] /tmp/tmp.AzguH69EDZxfstests-dev/src/dbtest not built 2023-10-16T14:35:06.792 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/010 2023-10-16T14:35:06.792 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/010 2023-10-16T14:35:06.792 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:35:06.802 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:35:06.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:35:06.833 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-10-16T14:35:07.427 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:35:07.442 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:35:07.442 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:35:35.710 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:35:35.717 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:36:04.239 INFO:teuthology.orchestra.run.smithi059.stdout:generic/011 57s 2023-10-16T14:36:05.135 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/011 2023-10-16T14:36:05.136 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:36:05.148 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:36:05.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:36:05.206 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-10-16T14:36:05.763 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:36:05.774 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:36:05.774 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:36:05.876 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:36:05.881 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:36:10.766 INFO:teuthology.orchestra.run.smithi059.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T14:36:10.780 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/012 2023-10-16T14:36:10.781 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/012 2023-10-16T14:36:10.781 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:36:10.793 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:36:10.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:36:10.845 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-10-16T14:36:11.358 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:36:11.372 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:36:11.372 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:36:37.261 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:36:37.270 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:37:08.324 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:37:08.338 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:37:39.866 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:37:39.871 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:38:11.767 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:38:11.774 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:38:24.246 INFO:teuthology.orchestra.run.smithi059.stdout:generic/013 133s 2023-10-16T14:38:24.268 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/013 2023-10-16T14:38:24.268 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:38:24.281 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:38:24.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:38:24.314 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-10-16T14:38:24.968 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:38:24.986 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:38:24.987 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:38:41.915 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:38:41.922 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:39:12.083 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:39:12.093 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:39:12.257 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-10-16T14:39:12.254+0000 7fc73a4b6640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 149405) UID: 0 2023-10-16T14:39:12.257 INFO:tasks.ceph.mds.c.smithi059.stderr:2023-10-16T14:39:12.254+0000 7fbf1e8d8640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 149405) UID: 0 2023-10-16T14:42:42.609 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:42:42.619 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:43:12.926 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:43:12.932 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:43:43.078 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:43:43.088 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:43:59.149 INFO:teuthology.orchestra.run.smithi059.stdout:generic/014 334s 2023-10-16T14:44:00.611 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/014 2023-10-16T14:44:00.611 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:44:00.622 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:00.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:44:00.658 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-10-16T14:44:02.095 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:02.112 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:02.113 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:02.531 INFO:teuthology.orchestra.run.smithi059.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:44:02.544 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/015 2023-10-16T14:44:02.544 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/015 2023-10-16T14:44:02.544 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:44:02.554 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:02.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:44:02.590 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-10-16T14:44:03.225 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:03.244 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:03.244 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:06.269 INFO:teuthology.orchestra.run.smithi059.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T14:44:06.287 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/016 2023-10-16T14:44:06.287 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/016 2023-10-16T14:44:06.287 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:44:06.297 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:06.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:44:06.337 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-10-16T14:44:07.131 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:07.147 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:07.147 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:07.572 INFO:teuthology.orchestra.run.smithi059.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:44:07.584 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/017 2023-10-16T14:44:07.585 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/017 2023-10-16T14:44:07.585 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:44:07.597 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:07.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:44:07.630 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-10-16T14:44:08.255 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:08.271 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:08.271 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:08.715 INFO:teuthology.orchestra.run.smithi059.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:44:08.728 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/018 2023-10-16T14:44:08.729 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/018 2023-10-16T14:44:08.729 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:44:08.741 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:08.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:44:08.780 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-10-16T14:44:09.426 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:09.441 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:09.442 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:09.863 INFO:teuthology.orchestra.run.smithi059.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:44:09.876 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/019 2023-10-16T14:44:09.876 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/019 2023-10-16T14:44:09.877 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:44:09.886 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:09.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:44:09.915 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-10-16T14:44:10.562 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:10.577 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:10.578 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:13.246 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:44:13.565 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:44:28.221 INFO:teuthology.orchestra.run.smithi059.stdout:generic/020 - output mismatch (see /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/020.out.bad) 2023-10-16T14:44:28.230 INFO:teuthology.orchestra.run.smithi059.stdout: --- tests/generic/020.out 2023-10-16 14:27:43.291522533 +0000 2023-10-16T14:44:28.230 INFO:teuthology.orchestra.run.smithi059.stdout: +++ /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/020.out.bad 2023-10-16 14:44:28.213700608 +0000 2023-10-16T14:44:28.230 INFO:teuthology.orchestra.run.smithi059.stdout: @@ -47,9 +47,13 @@ 2023-10-16T14:44:28.231 INFO:teuthology.orchestra.run.smithi059.stdout: user.snrub="fish2\012" 2023-10-16T14:44:28.231 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:28.231 INFO:teuthology.orchestra.run.smithi059.stdout: *** really long value 2023-10-16T14:44:28.231 INFO:teuthology.orchestra.run.smithi059.stdout: -0000000 00 2023-10-16T14:44:28.231 INFO:teuthology.orchestra.run.smithi059.stdout: -* 2023-10-16T14:44:28.232 INFO:teuthology.orchestra.run.smithi059.stdout: -ATTRSIZE 2023-10-16T14:44:28.232 INFO:teuthology.orchestra.run.smithi059.stdout: +attr_set: No space left on device 2023-10-16T14:44:28.232 INFO:teuthology.orchestra.run.smithi059.stdout: +Could not set "long_attr" for 2023-10-16T14:44:28.232 INFO:teuthology.orchestra.run.smithi059.stdout: +attr_get: No data available 2023-10-16T14:44:28.232 INFO:teuthology.orchestra.run.smithi059.stdout: +Could not get "long_attr" for 2023-10-16T14:44:28.233 INFO:teuthology.orchestra.run.smithi059.stdout: +0000000 2023-10-16T14:44:28.233 INFO:teuthology.orchestra.run.smithi059.stdout: +attr_remove: No data available 2023-10-16T14:44:28.233 INFO:teuthology.orchestra.run.smithi059.stdout: +Could not remove "long_attr" for 2023-10-16T14:44:28.233 INFO:teuthology.orchestra.run.smithi059.stdout: *** set/get/remove really long names (expect failure) 2023-10-16T14:44:28.233 INFO:teuthology.orchestra.run.smithi059.stdout: attr_set: Invalid argument 2023-10-16T14:44:28.234 INFO:teuthology.orchestra.run.smithi059.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-10-16T14:44:28.237 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/020 2023-10-16T14:44:28.237 INFO:teuthology.orchestra.run.smithi059.stdout:Failures: generic/020 2023-10-16T14:44:28.238 INFO:teuthology.orchestra.run.smithi059.stdout:Failed 1 of 1 tests 2023-10-16T14:44:28.248 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:28.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T14:44:28.299 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T14:44:28.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T14:44:28.300 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-10-16T14:44:29.096 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:29.116 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:29.116 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:32.010 INFO:teuthology.orchestra.run.smithi059.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T14:44:32.022 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/021 2023-10-16T14:44:32.022 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/021 2023-10-16T14:44:32.022 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:44:32.034 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:32.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:44:32.081 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-10-16T14:44:32.917 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:32.935 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:32.935 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:36.029 INFO:teuthology.orchestra.run.smithi059.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T14:44:36.042 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/022 2023-10-16T14:44:36.042 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/022 2023-10-16T14:44:36.042 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:44:36.052 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:36.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:44:36.134 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-10-16T14:44:36.967 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:36.986 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:36.986 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:40.880 INFO:teuthology.orchestra.run.smithi059.stdout:generic/023 3s 2023-10-16T14:44:40.901 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/023 2023-10-16T14:44:40.902 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:44:40.916 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:40.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:44:40.961 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-10-16T14:44:41.768 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:41.789 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:41.790 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:42.286 INFO:teuthology.orchestra.run.smithi059.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-10-16T14:44:42.299 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/024 2023-10-16T14:44:42.300 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/024 2023-10-16T14:44:42.300 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:44:42.309 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:42.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:44:42.350 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-10-16T14:44:43.140 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:43.157 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:43.157 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:43.665 INFO:teuthology.orchestra.run.smithi059.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-10-16T14:44:43.679 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/025 2023-10-16T14:44:43.679 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/025 2023-10-16T14:44:43.680 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:44:43.689 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:43.706 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:44:43.715 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:44:43.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:44:43.732 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-10-16T14:44:44.553 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:44.569 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:44.570 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:45.084 INFO:teuthology.orchestra.run.smithi059.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-16T14:44:45.099 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/026 2023-10-16T14:44:45.099 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/026 2023-10-16T14:44:45.100 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:44:45.109 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:45.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:44:45.141 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-10-16T14:44:45.781 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:45.797 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:45.798 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:46.217 INFO:teuthology.orchestra.run.smithi059.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:44:46.229 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/027 2023-10-16T14:44:46.229 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/027 2023-10-16T14:44:46.230 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:44:46.237 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:46.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:44:46.272 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-10-16T14:44:46.888 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:46.905 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:46.905 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:52.401 INFO:teuthology.orchestra.run.smithi059.stdout:generic/028 6s 2023-10-16T14:44:52.422 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/028 2023-10-16T14:44:52.422 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:44:52.432 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:52.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:44:52.468 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-10-16T14:44:53.098 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:53.112 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:53.112 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:53.532 INFO:teuthology.orchestra.run.smithi059.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:44:53.545 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/029 2023-10-16T14:44:53.546 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/029 2023-10-16T14:44:53.546 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:44:53.556 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:53.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:44:53.587 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-10-16T14:44:54.232 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:54.248 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:54.249 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:54.691 INFO:teuthology.orchestra.run.smithi059.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:44:54.703 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/030 2023-10-16T14:44:54.704 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/030 2023-10-16T14:44:54.704 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:44:54.716 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:54.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:44:54.753 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-10-16T14:44:55.376 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:55.391 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:55.391 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:55.805 INFO:teuthology.orchestra.run.smithi059.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:44:55.818 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/031 2023-10-16T14:44:55.818 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/031 2023-10-16T14:44:55.818 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:44:55.828 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:55.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:44:55.862 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-10-16T14:44:56.477 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:56.495 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:56.495 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:56.909 INFO:teuthology.orchestra.run.smithi059.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:44:56.923 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/032 2023-10-16T14:44:56.923 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/032 2023-10-16T14:44:56.924 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:44:56.933 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:56.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:44:56.971 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-10-16T14:44:57.600 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:57.616 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:57.617 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:58.039 INFO:teuthology.orchestra.run.smithi059.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:44:58.052 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/033 2023-10-16T14:44:58.053 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/033 2023-10-16T14:44:58.053 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:44:58.060 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:58.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:44:58.092 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-10-16T14:44:58.711 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:58.728 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:58.728 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:59.208 INFO:teuthology.orchestra.run.smithi059.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:44:59.222 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/034 2023-10-16T14:44:59.222 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/034 2023-10-16T14:44:59.222 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:44:59.231 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:44:59.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:44:59.263 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-10-16T14:44:59.897 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:44:59.915 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:44:59.915 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:00.531 INFO:teuthology.orchestra.run.smithi059.stdout:generic/035 1s 2023-10-16T14:45:00.552 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/035 2023-10-16T14:45:00.552 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:00.561 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:00.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:00.610 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-10-16T14:45:01.407 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:01.423 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:01.424 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:12.056 INFO:teuthology.orchestra.run.smithi059.stdout:generic/036 11s 2023-10-16T14:45:12.390 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/036 2023-10-16T14:45:12.390 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:12.410 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:12.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:12.459 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-10-16T14:45:13.143 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:13.157 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:13.157 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:13.584 INFO:teuthology.orchestra.run.smithi059.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:13.597 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/037 2023-10-16T14:45:13.597 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/037 2023-10-16T14:45:13.597 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:13.604 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:13.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:13.636 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-10-16T14:45:13.941 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:45:13.948 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:45:14.176 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:14.189 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:14.189 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:14.642 INFO:teuthology.orchestra.run.smithi059.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:14.657 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/038 2023-10-16T14:45:14.658 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/038 2023-10-16T14:45:14.658 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:14.671 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:14.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:14.707 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-10-16T14:45:15.294 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:15.310 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:15.310 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:15.841 INFO:teuthology.orchestra.run.smithi059.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:15.857 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/039 2023-10-16T14:45:15.858 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/039 2023-10-16T14:45:15.858 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:15.870 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:15.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:15.909 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-10-16T14:45:16.491 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:16.505 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:16.505 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:17.014 INFO:teuthology.orchestra.run.smithi059.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:17.029 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/040 2023-10-16T14:45:17.029 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/040 2023-10-16T14:45:17.030 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:17.042 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:17.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:17.077 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-10-16T14:45:17.661 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:17.677 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:17.677 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:18.179 INFO:teuthology.orchestra.run.smithi059.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:18.196 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/041 2023-10-16T14:45:18.196 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/041 2023-10-16T14:45:18.197 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:18.208 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:18.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:18.241 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-10-16T14:45:18.802 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:18.813 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:18.813 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:19.227 INFO:teuthology.orchestra.run.smithi059.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:19.240 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/042 2023-10-16T14:45:19.241 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/042 2023-10-16T14:45:19.241 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:19.250 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:19.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:19.282 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-10-16T14:45:19.849 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:19.861 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:19.861 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:20.273 INFO:teuthology.orchestra.run.smithi059.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:20.287 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/043 2023-10-16T14:45:20.287 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/043 2023-10-16T14:45:20.288 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:20.299 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:20.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:20.333 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-10-16T14:45:20.888 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:20.901 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:20.901 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:21.363 INFO:teuthology.orchestra.run.smithi059.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:21.377 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/044 2023-10-16T14:45:21.377 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/044 2023-10-16T14:45:21.377 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:21.389 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:21.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:21.420 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-10-16T14:45:22.014 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:22.025 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:22.026 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:22.433 INFO:teuthology.orchestra.run.smithi059.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:22.444 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/045 2023-10-16T14:45:22.444 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/045 2023-10-16T14:45:22.445 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:22.453 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:22.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:22.484 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-10-16T14:45:23.062 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:23.075 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:23.076 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:23.503 INFO:teuthology.orchestra.run.smithi059.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:23.514 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/046 2023-10-16T14:45:23.515 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/046 2023-10-16T14:45:23.515 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:23.523 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:23.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:23.554 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-10-16T14:45:24.117 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:24.129 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:24.130 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:24.567 INFO:teuthology.orchestra.run.smithi059.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:24.579 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/047 2023-10-16T14:45:24.579 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/047 2023-10-16T14:45:24.579 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:24.589 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:24.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:24.621 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-10-16T14:45:25.210 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:25.223 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:25.223 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:25.661 INFO:teuthology.orchestra.run.smithi059.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:25.674 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/048 2023-10-16T14:45:25.674 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/048 2023-10-16T14:45:25.674 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:25.684 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:25.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:25.717 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-10-16T14:45:26.310 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:26.323 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:26.323 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:26.774 INFO:teuthology.orchestra.run.smithi059.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:26.786 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/049 2023-10-16T14:45:26.787 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/049 2023-10-16T14:45:26.787 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:26.795 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:26.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:26.830 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-10-16T14:45:27.426 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:27.440 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:27.441 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:27.920 INFO:teuthology.orchestra.run.smithi059.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:27.936 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/050 2023-10-16T14:45:27.936 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/050 2023-10-16T14:45:27.936 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:27.950 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:27.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:27.984 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-10-16T14:45:28.570 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:28.583 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:28.584 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:29.048 INFO:teuthology.orchestra.run.smithi059.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:29.062 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/051 2023-10-16T14:45:29.062 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/051 2023-10-16T14:45:29.063 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:29.073 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:29.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:29.107 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-10-16T14:45:29.677 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:29.693 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:29.693 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:30.146 INFO:teuthology.orchestra.run.smithi059.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:30.158 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/052 2023-10-16T14:45:30.159 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/052 2023-10-16T14:45:30.159 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:30.168 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:30.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:30.202 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-10-16T14:45:30.775 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:30.791 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:30.791 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:31.242 INFO:teuthology.orchestra.run.smithi059.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:31.254 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/053 2023-10-16T14:45:31.254 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/053 2023-10-16T14:45:31.255 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:31.263 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:31.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:31.295 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-10-16T14:45:31.878 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:31.892 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:31.892 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:32.327 INFO:teuthology.orchestra.run.smithi059.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:32.338 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/054 2023-10-16T14:45:32.339 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/054 2023-10-16T14:45:32.339 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:32.348 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:32.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:32.380 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-10-16T14:45:32.970 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:32.982 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:32.982 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:33.419 INFO:teuthology.orchestra.run.smithi059.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:33.434 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/055 2023-10-16T14:45:33.435 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/055 2023-10-16T14:45:33.435 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:33.446 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:33.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:33.482 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-10-16T14:45:34.080 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:34.094 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:34.157 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:34.570 INFO:teuthology.orchestra.run.smithi059.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:34.586 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/056 2023-10-16T14:45:34.586 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/056 2023-10-16T14:45:34.587 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:34.600 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:34.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:34.637 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-10-16T14:45:35.209 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:35.222 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:35.222 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:35.681 INFO:teuthology.orchestra.run.smithi059.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:35.692 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/057 2023-10-16T14:45:35.693 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/057 2023-10-16T14:45:35.693 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:35.701 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:35.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:35.731 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-10-16T14:45:36.348 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:36.363 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:36.363 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:41.415 INFO:teuthology.orchestra.run.smithi059.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T14:45:41.431 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/058 2023-10-16T14:45:41.431 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/058 2023-10-16T14:45:41.431 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:41.443 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:41.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:41.506 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-10-16T14:45:42.205 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:42.218 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:42.218 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:42.687 INFO:teuthology.orchestra.run.smithi059.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:42.698 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/059 2023-10-16T14:45:42.698 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/059 2023-10-16T14:45:42.699 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:42.707 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:42.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:42.737 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-10-16T14:45:43.326 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:43.340 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:43.341 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:44.997 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:45:45.006 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:45:47.891 INFO:teuthology.orchestra.run.smithi059.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T14:45:47.907 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/060 2023-10-16T14:45:47.907 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/060 2023-10-16T14:45:47.907 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:47.919 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:47.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:47.965 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-10-16T14:45:48.639 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:48.651 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:48.652 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:52.555 INFO:teuthology.orchestra.run.smithi059.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T14:45:52.570 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/061 2023-10-16T14:45:52.570 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/061 2023-10-16T14:45:52.571 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:52.582 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:52.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:52.637 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-10-16T14:45:53.337 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:53.349 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:53.767 INFO:teuthology.orchestra.run.smithi059.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:45:53.778 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/062 2023-10-16T14:45:53.778 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/062 2023-10-16T14:45:53.778 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:53.786 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:53.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:53.814 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-10-16T14:45:54.365 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:45:54.379 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:45:54.379 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:59.245 INFO:teuthology.orchestra.run.smithi059.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T14:45:59.259 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/063 2023-10-16T14:45:59.260 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/063 2023-10-16T14:45:59.260 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:45:59.269 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:45:59.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:45:59.326 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-10-16T14:46:00.001 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:46:00.013 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:46:00.014 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:46:00.430 INFO:teuthology.orchestra.run.smithi059.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:46:00.444 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/064 2023-10-16T14:46:00.445 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/064 2023-10-16T14:46:00.445 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:46:00.457 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:46:00.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:46:00.490 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-10-16T14:46:01.081 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:46:01.093 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:46:01.094 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:46:01.554 INFO:teuthology.orchestra.run.smithi059.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:46:01.566 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/065 2023-10-16T14:46:01.566 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/065 2023-10-16T14:46:01.566 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:46:01.576 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:46:01.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:46:01.612 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-10-16T14:46:02.212 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:46:02.225 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:46:02.226 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:46:02.740 INFO:teuthology.orchestra.run.smithi059.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:46:02.755 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/066 2023-10-16T14:46:02.756 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/066 2023-10-16T14:46:02.756 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:46:02.768 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:46:02.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:46:02.802 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-10-16T14:46:03.359 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:46:03.373 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:46:03.373 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:46:03.893 INFO:teuthology.orchestra.run.smithi059.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:46:03.908 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/067 2023-10-16T14:46:03.909 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/067 2023-10-16T14:46:03.909 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:46:03.922 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:46:03.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:46:03.958 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-10-16T14:46:04.577 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:46:04.594 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:46:04.595 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:46:05.096 INFO:teuthology.orchestra.run.smithi059.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:46:05.108 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/068 2023-10-16T14:46:05.108 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/068 2023-10-16T14:46:05.108 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:46:05.118 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:46:05.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:46:05.150 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-10-16T14:46:05.759 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:46:05.773 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:46:05.774 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:46:06.244 INFO:teuthology.orchestra.run.smithi059.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:46:06.256 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/069 2023-10-16T14:46:06.257 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/069 2023-10-16T14:46:06.257 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:46:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:46:06.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:46:06.299 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-10-16T14:46:06.865 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:46:06.878 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:46:06.878 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:46:15.134 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:46:15.147 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:46:45.353 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:46:45.364 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:47:15.513 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:47:15.526 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:47:45.660 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:47:45.671 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:48:15.797 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:48:15.809 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:48:46.145 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:48:46.156 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:48:57.104 INFO:teuthology.orchestra.run.smithi059.stdout:generic/070 171s 2023-10-16T14:48:57.125 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/070 2023-10-16T14:48:57.125 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:48:57.133 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:48:57.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:48:57.175 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-10-16T14:48:58.024 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:48:58.039 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:48:58.039 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:48:58.451 INFO:teuthology.orchestra.run.smithi059.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:48:58.466 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/071 2023-10-16T14:48:58.467 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/071 2023-10-16T14:48:58.467 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:48:58.477 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:48:58.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:48:58.509 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-10-16T14:48:59.148 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:48:59.166 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:48:59.166 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:49:01.849 INFO:teuthology.orchestra.run.smithi059.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-10-16T14:49:01.861 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/072 2023-10-16T14:49:01.861 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/072 2023-10-16T14:49:01.861 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:49:01.872 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:49:01.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:49:01.907 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-10-16T14:49:02.539 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:49:02.555 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:49:02.556 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:49:03.009 INFO:teuthology.orchestra.run.smithi059.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T14:49:03.021 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/073 2023-10-16T14:49:03.021 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/073 2023-10-16T14:49:03.022 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T14:49:03.031 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:49:03.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T14:49:03.070 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-10-16T14:49:03.725 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T14:49:03.744 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T14:49:03.744 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T14:49:16.308 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:49:16.315 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:49:47.016 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:49:47.026 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:50:17.181 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:50:17.188 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:50:47.696 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:50:47.704 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:51:17.846 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:51:17.859 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:51:48.027 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:51:48.038 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:52:19.279 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:52:19.287 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:52:50.391 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:52:50.403 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:53:20.723 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:53:20.762 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:53:51.145 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:53:51.154 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:54:21.312 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:54:21.320 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:54:55.857 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:54:55.867 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:55:26.151 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:55:26.157 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:55:57.116 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:55:57.122 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:56:31.593 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:56:31.609 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:57:02.819 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:57:02.827 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T14:57:02.979 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-10-16T14:57:02.977+0000 7f91056c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179617) UID: 0 2023-10-16T14:57:02.979 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-10-16T14:57:02.977+0000 7f33baba1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179617) UID: 0 2023-10-16T14:57:02.980 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-10-16T14:57:02.977+0000 7f5953fdd640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179617) UID: 0 2023-10-16T14:57:02.980 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-10-16T14:57:02.977+0000 7f98840e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179617) UID: 0 2023-10-16T14:57:05.269 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-10-16T14:57:05.266+0000 7efc1aede640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94940) UID: 0 2023-10-16T14:57:05.271 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-10-16T14:57:05.266+0000 7f104c58c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94940) UID: 0 2023-10-16T14:57:05.272 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-10-16T14:57:05.268+0000 7f9061646640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94940) UID: 0 2023-10-16T14:57:05.272 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-10-16T14:57:05.266+0000 7f977ef33640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94940) UID: 0 2023-10-16T15:07:41.615 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:07:41.625 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:07:41.831 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-10-16T15:07:41.829+0000 7efc1aede640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95217) UID: 0 2023-10-16T15:07:41.832 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-10-16T15:07:41.829+0000 7f104c58c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95217) UID: 0 2023-10-16T15:07:41.832 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-10-16T15:07:41.829+0000 7f9061646640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95217) UID: 0 2023-10-16T15:07:41.833 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-10-16T15:07:41.829+0000 7f977ef33640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95217) UID: 0 2023-10-16T15:07:41.845 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-10-16T15:07:41.842+0000 7f98840e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 180328) UID: 0 2023-10-16T15:07:41.845 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-10-16T15:07:41.842+0000 7f33baba1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 180328) UID: 0 2023-10-16T15:07:41.846 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-10-16T15:07:41.843+0000 7f91056c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 180328) UID: 0 2023-10-16T15:07:41.846 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-10-16T15:07:41.843+0000 7f5953fdd640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 180328) UID: 0 2023-10-16T15:14:34.858 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:14:34.867 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:14:35.139 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-10-16T15:14:35.136+0000 7f98840e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 180742) UID: 0 2023-10-16T15:14:35.140 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-10-16T15:14:35.137+0000 7f91056c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 180742) UID: 0 2023-10-16T15:14:35.140 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-10-16T15:14:35.138+0000 7f33baba1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 180742) UID: 0 2023-10-16T15:14:35.141 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-10-16T15:14:35.138+0000 7f5953fdd640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 180742) UID: 0 2023-10-16T15:14:35.156 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-10-16T15:14:35.154+0000 7efc1aede640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95369) UID: 0 2023-10-16T15:14:35.156 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-10-16T15:14:35.154+0000 7f9061646640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95369) UID: 0 2023-10-16T15:14:35.157 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-10-16T15:14:35.154+0000 7f104c58c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95369) UID: 0 2023-10-16T15:14:35.157 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-10-16T15:14:35.154+0000 7f977ef33640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95369) UID: 0 2023-10-16T15:20:20.907 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:20:20.917 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:20:21.143 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-10-16T15:20:21.141+0000 7f5953fdd640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 181124) UID: 0 2023-10-16T15:20:21.143 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-10-16T15:20:21.141+0000 7f91056c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 181124) UID: 0 2023-10-16T15:20:21.144 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-10-16T15:20:21.141+0000 7f98840e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 181124) UID: 0 2023-10-16T15:20:21.144 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-10-16T15:20:21.141+0000 7f33baba1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 181124) UID: 0 2023-10-16T15:20:22.227 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-10-16T15:20:22.226+0000 7f9061646640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95450) UID: 0 2023-10-16T15:20:22.228 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-10-16T15:20:22.227+0000 7f977ef33640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95450) UID: 0 2023-10-16T15:20:22.229 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-10-16T15:20:22.226+0000 7f104c58c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95450) UID: 0 2023-10-16T15:20:22.229 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-10-16T15:20:22.226+0000 7efc1aede640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95450) UID: 0 2023-10-16T15:24:33.760 INFO:teuthology.orchestra.run.smithi059.stdout:generic/074 2130s 2023-10-16T15:24:33.796 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/074 2023-10-16T15:24:33.796 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T15:24:33.803 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:24:33.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:24:33.854 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-10-16T15:24:35.037 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T15:24:35.049 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T15:24:35.050 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:12.718 INFO:teuthology.orchestra.run.smithi059.stdout:generic/075 97s 2023-10-16T15:26:12.735 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/075 2023-10-16T15:26:12.736 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T15:26:12.744 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:12.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:26:12.784 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-10-16T15:26:13.544 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T15:26:13.556 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T15:26:13.556 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:13.942 INFO:teuthology.orchestra.run.smithi059.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T15:26:13.953 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/076 2023-10-16T15:26:13.954 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/076 2023-10-16T15:26:13.954 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T15:26:13.962 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:13.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:26:13.994 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-10-16T15:26:14.534 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T15:26:14.545 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T15:26:14.546 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:17.507 INFO:teuthology.orchestra.run.smithi059.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T15:26:17.520 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/077 2023-10-16T15:26:17.521 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/077 2023-10-16T15:26:17.521 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T15:26:17.530 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:17.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:26:17.561 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-10-16T15:26:18.090 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T15:26:18.103 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T15:26:18.104 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:18.568 INFO:teuthology.orchestra.run.smithi059.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-10-16T15:26:18.579 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/078 2023-10-16T15:26:18.579 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/078 2023-10-16T15:26:18.579 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T15:26:18.587 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:18.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:26:18.628 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-10-16T15:26:19.389 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T15:26:19.402 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T15:26:19.402 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:19.879 INFO:teuthology.orchestra.run.smithi059.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-10-16T15:26:19.890 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/079 2023-10-16T15:26:19.891 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/079 2023-10-16T15:26:19.891 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T15:26:19.902 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:19.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:26:19.931 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-10-16T15:26:20.491 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T15:26:20.505 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T15:26:20.505 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:23.049 INFO:teuthology.orchestra.run.smithi059.stdout:generic/080 3s 2023-10-16T15:26:23.064 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/080 2023-10-16T15:26:23.064 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T15:26:23.072 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:23.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:26:23.100 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-10-16T15:26:23.623 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T15:26:23.635 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T15:26:23.636 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:24.019 INFO:teuthology.orchestra.run.smithi059.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T15:26:24.028 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/081 2023-10-16T15:26:24.028 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/081 2023-10-16T15:26:24.029 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T15:26:24.036 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:24.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:26:24.065 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-10-16T15:26:24.564 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T15:26:24.577 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T15:26:24.577 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:24.978 INFO:teuthology.orchestra.run.smithi059.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T15:26:24.990 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/082 2023-10-16T15:26:24.990 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/082 2023-10-16T15:26:24.990 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T15:26:24.999 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:25.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:26:25.028 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-10-16T15:26:25.552 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T15:26:25.566 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T15:26:25.566 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:25.952 INFO:teuthology.orchestra.run.smithi059.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T15:26:25.961 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/083 2023-10-16T15:26:25.961 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/083 2023-10-16T15:26:25.961 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T15:26:25.968 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:25.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:26:25.993 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-10-16T15:26:26.469 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T15:26:26.480 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T15:26:26.480 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:26.838 INFO:teuthology.orchestra.run.smithi059.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T15:26:26.847 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/084 2023-10-16T15:26:26.848 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/084 2023-10-16T15:26:26.848 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T15:26:26.854 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:26.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:26:26.880 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-10-16T15:26:27.426 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T15:26:27.439 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T15:26:27.439 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:27.958 INFO:teuthology.orchestra.run.smithi059.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T15:26:27.973 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/085 2023-10-16T15:26:27.974 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/085 2023-10-16T15:26:27.974 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T15:26:27.984 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:28.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:26:28.017 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-10-16T15:26:28.532 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T15:26:28.543 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T15:26:28.544 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:49.764 INFO:teuthology.orchestra.run.smithi059.stdout:generic/086 21s 2023-10-16T15:26:49.966 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/086 2023-10-16T15:26:49.966 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T15:26:49.980 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:50.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:26:50.375 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-10-16T15:26:53.026 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T15:26:53.039 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T15:26:53.039 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:54.209 INFO:teuthology.orchestra.run.smithi059.stdout:generic/087 1s 2023-10-16T15:26:54.223 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/087 2023-10-16T15:26:54.223 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T15:26:54.230 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:54.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:26:54.265 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-10-16T15:26:55.015 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T15:26:55.026 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T15:26:55.027 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:55.608 INFO:teuthology.orchestra.run.smithi059.stdout:generic/088 0s 2023-10-16T15:26:55.622 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/088 2023-10-16T15:26:55.622 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T15:26:55.629 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:26:55.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T15:26:55.661 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-10-16T15:26:56.411 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T15:26:56.423 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T15:26:56.423 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T15:28:59.610 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:28:59.622 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:29:30.032 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:29:30.043 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:30:00.276 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:30:00.288 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:30:30.433 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:30:30.443 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:31:00.572 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:31:00.594 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:31:30.721 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:31:30.732 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:32:00.871 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:32:00.882 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:32:01.022 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-10-16T15:32:01.020+0000 7fc73a4b6640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 189135) UID: 0 2023-10-16T15:32:01.022 INFO:tasks.ceph.mds.c.smithi059.stderr:2023-10-16T15:32:01.020+0000 7fbf1e8d8640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 189135) UID: 0 2023-10-16T15:35:03.943 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:35:03.954 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:35:34.318 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:35:34.329 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:36:06.656 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:36:06.663 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:36:36.847 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:36:36.853 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:37:06.985 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:37:06.991 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:37:37.344 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:37:37.355 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:38:07.750 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:38:07.763 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:38:37.893 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:38:37.907 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:39:08.040 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:39:08.049 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:39:08.155 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-10-16T15:39:08.153+0000 7fc73a4b6640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 189532) UID: 0 2023-10-16T15:39:08.155 INFO:tasks.ceph.mds.c.smithi059.stderr:2023-10-16T15:39:08.154+0000 7fbf1e8d8640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 189532) UID: 0 2023-10-16T15:42:01.322 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:42:01.334 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:42:31.567 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:42:31.573 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:43:01.755 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:43:01.765 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:43:31.876 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:43:31.881 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:44:02.050 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:44:02.056 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:44:32.195 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:44:32.203 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:45:02.334 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:45:02.339 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:45:32.457 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:45:32.463 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:46:02.571 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:46:02.586 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:46:32.710 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:46:32.721 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:46:32.834 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-10-16T15:46:32.832+0000 7fc73a4b6640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 189725) UID: 0 2023-10-16T15:46:32.834 INFO:tasks.ceph.mds.c.smithi059.stderr:2023-10-16T15:46:32.832+0000 7fbf1e8d8640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 189725) UID: 0 2023-10-16T15:49:21.495 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:49:21.506 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:49:51.908 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:49:51.918 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:50:22.842 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:50:22.852 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:50:52.988 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:50:53.000 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:51:23.128 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:51:23.139 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:51:53.264 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:51:53.270 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:52:23.397 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:52:23.404 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:52:53.525 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:52:53.532 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:53:23.648 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:53:23.663 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:53:53.780 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:53:53.790 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:54:23.935 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:54:23.945 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:54:54.088 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:54:54.096 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:54:54.213 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-10-16T15:54:54.212+0000 7fc73a4b6640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 191963) UID: 0 2023-10-16T15:54:54.214 INFO:tasks.ceph.mds.c.smithi059.stderr:2023-10-16T15:54:54.212+0000 7fbf1e8d8640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 191963) UID: 0 2023-10-16T15:57:46.772 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:57:46.783 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:58:16.991 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:58:17.001 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:58:47.146 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:58:47.158 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:59:17.292 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:59:17.303 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:59:47.440 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T15:59:47.451 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:00:02.185 INFO:teuthology.orchestra.run.smithi059.stdout:generic/089 1986s 2023-10-16T16:00:02.230 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/089 2023-10-16T16:00:02.230 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:00:02.244 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:00:02.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:00:02.294 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-10-16T16:00:03.343 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:00:03.358 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:00:03.358 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:00:03.941 INFO:teuthology.orchestra.run.smithi059.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:00:03.954 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/090 2023-10-16T16:00:03.955 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/090 2023-10-16T16:00:03.955 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:00:03.965 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:00:04.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:00:04.001 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-10-16T16:00:04.600 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:00:04.613 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:00:04.613 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:00:17.577 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:00:17.589 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:00:47.957 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:00:47.969 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:01:18.096 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:01:18.107 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:01:48.276 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:01:48.288 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:02:18.428 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:02:18.443 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:02:48.580 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:02:48.590 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:02:48.709 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-10-16T16:02:48.707+0000 7efc1aede640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96668) UID: 0 2023-10-16T16:02:48.710 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-10-16T16:02:48.707+0000 7f9061646640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96668) UID: 0 2023-10-16T16:02:48.710 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-10-16T16:02:48.707+0000 7f977ef33640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96668) UID: 0 2023-10-16T16:02:48.711 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-10-16T16:02:48.707+0000 7f104c58c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96668) UID: 0 2023-10-16T16:05:34.138 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:05:34.152 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:05:59.370 INFO:teuthology.orchestra.run.smithi059.stdout:generic/091 355s 2023-10-16T16:05:59.392 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/091 2023-10-16T16:05:59.393 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:05:59.404 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:05:59.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:05:59.451 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-10-16T16:06:00.177 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:06:00.189 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:06:00.190 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:06:00.780 INFO:teuthology.orchestra.run.smithi059.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T16:06:00.795 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/092 2023-10-16T16:06:00.795 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/092 2023-10-16T16:06:00.796 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:06:00.811 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:06:00.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:06:00.854 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-10-16T16:06:01.554 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:06:01.565 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:06:01.566 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:06:03.144 INFO:teuthology.orchestra.run.smithi059.stdout:generic/093 2s 2023-10-16T16:06:03.160 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/093 2023-10-16T16:06:03.160 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:06:03.169 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:06:03.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:06:03.204 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-10-16T16:06:03.940 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:06:03.952 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:06:03.952 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:06:04.306 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:06:04.313 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:06:04.509 INFO:teuthology.orchestra.run.smithi059.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:06:04.518 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/094 2023-10-16T16:06:04.518 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/094 2023-10-16T16:06:04.518 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:06:04.525 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:06:04.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:06:04.548 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-10-16T16:06:05.022 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:06:05.035 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:06:05.036 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:06:05.454 INFO:teuthology.orchestra.run.smithi059.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:06:05.465 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/095 2023-10-16T16:06:05.465 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/095 2023-10-16T16:06:05.466 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:06:05.474 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:06:05.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:06:05.507 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-10-16T16:06:06.108 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:06:06.122 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:06:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:06:06.584 INFO:teuthology.orchestra.run.smithi059.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:06:06.596 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/096 2023-10-16T16:06:06.596 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/096 2023-10-16T16:06:06.597 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:06:06.606 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:06:06.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:06:06.638 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-10-16T16:06:07.241 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:06:07.254 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:06:07.255 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:06:08.466 INFO:teuthology.orchestra.run.smithi059.stdout:generic/097 1s 2023-10-16T16:06:08.479 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/097 2023-10-16T16:06:08.480 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:06:08.486 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:06:08.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:06:08.508 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-10-16T16:06:09.066 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:06:09.079 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:06:09.079 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:06:09.531 INFO:teuthology.orchestra.run.smithi059.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:06:09.547 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/098 2023-10-16T16:06:09.547 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/098 2023-10-16T16:06:09.548 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:06:09.560 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:06:09.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:06:09.597 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-10-16T16:06:10.206 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:06:10.222 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:06:10.222 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:06:10.750 INFO:teuthology.orchestra.run.smithi059.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-16T16:06:10.765 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/099 2023-10-16T16:06:10.766 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/099 2023-10-16T16:06:10.767 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:06:10.778 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:06:10.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:06:10.817 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-10-16T16:06:11.428 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:06:11.441 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:06:11.442 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:06:34.447 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:06:34.458 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:07:04.709 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:07:04.719 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:07:34.864 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:07:34.875 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:08:05.028 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:08:05.041 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:08:13.512 INFO:teuthology.orchestra.run.smithi059.stdout:generic/100 122s 2023-10-16T16:08:13.531 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/100 2023-10-16T16:08:13.532 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:08:13.540 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:13.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:08:13.607 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-10-16T16:08:14.394 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:08:14.405 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:08:14.405 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:14.817 INFO:teuthology.orchestra.run.smithi059.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:08:14.830 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/101 2023-10-16T16:08:14.830 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/101 2023-10-16T16:08:14.831 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:08:14.840 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:14.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:08:14.873 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-10-16T16:08:15.454 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:08:15.467 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:08:15.467 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:15.935 INFO:teuthology.orchestra.run.smithi059.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:08:15.950 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/102 2023-10-16T16:08:15.950 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/102 2023-10-16T16:08:15.951 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:08:15.963 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:16.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:08:16.001 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-10-16T16:08:16.583 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:08:16.598 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:08:16.598 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:17.035 INFO:teuthology.orchestra.run.smithi059.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:08:17.047 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/103 2023-10-16T16:08:17.047 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/103 2023-10-16T16:08:17.047 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:08:17.057 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:17.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:08:17.087 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-10-16T16:08:17.676 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:08:17.691 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:08:17.691 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:18.177 INFO:teuthology.orchestra.run.smithi059.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:08:18.191 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/104 2023-10-16T16:08:18.192 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/104 2023-10-16T16:08:18.192 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:08:18.204 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:18.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:08:18.237 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-10-16T16:08:18.832 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:08:18.846 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:08:18.847 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:19.268 INFO:teuthology.orchestra.run.smithi059.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:08:19.283 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/105 2023-10-16T16:08:19.284 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/105 2023-10-16T16:08:19.284 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:08:19.296 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:19.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:08:19.330 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-10-16T16:08:19.927 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:08:19.943 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:08:19.943 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:20.445 INFO:teuthology.orchestra.run.smithi059.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:08:20.457 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/106 2023-10-16T16:08:20.458 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/106 2023-10-16T16:08:20.458 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:08:20.468 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:20.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:08:20.502 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-10-16T16:08:21.113 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:08:21.125 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:08:21.125 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:21.621 INFO:teuthology.orchestra.run.smithi059.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:08:21.635 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/107 2023-10-16T16:08:21.636 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/107 2023-10-16T16:08:21.636 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:08:21.647 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:21.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:08:21.688 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-10-16T16:08:22.281 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:08:22.294 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:08:22.294 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:22.960 INFO:teuthology.orchestra.run.smithi059.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:08:22.977 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/108 2023-10-16T16:08:22.977 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/108 2023-10-16T16:08:22.977 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:08:22.990 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:23.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:08:23.029 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-10-16T16:08:23.623 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:08:23.638 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:08:23.638 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:24.086 INFO:teuthology.orchestra.run.smithi059.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:08:24.099 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/109 2023-10-16T16:08:24.100 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/109 2023-10-16T16:08:24.100 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:08:24.112 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:24.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:08:24.148 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-10-16T16:08:24.745 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:08:24.759 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:08:24.760 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:25.357 INFO:teuthology.orchestra.run.smithi059.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T16:08:25.371 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/110 2023-10-16T16:08:25.371 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/110 2023-10-16T16:08:25.372 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:08:25.385 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:25.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:08:25.433 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-10-16T16:08:26.158 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:08:26.170 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:08:26.170 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:26.744 INFO:teuthology.orchestra.run.smithi059.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T16:08:26.758 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/111 2023-10-16T16:08:26.758 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/111 2023-10-16T16:08:26.758 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:08:26.771 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:26.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:08:26.829 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-10-16T16:08:27.533 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:08:27.546 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:08:27.546 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:08:35.234 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:08:35.246 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:09:05.413 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:09:05.427 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:09:35.554 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:09:35.569 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:10:05.699 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:10:05.710 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:10:33.743 INFO:teuthology.orchestra.run.smithi059.stdout:generic/112 126s 2023-10-16T16:10:33.760 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/112 2023-10-16T16:10:33.761 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:10:33.769 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:10:33.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:10:33.800 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-10-16T16:10:34.563 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:10:34.577 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:10:34.578 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:10:35.842 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:10:35.856 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:11:05.995 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:11:06.005 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:11:29.117 INFO:teuthology.orchestra.run.smithi059.stdout:generic/113 55s 2023-10-16T16:11:29.137 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/113 2023-10-16T16:11:29.137 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:11:29.147 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:29.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:11:29.193 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-10-16T16:11:29.941 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:11:29.953 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:11:29.954 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:30.589 INFO:teuthology.orchestra.run.smithi059.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-10-16T16:11:30.605 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/114 2023-10-16T16:11:30.605 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/114 2023-10-16T16:11:30.606 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:11:30.619 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:30.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:11:30.655 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-10-16T16:11:31.261 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:11:31.276 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:11:31.276 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:31.893 INFO:teuthology.orchestra.run.smithi059.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T16:11:31.906 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/115 2023-10-16T16:11:31.907 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/115 2023-10-16T16:11:31.907 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:11:31.919 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:31.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:11:31.962 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-10-16T16:11:32.698 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:11:32.711 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:11:32.711 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:33.246 INFO:teuthology.orchestra.run.smithi059.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T16:11:33.261 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/116 2023-10-16T16:11:33.261 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/116 2023-10-16T16:11:33.261 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:11:33.272 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:33.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:11:33.332 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-10-16T16:11:34.035 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:11:34.048 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:11:34.048 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:34.478 INFO:teuthology.orchestra.run.smithi059.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:11:34.487 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/117 2023-10-16T16:11:34.488 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/117 2023-10-16T16:11:34.488 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:11:34.496 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:34.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:11:34.525 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-10-16T16:11:35.118 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:11:35.131 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:11:35.132 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:35.748 INFO:teuthology.orchestra.run.smithi059.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T16:11:35.761 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/118 2023-10-16T16:11:35.762 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/118 2023-10-16T16:11:35.762 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:11:35.771 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:35.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:11:35.818 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-10-16T16:11:36.132 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:11:36.140 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:11:36.452 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-10-16T16:11:36.451+0000 7f91056c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 219725) UID: 0 2023-10-16T16:11:36.453 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-10-16T16:11:36.451+0000 7f33baba1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 219725) UID: 0 2023-10-16T16:11:36.453 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-10-16T16:11:36.451+0000 7f98840e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 219725) UID: 0 2023-10-16T16:11:36.454 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-10-16T16:11:36.451+0000 7f5953fdd640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 219725) UID: 0 2023-10-16T16:11:36.567 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:11:36.578 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:11:36.578 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:37.305 INFO:teuthology.orchestra.run.smithi059.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T16:11:37.316 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/119 2023-10-16T16:11:37.317 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/119 2023-10-16T16:11:37.317 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:11:37.326 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:37.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:11:37.387 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-10-16T16:11:38.133 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:11:38.144 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:11:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:38.518 INFO:teuthology.orchestra.run.smithi059.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:11:38.528 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/120 2023-10-16T16:11:38.528 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/120 2023-10-16T16:11:38.528 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:11:38.536 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:38.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:11:38.568 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-10-16T16:11:39.109 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:11:39.121 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:11:39.122 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:39.622 INFO:teuthology.orchestra.run.smithi059.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-16T16:11:39.632 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/121 2023-10-16T16:11:39.633 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/121 2023-10-16T16:11:39.633 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:11:39.641 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:39.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:11:39.682 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-10-16T16:11:40.421 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:11:40.433 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:11:40.433 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:40.915 INFO:teuthology.orchestra.run.smithi059.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-16T16:11:40.925 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/122 2023-10-16T16:11:40.925 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/122 2023-10-16T16:11:40.926 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:11:40.933 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:40.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:11:40.988 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-10-16T16:11:41.732 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:11:41.743 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:11:41.744 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:45.366 INFO:teuthology.orchestra.run.smithi059.stdout:generic/123 4s 2023-10-16T16:11:45.381 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/123 2023-10-16T16:11:45.381 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:11:45.389 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:45.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:11:45.456 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-10-16T16:11:46.494 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:11:46.505 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:11:46.505 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:47.042 INFO:teuthology.orchestra.run.smithi059.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:11:47.051 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/124 2023-10-16T16:11:47.052 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/124 2023-10-16T16:11:47.052 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:11:47.060 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:11:47.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:11:47.089 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-10-16T16:11:47.715 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:11:47.730 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:11:47.730 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:12:50.125 INFO:teuthology.orchestra.run.smithi059.stdout:generic/125 63s 2023-10-16T16:12:50.140 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/125 2023-10-16T16:12:50.141 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:12:50.149 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:12:50.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:12:50.202 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-10-16T16:12:50.954 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:12:50.967 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:12:50.967 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:12:52.246 INFO:teuthology.orchestra.run.smithi059.stdout:generic/126 - output mismatch (see /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/126.out.bad) 2023-10-16T16:12:52.253 INFO:teuthology.orchestra.run.smithi059.stdout: --- tests/generic/126.out 2023-10-16 14:27:43.308522332 +0000 2023-10-16T16:12:52.253 INFO:teuthology.orchestra.run.smithi059.stdout: +++ /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/126.out.bad 2023-10-16 16:12:52.241930102 +0000 2023-10-16T16:12:52.253 INFO:teuthology.orchestra.run.smithi059.stdout: @@ -1,7 +1,7 @@ 2023-10-16T16:12:52.254 INFO:teuthology.orchestra.run.smithi059.stdout: QA output created by 126 2023-10-16T16:12:52.254 INFO:teuthology.orchestra.run.smithi059.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2023-10-16T16:12:52.254 INFO:teuthology.orchestra.run.smithi059.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2023-10-16T16:12:52.254 INFO:teuthology.orchestra.run.smithi059.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2023-10-16T16:12:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2023-10-16T16:12:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2023-10-16T16:12:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2023-10-16T16:12:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2023-10-16T16:12:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2023-10-16T16:12:52.255 INFO:teuthology.orchestra.run.smithi059.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2023-10-16T16:12:52.260 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/126 2023-10-16T16:12:52.260 INFO:teuthology.orchestra.run.smithi059.stdout:Failures: generic/126 2023-10-16T16:12:52.260 INFO:teuthology.orchestra.run.smithi059.stdout:Failed 1 of 1 tests 2023-10-16T16:12:52.268 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:12:52.315 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T16:12:52.316 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T16:12:52.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T16:12:52.317 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-10-16T16:12:53.682 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:12:53.697 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:12:53.698 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:14:42.697 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:14:42.707 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:15:13.106 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:15:13.116 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:15:43.246 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:15:43.255 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:16:13.394 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:16:13.406 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:16:43.539 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:16:43.550 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:17:13.687 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:17:13.698 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:17:43.833 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:17:43.843 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:18:13.972 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:18:13.983 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:18:44.111 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:18:44.120 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:19:14.241 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:19:14.255 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:19:44.527 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:19:44.538 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:20:14.678 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:20:14.688 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:20:14.810 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-10-16T16:20:14.808+0000 7f91056c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 223929) UID: 0 2023-10-16T16:20:14.811 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-10-16T16:20:14.808+0000 7f98840e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 223929) UID: 0 2023-10-16T16:20:14.811 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-10-16T16:20:14.808+0000 7f5953fdd640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 223929) UID: 0 2023-10-16T16:20:14.811 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-10-16T16:20:14.808+0000 7f33baba1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 223929) UID: 0 2023-10-16T16:23:23.668 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:23:23.680 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:23:53.885 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:23:53.895 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:24:24.031 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:24:24.041 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:24:54.175 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:24:54.186 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:25:24.760 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:25:24.772 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:25:54.898 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:25:54.908 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:26:25.038 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:26:25.048 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:26:55.193 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:26:55.209 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:27:25.347 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:27:25.357 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:27:55.486 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:27:55.496 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:28:25.631 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:28:25.643 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:28:55.780 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:28:55.792 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:29:25.919 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:29:25.929 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:29:56.066 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:29:56.076 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:30:26.212 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:30:26.222 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:30:56.347 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:30:56.359 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:31:26.489 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:31:26.498 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:31:56.645 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:31:56.655 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:32:26.793 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:32:26.804 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:32:56.934 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:32:56.945 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:33:27.078 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:33:27.089 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:33:57.216 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:33:57.229 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:34:27.364 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:34:27.375 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:34:57.522 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:34:57.532 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:35:27.671 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:35:27.682 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:35:57.812 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:35:57.827 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:36:27.976 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:36:27.987 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:36:58.115 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:36:58.125 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:37:28.264 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:37:28.273 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:37:58.413 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:37:58.424 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:38:28.554 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:38:28.565 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:38:58.694 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:38:58.704 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:39:28.825 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:39:28.835 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:39:58.969 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:39:58.979 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:40:29.109 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:40:29.119 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:40:59.250 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:40:59.260 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:41:29.390 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:41:29.401 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:41:59.526 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:41:59.538 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:42:29.685 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:42:29.695 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:42:59.820 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:42:59.829 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:43:29.968 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:43:29.978 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:44:00.118 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:44:00.128 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:44:30.254 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:44:30.264 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:45:00.393 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:45:00.404 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:45:30.521 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:45:30.533 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:46:00.671 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:46:00.680 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:46:30.818 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:46:30.828 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:47:00.958 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:47:00.969 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:47:31.108 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:47:31.119 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:48:01.248 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:48:01.258 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:48:31.377 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:48:31.391 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:48:31.509 INFO:tasks.ceph.mds.c.smithi059.stderr:2023-10-16T16:48:31.505+0000 7fbf1e8d8640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 224880) UID: 0 2023-10-16T16:48:31.509 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-10-16T16:48:31.505+0000 7fc73a4b6640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 224880) UID: 0 2023-10-16T16:51:10.381 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:51:10.391 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:51:40.576 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:51:40.587 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:52:10.720 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:52:10.731 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:52:40.870 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:52:40.881 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:53:11.009 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:53:11.019 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:53:25.238 INFO:teuthology.orchestra.run.smithi059.stdout:generic/127 2432s 2023-10-16T16:53:25.258 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/127 2023-10-16T16:53:25.258 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:53:25.267 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:53:25.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:53:25.310 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-10-16T16:53:26.062 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:53:26.076 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:53:26.076 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:53:26.559 INFO:teuthology.orchestra.run.smithi059.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:53:26.574 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/128 2023-10-16T16:53:26.574 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/128 2023-10-16T16:53:26.574 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:53:26.587 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:53:26.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:53:26.619 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-10-16T16:53:27.232 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:53:27.245 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:53:27.245 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:53:27.660 INFO:teuthology.orchestra.run.smithi059.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:53:27.671 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/129 2023-10-16T16:53:27.671 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/129 2023-10-16T16:53:27.671 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:53:27.680 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:53:27.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:53:27.710 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-10-16T16:53:28.286 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:53:28.300 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:53:28.300 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:53:28.734 INFO:teuthology.orchestra.run.smithi059.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:53:28.747 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/130 2023-10-16T16:53:28.747 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/130 2023-10-16T16:53:28.747 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:53:28.757 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:53:28.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:53:28.787 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-10-16T16:53:29.370 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:53:29.383 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:53:29.383 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:53:31.421 INFO:teuthology.orchestra.run.smithi059.stdout:generic/131 2s 2023-10-16T16:53:31.436 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/131 2023-10-16T16:53:31.437 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:53:31.445 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:53:31.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:53:31.471 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-10-16T16:53:32.200 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:53:32.211 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:53:32.212 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:53:32.650 INFO:teuthology.orchestra.run.smithi059.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T16:53:32.663 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/132 2023-10-16T16:53:32.663 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/132 2023-10-16T16:53:32.664 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T16:53:32.674 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:53:32.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T16:53:32.704 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-10-16T16:53:33.299 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T16:53:33.313 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T16:53:33.313 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T16:53:41.147 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:53:41.161 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:54:11.300 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:54:11.314 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:54:11.427 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-10-16T16:54:11.425+0000 7efc1aede640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98258) UID: 0 2023-10-16T16:54:11.427 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-10-16T16:54:11.425+0000 7f104c58c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98258) UID: 0 2023-10-16T16:54:11.428 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-10-16T16:54:11.425+0000 7f9061646640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98258) UID: 0 2023-10-16T16:54:11.428 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-10-16T16:54:11.425+0000 7f977ef33640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98258) UID: 0 2023-10-16T16:57:05.491 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:57:05.501 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:57:35.636 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:57:35.646 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:58:05.767 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:58:05.780 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:58:35.929 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:58:35.939 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:59:06.534 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:59:06.545 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:59:36.680 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T16:59:36.691 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:00:06.938 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:00:06.948 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:00:37.075 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:00:37.091 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:01:07.221 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:01:07.231 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:01:37.372 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:01:37.382 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:02:07.505 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:02:07.515 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:02:37.646 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:02:37.657 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:03:07.896 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:03:07.906 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:03:38.085 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:03:38.096 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:04:08.223 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:04:08.233 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:04:09.896 INFO:teuthology.orchestra.run.smithi059.stdout:generic/133 636s 2023-10-16T17:04:09.917 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/133 2023-10-16T17:04:09.918 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:09.927 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:09.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:09.963 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-10-16T17:04:10.798 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:10.809 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:10.809 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:11.364 INFO:teuthology.orchestra.run.smithi059.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:11.375 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/134 2023-10-16T17:04:11.376 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/134 2023-10-16T17:04:11.376 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:11.386 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:11.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:11.417 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-10-16T17:04:12.157 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:12.170 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:12.171 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:12.727 INFO:teuthology.orchestra.run.smithi059.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:04:12.740 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/135 2023-10-16T17:04:12.740 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/135 2023-10-16T17:04:12.740 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:12.750 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:12.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:12.782 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-10-16T17:04:13.374 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:13.387 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:13.388 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:14.003 INFO:teuthology.orchestra.run.smithi059.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:14.017 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/136 2023-10-16T17:04:14.018 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/136 2023-10-16T17:04:14.018 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:14.029 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:14.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:14.066 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-10-16T17:04:14.793 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:14.806 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:14.806 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:15.353 INFO:teuthology.orchestra.run.smithi059.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:15.365 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/137 2023-10-16T17:04:15.365 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/137 2023-10-16T17:04:15.365 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:15.375 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:15.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:15.416 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-10-16T17:04:16.147 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:16.160 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:16.160 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:16.746 INFO:teuthology.orchestra.run.smithi059.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:16.758 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/138 2023-10-16T17:04:16.759 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/138 2023-10-16T17:04:16.759 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:16.767 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:16.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:16.804 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-10-16T17:04:17.555 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:17.567 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:17.567 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:18.088 INFO:teuthology.orchestra.run.smithi059.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:18.100 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/139 2023-10-16T17:04:18.100 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/139 2023-10-16T17:04:18.100 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:18.109 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:18.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:18.139 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-10-16T17:04:18.847 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:18.859 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:18.859 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:19.418 INFO:teuthology.orchestra.run.smithi059.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:19.429 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/140 2023-10-16T17:04:19.430 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/140 2023-10-16T17:04:19.430 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:19.438 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:19.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:19.476 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-10-16T17:04:20.192 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:20.204 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:20.204 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:20.630 INFO:teuthology.orchestra.run.smithi059.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:04:20.643 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/141 2023-10-16T17:04:20.643 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/141 2023-10-16T17:04:20.644 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:20.653 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:20.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:20.684 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-10-16T17:04:21.284 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:21.299 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:21.299 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:21.888 INFO:teuthology.orchestra.run.smithi059.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:21.901 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/142 2023-10-16T17:04:21.902 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/142 2023-10-16T17:04:21.902 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:21.912 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:21.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:21.957 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-10-16T17:04:22.700 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:22.711 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:22.712 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:23.255 INFO:teuthology.orchestra.run.smithi059.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:23.267 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/143 2023-10-16T17:04:23.268 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/143 2023-10-16T17:04:23.268 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:23.278 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:23.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:23.317 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-10-16T17:04:24.045 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:24.057 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:24.058 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:24.638 INFO:teuthology.orchestra.run.smithi059.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:24.652 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/144 2023-10-16T17:04:24.652 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/144 2023-10-16T17:04:24.653 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:24.666 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:24.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:24.706 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-10-16T17:04:25.441 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:25.456 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:25.456 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:26.073 INFO:teuthology.orchestra.run.smithi059.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:26.085 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/145 2023-10-16T17:04:26.085 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/145 2023-10-16T17:04:26.085 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:26.094 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:26.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:26.145 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-10-16T17:04:26.860 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:26.872 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:26.873 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:27.387 INFO:teuthology.orchestra.run.smithi059.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:27.399 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/146 2023-10-16T17:04:27.400 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/146 2023-10-16T17:04:27.400 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:27.409 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:27.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:27.443 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-10-16T17:04:28.156 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:28.167 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:28.168 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:28.754 INFO:teuthology.orchestra.run.smithi059.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:28.770 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/147 2023-10-16T17:04:28.770 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/147 2023-10-16T17:04:28.770 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:28.782 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:28.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:28.830 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-10-16T17:04:29.550 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:29.559 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:29.559 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:30.082 INFO:teuthology.orchestra.run.smithi059.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:30.095 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/148 2023-10-16T17:04:30.095 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/148 2023-10-16T17:04:30.096 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:30.108 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:30.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:30.162 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-10-16T17:04:30.891 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:30.903 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:30.904 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:31.459 INFO:teuthology.orchestra.run.smithi059.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:31.472 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/149 2023-10-16T17:04:31.472 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/149 2023-10-16T17:04:31.472 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:31.482 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:31.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:31.525 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-10-16T17:04:32.273 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:32.287 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:32.287 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:32.839 INFO:teuthology.orchestra.run.smithi059.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:32.855 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/150 2023-10-16T17:04:32.855 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/150 2023-10-16T17:04:32.855 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:32.866 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:32.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:32.907 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-10-16T17:04:33.649 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:33.661 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:33.661 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:34.176 INFO:teuthology.orchestra.run.smithi059.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:34.187 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/151 2023-10-16T17:04:34.187 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/151 2023-10-16T17:04:34.187 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:34.195 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:34.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:34.240 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-10-16T17:04:34.964 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:34.975 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:34.975 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:35.542 INFO:teuthology.orchestra.run.smithi059.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:35.556 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/152 2023-10-16T17:04:35.556 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/152 2023-10-16T17:04:35.556 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:35.565 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:35.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:35.603 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-10-16T17:04:36.334 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:36.346 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:36.346 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:36.873 INFO:teuthology.orchestra.run.smithi059.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:36.885 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/153 2023-10-16T17:04:36.886 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/153 2023-10-16T17:04:36.886 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:36.895 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:36.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:36.925 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-10-16T17:04:37.672 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:37.685 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:37.685 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:38.281 INFO:teuthology.orchestra.run.smithi059.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:38.295 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/154 2023-10-16T17:04:38.296 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/154 2023-10-16T17:04:38.296 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:38.307 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:38.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:38.348 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-10-16T17:04:38.362 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:04:38.406 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:04:39.099 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:39.112 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:39.112 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:39.595 INFO:teuthology.orchestra.run.smithi059.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:39.604 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/155 2023-10-16T17:04:39.605 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/155 2023-10-16T17:04:39.605 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:39.611 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:39.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:39.644 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-10-16T17:04:40.408 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:40.419 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:40.419 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:41.055 INFO:teuthology.orchestra.run.smithi059.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:41.067 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/156 2023-10-16T17:04:41.067 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/156 2023-10-16T17:04:41.068 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:41.077 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:41.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:41.105 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-10-16T17:04:41.875 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:41.886 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:41.886 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:42.412 INFO:teuthology.orchestra.run.smithi059.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:42.425 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/157 2023-10-16T17:04:42.426 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/157 2023-10-16T17:04:42.426 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:42.438 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:42.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:42.474 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-10-16T17:04:43.193 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:43.205 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:43.205 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:43.769 INFO:teuthology.orchestra.run.smithi059.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-16T17:04:43.780 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/158 2023-10-16T17:04:43.780 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/158 2023-10-16T17:04:43.781 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:43.790 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:43.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:43.828 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-10-16T17:04:44.542 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:44.555 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:44.555 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:45.106 INFO:teuthology.orchestra.run.smithi059.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-10-16T17:04:45.122 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/159 2023-10-16T17:04:45.122 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/159 2023-10-16T17:04:45.123 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:45.134 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:45.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:45.168 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-10-16T17:04:45.773 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:45.786 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:45.787 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:46.327 INFO:teuthology.orchestra.run.smithi059.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-10-16T17:04:46.340 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/160 2023-10-16T17:04:46.340 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/160 2023-10-16T17:04:46.340 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:46.351 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:46.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:46.383 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-10-16T17:04:46.996 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:47.009 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:47.009 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:47.524 INFO:teuthology.orchestra.run.smithi059.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:04:47.537 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/161 2023-10-16T17:04:47.537 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/161 2023-10-16T17:04:47.538 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:47.550 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:47.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:47.588 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-10-16T17:04:48.172 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:48.187 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:48.187 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:48.616 INFO:teuthology.orchestra.run.smithi059.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:04:48.629 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/162 2023-10-16T17:04:48.629 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/162 2023-10-16T17:04:48.630 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:48.642 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:48.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:48.681 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-10-16T17:04:49.292 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:49.307 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:49.307 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:49.766 INFO:teuthology.orchestra.run.smithi059.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:04:49.780 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/163 2023-10-16T17:04:49.780 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/163 2023-10-16T17:04:49.781 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:49.792 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:49.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:49.825 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-10-16T17:04:50.428 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:50.442 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:50.442 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:50.895 INFO:teuthology.orchestra.run.smithi059.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:04:50.909 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/164 2023-10-16T17:04:50.911 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/164 2023-10-16T17:04:50.911 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:50.922 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:50.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:50.958 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-10-16T17:04:51.545 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:51.557 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:51.558 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:52.006 INFO:teuthology.orchestra.run.smithi059.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:04:52.017 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/165 2023-10-16T17:04:52.017 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/165 2023-10-16T17:04:52.017 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:52.026 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:52.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:52.055 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-10-16T17:04:52.626 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:52.640 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:52.640 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:53.057 INFO:teuthology.orchestra.run.smithi059.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:04:53.069 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/166 2023-10-16T17:04:53.069 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/166 2023-10-16T17:04:53.069 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:53.079 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:53.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:53.107 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-10-16T17:04:53.720 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:53.734 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:53.734 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:54.150 INFO:teuthology.orchestra.run.smithi059.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:04:54.161 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/167 2023-10-16T17:04:54.162 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/167 2023-10-16T17:04:54.162 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:54.170 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:54.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:54.202 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-10-16T17:04:54.823 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:54.839 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:54.839 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:55.298 INFO:teuthology.orchestra.run.smithi059.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:04:55.311 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/168 2023-10-16T17:04:55.311 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/168 2023-10-16T17:04:55.312 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:55.323 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:55.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:55.357 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-10-16T17:04:55.948 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:55.962 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:55.962 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:56.396 INFO:teuthology.orchestra.run.smithi059.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:04:56.410 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/169 2023-10-16T17:04:56.410 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/169 2023-10-16T17:04:56.410 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:56.424 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:56.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:56.458 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-10-16T17:04:57.097 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:57.110 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:57.110 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:57.528 INFO:teuthology.orchestra.run.smithi059.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:04:57.542 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/170 2023-10-16T17:04:57.543 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/170 2023-10-16T17:04:57.543 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:57.557 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:57.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:57.591 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-10-16T17:04:58.188 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:58.200 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:58.200 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:58.672 INFO:teuthology.orchestra.run.smithi059.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:04:58.686 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/171 2023-10-16T17:04:58.686 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/171 2023-10-16T17:04:58.689 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:58.698 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:58.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:58.735 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-10-16T17:04:59.321 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:04:59.334 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:04:59.335 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:59.784 INFO:teuthology.orchestra.run.smithi059.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:04:59.800 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/172 2023-10-16T17:04:59.800 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/172 2023-10-16T17:04:59.801 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:04:59.813 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:04:59.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:04:59.851 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-10-16T17:05:00.424 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:00.439 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:00.439 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:00.901 INFO:teuthology.orchestra.run.smithi059.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:00.914 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/173 2023-10-16T17:05:00.914 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/173 2023-10-16T17:05:00.914 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:00.924 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:00.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:00.957 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-10-16T17:05:01.550 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:01.564 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:01.564 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:02.053 INFO:teuthology.orchestra.run.smithi059.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:02.066 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/174 2023-10-16T17:05:02.066 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/174 2023-10-16T17:05:02.066 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:02.076 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:02.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:02.110 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-10-16T17:05:02.723 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:02.735 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:02.735 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:03.210 INFO:teuthology.orchestra.run.smithi059.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:03.222 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/175 2023-10-16T17:05:03.222 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/175 2023-10-16T17:05:03.222 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:03.232 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:03.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:03.267 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-10-16T17:05:03.858 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:03.872 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:03.872 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:04.334 INFO:teuthology.orchestra.run.smithi059.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:04.345 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/176 2023-10-16T17:05:04.345 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/176 2023-10-16T17:05:04.345 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:04.354 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:04.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:04.392 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-10-16T17:05:04.987 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:05.001 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:05.002 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:05.527 INFO:teuthology.orchestra.run.smithi059.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:05.540 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/177 2023-10-16T17:05:05.540 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/177 2023-10-16T17:05:05.540 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:05.550 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:05.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:05.584 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-10-16T17:05:06.183 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:06.197 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:06.197 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:06.805 INFO:teuthology.orchestra.run.smithi059.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:05:06.821 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/178 2023-10-16T17:05:06.822 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/178 2023-10-16T17:05:06.822 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:06.833 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:06.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:06.887 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-10-16T17:05:07.630 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:07.642 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:07.642 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:08.174 INFO:teuthology.orchestra.run.smithi059.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:05:08.186 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/179 2023-10-16T17:05:08.186 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/179 2023-10-16T17:05:08.187 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:08.196 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:08.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:08.234 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-10-16T17:05:08.608 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:05:08.620 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:05:08.972 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:08.984 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:08.985 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:09.559 INFO:teuthology.orchestra.run.smithi059.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:05:09.573 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/180 2023-10-16T17:05:09.574 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/180 2023-10-16T17:05:09.574 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:09.585 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:09.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:09.632 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-10-16T17:05:10.354 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:10.365 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:10.365 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:10.948 INFO:teuthology.orchestra.run.smithi059.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:05:10.960 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/181 2023-10-16T17:05:10.961 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/181 2023-10-16T17:05:10.961 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:10.971 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:11.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:11.007 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-10-16T17:05:11.738 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:11.750 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:11.750 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:12.316 INFO:teuthology.orchestra.run.smithi059.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-16T17:05:12.332 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/182 2023-10-16T17:05:12.332 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/182 2023-10-16T17:05:12.332 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:12.339 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:12.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:12.396 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-10-16T17:05:13.123 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:13.136 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:13.137 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:13.554 INFO:teuthology.orchestra.run.smithi059.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:13.569 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/183 2023-10-16T17:05:13.570 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/183 2023-10-16T17:05:13.570 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:13.583 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:13.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:13.618 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-10-16T17:05:14.224 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:14.240 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:14.240 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:14.831 INFO:teuthology.orchestra.run.smithi059.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/184.out.bad) 2023-10-16T17:05:14.840 INFO:teuthology.orchestra.run.smithi059.stdout: --- tests/generic/184.out 2023-10-16 14:27:43.318522214 +0000 2023-10-16T17:05:14.840 INFO:teuthology.orchestra.run.smithi059.stdout: +++ /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/184.out.bad 2023-10-16 17:05:14.827179048 +0000 2023-10-16T17:05:14.840 INFO:teuthology.orchestra.run.smithi059.stdout: @@ -1 +1,2 @@ 2023-10-16T17:05:14.840 INFO:teuthology.orchestra.run.smithi059.stdout: QA output created by 184 2023-10-16T17:05:14.840 INFO:teuthology.orchestra.run.smithi059.stdout: +/tmp/tmp.AzguH69EDZxfstests-dev/tests/generic/184: line 23: /tmp/tmp.WAE0cdes5xtest/null: Permission denied 2023-10-16T17:05:14.848 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/184 2023-10-16T17:05:14.849 INFO:teuthology.orchestra.run.smithi059.stdout:Failures: generic/184 2023-10-16T17:05:14.849 INFO:teuthology.orchestra.run.smithi059.stdout:Failed 1 of 1 tests 2023-10-16T17:05:14.858 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:14.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T17:05:14.888 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T17:05:14.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T17:05:14.889 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-10-16T17:05:15.481 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:15.495 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:15.495 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:15.968 INFO:teuthology.orchestra.run.smithi059.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:15.980 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/185 2023-10-16T17:05:15.980 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/185 2023-10-16T17:05:15.980 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:15.989 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:16.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:16.020 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-10-16T17:05:16.620 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:16.635 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:16.635 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:17.085 INFO:teuthology.orchestra.run.smithi059.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:17.100 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/186 2023-10-16T17:05:17.100 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/186 2023-10-16T17:05:17.100 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:17.112 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:17.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:17.147 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-10-16T17:05:17.737 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:17.749 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:17.750 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:18.146 INFO:teuthology.orchestra.run.smithi059.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:18.157 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/187 2023-10-16T17:05:18.157 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/187 2023-10-16T17:05:18.158 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:18.167 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:18.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:18.197 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-10-16T17:05:18.782 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:18.796 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:18.796 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:19.243 INFO:teuthology.orchestra.run.smithi059.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:19.258 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/188 2023-10-16T17:05:19.258 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/188 2023-10-16T17:05:19.259 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:19.271 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:19.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:19.306 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-10-16T17:05:19.950 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:19.966 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:19.966 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:20.431 INFO:teuthology.orchestra.run.smithi059.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:20.442 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/189 2023-10-16T17:05:20.442 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/189 2023-10-16T17:05:20.442 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:20.451 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:20.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:20.482 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-10-16T17:05:21.081 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:21.096 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:21.097 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:21.561 INFO:teuthology.orchestra.run.smithi059.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:21.572 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/190 2023-10-16T17:05:21.572 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/190 2023-10-16T17:05:21.573 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:21.581 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:21.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:21.613 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-10-16T17:05:22.178 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:22.190 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:22.191 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:22.637 INFO:teuthology.orchestra.run.smithi059.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:22.649 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/191 2023-10-16T17:05:22.650 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/191 2023-10-16T17:05:22.650 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:22.659 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:22.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:22.692 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-10-16T17:05:23.313 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:23.328 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:23.328 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:23.789 INFO:teuthology.orchestra.run.smithi059.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2023-10-16T17:05:23.799 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/192 2023-10-16T17:05:23.799 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/192 2023-10-16T17:05:23.799 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:23.807 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:23.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:23.839 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-10-16T17:05:24.384 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:24.397 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:24.398 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:26.778 INFO:teuthology.orchestra.run.smithi059.stdout:generic/193 - output mismatch (see /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/193.out.bad) 2023-10-16T17:05:26.785 INFO:teuthology.orchestra.run.smithi059.stdout: --- tests/generic/193.out 2023-10-16 14:27:43.320522190 +0000 2023-10-16T17:05:26.785 INFO:teuthology.orchestra.run.smithi059.stdout: +++ /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/193.out.bad 2023-10-16 17:05:26.773031497 +0000 2023-10-16T17:05:26.785 INFO:teuthology.orchestra.run.smithi059.stdout: @@ -24,7 +24,6 @@ 2023-10-16T17:05:26.786 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:26.786 INFO:teuthology.orchestra.run.smithi059.stdout: user: chmod a+r on qa_user owned file (should succeed) 2023-10-16T17:05:26.786 INFO:teuthology.orchestra.run.smithi059.stdout: user: chmod a+r on root owned file (should fail) 2023-10-16T17:05:26.786 INFO:teuthology.orchestra.run.smithi059.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2023-10-16T17:05:26.786 INFO:teuthology.orchestra.run.smithi059.stdout: check that the sgid bit is cleared 2023-10-16T17:05:26.787 INFO:teuthology.orchestra.run.smithi059.stdout: -rw-rw-rw- 2023-10-16T17:05:26.787 INFO:teuthology.orchestra.run.smithi059.stdout: check that suid bit is not cleared 2023-10-16T17:05:26.792 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/193 2023-10-16T17:05:26.792 INFO:teuthology.orchestra.run.smithi059.stdout:Failures: generic/193 2023-10-16T17:05:26.792 INFO:teuthology.orchestra.run.smithi059.stdout:Failed 1 of 1 tests 2023-10-16T17:05:26.800 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:26.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T17:05:26.825 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T17:05:26.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T17:05:26.826 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-10-16T17:05:27.529 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:27.540 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:27.540 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:27.964 INFO:teuthology.orchestra.run.smithi059.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:27.977 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/194 2023-10-16T17:05:27.978 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/194 2023-10-16T17:05:27.978 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:27.989 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:28.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:28.023 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-10-16T17:05:28.619 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:28.632 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:28.632 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:29.040 INFO:teuthology.orchestra.run.smithi059.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:29.053 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/195 2023-10-16T17:05:29.053 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/195 2023-10-16T17:05:29.053 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:29.063 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:29.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:29.094 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-10-16T17:05:29.696 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:29.712 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:29.712 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:30.214 INFO:teuthology.orchestra.run.smithi059.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:30.227 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/196 2023-10-16T17:05:30.228 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/196 2023-10-16T17:05:30.228 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:30.238 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:30.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:30.267 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-10-16T17:05:30.860 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:30.874 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:30.874 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:31.348 INFO:teuthology.orchestra.run.smithi059.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:31.360 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/197 2023-10-16T17:05:31.360 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/197 2023-10-16T17:05:31.361 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:31.372 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:31.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:31.412 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-10-16T17:05:32.030 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:32.043 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:32.043 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:34.330 INFO:teuthology.orchestra.run.smithi059.stdout:generic/198 2s 2023-10-16T17:05:34.348 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/198 2023-10-16T17:05:34.348 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:34.357 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:34.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:34.406 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-10-16T17:05:35.179 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:35.190 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:35.190 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:35.629 INFO:teuthology.orchestra.run.smithi059.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:35.645 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/199 2023-10-16T17:05:35.645 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/199 2023-10-16T17:05:35.646 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:35.659 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:35.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:35.693 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-10-16T17:05:36.273 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:36.286 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:36.286 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:36.721 INFO:teuthology.orchestra.run.smithi059.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:36.731 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/200 2023-10-16T17:05:36.732 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/200 2023-10-16T17:05:36.732 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:36.740 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:36.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:36.770 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-10-16T17:05:37.337 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:37.352 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:37.353 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:37.816 INFO:teuthology.orchestra.run.smithi059.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:37.826 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/201 2023-10-16T17:05:37.827 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/201 2023-10-16T17:05:37.827 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:37.835 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:37.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:37.862 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-10-16T17:05:38.449 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:38.464 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:38.465 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:38.779 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:05:38.786 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:05:38.867 INFO:teuthology.orchestra.run.smithi059.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:38.877 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/202 2023-10-16T17:05:38.878 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/202 2023-10-16T17:05:38.878 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:38.888 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:38.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:38.920 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-10-16T17:05:39.555 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:39.568 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:39.568 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:39.997 INFO:teuthology.orchestra.run.smithi059.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:40.008 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/203 2023-10-16T17:05:40.008 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/203 2023-10-16T17:05:40.009 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:40.017 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:40.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:40.053 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-10-16T17:05:40.608 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:40.623 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:40.623 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:41.485 INFO:teuthology.orchestra.run.smithi059.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:41.501 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/204 2023-10-16T17:05:41.502 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/204 2023-10-16T17:05:41.502 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:41.516 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:41.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:41.551 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-10-16T17:05:42.117 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:42.131 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:42.131 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:42.610 INFO:teuthology.orchestra.run.smithi059.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:42.622 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/205 2023-10-16T17:05:42.623 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/205 2023-10-16T17:05:42.623 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:42.632 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:42.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:42.661 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-10-16T17:05:43.272 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:43.286 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:43.287 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:43.715 INFO:teuthology.orchestra.run.smithi059.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:05:43.725 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/206 2023-10-16T17:05:43.725 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/206 2023-10-16T17:05:43.726 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:05:43.734 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:05:43.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:05:43.762 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-10-16T17:05:44.356 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:05:44.371 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:05:44.371 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:06:08.916 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:06:08.930 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:06:34.325 INFO:teuthology.orchestra.run.smithi059.stdout:generic/207 50s 2023-10-16T17:06:34.343 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/207 2023-10-16T17:06:34.344 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:06:34.354 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:06:34.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:06:34.390 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-10-16T17:06:35.128 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:06:35.140 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:06:35.140 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:06:39.063 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:06:39.073 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:07:09.207 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:07:09.217 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:07:40.090 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:07:40.100 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:08:10.336 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:08:10.346 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:08:40.485 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:08:40.495 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:09:10.634 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:09:10.645 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:09:40.780 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:09:40.790 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:09:55.869 INFO:teuthology.orchestra.run.smithi059.stdout:generic/208 200s 2023-10-16T17:09:55.886 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/208 2023-10-16T17:09:55.886 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:09:55.894 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:09:55.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:09:55.922 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-10-16T17:09:56.674 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:09:56.686 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:09:56.686 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:10.939 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:10:10.951 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:10:22.449 INFO:teuthology.orchestra.run.smithi059.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/209.out.bad) 2023-10-16T17:10:22.469 INFO:teuthology.orchestra.run.smithi059.stdout: --- tests/generic/209.out 2023-10-16 14:27:43.322522167 +0000 2023-10-16T17:10:22.469 INFO:teuthology.orchestra.run.smithi059.stdout: +++ /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/209.out.bad 2023-10-16 17:10:22.438370459 +0000 2023-10-16T17:10:22.469 INFO:teuthology.orchestra.run.smithi059.stdout: @@ -1,2 +1,2 @@ 2023-10-16T17:10:22.469 INFO:teuthology.orchestra.run.smithi059.stdout: QA output created by 209 2023-10-16T17:10:22.470 INFO:teuthology.orchestra.run.smithi059.stdout: -test ran for 30 seconds without error 2023-10-16T17:10:22.470 INFO:teuthology.orchestra.run.smithi059.stdout: +reader found old byte at pos 4096 2023-10-16T17:10:22.470 INFO:teuthology.orchestra.run.smithi059.stdout: \ No newline at end of file 2023-10-16T17:10:22.479 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/209 2023-10-16T17:10:22.480 INFO:teuthology.orchestra.run.smithi059.stdout:Failures: generic/209 2023-10-16T17:10:22.480 INFO:teuthology.orchestra.run.smithi059.stdout:Failed 1 of 1 tests 2023-10-16T17:10:22.493 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:22.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T17:10:22.540 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T17:10:22.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T17:10:22.541 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-10-16T17:10:23.166 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:23.177 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:23.178 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:23.850 INFO:teuthology.orchestra.run.smithi059.stdout:generic/210 0s 2023-10-16T17:10:23.870 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/210 2023-10-16T17:10:23.870 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:23.879 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:23.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:23.921 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-10-16T17:10:24.638 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:24.649 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:24.649 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:25.676 INFO:teuthology.orchestra.run.smithi059.stdout:generic/211 1s 2023-10-16T17:10:25.694 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/211 2023-10-16T17:10:25.695 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:25.704 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:25.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:25.735 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-10-16T17:10:26.323 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:26.337 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:26.337 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:27.012 INFO:teuthology.orchestra.run.smithi059.stdout:generic/212 0s 2023-10-16T17:10:27.030 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/212 2023-10-16T17:10:27.031 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:27.040 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:27.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:27.073 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-10-16T17:10:27.696 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:27.711 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:27.711 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:28.568 INFO:teuthology.orchestra.run.smithi059.stdout:generic/213 - output mismatch (see /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/213.out.bad) 2023-10-16T17:10:28.575 INFO:teuthology.orchestra.run.smithi059.stdout: --- tests/generic/213.out 2023-10-16 14:27:43.323522155 +0000 2023-10-16T17:10:28.575 INFO:teuthology.orchestra.run.smithi059.stdout: +++ /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/213.out.bad 2023-10-16 17:10:28.563294813 +0000 2023-10-16T17:10:28.575 INFO:teuthology.orchestra.run.smithi059.stdout: @@ -1,4 +1,3 @@ 2023-10-16T17:10:28.575 INFO:teuthology.orchestra.run.smithi059.stdout: QA output created by 213 2023-10-16T17:10:28.576 INFO:teuthology.orchestra.run.smithi059.stdout: We should get: fallocate: No space left on device 2023-10-16T17:10:28.576 INFO:teuthology.orchestra.run.smithi059.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2023-10-16T17:10:28.576 INFO:teuthology.orchestra.run.smithi059.stdout: -fallocate: No space left on device 2023-10-16T17:10:28.581 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/213 2023-10-16T17:10:28.581 INFO:teuthology.orchestra.run.smithi059.stdout:Failures: generic/213 2023-10-16T17:10:28.581 INFO:teuthology.orchestra.run.smithi059.stdout:Failed 1 of 1 tests 2023-10-16T17:10:28.588 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:28.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T17:10:28.631 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T17:10:28.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T17:10:28.632 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-10-16T17:10:29.426 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:29.441 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:29.442 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:30.484 INFO:teuthology.orchestra.run.smithi059.stdout:generic/214 1s 2023-10-16T17:10:30.505 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/214 2023-10-16T17:10:30.505 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:30.516 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:30.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:30.552 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-10-16T17:10:31.342 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:31.359 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:31.359 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:35.522 INFO:teuthology.orchestra.run.smithi059.stdout:generic/215 4s 2023-10-16T17:10:35.540 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/215 2023-10-16T17:10:35.540 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:35.552 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:35.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:35.586 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-10-16T17:10:36.211 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:36.225 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:36.226 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:36.646 INFO:teuthology.orchestra.run.smithi059.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:10:36.659 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/216 2023-10-16T17:10:36.659 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/216 2023-10-16T17:10:36.659 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:36.669 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:36.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:36.704 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-10-16T17:10:37.330 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:37.347 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:37.347 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:37.757 INFO:teuthology.orchestra.run.smithi059.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:10:37.770 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/217 2023-10-16T17:10:37.770 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/217 2023-10-16T17:10:37.770 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:37.779 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:37.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:37.815 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-10-16T17:10:38.424 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:38.440 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:38.441 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:38.851 INFO:teuthology.orchestra.run.smithi059.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:10:38.864 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/218 2023-10-16T17:10:38.865 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/218 2023-10-16T17:10:38.865 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:38.874 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:38.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:38.912 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-10-16T17:10:39.550 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:39.565 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:39.565 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:39.984 INFO:teuthology.orchestra.run.smithi059.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:10:39.996 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/219 2023-10-16T17:10:39.997 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/219 2023-10-16T17:10:39.997 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:40.006 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:40.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:40.038 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-10-16T17:10:40.669 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:40.689 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:40.689 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:41.123 INFO:teuthology.orchestra.run.smithi059.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:10:41.136 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/220 2023-10-16T17:10:41.136 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/220 2023-10-16T17:10:41.137 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:41.145 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:41.148 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:10:41.156 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:10:41.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:41.180 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-10-16T17:10:41.835 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:41.853 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:41.854 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:43.348 INFO:teuthology.orchestra.run.smithi059.stdout:generic/221 2s 2023-10-16T17:10:43.368 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/221 2023-10-16T17:10:43.368 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:43.380 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:43.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:43.413 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-10-16T17:10:44.051 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:44.068 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:44.068 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:44.491 INFO:teuthology.orchestra.run.smithi059.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:10:44.504 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/222 2023-10-16T17:10:44.504 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/222 2023-10-16T17:10:44.505 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:44.514 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:44.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:44.548 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-10-16T17:10:45.191 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:45.212 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:45.212 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:45.630 INFO:teuthology.orchestra.run.smithi059.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:10:45.643 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/223 2023-10-16T17:10:45.644 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/223 2023-10-16T17:10:45.644 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:45.652 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:45.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:45.683 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-10-16T17:10:46.307 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:46.322 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:46.322 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:46.763 INFO:teuthology.orchestra.run.smithi059.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:10:46.776 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/224 2023-10-16T17:10:46.776 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/224 2023-10-16T17:10:46.777 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:46.786 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:46.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:46.817 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-10-16T17:10:47.443 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:47.465 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:47.465 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:47.877 INFO:teuthology.orchestra.run.smithi059.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:10:47.889 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/225 2023-10-16T17:10:47.889 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/225 2023-10-16T17:10:47.889 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:47.898 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:47.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:47.927 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-10-16T17:10:48.558 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:48.576 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:48.577 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:48.975 INFO:teuthology.orchestra.run.smithi059.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:10:48.986 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/226 2023-10-16T17:10:48.987 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/226 2023-10-16T17:10:48.987 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:48.997 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:49.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:49.035 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-10-16T17:10:49.652 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:49.667 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:49.667 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:50.087 INFO:teuthology.orchestra.run.smithi059.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:10:50.102 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/227 2023-10-16T17:10:50.102 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/227 2023-10-16T17:10:50.102 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:50.115 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:50.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:50.149 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-10-16T17:10:50.754 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:50.765 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:50.765 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:52.164 INFO:teuthology.orchestra.run.smithi059.stdout:generic/228 2s 2023-10-16T17:10:52.363 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/228 2023-10-16T17:10:52.363 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:52.369 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:52.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:52.419 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-10-16T17:10:53.258 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:53.273 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:53.273 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:53.697 INFO:teuthology.orchestra.run.smithi059.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:10:53.709 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/229 2023-10-16T17:10:53.709 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/229 2023-10-16T17:10:53.709 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:53.719 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:53.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:53.752 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-10-16T17:10:54.372 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:54.387 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:54.387 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:54.790 INFO:teuthology.orchestra.run.smithi059.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:10:54.804 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/230 2023-10-16T17:10:54.804 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/230 2023-10-16T17:10:54.804 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:54.815 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:54.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:54.851 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-10-16T17:10:55.489 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:55.507 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:55.507 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:55.913 INFO:teuthology.orchestra.run.smithi059.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:10:55.925 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/231 2023-10-16T17:10:55.925 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/231 2023-10-16T17:10:55.925 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:55.934 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:55.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:55.966 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-10-16T17:10:56.583 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:56.600 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:56.601 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:57.024 INFO:teuthology.orchestra.run.smithi059.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:10:57.037 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/232 2023-10-16T17:10:57.037 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/232 2023-10-16T17:10:57.037 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:57.046 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:57.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:57.078 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-10-16T17:10:57.699 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:57.716 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:57.717 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:58.155 INFO:teuthology.orchestra.run.smithi059.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:10:58.168 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/233 2023-10-16T17:10:58.168 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/233 2023-10-16T17:10:58.168 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:58.181 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:58.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:58.217 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-10-16T17:10:58.839 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:58.854 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:58.854 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:59.262 INFO:teuthology.orchestra.run.smithi059.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:10:59.271 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/234 2023-10-16T17:10:59.271 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/234 2023-10-16T17:10:59.271 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:10:59.279 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:10:59.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:10:59.308 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-10-16T17:10:59.922 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:10:59.938 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:10:59.938 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:11:00.376 INFO:teuthology.orchestra.run.smithi059.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:11:00.386 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/235 2023-10-16T17:11:00.387 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/235 2023-10-16T17:11:00.387 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:11:00.398 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:11:00.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:11:00.428 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-10-16T17:11:01.052 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:11:01.069 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:11:01.070 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:11:02.687 INFO:teuthology.orchestra.run.smithi059.stdout:generic/236 1s 2023-10-16T17:11:02.711 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/236 2023-10-16T17:11:02.711 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:11:02.722 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:11:02.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:11:02.785 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-10-16T17:11:03.603 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:11:03.616 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:11:03.616 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:11:04.160 INFO:teuthology.orchestra.run.smithi059.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-16T17:11:04.174 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/237 2023-10-16T17:11:04.174 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/237 2023-10-16T17:11:04.175 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:11:04.183 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:11:04.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:11:04.218 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-10-16T17:11:04.842 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:11:04.856 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:11:04.856 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:11:05.272 INFO:teuthology.orchestra.run.smithi059.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:11:05.283 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/238 2023-10-16T17:11:05.284 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/238 2023-10-16T17:11:05.284 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:11:05.293 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:11:05.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:11:05.332 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-10-16T17:11:05.982 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:11:05.997 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:11:05.998 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:11:11.291 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:11:11.302 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:11:41.509 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:11:41.516 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:12:12.479 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:12:12.488 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:12:42.649 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:12:42.659 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:13:13.483 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:13:13.492 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:13:43.161 INFO:teuthology.orchestra.run.smithi059.stdout:generic/239 157s 2023-10-16T17:13:43.184 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/239 2023-10-16T17:13:43.184 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:13:43.196 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:13:43.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:13:43.238 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-10-16T17:13:43.646 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:13:43.655 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:13:44.094 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:13:44.107 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:13:44.107 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:13:48.068 INFO:teuthology.orchestra.run.smithi059.stdout:generic/240 4s 2023-10-16T17:13:48.088 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/240 2023-10-16T17:13:48.088 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:13:48.097 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:13:48.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:13:48.151 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-10-16T17:13:48.995 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:13:49.013 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:13:49.013 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:14:13.815 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:14:13.825 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:14:44.006 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:14:44.013 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:15:03.151 INFO:teuthology.orchestra.run.smithi059.stdout:generic/241 74s 2023-10-16T17:15:03.189 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/241 2023-10-16T17:15:03.189 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:15:03.198 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:15:03.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:15:03.235 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-10-16T17:15:04.284 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:15:04.300 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:15:04.300 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:15:04.747 INFO:teuthology.orchestra.run.smithi059.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:15:04.758 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/242 2023-10-16T17:15:04.758 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/242 2023-10-16T17:15:04.759 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:15:04.767 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:15:04.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:15:04.803 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-10-16T17:15:05.448 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:15:05.464 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:15:05.464 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:15:06.285 INFO:teuthology.orchestra.run.smithi059.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:15:06.298 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/243 2023-10-16T17:15:06.299 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/243 2023-10-16T17:15:06.299 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:15:06.309 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:15:06.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:15:06.344 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-10-16T17:15:07.008 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:15:07.025 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:15:07.025 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:15:07.488 INFO:teuthology.orchestra.run.smithi059.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-16T17:15:07.502 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/244 2023-10-16T17:15:07.502 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/244 2023-10-16T17:15:07.503 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:15:07.513 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:15:07.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:15:07.546 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-10-16T17:15:08.189 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:15:08.205 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:15:08.205 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:15:10.046 INFO:teuthology.orchestra.run.smithi059.stdout:generic/245 1s 2023-10-16T17:15:10.263 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/245 2023-10-16T17:15:10.263 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:15:10.279 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:15:10.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:15:10.339 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-10-16T17:15:11.185 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:15:11.201 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:15:11.201 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:15:12.105 INFO:teuthology.orchestra.run.smithi059.stdout:generic/246 1s 2023-10-16T17:15:12.126 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/246 2023-10-16T17:15:12.126 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:15:12.136 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:15:12.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:15:12.183 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-10-16T17:15:13.032 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:15:13.050 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:15:13.050 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:15:14.174 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:15:14.185 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:15:44.333 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:15:44.340 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:16:03.862 INFO:teuthology.orchestra.run.smithi059.stdout:generic/247 50s 2023-10-16T17:16:03.879 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/247 2023-10-16T17:16:03.880 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:16:03.889 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:03.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:16:03.922 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-10-16T17:16:04.539 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:16:04.557 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:16:04.558 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:05.134 INFO:teuthology.orchestra.run.smithi059.stdout:generic/248 1s 2023-10-16T17:16:05.155 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/248 2023-10-16T17:16:05.155 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:16:05.163 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:05.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:16:05.199 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-10-16T17:16:05.836 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:16:05.854 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:16:05.854 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:10.206 INFO:teuthology.orchestra.run.smithi059.stdout:generic/249 5s 2023-10-16T17:16:10.227 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/249 2023-10-16T17:16:10.227 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:16:10.235 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:10.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:16:10.270 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-10-16T17:16:11.128 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:16:11.143 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:16:11.143 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:11.637 INFO:teuthology.orchestra.run.smithi059.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:16:11.649 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/250 2023-10-16T17:16:11.649 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/250 2023-10-16T17:16:11.650 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:16:11.657 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:11.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:16:11.692 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-10-16T17:16:12.319 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:16:12.337 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:16:12.338 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:12.773 INFO:teuthology.orchestra.run.smithi059.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:16:12.787 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/251 2023-10-16T17:16:12.787 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/251 2023-10-16T17:16:12.787 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:16:12.798 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:12.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:16:12.833 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-10-16T17:16:13.484 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:16:13.499 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:16:13.499 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:13.960 INFO:teuthology.orchestra.run.smithi059.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:16:13.972 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/252 2023-10-16T17:16:13.972 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/252 2023-10-16T17:16:13.973 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:16:13.982 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:14.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:16:14.018 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-10-16T17:16:14.621 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:16:14.633 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:16:14.633 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:14.723 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:16:14.730 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:16:15.062 INFO:teuthology.orchestra.run.smithi059.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:16:15.077 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/253 2023-10-16T17:16:15.077 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/253 2023-10-16T17:16:15.077 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:16:15.088 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:15.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:16:15.120 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-10-16T17:16:15.746 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:16:15.763 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:16:15.763 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:16.180 INFO:teuthology.orchestra.run.smithi059.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:16:16.193 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/254 2023-10-16T17:16:16.193 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/254 2023-10-16T17:16:16.193 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:16:16.203 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:16.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:16:16.236 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-10-16T17:16:16.860 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:16:16.878 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:16:16.880 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:19.728 INFO:teuthology.orchestra.run.smithi059.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T17:16:19.744 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/255 2023-10-16T17:16:19.744 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/255 2023-10-16T17:16:19.745 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:16:19.753 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:19.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:16:19.800 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-10-16T17:16:20.658 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:16:20.675 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:16:20.675 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:23.368 INFO:teuthology.orchestra.run.smithi059.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:16:23.381 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/256 2023-10-16T17:16:23.381 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/256 2023-10-16T17:16:23.382 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:16:23.390 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:23.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:16:23.427 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-10-16T17:16:24.061 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:16:24.075 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:16:24.075 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:26.695 INFO:teuthology.orchestra.run.smithi059.stdout:generic/257 2s 2023-10-16T17:16:26.714 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/257 2023-10-16T17:16:26.714 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:16:26.725 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:26.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:16:26.760 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-10-16T17:16:27.619 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:16:27.633 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:16:27.633 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:28.179 INFO:teuthology.orchestra.run.smithi059.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/258.out.bad) 2023-10-16T17:16:28.188 INFO:teuthology.orchestra.run.smithi059.stdout: --- tests/generic/258.out 2023-10-16 14:27:43.331522060 +0000 2023-10-16T17:16:28.188 INFO:teuthology.orchestra.run.smithi059.stdout: +++ /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/258.out.bad 2023-10-16 17:16:28.174899910 +0000 2023-10-16T17:16:28.188 INFO:teuthology.orchestra.run.smithi059.stdout: @@ -1,5 +1,6 @@ 2023-10-16T17:16:28.188 INFO:teuthology.orchestra.run.smithi059.stdout: QA output created by 258 2023-10-16T17:16:28.188 INFO:teuthology.orchestra.run.smithi059.stdout: Creating file with timestamp of Jan 1, 1960 2023-10-16T17:16:28.189 INFO:teuthology.orchestra.run.smithi059.stdout: Testing for negative seconds since epoch 2023-10-16T17:16:28.189 INFO:teuthology.orchestra.run.smithi059.stdout: -Remounting to flush cache 2023-10-16T17:16:28.189 INFO:teuthology.orchestra.run.smithi059.stdout: -Testing for negative seconds since epoch 2023-10-16T17:16:28.189 INFO:teuthology.orchestra.run.smithi059.stdout: +Timestamp wrapped: 3979351756 2023-10-16T17:16:28.189 INFO:teuthology.orchestra.run.smithi059.stdout: +Timestamp wrapped 2023-10-16T17:16:28.190 INFO:teuthology.orchestra.run.smithi059.stdout: +(see /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/258.full for details) 2023-10-16T17:16:28.199 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/258 2023-10-16T17:16:28.199 INFO:teuthology.orchestra.run.smithi059.stdout:Failures: generic/258 2023-10-16T17:16:28.199 INFO:teuthology.orchestra.run.smithi059.stdout:Failed 1 of 1 tests 2023-10-16T17:16:28.209 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:28.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T17:16:28.237 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T17:16:28.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T17:16:28.238 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-10-16T17:16:28.859 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:16:28.875 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:16:28.875 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:29.289 INFO:teuthology.orchestra.run.smithi059.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:16:29.303 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/259 2023-10-16T17:16:29.304 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/259 2023-10-16T17:16:29.304 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:16:29.314 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:29.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:16:29.349 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-10-16T17:16:29.941 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:16:29.959 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:16:29.959 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:30.402 INFO:teuthology.orchestra.run.smithi059.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:16:30.414 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/260 2023-10-16T17:16:30.415 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/260 2023-10-16T17:16:30.415 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:16:30.424 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:30.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:16:30.455 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-10-16T17:16:31.031 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:16:31.047 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:16:31.047 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:31.463 INFO:teuthology.orchestra.run.smithi059.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:16:31.473 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/261 2023-10-16T17:16:31.473 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/261 2023-10-16T17:16:31.473 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:16:31.482 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:31.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:16:31.512 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-10-16T17:16:32.152 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:16:32.166 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:16:32.167 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:32.592 INFO:teuthology.orchestra.run.smithi059.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:16:32.607 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/262 2023-10-16T17:16:32.607 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/262 2023-10-16T17:16:32.607 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:16:32.618 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:32.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:16:32.651 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-10-16T17:16:33.317 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:16:33.331 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:16:33.332 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:16:44.874 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:16:44.887 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:17:15.081 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:17:15.094 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:17:45.232 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:17:45.242 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:18:15.710 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:18:15.721 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:18:40.441 INFO:teuthology.orchestra.run.smithi059.stdout:generic/263 127s 2023-10-16T17:18:40.465 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/263 2023-10-16T17:18:40.466 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:18:40.476 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:40.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:18:40.528 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-10-16T17:18:41.289 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:18:41.303 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:18:41.303 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:41.761 INFO:teuthology.orchestra.run.smithi059.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:18:41.774 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/264 2023-10-16T17:18:41.774 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/264 2023-10-16T17:18:41.774 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:18:41.784 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:41.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:18:41.817 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-10-16T17:18:42.440 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:18:42.453 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:18:42.453 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:43.158 INFO:teuthology.orchestra.run.smithi059.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:18:43.173 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/265 2023-10-16T17:18:43.174 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/265 2023-10-16T17:18:43.174 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:18:43.186 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:43.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:18:43.221 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-10-16T17:18:43.812 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:18:43.825 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:18:43.826 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:44.304 INFO:teuthology.orchestra.run.smithi059.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:18:44.317 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/266 2023-10-16T17:18:44.318 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/266 2023-10-16T17:18:44.318 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:18:44.330 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:44.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:18:44.363 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-10-16T17:18:44.969 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:18:44.982 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:18:44.982 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:45.464 INFO:teuthology.orchestra.run.smithi059.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:18:45.479 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/267 2023-10-16T17:18:45.479 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/267 2023-10-16T17:18:45.480 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:18:45.489 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:45.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:18:45.520 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-10-16T17:18:45.847 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:18:45.853 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:18:46.088 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:18:46.102 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:18:46.102 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:46.596 INFO:teuthology.orchestra.run.smithi059.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:18:46.609 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/268 2023-10-16T17:18:46.610 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/268 2023-10-16T17:18:46.610 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:18:46.622 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:46.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:18:46.655 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-10-16T17:18:47.226 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:18:47.239 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:18:47.239 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:47.718 INFO:teuthology.orchestra.run.smithi059.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:18:47.729 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/269 2023-10-16T17:18:47.729 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/269 2023-10-16T17:18:47.729 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:18:47.739 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:47.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:18:47.776 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-10-16T17:18:48.344 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:18:48.357 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:18:48.357 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:48.944 INFO:teuthology.orchestra.run.smithi059.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-16T17:18:48.957 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/270 2023-10-16T17:18:48.958 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/270 2023-10-16T17:18:48.958 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:18:48.969 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:49.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:18:49.001 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-10-16T17:18:49.567 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:18:49.582 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:18:49.583 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:50.068 INFO:teuthology.orchestra.run.smithi059.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:18:50.084 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/271 2023-10-16T17:18:50.085 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/271 2023-10-16T17:18:50.085 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:18:50.096 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:50.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:18:50.136 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-10-16T17:18:50.727 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:18:50.740 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:18:50.740 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:51.244 INFO:teuthology.orchestra.run.smithi059.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:18:51.256 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/272 2023-10-16T17:18:51.256 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/272 2023-10-16T17:18:51.256 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:18:51.266 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:51.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:18:51.298 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-10-16T17:18:51.914 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:18:51.926 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:18:51.927 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:52.353 INFO:teuthology.orchestra.run.smithi059.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:18:52.365 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/273 2023-10-16T17:18:52.365 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/273 2023-10-16T17:18:52.365 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:18:52.374 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:52.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:18:52.405 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-10-16T17:18:52.983 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:18:52.997 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:18:52.997 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:53.443 INFO:teuthology.orchestra.run.smithi059.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:18:53.456 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/274 2023-10-16T17:18:53.457 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/274 2023-10-16T17:18:53.457 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:18:53.466 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:53.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:18:53.498 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-10-16T17:18:54.071 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:18:54.086 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:18:54.086 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:54.524 INFO:teuthology.orchestra.run.smithi059.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:18:54.536 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/275 2023-10-16T17:18:54.536 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/275 2023-10-16T17:18:54.537 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:18:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:54.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:18:54.578 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-10-16T17:18:55.175 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:18:55.189 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:18:55.190 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:55.660 INFO:teuthology.orchestra.run.smithi059.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:18:55.674 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/276 2023-10-16T17:18:55.674 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/276 2023-10-16T17:18:55.675 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:18:55.687 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:55.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:18:55.718 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-10-16T17:18:56.322 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:18:56.336 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:18:56.337 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:56.780 INFO:teuthology.orchestra.run.smithi059.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:18:56.795 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/277 2023-10-16T17:18:56.795 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/277 2023-10-16T17:18:56.796 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:18:56.807 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:56.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:18:56.843 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-10-16T17:18:57.418 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:18:57.433 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:18:57.434 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:57.943 INFO:teuthology.orchestra.run.smithi059.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:18:57.956 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/278 2023-10-16T17:18:57.956 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/278 2023-10-16T17:18:57.956 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:18:57.966 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:57.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:18:57.999 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-10-16T17:18:58.598 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:18:58.611 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:18:58.612 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:59.123 INFO:teuthology.orchestra.run.smithi059.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:18:59.136 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/279 2023-10-16T17:18:59.137 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/279 2023-10-16T17:18:59.137 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:18:59.146 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:18:59.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:18:59.177 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-10-16T17:18:59.786 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:18:59.800 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:18:59.801 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:19:00.292 INFO:teuthology.orchestra.run.smithi059.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:19:00.308 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/280 2023-10-16T17:19:00.308 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/280 2023-10-16T17:19:00.308 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:19:00.321 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:19:00.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:19:00.359 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-10-16T17:19:00.958 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:19:00.972 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:19:00.973 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:19:01.473 INFO:teuthology.orchestra.run.smithi059.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:19:01.487 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/281 2023-10-16T17:19:01.487 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/281 2023-10-16T17:19:01.488 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:19:01.501 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:19:01.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:19:01.536 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-10-16T17:19:02.134 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:19:02.149 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:19:02.149 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:19:02.625 INFO:teuthology.orchestra.run.smithi059.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:19:02.639 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/282 2023-10-16T17:19:02.639 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/282 2023-10-16T17:19:02.640 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:19:02.652 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:19:02.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:19:02.685 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-10-16T17:19:03.269 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:19:03.282 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:19:03.282 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:19:03.781 INFO:teuthology.orchestra.run.smithi059.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:19:03.795 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/283 2023-10-16T17:19:03.795 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/283 2023-10-16T17:19:03.795 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:19:03.806 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:19:03.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:19:03.840 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-10-16T17:19:04.403 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:19:04.417 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:19:04.417 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:19:04.896 INFO:teuthology.orchestra.run.smithi059.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:19:04.908 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/284 2023-10-16T17:19:04.908 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/284 2023-10-16T17:19:04.908 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:19:04.917 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:19:04.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:19:04.949 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-10-16T17:19:05.536 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:19:05.550 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:19:05.551 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:19:11.262 INFO:teuthology.orchestra.run.smithi059.stdout:generic/285 6s 2023-10-16T17:19:11.283 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/285 2023-10-16T17:19:11.284 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:19:11.293 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:19:11.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:19:11.325 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-10-16T17:19:12.132 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:19:12.149 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:19:12.149 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:19:15.989 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:19:16.002 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:19:46.196 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:19:46.205 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:20:16.401 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:20:16.413 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:20:46.598 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:20:46.609 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:21:17.418 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:21:17.429 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:21:47.567 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:21:47.577 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:21:47.698 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-10-16T17:21:47.697+0000 7f91056c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 296894) UID: 0 2023-10-16T17:21:47.698 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-10-16T17:21:47.697+0000 7f33baba1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 296894) UID: 0 2023-10-16T17:21:47.699 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-10-16T17:21:47.697+0000 7f98840e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 296894) UID: 0 2023-10-16T17:21:47.699 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-10-16T17:21:47.697+0000 7f5953fdd640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 296894) UID: 0 2023-10-16T17:22:02.363 INFO:teuthology.orchestra.run.smithi059.stdout:generic/286 170s 2023-10-16T17:22:02.379 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/286 2023-10-16T17:22:02.380 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:02.388 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:02.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:02.415 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-10-16T17:22:03.214 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:03.226 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:03.226 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:03.697 INFO:teuthology.orchestra.run.smithi059.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:22:03.706 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/287 2023-10-16T17:22:03.707 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/287 2023-10-16T17:22:03.707 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:03.714 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:03.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:03.739 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-10-16T17:22:04.256 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:04.271 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:04.271 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:04.672 INFO:teuthology.orchestra.run.smithi059.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:22:04.683 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/288 2023-10-16T17:22:04.684 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/288 2023-10-16T17:22:04.684 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:04.693 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:04.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:04.719 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-10-16T17:22:05.245 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:05.257 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:05.257 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:05.655 INFO:teuthology.orchestra.run.smithi059.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:22:05.666 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/289 2023-10-16T17:22:05.667 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/289 2023-10-16T17:22:05.667 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:05.676 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:05.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:05.706 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-10-16T17:22:06.245 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:06.256 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:06.257 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:06.647 INFO:teuthology.orchestra.run.smithi059.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:22:06.659 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/290 2023-10-16T17:22:06.659 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/290 2023-10-16T17:22:06.659 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:06.667 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:06.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:06.692 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-10-16T17:22:07.195 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:07.206 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:07.207 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:07.590 INFO:teuthology.orchestra.run.smithi059.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:22:07.600 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/291 2023-10-16T17:22:07.601 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/291 2023-10-16T17:22:07.601 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:07.610 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:07.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:07.639 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-10-16T17:22:08.169 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:08.181 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:08.182 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:08.578 INFO:teuthology.orchestra.run.smithi059.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:22:08.589 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/292 2023-10-16T17:22:08.590 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/292 2023-10-16T17:22:08.590 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:08.598 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:08.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:08.625 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-10-16T17:22:09.166 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:09.180 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:09.180 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:09.564 INFO:teuthology.orchestra.run.smithi059.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:22:09.574 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/293 2023-10-16T17:22:09.574 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/293 2023-10-16T17:22:09.575 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:09.583 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:09.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:09.612 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-10-16T17:22:10.133 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:10.147 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:10.147 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:10.556 INFO:teuthology.orchestra.run.smithi059.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:22:10.567 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/294 2023-10-16T17:22:10.567 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/294 2023-10-16T17:22:10.567 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:10.576 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:10.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:10.603 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-10-16T17:22:11.130 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:11.142 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:11.142 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:11.534 INFO:teuthology.orchestra.run.smithi059.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:22:11.543 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/295 2023-10-16T17:22:11.543 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/295 2023-10-16T17:22:11.543 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:11.550 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:11.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:11.573 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-10-16T17:22:12.105 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:12.120 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:12.120 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:12.537 INFO:teuthology.orchestra.run.smithi059.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:22:12.546 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/296 2023-10-16T17:22:12.547 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/296 2023-10-16T17:22:12.547 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:12.554 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:12.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:12.585 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-10-16T17:22:13.110 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:13.123 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:13.123 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:13.569 INFO:teuthology.orchestra.run.smithi059.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:22:13.583 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/297 2023-10-16T17:22:13.584 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/297 2023-10-16T17:22:13.584 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:13.595 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:13.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:13.625 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-10-16T17:22:14.152 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:14.164 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:14.164 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:14.606 INFO:teuthology.orchestra.run.smithi059.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:22:14.617 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/298 2023-10-16T17:22:14.617 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/298 2023-10-16T17:22:14.618 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:14.627 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:14.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:14.659 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-10-16T17:22:15.203 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:15.216 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:15.217 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:15.990 INFO:teuthology.orchestra.run.smithi059.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:22:16.000 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/299 2023-10-16T17:22:16.000 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/299 2023-10-16T17:22:16.000 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:16.009 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:16.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:16.039 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-10-16T17:22:16.617 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:16.630 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:16.630 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:17.044 INFO:teuthology.orchestra.run.smithi059.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:22:17.054 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/300 2023-10-16T17:22:17.054 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/300 2023-10-16T17:22:17.055 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:17.062 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:17.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:17.085 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-10-16T17:22:17.582 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:17.593 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:17.593 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:18.348 INFO:teuthology.orchestra.run.smithi059.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:22:18.358 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/301 2023-10-16T17:22:18.358 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/301 2023-10-16T17:22:18.358 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:18.366 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:18.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:18.396 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-10-16T17:22:18.917 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:18.929 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:18.929 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:19.312 INFO:teuthology.orchestra.run.smithi059.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:22:19.322 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/302 2023-10-16T17:22:19.323 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/302 2023-10-16T17:22:19.323 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:19.331 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:19.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:19.362 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-10-16T17:22:19.902 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:19.915 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:19.915 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:20.443 INFO:teuthology.orchestra.run.smithi059.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:22:20.454 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/303 2023-10-16T17:22:20.455 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/303 2023-10-16T17:22:20.455 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:20.464 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:20.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:20.508 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-10-16T17:22:21.258 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:21.271 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:21.271 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:21.799 INFO:teuthology.orchestra.run.smithi059.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-16T17:22:21.810 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/304 2023-10-16T17:22:21.810 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/304 2023-10-16T17:22:21.810 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:21.819 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:21.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:21.847 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-10-16T17:22:22.587 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:22.600 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:22.600 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:22.973 INFO:teuthology.orchestra.run.smithi059.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:22:22.988 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/305 2023-10-16T17:22:22.988 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/305 2023-10-16T17:22:22.988 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:23.000 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:23.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:23.031 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-10-16T17:22:23.557 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:23.569 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:23.570 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:23.975 INFO:teuthology.orchestra.run.smithi059.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:22:23.988 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/306 2023-10-16T17:22:23.988 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/306 2023-10-16T17:22:23.988 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:23.997 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:24.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:24.026 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-10-16T17:22:24.549 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:24.562 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:24.562 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:24.961 INFO:teuthology.orchestra.run.smithi059.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:22:24.971 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/307 2023-10-16T17:22:24.971 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/307 2023-10-16T17:22:24.972 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:24.980 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:25.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:25.003 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-10-16T17:22:25.488 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:25.500 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:25.500 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:26.039 INFO:teuthology.orchestra.run.smithi059.stdout:generic/308 1s 2023-10-16T17:22:26.053 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/308 2023-10-16T17:22:26.054 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:26.060 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:26.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:26.082 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-10-16T17:22:26.548 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:26.560 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:26.560 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:28.094 INFO:teuthology.orchestra.run.smithi059.stdout:generic/309 2s 2023-10-16T17:22:28.108 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/309 2023-10-16T17:22:28.108 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:22:28.115 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:22:28.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:22:28.142 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-10-16T17:22:28.913 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:22:28.924 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:22:28.924 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:12.605 INFO:teuthology.orchestra.run.smithi059.stdout:generic/310 104s 2023-10-16T17:24:12.623 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/310 2023-10-16T17:24:12.623 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:24:12.632 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:12.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:24:12.689 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-10-16T17:24:13.679 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:24:13.690 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:24:13.691 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:14.405 INFO:teuthology.orchestra.run.smithi059.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:24:14.420 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/311 2023-10-16T17:24:14.420 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/311 2023-10-16T17:24:14.420 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:24:14.433 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:14.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:24:14.466 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-10-16T17:24:14.966 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:24:14.976 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:24:14.977 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:15.399 INFO:teuthology.orchestra.run.smithi059.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:24:15.410 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/312 2023-10-16T17:24:15.410 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/312 2023-10-16T17:24:15.410 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:24:15.418 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:15.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:24:15.449 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-10-16T17:24:15.992 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:24:16.004 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:24:16.004 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:21.256 INFO:teuthology.orchestra.run.smithi059.stdout:generic/313 5s 2023-10-16T17:24:21.279 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/313 2023-10-16T17:24:21.279 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:24:21.289 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:21.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:24:21.322 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-10-16T17:24:21.869 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:24:21.881 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:24:21.881 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:24.037 INFO:teuthology.orchestra.run.smithi059.stdout:generic/314 3s 2023-10-16T17:24:24.054 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/314 2023-10-16T17:24:24.055 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:24:24.063 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:24.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:24:24.095 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-10-16T17:24:24.628 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:24:24.639 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:24:24.639 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:25.555 INFO:teuthology.orchestra.run.smithi059.stdout:generic/315 1s 2023-10-16T17:24:25.573 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/315 2023-10-16T17:24:25.573 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:24:25.582 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:25.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:24:25.624 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-10-16T17:24:26.359 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:24:26.369 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:24:26.370 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:29.998 INFO:teuthology.orchestra.run.smithi059.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T17:24:30.009 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/316 2023-10-16T17:24:30.009 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/316 2023-10-16T17:24:30.010 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:24:30.018 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:30.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:24:30.049 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-10-16T17:24:30.831 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:24:30.843 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:24:30.843 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:31.553 INFO:teuthology.orchestra.run.smithi059.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:24:31.568 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/317 2023-10-16T17:24:31.568 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/317 2023-10-16T17:24:31.568 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:24:31.581 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:31.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:24:31.613 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-10-16T17:24:32.162 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:24:32.173 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:24:32.173 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:32.576 INFO:teuthology.orchestra.run.smithi059.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:24:32.587 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/318 2023-10-16T17:24:32.588 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/318 2023-10-16T17:24:32.588 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:24:32.596 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:32.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:24:32.623 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-10-16T17:24:33.148 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:24:33.161 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:24:33.162 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:33.627 INFO:teuthology.orchestra.run.smithi059.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-16T17:24:33.638 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/319 2023-10-16T17:24:33.638 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/319 2023-10-16T17:24:33.638 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:24:33.647 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:33.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:24:33.674 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-10-16T17:24:34.200 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:24:34.211 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:24:34.211 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:34.610 INFO:teuthology.orchestra.run.smithi059.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:24:34.622 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/320 2023-10-16T17:24:34.622 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/320 2023-10-16T17:24:34.622 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:24:34.632 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:34.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:24:34.663 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-10-16T17:24:35.184 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:24:35.195 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:24:35.195 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:35.667 INFO:teuthology.orchestra.run.smithi059.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:24:35.679 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/321 2023-10-16T17:24:35.680 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/321 2023-10-16T17:24:35.680 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:24:35.689 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:35.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:24:35.718 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-10-16T17:24:36.245 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:24:36.257 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:24:36.257 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:36.664 INFO:teuthology.orchestra.run.smithi059.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:24:36.675 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/322 2023-10-16T17:24:36.676 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/322 2023-10-16T17:24:36.676 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:24:36.687 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:24:36.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:24:36.721 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-10-16T17:24:37.237 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:24:37.250 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:24:37.250 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:25:34.761 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:25:34.767 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:26:05.068 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:26:05.074 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:26:35.199 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:26:35.205 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:26:39.547 INFO:teuthology.orchestra.run.smithi059.stdout:generic/323 122s 2023-10-16T17:26:39.569 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/323 2023-10-16T17:26:39.570 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:26:39.582 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:39.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:26:39.630 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-10-16T17:26:40.346 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:26:40.359 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:26:40.359 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:40.820 INFO:teuthology.orchestra.run.smithi059.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:26:40.835 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/324 2023-10-16T17:26:40.836 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/324 2023-10-16T17:26:40.836 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:26:40.848 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:40.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:26:40.883 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-10-16T17:26:41.488 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:26:41.503 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:26:41.503 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:42.040 INFO:teuthology.orchestra.run.smithi059.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:26:42.056 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/325 2023-10-16T17:26:42.056 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/325 2023-10-16T17:26:42.057 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:26:42.069 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:42.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:26:42.103 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-10-16T17:26:42.708 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:26:42.725 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:26:42.725 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:43.168 INFO:teuthology.orchestra.run.smithi059.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:26:43.179 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/326 2023-10-16T17:26:43.179 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/326 2023-10-16T17:26:43.179 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:26:43.187 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:43.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:26:43.216 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-10-16T17:26:43.828 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:26:43.841 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:26:43.841 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:44.283 INFO:teuthology.orchestra.run.smithi059.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:26:44.296 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/327 2023-10-16T17:26:44.296 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/327 2023-10-16T17:26:44.296 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:26:44.307 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:44.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:26:44.338 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-10-16T17:26:44.921 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:26:44.935 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:26:44.935 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:45.363 INFO:teuthology.orchestra.run.smithi059.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:26:45.376 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/328 2023-10-16T17:26:45.376 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/328 2023-10-16T17:26:45.376 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:26:45.385 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:45.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:26:45.417 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-10-16T17:26:46.035 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:26:46.049 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:26:46.050 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:46.533 INFO:teuthology.orchestra.run.smithi059.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:26:46.548 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/329 2023-10-16T17:26:46.548 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/329 2023-10-16T17:26:46.549 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:26:46.560 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:46.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:26:46.597 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-10-16T17:26:47.174 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:26:47.190 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:26:47.190 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:47.623 INFO:teuthology.orchestra.run.smithi059.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:26:47.634 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/330 2023-10-16T17:26:47.634 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/330 2023-10-16T17:26:47.634 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:26:47.643 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:47.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:26:47.673 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-10-16T17:26:48.266 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:26:48.279 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:26:48.280 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:48.765 INFO:teuthology.orchestra.run.smithi059.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:26:48.780 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/331 2023-10-16T17:26:48.781 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/331 2023-10-16T17:26:48.781 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:26:48.793 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:48.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:26:48.827 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-10-16T17:26:49.418 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:26:49.433 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:26:49.434 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:49.903 INFO:teuthology.orchestra.run.smithi059.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:26:49.917 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/332 2023-10-16T17:26:49.918 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/332 2023-10-16T17:26:49.918 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:26:49.929 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:49.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:26:49.966 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-10-16T17:26:50.601 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:26:50.613 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:26:50.613 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:51.019 INFO:teuthology.orchestra.run.smithi059.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:26:51.032 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/333 2023-10-16T17:26:51.032 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/333 2023-10-16T17:26:51.032 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:26:51.044 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:51.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:26:51.077 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-10-16T17:26:51.673 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:26:51.688 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:26:51.689 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:52.134 INFO:teuthology.orchestra.run.smithi059.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:26:52.145 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/334 2023-10-16T17:26:52.145 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/334 2023-10-16T17:26:52.146 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:26:52.153 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:52.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:26:52.181 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-10-16T17:26:52.722 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:26:52.734 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:26:52.734 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:53.283 INFO:teuthology.orchestra.run.smithi059.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:26:53.298 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/335 2023-10-16T17:26:53.299 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/335 2023-10-16T17:26:53.299 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:26:53.312 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:53.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:26:53.347 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-10-16T17:26:53.945 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:26:53.960 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:26:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:54.445 INFO:teuthology.orchestra.run.smithi059.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:26:54.456 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/336 2023-10-16T17:26:54.456 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/336 2023-10-16T17:26:54.457 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:26:54.466 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:54.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:26:54.499 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-10-16T17:26:55.083 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:26:55.096 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:26:55.096 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:55.555 INFO:teuthology.orchestra.run.smithi059.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:26:55.570 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/337 2023-10-16T17:26:55.570 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/337 2023-10-16T17:26:55.570 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:26:55.582 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:55.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:26:55.616 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-10-16T17:26:56.160 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:26:56.172 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:26:56.172 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:56.641 INFO:teuthology.orchestra.run.smithi059.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:26:56.653 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/338 2023-10-16T17:26:56.653 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/338 2023-10-16T17:26:56.654 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:26:56.662 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:56.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:26:56.694 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-10-16T17:26:57.268 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:26:57.282 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:26:57.283 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:57.709 INFO:teuthology.orchestra.run.smithi059.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:26:57.722 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/339 2023-10-16T17:26:57.722 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/339 2023-10-16T17:26:57.722 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:26:57.731 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:57.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:26:57.759 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-10-16T17:26:58.375 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:26:58.390 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:26:58.390 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:58.858 INFO:teuthology.orchestra.run.smithi059.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:26:58.870 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/340 2023-10-16T17:26:58.871 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/340 2023-10-16T17:26:58.871 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:26:58.880 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:26:58.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:26:58.913 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-10-16T17:26:59.517 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:26:59.531 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:26:59.531 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:00.022 INFO:teuthology.orchestra.run.smithi059.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:00.038 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/341 2023-10-16T17:27:00.038 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/341 2023-10-16T17:27:00.038 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:00.049 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:00.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:00.083 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-10-16T17:27:00.680 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:00.694 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:00.694 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:01.175 INFO:teuthology.orchestra.run.smithi059.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:01.190 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/342 2023-10-16T17:27:01.191 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/342 2023-10-16T17:27:01.191 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:01.203 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:01.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:01.237 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-10-16T17:27:01.830 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:01.844 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:01.845 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:02.320 INFO:teuthology.orchestra.run.smithi059.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:02.333 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/343 2023-10-16T17:27:02.334 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/343 2023-10-16T17:27:02.334 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:02.347 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:02.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:02.383 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-10-16T17:27:02.998 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:03.011 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:03.012 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:03.445 INFO:teuthology.orchestra.run.smithi059.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:03.457 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/344 2023-10-16T17:27:03.457 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/344 2023-10-16T17:27:03.457 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:03.466 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:03.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:03.497 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-10-16T17:27:04.126 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:04.142 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:04.142 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:04.596 INFO:teuthology.orchestra.run.smithi059.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:04.607 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/345 2023-10-16T17:27:04.608 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/345 2023-10-16T17:27:04.608 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:04.617 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:04.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:04.650 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-10-16T17:27:05.216 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:05.230 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:05.230 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:05.357 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:27:05.363 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:27:05.593 INFO:teuthology.orchestra.run.smithi059.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:05.606 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/346 2023-10-16T17:27:05.607 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/346 2023-10-16T17:27:05.607 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:05.617 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:05.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:05.648 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-10-16T17:27:06.230 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:06.242 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:06.243 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:06.820 INFO:teuthology.orchestra.run.smithi059.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:06.834 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/347 2023-10-16T17:27:06.834 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/347 2023-10-16T17:27:06.834 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:06.844 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:06.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:06.878 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-10-16T17:27:07.465 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:07.479 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:07.479 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:07.961 INFO:teuthology.orchestra.run.smithi059.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:07.973 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/348 2023-10-16T17:27:07.973 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/348 2023-10-16T17:27:07.973 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:07.982 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:08.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:08.015 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-10-16T17:27:08.602 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:08.615 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:08.616 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:12.901 INFO:teuthology.orchestra.run.smithi059.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-16T17:27:12.914 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/349 2023-10-16T17:27:12.914 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/349 2023-10-16T17:27:12.914 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:12.924 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:12.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:12.956 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-10-16T17:27:13.503 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:13.516 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:13.516 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:18.565 INFO:teuthology.orchestra.run.smithi059.stdout:generic/350 5s 2023-10-16T17:27:18.584 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/350 2023-10-16T17:27:18.584 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:18.592 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:18.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:18.618 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-10-16T17:27:19.162 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:19.175 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:19.175 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:23.473 INFO:teuthology.orchestra.run.smithi059.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-10-16T17:27:23.487 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/351 2023-10-16T17:27:23.488 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/351 2023-10-16T17:27:23.488 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:23.500 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:23.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:23.536 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-10-16T17:27:24.285 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:24.296 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:24.296 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:24.750 INFO:teuthology.orchestra.run.smithi059.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:24.761 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/352 2023-10-16T17:27:24.761 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/352 2023-10-16T17:27:24.761 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:24.770 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:24.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:24.806 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-10-16T17:27:25.452 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:25.466 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:25.467 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:25.928 INFO:teuthology.orchestra.run.smithi059.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:25.940 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/353 2023-10-16T17:27:25.940 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/353 2023-10-16T17:27:25.940 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:25.951 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:25.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:25.986 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-10-16T17:27:26.578 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:26.593 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:26.593 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:27.027 INFO:teuthology.orchestra.run.smithi059.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:27.041 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/354 2023-10-16T17:27:27.041 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/354 2023-10-16T17:27:27.041 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:27.052 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:27.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:27.087 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-10-16T17:27:27.700 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:27.713 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:27.713 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:29.390 INFO:teuthology.orchestra.run.smithi059.stdout:generic/355 2s 2023-10-16T17:27:29.407 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/355 2023-10-16T17:27:29.407 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:29.415 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:29.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:29.444 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-10-16T17:27:30.236 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:30.249 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:30.249 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:30.636 INFO:teuthology.orchestra.run.smithi059.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:30.647 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/356 2023-10-16T17:27:30.647 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/356 2023-10-16T17:27:30.647 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:30.656 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:30.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:30.686 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-10-16T17:27:31.261 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:31.274 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:31.275 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:31.731 INFO:teuthology.orchestra.run.smithi059.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:31.743 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/357 2023-10-16T17:27:31.743 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/357 2023-10-16T17:27:31.744 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:31.753 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:31.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:31.786 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-10-16T17:27:32.372 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:32.385 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:32.385 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:32.801 INFO:teuthology.orchestra.run.smithi059.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:32.814 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/358 2023-10-16T17:27:32.814 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/358 2023-10-16T17:27:32.814 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:32.824 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:32.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:32.858 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-10-16T17:27:33.458 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:33.470 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:33.471 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:33.913 INFO:teuthology.orchestra.run.smithi059.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:33.924 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/359 2023-10-16T17:27:33.924 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/359 2023-10-16T17:27:33.924 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:33.933 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:33.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:33.962 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-10-16T17:27:34.545 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:34.559 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:34.559 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:35.256 INFO:teuthology.orchestra.run.smithi059.stdout:generic/360 1s 2023-10-16T17:27:35.276 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/360 2023-10-16T17:27:35.277 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:35.286 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:35.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:35.321 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-10-16T17:27:35.521 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:27:35.529 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:27:35.893 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:35.909 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:35.909 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:36.372 INFO:teuthology.orchestra.run.smithi059.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:36.384 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/361 2023-10-16T17:27:36.384 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/361 2023-10-16T17:27:36.385 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:36.394 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:36.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:36.426 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-10-16T17:27:36.944 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:36.956 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:36.956 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:37.318 INFO:teuthology.orchestra.run.smithi059.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:37.327 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/362 2023-10-16T17:27:37.328 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/362 2023-10-16T17:27:37.328 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:37.334 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:37.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:37.360 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-10-16T17:27:37.938 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:37.951 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:37.951 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:38.403 INFO:teuthology.orchestra.run.smithi059.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:38.415 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/363 2023-10-16T17:27:38.415 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/363 2023-10-16T17:27:38.415 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:38.424 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:38.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:38.456 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-10-16T17:27:39.013 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:39.027 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:39.028 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:39.460 INFO:teuthology.orchestra.run.smithi059.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:39.474 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/364 2023-10-16T17:27:39.475 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/364 2023-10-16T17:27:39.475 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:39.486 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:39.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:39.517 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-10-16T17:27:40.118 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:40.132 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:40.132 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:40.587 INFO:teuthology.orchestra.run.smithi059.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:40.602 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/365 2023-10-16T17:27:40.602 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/365 2023-10-16T17:27:40.602 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:40.610 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:40.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:40.641 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-10-16T17:27:41.248 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:41.261 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:41.261 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:41.738 INFO:teuthology.orchestra.run.smithi059.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:41.753 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/366 2023-10-16T17:27:41.754 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/366 2023-10-16T17:27:41.754 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:41.766 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:41.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:41.805 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-10-16T17:27:42.428 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:42.441 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:42.441 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:42.938 INFO:teuthology.orchestra.run.smithi059.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:42.950 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/367 2023-10-16T17:27:42.950 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/367 2023-10-16T17:27:42.951 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:42.962 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:42.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:42.995 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-10-16T17:27:43.605 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:43.618 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:43.618 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:44.063 INFO:teuthology.orchestra.run.smithi059.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:44.073 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/368 2023-10-16T17:27:44.074 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/368 2023-10-16T17:27:44.074 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:44.082 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:44.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:44.111 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-10-16T17:27:44.695 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:44.709 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:44.709 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:45.130 INFO:teuthology.orchestra.run.smithi059.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:45.144 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/369 2023-10-16T17:27:45.144 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/369 2023-10-16T17:27:45.144 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:45.156 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:45.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:45.187 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-10-16T17:27:45.784 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:45.799 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:45.799 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:46.254 INFO:teuthology.orchestra.run.smithi059.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:46.264 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/370 2023-10-16T17:27:46.265 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/370 2023-10-16T17:27:46.265 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:46.273 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:46.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:46.303 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-10-16T17:27:46.897 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:46.909 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:46.909 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:47.336 INFO:teuthology.orchestra.run.smithi059.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:47.348 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/371 2023-10-16T17:27:47.348 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/371 2023-10-16T17:27:47.348 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:47.357 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:47.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:47.388 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-10-16T17:27:47.993 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:48.005 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:48.005 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:48.460 INFO:teuthology.orchestra.run.smithi059.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:48.475 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/372 2023-10-16T17:27:48.475 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/372 2023-10-16T17:27:48.476 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:48.487 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:48.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:48.525 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-10-16T17:27:49.120 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:49.134 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:49.134 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:49.580 INFO:teuthology.orchestra.run.smithi059.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:49.593 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/373 2023-10-16T17:27:49.593 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/373 2023-10-16T17:27:49.593 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:49.605 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:49.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:49.638 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-10-16T17:27:50.246 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:50.259 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:50.259 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:50.696 INFO:teuthology.orchestra.run.smithi059.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:50.710 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/374 2023-10-16T17:27:50.711 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/374 2023-10-16T17:27:50.711 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:50.723 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:50.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:50.759 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-10-16T17:27:51.341 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:51.354 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:51.354 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:51.894 INFO:teuthology.orchestra.run.smithi059.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-16T17:27:51.909 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/375 2023-10-16T17:27:51.909 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/375 2023-10-16T17:27:51.909 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:51.921 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:51.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:51.958 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-10-16T17:27:52.559 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:52.573 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:52.573 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:53.039 INFO:teuthology.orchestra.run.smithi059.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:53.052 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/376 2023-10-16T17:27:53.052 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/376 2023-10-16T17:27:53.052 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:53.062 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:53.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:53.093 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-10-16T17:27:53.673 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:53.687 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:53.688 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:54.134 INFO:teuthology.orchestra.run.smithi059.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:54.149 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/377 2023-10-16T17:27:54.150 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/377 2023-10-16T17:27:54.150 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:54.162 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:54.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:54.195 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-10-16T17:27:54.788 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:54.802 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:54.802 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:55.894 INFO:teuthology.orchestra.run.smithi059.stdout:generic/378 1s 2023-10-16T17:27:55.910 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/378 2023-10-16T17:27:55.911 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:55.920 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:55.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:55.952 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-10-16T17:27:56.711 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:56.725 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:56.725 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:57.213 INFO:teuthology.orchestra.run.smithi059.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:57.226 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/379 2023-10-16T17:27:57.226 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/379 2023-10-16T17:27:57.227 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:57.237 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:57.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:57.271 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-10-16T17:27:57.868 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:57.881 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:57.882 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:58.387 INFO:teuthology.orchestra.run.smithi059.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:58.402 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/380 2023-10-16T17:27:58.403 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/380 2023-10-16T17:27:58.403 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:58.416 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:58.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:58.449 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-10-16T17:27:59.045 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:27:59.057 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:27:59.057 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:59.535 INFO:teuthology.orchestra.run.smithi059.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:27:59.549 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/381 2023-10-16T17:27:59.550 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/381 2023-10-16T17:27:59.550 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:27:59.564 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:27:59.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:27:59.600 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-10-16T17:28:00.205 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:28:00.219 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:28:00.219 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:28:00.632 INFO:teuthology.orchestra.run.smithi059.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:28:00.643 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/382 2023-10-16T17:28:00.643 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/382 2023-10-16T17:28:00.644 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:28:00.652 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:28:00.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:28:00.683 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-10-16T17:28:01.298 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:28:01.311 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:28:01.312 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:28:01.759 INFO:teuthology.orchestra.run.smithi059.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:28:01.771 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/383 2023-10-16T17:28:01.771 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/383 2023-10-16T17:28:01.771 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:28:01.780 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:28:01.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:28:01.815 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-10-16T17:28:02.419 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:28:02.433 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:28:02.433 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:28:02.904 INFO:teuthology.orchestra.run.smithi059.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-16T17:28:02.917 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/384 2023-10-16T17:28:02.917 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/384 2023-10-16T17:28:02.918 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:28:02.927 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:28:02.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:28:02.961 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-10-16T17:28:03.550 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:28:03.563 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:28:03.564 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:28:04.009 INFO:teuthology.orchestra.run.smithi059.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:28:04.022 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/385 2023-10-16T17:28:04.022 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/385 2023-10-16T17:28:04.023 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:28:04.032 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:28:04.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:28:04.064 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-10-16T17:28:04.683 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:28:04.698 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:28:04.698 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:28:05.174 INFO:teuthology.orchestra.run.smithi059.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-16T17:28:05.185 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/386 2023-10-16T17:28:05.186 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/386 2023-10-16T17:28:05.186 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:28:05.194 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:28:05.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:28:05.221 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-10-16T17:28:05.785 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:28:05.786 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:28:05.790 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:28:05.801 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:28:05.801 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:28:06.172 INFO:teuthology.orchestra.run.smithi059.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:28:06.183 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/387 2023-10-16T17:28:06.183 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/387 2023-10-16T17:28:06.183 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:28:06.192 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:28:06.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:28:06.223 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-10-16T17:28:06.809 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:28:06.825 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:28:06.826 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:28:07.267 INFO:teuthology.orchestra.run.smithi059.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:28:07.283 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/388 2023-10-16T17:28:07.283 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/388 2023-10-16T17:28:07.283 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:28:07.295 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:28:07.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:28:07.329 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-10-16T17:28:07.917 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:28:07.931 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:28:07.932 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:28:08.414 INFO:teuthology.orchestra.run.smithi059.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-10-16T17:28:08.425 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/389 2023-10-16T17:28:08.425 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/389 2023-10-16T17:28:08.425 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:28:08.433 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:28:08.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:28:08.463 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-10-16T17:28:09.060 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:28:09.075 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:28:09.075 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:28:09.564 INFO:teuthology.orchestra.run.smithi059.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:28:09.577 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/390 2023-10-16T17:28:09.577 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/390 2023-10-16T17:28:09.577 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:28:09.589 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:28:09.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:28:09.625 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-10-16T17:28:10.203 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:28:10.217 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:28:10.217 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:28:35.950 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:28:35.960 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:29:06.793 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:29:06.804 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:29:20.166 INFO:teuthology.orchestra.run.smithi059.stdout:generic/391 70s 2023-10-16T17:29:20.254 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/391 2023-10-16T17:29:20.255 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:20.267 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:20.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:20.324 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-10-16T17:29:21.490 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:21.505 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:21.505 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:22.183 INFO:teuthology.orchestra.run.smithi059.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:22.194 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/392 2023-10-16T17:29:22.194 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/392 2023-10-16T17:29:22.195 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:22.204 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:22.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:22.241 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-10-16T17:29:22.912 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:22.927 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:22.928 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:23.442 INFO:teuthology.orchestra.run.smithi059.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:23.455 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/393 2023-10-16T17:29:23.455 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/393 2023-10-16T17:29:23.455 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:23.465 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:23.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:23.497 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-10-16T17:29:24.143 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:24.162 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:24.162 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:24.594 INFO:teuthology.orchestra.run.smithi059.stdout:generic/394 0s 2023-10-16T17:29:24.610 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/394 2023-10-16T17:29:24.611 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:24.621 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:24.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:24.650 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-10-16T17:29:25.540 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:25.554 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:25.554 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:26.028 INFO:teuthology.orchestra.run.smithi059.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:26.041 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/395 2023-10-16T17:29:26.041 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/395 2023-10-16T17:29:26.042 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:26.053 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:26.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:26.083 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-10-16T17:29:26.645 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:26.659 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:26.659 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:27.244 INFO:teuthology.orchestra.run.smithi059.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:27.261 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/396 2023-10-16T17:29:27.261 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/396 2023-10-16T17:29:27.261 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:27.274 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:27.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:27.307 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-10-16T17:29:27.881 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:27.894 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:27.894 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:28.508 INFO:teuthology.orchestra.run.smithi059.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:28.521 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/397 2023-10-16T17:29:28.521 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/397 2023-10-16T17:29:28.522 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:28.534 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:28.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:28.568 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-10-16T17:29:29.144 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:29.157 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:29.158 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:29.741 INFO:teuthology.orchestra.run.smithi059.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:29.755 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/398 2023-10-16T17:29:29.755 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/398 2023-10-16T17:29:29.755 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:29.765 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:29.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:29.798 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-10-16T17:29:30.420 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:30.433 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:30.433 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:30.988 INFO:teuthology.orchestra.run.smithi059.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:31.003 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/399 2023-10-16T17:29:31.004 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/399 2023-10-16T17:29:31.004 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:31.016 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:31.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:31.051 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-10-16T17:29:31.681 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:31.695 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:31.696 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:32.154 INFO:teuthology.orchestra.run.smithi059.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-16T17:29:32.167 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/400 2023-10-16T17:29:32.167 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/400 2023-10-16T17:29:32.167 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:32.177 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:32.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:32.210 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-10-16T17:29:32.801 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:32.815 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:32.815 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:33.256 INFO:teuthology.orchestra.run.smithi059.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:33.267 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/401 2023-10-16T17:29:33.268 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/401 2023-10-16T17:29:33.268 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:33.278 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:33.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:33.308 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-10-16T17:29:33.904 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:33.921 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:33.921 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:34.383 INFO:teuthology.orchestra.run.smithi059.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:34.395 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/402 2023-10-16T17:29:34.396 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/402 2023-10-16T17:29:34.396 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:34.405 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:34.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:34.438 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-10-16T17:29:35.060 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:35.074 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:35.074 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:35.561 INFO:teuthology.orchestra.run.smithi059.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:35.574 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/403 2023-10-16T17:29:35.574 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/403 2023-10-16T17:29:35.574 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:35.584 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:35.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:35.618 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-10-16T17:29:36.231 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:36.245 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:36.245 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:36.928 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:29:36.938 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:29:40.834 INFO:teuthology.orchestra.run.smithi059.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-10-16T17:29:40.849 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/404 2023-10-16T17:29:40.849 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/404 2023-10-16T17:29:40.849 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:40.861 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:40.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:40.910 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-10-16T17:29:41.669 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:41.681 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:41.682 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:42.287 INFO:teuthology.orchestra.run.smithi059.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:42.300 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/405 2023-10-16T17:29:42.300 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/405 2023-10-16T17:29:42.300 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:42.311 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:42.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:42.345 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-10-16T17:29:42.928 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:42.942 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:42.943 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:43.375 INFO:teuthology.orchestra.run.smithi059.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:43.387 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/406 2023-10-16T17:29:43.387 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/406 2023-10-16T17:29:43.388 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:43.398 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:43.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:43.433 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-10-16T17:29:44.035 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:44.051 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:44.051 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:44.689 INFO:teuthology.orchestra.run.smithi059.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:29:44.704 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/407 2023-10-16T17:29:44.704 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/407 2023-10-16T17:29:44.704 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:44.716 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:44.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:44.765 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-10-16T17:29:45.493 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:45.505 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:45.506 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:46.064 INFO:teuthology.orchestra.run.smithi059.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-16T17:29:46.077 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/408 2023-10-16T17:29:46.077 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/408 2023-10-16T17:29:46.078 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:46.087 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:46.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:46.133 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-10-16T17:29:46.851 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:46.864 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:46.865 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:47.331 INFO:teuthology.orchestra.run.smithi059.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:47.342 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/409 2023-10-16T17:29:47.343 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/409 2023-10-16T17:29:47.343 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:47.351 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:47.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:47.381 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-10-16T17:29:47.985 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:48.000 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:48.001 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:48.472 INFO:teuthology.orchestra.run.smithi059.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:48.483 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/410 2023-10-16T17:29:48.484 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/410 2023-10-16T17:29:48.484 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:48.493 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:48.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:48.522 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-10-16T17:29:49.102 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:49.115 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:49.115 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:49.584 INFO:teuthology.orchestra.run.smithi059.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:49.601 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/411 2023-10-16T17:29:49.601 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/411 2023-10-16T17:29:49.601 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:49.614 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:49.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:49.653 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-10-16T17:29:50.250 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:50.263 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:50.264 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:50.748 INFO:teuthology.orchestra.run.smithi059.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:50.760 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/412 2023-10-16T17:29:50.760 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/412 2023-10-16T17:29:50.760 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:50.769 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:50.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:50.801 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-10-16T17:29:51.377 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:51.391 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:51.391 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:51.858 INFO:teuthology.orchestra.run.smithi059.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:51.868 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/413 2023-10-16T17:29:51.868 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/413 2023-10-16T17:29:51.869 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:51.877 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:51.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:51.907 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-10-16T17:29:52.522 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:52.537 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:52.538 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:53.020 INFO:teuthology.orchestra.run.smithi059.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:53.035 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/414 2023-10-16T17:29:53.035 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/414 2023-10-16T17:29:53.035 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:53.047 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:53.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:53.081 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-10-16T17:29:53.663 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:53.677 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:53.677 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:54.148 INFO:teuthology.orchestra.run.smithi059.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:54.163 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/415 2023-10-16T17:29:54.163 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/415 2023-10-16T17:29:54.163 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:54.176 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:54.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:54.213 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-10-16T17:29:54.750 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:54.762 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:54.763 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:55.237 INFO:teuthology.orchestra.run.smithi059.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:55.252 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/416 2023-10-16T17:29:55.252 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/416 2023-10-16T17:29:55.253 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:55.264 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:55.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:55.301 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-10-16T17:29:55.892 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:55.905 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:55.905 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:56.353 INFO:teuthology.orchestra.run.smithi059.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:56.364 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/417 2023-10-16T17:29:56.364 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/417 2023-10-16T17:29:56.364 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:56.373 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:56.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:56.403 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-10-16T17:29:57.033 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:57.048 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:57.048 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:57.619 INFO:teuthology.orchestra.run.smithi059.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2023-10-16T17:29:57.632 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/418 2023-10-16T17:29:57.632 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/418 2023-10-16T17:29:57.632 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:57.643 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:57.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:57.680 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-10-16T17:29:58.263 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:58.277 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:58.278 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:58.844 INFO:teuthology.orchestra.run.smithi059.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:29:58.856 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/419 2023-10-16T17:29:58.856 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/419 2023-10-16T17:29:58.857 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:29:58.867 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:29:58.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:29:58.898 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-10-16T17:29:59.540 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:29:59.555 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:29:59.555 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:30:03.783 INFO:teuthology.orchestra.run.smithi059.stdout:generic/420 4s 2023-10-16T17:30:03.800 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/420 2023-10-16T17:30:03.800 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:30:03.808 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:30:03.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:30:03.841 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-10-16T17:30:04.599 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:30:04.611 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:30:04.612 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:30:05.220 INFO:teuthology.orchestra.run.smithi059.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:30:05.235 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/421 2023-10-16T17:30:05.235 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/421 2023-10-16T17:30:05.235 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:30:05.246 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:30:05.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:30:05.284 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-10-16T17:30:05.886 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:30:05.902 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:30:05.902 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:30:06.383 INFO:teuthology.orchestra.run.smithi059.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:30:06.395 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/422 2023-10-16T17:30:06.395 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/422 2023-10-16T17:30:06.396 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:30:06.404 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:30:06.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:30:06.434 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-10-16T17:30:06.992 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:30:07.006 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:30:07.006 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:30:07.074 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:30:07.081 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:30:07.740 INFO:teuthology.orchestra.run.smithi059.stdout:generic/423 0s 2023-10-16T17:30:07.758 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/423 2023-10-16T17:30:07.758 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:30:07.767 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:30:07.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:30:07.800 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-10-16T17:30:08.594 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:30:08.608 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:30:08.609 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:30:09.140 INFO:teuthology.orchestra.run.smithi059.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-10-16T17:30:09.152 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/424 2023-10-16T17:30:09.153 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/424 2023-10-16T17:30:09.153 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:30:09.163 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:30:09.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:30:09.196 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-10-16T17:30:09.830 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:30:09.844 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:30:09.845 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:30:10.272 INFO:teuthology.orchestra.run.smithi059.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:30:10.283 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/425 2023-10-16T17:30:10.283 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/425 2023-10-16T17:30:10.283 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:30:10.293 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:30:10.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:30:10.323 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-10-16T17:30:10.927 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:30:10.942 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:30:10.942 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:30:37.203 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:30:37.217 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:31:08.453 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:31:08.465 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:31:39.381 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:31:39.392 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:31:45.722 INFO:teuthology.orchestra.run.smithi059.stdout:generic/426 95s 2023-10-16T17:31:45.813 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/426 2023-10-16T17:31:45.814 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:31:45.827 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:31:45.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:31:45.967 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-10-16T17:31:47.655 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:31:47.668 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:31:47.668 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:31:48.168 INFO:teuthology.orchestra.run.smithi059.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:31:48.179 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/427 2023-10-16T17:31:48.179 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/427 2023-10-16T17:31:48.180 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:31:48.190 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:31:48.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:31:48.223 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-10-16T17:31:48.790 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:31:48.804 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:31:48.804 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:31:49.389 INFO:teuthology.orchestra.run.smithi059.stdout:generic/428 1s 2023-10-16T17:31:49.409 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/428 2023-10-16T17:31:49.410 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:31:49.419 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:31:49.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:31:49.453 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-10-16T17:31:50.062 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:31:50.077 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:31:50.077 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:31:50.704 INFO:teuthology.orchestra.run.smithi059.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:31:50.718 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/429 2023-10-16T17:31:50.718 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/429 2023-10-16T17:31:50.718 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:31:50.728 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:31:50.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:31:50.760 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-10-16T17:31:51.356 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:31:51.372 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:31:51.372 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:31:52.221 INFO:teuthology.orchestra.run.smithi059.stdout:generic/430 1s 2023-10-16T17:31:52.239 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/430 2023-10-16T17:31:52.239 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:31:52.248 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:31:52.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:31:52.280 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-10-16T17:31:53.035 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:31:53.046 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:31:53.046 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:31:53.816 INFO:teuthology.orchestra.run.smithi059.stdout:generic/431 0s 2023-10-16T17:31:53.831 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/431 2023-10-16T17:31:53.831 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:31:53.838 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:31:53.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:31:53.865 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-10-16T17:31:54.740 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:31:54.768 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:31:54.768 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:31:55.449 INFO:teuthology.orchestra.run.smithi059.stdout:generic/432 1s 2023-10-16T17:31:55.463 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/432 2023-10-16T17:31:55.463 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:31:55.470 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:31:55.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:31:55.494 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-10-16T17:31:56.321 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:31:56.349 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:31:56.350 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:31:56.943 INFO:teuthology.orchestra.run.smithi059.stdout:generic/433 0s 2023-10-16T17:31:56.958 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/433 2023-10-16T17:31:56.958 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:31:56.967 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:31:56.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:31:56.993 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-10-16T17:31:57.729 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:31:57.741 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:31:57.742 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:31:58.477 INFO:teuthology.orchestra.run.smithi059.stdout:generic/434 - output mismatch (see /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/434.out.bad) 2023-10-16T17:31:58.484 INFO:teuthology.orchestra.run.smithi059.stdout: --- tests/generic/434.out 2023-10-16 14:27:43.361521706 +0000 2023-10-16T17:31:58.485 INFO:teuthology.orchestra.run.smithi059.stdout: +++ /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/434.out.bad 2023-10-16 17:31:58.473072171 +0000 2023-10-16T17:31:58.486 INFO:teuthology.orchestra.run.smithi059.stdout: @@ -9,6 +9,6 @@ 2023-10-16T17:31:58.486 INFO:teuthology.orchestra.run.smithi059.stdout: copy_range: Bad file descriptor 2023-10-16T17:31:58.486 INFO:teuthology.orchestra.run.smithi059.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2023-10-16T17:31:58.486 INFO:teuthology.orchestra.run.smithi059.stdout: Try to copy to a device 2023-10-16T17:31:58.486 INFO:teuthology.orchestra.run.smithi059.stdout: -copy_range: Invalid argument 2023-10-16T17:31:58.486 INFO:teuthology.orchestra.run.smithi059.stdout: +/tmp/tmp.WAE0cdes5xtest/test-434/dev1: Permission denied 2023-10-16T17:31:58.487 INFO:teuthology.orchestra.run.smithi059.stdout: Try to copy to a fifo 2023-10-16T17:31:58.487 INFO:teuthology.orchestra.run.smithi059.stdout: copy_range: Invalid argument 2023-10-16T17:31:58.491 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/434 2023-10-16T17:31:58.492 INFO:teuthology.orchestra.run.smithi059.stdout:Failures: generic/434 2023-10-16T17:31:58.492 INFO:teuthology.orchestra.run.smithi059.stdout:Failed 1 of 1 tests 2023-10-16T17:31:58.500 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:31:58.528 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T17:31:58.529 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T17:31:58.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T17:31:58.530 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-10-16T17:31:59.299 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:31:59.310 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:31:59.311 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:31:59.847 INFO:teuthology.orchestra.run.smithi059.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:31:59.861 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/435 2023-10-16T17:31:59.861 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/435 2023-10-16T17:31:59.861 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:31:59.871 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:31:59.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:31:59.905 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-10-16T17:32:00.499 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:32:00.513 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:32:00.514 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:32:03.369 INFO:teuthology.orchestra.run.smithi059.stdout:generic/436 3s 2023-10-16T17:32:03.386 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/436 2023-10-16T17:32:03.386 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:32:03.395 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:32:03.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:32:03.424 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-10-16T17:32:04.185 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:32:04.198 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:32:04.198 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:32:05.661 INFO:teuthology.orchestra.run.smithi059.stdout:generic/437 1s 2023-10-16T17:32:05.681 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/437 2023-10-16T17:32:05.682 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:32:05.691 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:32:05.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:32:05.726 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-10-16T17:32:06.322 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:32:06.336 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:32:06.337 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:32:09.577 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:32:09.586 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:32:39.758 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:32:39.765 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:33:09.900 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:33:09.907 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:33:40.040 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:33:40.047 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:34:10.179 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:34:10.190 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:34:40.324 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:34:40.336 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:35:10.470 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:35:10.480 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:35:40.617 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:35:40.629 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:36:10.758 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:36:10.764 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:36:26.874 INFO:teuthology.orchestra.run.smithi059.stdout:generic/438 260s 2023-10-16T17:36:26.893 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/438 2023-10-16T17:36:26.893 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:36:26.902 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:26.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:36:26.933 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-10-16T17:36:27.518 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:27.532 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:27.533 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:28.015 INFO:teuthology.orchestra.run.smithi059.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:36:28.029 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/439 2023-10-16T17:36:28.029 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/439 2023-10-16T17:36:28.030 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:36:28.040 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:28.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:36:28.069 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-10-16T17:36:28.598 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:28.613 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:28.613 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:29.178 INFO:teuthology.orchestra.run.smithi059.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:36:29.193 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/440 2023-10-16T17:36:29.194 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/440 2023-10-16T17:36:29.194 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:36:29.207 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:29.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:36:29.241 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-10-16T17:36:29.814 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:29.827 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:29.827 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:30.400 INFO:teuthology.orchestra.run.smithi059.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:36:30.416 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/441 2023-10-16T17:36:30.417 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/441 2023-10-16T17:36:30.417 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:36:30.429 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:30.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:36:30.467 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-10-16T17:36:31.059 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:31.072 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:31.072 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:31.572 INFO:teuthology.orchestra.run.smithi059.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:36:31.588 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/442 2023-10-16T17:36:31.588 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/442 2023-10-16T17:36:31.588 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:36:31.601 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:31.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:36:31.634 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-10-16T17:36:32.252 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:32.267 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:32.268 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:32.836 INFO:teuthology.orchestra.run.smithi059.stdout:generic/443 0s 2023-10-16T17:36:32.856 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/443 2023-10-16T17:36:32.856 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:36:32.866 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:32.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:36:32.898 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-10-16T17:36:33.478 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:33.491 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:33.492 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:34.281 INFO:teuthology.orchestra.run.smithi059.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-16T17:36:34.294 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/444 2023-10-16T17:36:34.294 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/444 2023-10-16T17:36:34.294 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:36:34.304 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:34.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:36:34.336 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-10-16T17:36:34.940 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:34.953 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:34.953 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:37.457 INFO:teuthology.orchestra.run.smithi059.stdout:generic/445 3s 2023-10-16T17:36:37.475 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/445 2023-10-16T17:36:37.475 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:36:37.484 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:37.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:36:37.526 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-10-16T17:36:38.311 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:38.323 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:38.323 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:38.729 INFO:teuthology.orchestra.run.smithi059.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:36:38.741 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/446 2023-10-16T17:36:38.742 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/446 2023-10-16T17:36:38.742 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:36:38.753 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:38.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:36:38.783 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-10-16T17:36:39.366 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:39.381 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:39.381 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:39.867 INFO:teuthology.orchestra.run.smithi059.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:36:39.883 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/447 2023-10-16T17:36:39.883 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/447 2023-10-16T17:36:39.884 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:36:39.896 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:39.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:36:39.930 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-10-16T17:36:40.519 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:40.532 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:40.532 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:40.895 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:36:40.903 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:36:43.089 INFO:teuthology.orchestra.run.smithi059.stdout:generic/448 3s 2023-10-16T17:36:43.107 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/448 2023-10-16T17:36:43.108 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:36:43.117 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:43.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:36:43.170 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-10-16T17:36:43.933 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:43.945 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:43.946 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:44.356 INFO:teuthology.orchestra.run.smithi059.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:36:44.367 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/449 2023-10-16T17:36:44.368 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/449 2023-10-16T17:36:44.368 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:36:44.377 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:44.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:36:44.410 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-10-16T17:36:45.000 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:45.012 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:45.013 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:49.082 INFO:teuthology.orchestra.run.smithi059.stdout:generic/450 4s 2023-10-16T17:36:49.097 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/450 2023-10-16T17:36:49.098 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:36:49.105 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:49.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:36:49.132 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-10-16T17:36:49.859 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:49.871 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:49.871 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:50.679 INFO:teuthology.orchestra.run.smithi059.stdout:generic/451 - output mismatch (see /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/451.out.bad) 2023-10-16T17:36:50.686 INFO:teuthology.orchestra.run.smithi059.stdout: --- tests/generic/451.out 2023-10-16 14:27:43.363521682 +0000 2023-10-16T17:36:50.686 INFO:teuthology.orchestra.run.smithi059.stdout: +++ /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/451.out.bad 2023-10-16 17:36:50.675659844 +0000 2023-10-16T17:36:50.686 INFO:teuthology.orchestra.run.smithi059.stdout: @@ -1,2 +1,5 @@ 2023-10-16T17:36:50.687 INFO:teuthology.orchestra.run.smithi059.stdout: QA output created by 451 2023-10-16T17:36:50.687 INFO:teuthology.orchestra.run.smithi059.stdout: +get stale data from buffer read 2023-10-16T17:36:50.687 INFO:teuthology.orchestra.run.smithi059.stdout: +00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 2023-10-16T17:36:50.687 INFO:teuthology.orchestra.run.smithi059.stdout: +000a0000 2023-10-16T17:36:50.687 INFO:teuthology.orchestra.run.smithi059.stdout: Silence is golden 2023-10-16T17:36:50.692 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/451 2023-10-16T17:36:50.692 INFO:teuthology.orchestra.run.smithi059.stdout:Failures: generic/451 2023-10-16T17:36:50.693 INFO:teuthology.orchestra.run.smithi059.stdout:Failed 1 of 1 tests 2023-10-16T17:36:50.700 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:50.722 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T17:36:50.723 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T17:36:50.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T17:36:50.724 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-10-16T17:36:51.622 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:51.655 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:51.655 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:51.984 INFO:teuthology.orchestra.run.smithi059.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:36:51.993 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/452 2023-10-16T17:36:51.993 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/452 2023-10-16T17:36:51.993 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:36:52.001 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:52.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:36:52.024 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-10-16T17:36:52.586 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:52.600 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:52.600 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:53.051 INFO:teuthology.orchestra.run.smithi059.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:36:53.065 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/453 2023-10-16T17:36:53.066 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/453 2023-10-16T17:36:53.066 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:36:53.077 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:53.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:36:53.109 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-10-16T17:36:53.691 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:53.704 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:53.704 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:54.157 INFO:teuthology.orchestra.run.smithi059.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:36:54.170 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/454 2023-10-16T17:36:54.171 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/454 2023-10-16T17:36:54.171 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:36:54.184 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:54.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:36:54.221 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-10-16T17:36:54.821 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:54.835 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:54.835 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:55.471 INFO:teuthology.orchestra.run.smithi059.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:36:55.486 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/455 2023-10-16T17:36:55.486 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/455 2023-10-16T17:36:55.486 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:36:55.498 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:55.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:36:55.534 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-10-16T17:36:56.122 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:56.134 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:56.134 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:56.627 INFO:teuthology.orchestra.run.smithi059.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:36:56.640 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/456 2023-10-16T17:36:56.640 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/456 2023-10-16T17:36:56.640 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:36:56.651 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:56.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:36:56.683 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-10-16T17:36:57.274 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:57.288 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:57.288 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:57.938 INFO:teuthology.orchestra.run.smithi059.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:36:57.953 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/457 2023-10-16T17:36:57.953 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/457 2023-10-16T17:36:57.953 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:36:57.965 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:57.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:36:57.999 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-10-16T17:36:58.597 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:58.611 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:58.612 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:59.042 INFO:teuthology.orchestra.run.smithi059.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:36:59.052 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/458 2023-10-16T17:36:59.052 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/458 2023-10-16T17:36:59.052 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:36:59.060 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:36:59.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:36:59.091 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-10-16T17:36:59.656 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:36:59.670 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:36:59.670 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:00.315 INFO:teuthology.orchestra.run.smithi059.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:37:00.327 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/459 2023-10-16T17:37:00.327 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/459 2023-10-16T17:37:00.327 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:37:00.336 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:00.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:37:00.366 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-10-16T17:37:00.960 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:37:00.973 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:37:00.974 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:01.439 INFO:teuthology.orchestra.run.smithi059.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:37:01.451 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/460 2023-10-16T17:37:01.451 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/460 2023-10-16T17:37:01.451 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:37:01.462 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:01.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:37:01.494 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-10-16T17:37:02.081 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:37:02.095 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:37:02.095 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:02.560 INFO:teuthology.orchestra.run.smithi059.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:37:02.573 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/461 2023-10-16T17:37:02.573 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/461 2023-10-16T17:37:02.573 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:37:02.583 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:02.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:37:02.618 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-10-16T17:37:03.254 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:37:03.269 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:37:03.269 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:03.712 INFO:teuthology.orchestra.run.smithi059.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:37:03.724 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/462 2023-10-16T17:37:03.724 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/462 2023-10-16T17:37:03.724 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:37:03.734 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:03.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:37:03.769 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-10-16T17:37:04.388 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:37:04.403 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:37:04.403 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:04.986 INFO:teuthology.orchestra.run.smithi059.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-16T17:37:04.997 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/463 2023-10-16T17:37:04.997 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/463 2023-10-16T17:37:04.997 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:37:05.006 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:05.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:37:05.042 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-10-16T17:37:05.804 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:37:05.816 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:37:05.816 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:06.223 INFO:teuthology.orchestra.run.smithi059.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:37:06.236 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/464 2023-10-16T17:37:06.236 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/464 2023-10-16T17:37:06.237 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:37:06.248 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:06.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:37:06.281 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-10-16T17:37:06.865 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:37:06.879 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:37:06.879 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:11.035 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:37:11.047 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:37:36.630 INFO:teuthology.orchestra.run.smithi059.stdout:generic/465 30s 2023-10-16T17:37:36.664 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/465 2023-10-16T17:37:36.665 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:37:36.684 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:36.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:37:36.729 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-10-16T17:37:37.252 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:37:37.266 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:37:37.266 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:37.606 INFO:teuthology.orchestra.run.smithi059.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:37:37.618 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/466 2023-10-16T17:37:37.618 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/466 2023-10-16T17:37:37.618 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:37:37.627 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:37.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:37:37.659 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-10-16T17:37:38.233 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:37:38.247 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:37:38.247 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:41.185 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:37:41.195 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:37:47.200 INFO:teuthology.orchestra.run.smithi059.stdout:generic/467 9s 2023-10-16T17:37:47.278 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/467 2023-10-16T17:37:47.278 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:37:47.292 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:47.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:37:47.497 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-10-16T17:37:49.211 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:37:49.226 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:37:49.226 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:49.715 INFO:teuthology.orchestra.run.smithi059.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:37:49.726 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/468 2023-10-16T17:37:49.727 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/468 2023-10-16T17:37:49.727 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:37:49.738 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:49.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:37:49.769 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-10-16T17:37:50.389 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:37:50.403 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:37:50.403 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:58.676 INFO:teuthology.orchestra.run.smithi059.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-16T17:37:58.690 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/469 2023-10-16T17:37:58.691 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/469 2023-10-16T17:37:58.691 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:37:58.703 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:37:58.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:37:58.756 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-10-16T17:37:59.490 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:37:59.502 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:37:59.502 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:38:00.030 INFO:teuthology.orchestra.run.smithi059.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:38:00.045 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/470 2023-10-16T17:38:00.046 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/470 2023-10-16T17:38:00.046 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:38:00.058 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:38:00.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:38:00.092 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-10-16T17:38:00.676 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:38:00.691 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:38:00.691 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:38:12.664 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:38:12.679 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:38:42.881 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:38:42.893 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:39:13.021 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:39:13.036 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:39:43.252 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:39:43.258 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:40:09.340 INFO:teuthology.orchestra.run.smithi059.stdout:generic/471 129s 2023-10-16T17:40:09.358 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/471 2023-10-16T17:40:09.359 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:40:09.368 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:09.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:40:09.402 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-10-16T17:40:10.513 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:40:10.536 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:40:10.536 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:10.949 INFO:teuthology.orchestra.run.smithi059.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:40:10.957 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/472 2023-10-16T17:40:10.958 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/472 2023-10-16T17:40:10.958 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:40:10.965 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:10.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:40:10.989 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-10-16T17:40:11.550 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:40:11.563 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:40:11.563 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:12.528 INFO:teuthology.orchestra.run.smithi059.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-16T17:40:12.540 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/473 2023-10-16T17:40:12.541 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/473 2023-10-16T17:40:12.541 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:40:12.550 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:12.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:40:12.583 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-10-16T17:40:13.167 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:40:13.181 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:40:13.182 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:13.449 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:40:13.457 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:40:13.596 INFO:teuthology.orchestra.run.smithi059.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:40:13.607 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/474 2023-10-16T17:40:13.607 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/474 2023-10-16T17:40:13.607 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:40:13.615 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:13.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:40:13.644 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-10-16T17:40:14.286 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:40:14.301 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:40:14.301 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:14.820 INFO:teuthology.orchestra.run.smithi059.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:40:14.833 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/475 2023-10-16T17:40:14.833 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/475 2023-10-16T17:40:14.833 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:40:14.843 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:14.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:40:14.874 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-10-16T17:40:15.493 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:40:15.507 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:40:15.508 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:15.975 INFO:teuthology.orchestra.run.smithi059.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:40:15.986 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/476 2023-10-16T17:40:15.987 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/476 2023-10-16T17:40:15.987 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:40:15.996 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:16.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:40:16.031 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-10-16T17:40:16.605 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:40:16.620 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:40:16.620 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:27.121 INFO:teuthology.orchestra.run.smithi059.stdout:generic/477 11s 2023-10-16T17:40:27.232 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/477 2023-10-16T17:40:27.232 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:40:27.247 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:27.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:40:27.361 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-10-16T17:40:29.009 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:40:29.025 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:40:29.025 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:41.361 INFO:teuthology.orchestra.run.smithi059.stdout:generic/478 - output mismatch (see /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/478.out.bad) 2023-10-16T17:40:41.370 INFO:teuthology.orchestra.run.smithi059.stdout: --- tests/generic/478.out 2023-10-16 14:27:43.368521623 +0000 2023-10-16T17:40:41.370 INFO:teuthology.orchestra.run.smithi059.stdout: +++ /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/478.out.bad 2023-10-16 17:40:41.355917288 +0000 2023-10-16T17:40:41.371 INFO:teuthology.orchestra.run.smithi059.stdout: @@ -10,7 +10,7 @@ 2023-10-16T17:40:41.371 INFO:teuthology.orchestra.run.smithi059.stdout: lock could be placed 2023-10-16T17:40:41.371 INFO:teuthology.orchestra.run.smithi059.stdout: get wrlck 2023-10-16T17:40:41.371 INFO:teuthology.orchestra.run.smithi059.stdout: lock could be placed 2023-10-16T17:40:41.371 INFO:teuthology.orchestra.run.smithi059.stdout: -lock could be placed 2023-10-16T17:40:41.371 INFO:teuthology.orchestra.run.smithi059.stdout: +get wrlck 2023-10-16T17:40:41.372 INFO:teuthology.orchestra.run.smithi059.stdout: lock could be placed 2023-10-16T17:40:41.372 INFO:teuthology.orchestra.run.smithi059.stdout: lock could be placed 2023-10-16T17:40:41.372 INFO:teuthology.orchestra.run.smithi059.stdout: lock could be placed 2023-10-16T17:40:41.372 INFO:teuthology.orchestra.run.smithi059.stdout: @@ -25,7 +25,7 @@ 2023-10-16T17:40:41.372 INFO:teuthology.orchestra.run.smithi059.stdout: lock could be placed 2023-10-16T17:40:41.373 INFO:teuthology.orchestra.run.smithi059.stdout: get wrlck 2023-10-16T17:40:41.373 INFO:teuthology.orchestra.run.smithi059.stdout: lock could be placed 2023-10-16T17:40:41.373 INFO:teuthology.orchestra.run.smithi059.stdout: -lock could be placed 2023-10-16T17:40:41.373 INFO:teuthology.orchestra.run.smithi059.stdout: +get wrlck 2023-10-16T17:40:41.373 INFO:teuthology.orchestra.run.smithi059.stdout: lock could be placed 2023-10-16T17:40:41.373 INFO:teuthology.orchestra.run.smithi059.stdout: lock could be placed 2023-10-16T17:40:41.374 INFO:teuthology.orchestra.run.smithi059.stdout: lock could be placed 2023-10-16T17:40:41.374 INFO:teuthology.orchestra.run.smithi059.stdout: @@ -37,7 +37,7 @@ 2023-10-16T17:40:41.374 INFO:teuthology.orchestra.run.smithi059.stdout: get rdlck 2023-10-16T17:40:41.374 INFO:teuthology.orchestra.run.smithi059.stdout: get rdlck 2023-10-16T17:40:41.375 INFO:teuthology.orchestra.run.smithi059.stdout: lock could be placed 2023-10-16T17:40:41.375 INFO:teuthology.orchestra.run.smithi059.stdout: -lock could be placed 2023-10-16T17:40:41.375 INFO:teuthology.orchestra.run.smithi059.stdout: +get rdlck 2023-10-16T17:40:41.375 INFO:teuthology.orchestra.run.smithi059.stdout: get rdlck 2023-10-16T17:40:41.375 INFO:teuthology.orchestra.run.smithi059.stdout: lock could be placed 2023-10-16T17:40:41.375 INFO:teuthology.orchestra.run.smithi059.stdout: get rdlck 2023-10-16T17:40:41.376 INFO:teuthology.orchestra.run.smithi059.stdout: @@ -46,7 +46,7 @@ 2023-10-16T17:40:41.376 INFO:teuthology.orchestra.run.smithi059.stdout: get rdlck 2023-10-16T17:40:41.376 INFO:teuthology.orchestra.run.smithi059.stdout: get rdlck 2023-10-16T17:40:41.376 INFO:teuthology.orchestra.run.smithi059.stdout: lock could be placed 2023-10-16T17:40:41.376 INFO:teuthology.orchestra.run.smithi059.stdout: -lock could be placed 2023-10-16T17:40:41.376 INFO:teuthology.orchestra.run.smithi059.stdout: +get rdlck 2023-10-16T17:40:41.377 INFO:teuthology.orchestra.run.smithi059.stdout: lock could be placed 2023-10-16T17:40:41.377 INFO:teuthology.orchestra.run.smithi059.stdout: lock could be placed 2023-10-16T17:40:41.377 INFO:teuthology.orchestra.run.smithi059.stdout: lock could be placed 2023-10-16T17:40:41.379 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/478 2023-10-16T17:40:41.379 INFO:teuthology.orchestra.run.smithi059.stdout:Failures: generic/478 2023-10-16T17:40:41.379 INFO:teuthology.orchestra.run.smithi059.stdout:Failed 1 of 1 tests 2023-10-16T17:40:41.389 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:41.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T17:40:41.418 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T17:40:41.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T17:40:41.419 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-10-16T17:40:41.991 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:40:42.004 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:40:42.004 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:42.560 INFO:teuthology.orchestra.run.smithi059.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:40:42.575 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/479 2023-10-16T17:40:42.576 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/479 2023-10-16T17:40:42.576 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:40:42.590 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:42.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:40:42.623 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-10-16T17:40:43.208 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:40:43.221 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:40:43.222 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:43.657 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:40:43.662 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:40:43.701 INFO:teuthology.orchestra.run.smithi059.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:40:43.713 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/480 2023-10-16T17:40:43.713 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/480 2023-10-16T17:40:43.713 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:40:43.721 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:43.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:40:43.748 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-10-16T17:40:44.368 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:40:44.381 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:40:44.382 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:44.860 INFO:teuthology.orchestra.run.smithi059.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:40:44.871 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/481 2023-10-16T17:40:44.872 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/481 2023-10-16T17:40:44.872 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:40:44.881 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:44.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:40:44.914 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-10-16T17:40:45.492 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:40:45.506 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:40:45.506 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:46.129 INFO:teuthology.orchestra.run.smithi059.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:40:46.143 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/482 2023-10-16T17:40:46.143 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/482 2023-10-16T17:40:46.143 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:40:46.153 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:46.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:40:46.185 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-10-16T17:40:46.776 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:40:46.789 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:40:46.789 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:47.328 INFO:teuthology.orchestra.run.smithi059.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:40:47.341 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/483 2023-10-16T17:40:47.341 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/483 2023-10-16T17:40:47.342 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:40:47.354 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:47.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:40:47.389 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-10-16T17:40:47.962 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:40:47.976 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:40:47.976 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:48.494 INFO:teuthology.orchestra.run.smithi059.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:40:48.509 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/484 2023-10-16T17:40:48.509 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/484 2023-10-16T17:40:48.510 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:40:48.522 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:48.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:40:48.557 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-10-16T17:40:49.164 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:40:49.178 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:40:49.179 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:53.819 INFO:teuthology.orchestra.run.smithi059.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-10-16T17:40:53.832 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/485 2023-10-16T17:40:53.832 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/485 2023-10-16T17:40:53.833 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:40:53.842 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:53.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:40:53.878 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-10-16T17:40:54.646 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:40:54.657 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:40:54.658 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:55.161 INFO:teuthology.orchestra.run.smithi059.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:40:55.173 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/486 2023-10-16T17:40:55.174 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/486 2023-10-16T17:40:55.174 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:40:55.184 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:55.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:40:55.222 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-10-16T17:40:55.823 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:40:55.836 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:40:55.836 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:56.297 INFO:teuthology.orchestra.run.smithi059.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:40:56.312 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/487 2023-10-16T17:40:56.312 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/487 2023-10-16T17:40:56.312 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:40:56.324 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:56.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:40:56.358 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-10-16T17:40:56.936 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:40:56.950 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:40:56.951 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:57.399 INFO:teuthology.orchestra.run.smithi059.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:40:57.411 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/488 2023-10-16T17:40:57.411 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/488 2023-10-16T17:40:57.411 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:40:57.420 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:57.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:40:57.450 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-10-16T17:40:58.039 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:40:58.053 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:40:58.053 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:58.538 INFO:teuthology.orchestra.run.smithi059.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:40:58.551 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/489 2023-10-16T17:40:58.552 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/489 2023-10-16T17:40:58.552 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:40:58.561 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:40:58.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:40:58.594 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-10-16T17:40:59.201 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:40:59.213 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:40:59.213 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:01.833 INFO:teuthology.orchestra.run.smithi059.stdout:generic/490 2s 2023-10-16T17:41:01.852 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/490 2023-10-16T17:41:01.852 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:01.862 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:01.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:01.903 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-10-16T17:41:02.694 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:02.705 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:02.705 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:03.150 INFO:teuthology.orchestra.run.smithi059.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:03.165 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/491 2023-10-16T17:41:03.165 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/491 2023-10-16T17:41:03.166 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:03.177 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:03.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:03.209 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-10-16T17:41:03.806 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:03.819 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:03.819 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:04.255 INFO:teuthology.orchestra.run.smithi059.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:04.270 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/492 2023-10-16T17:41:04.270 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/492 2023-10-16T17:41:04.271 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:04.283 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:04.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:04.319 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-10-16T17:41:04.896 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:04.910 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:04.910 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:05.358 INFO:teuthology.orchestra.run.smithi059.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:05.373 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/493 2023-10-16T17:41:05.374 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/493 2023-10-16T17:41:05.374 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:05.386 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:05.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:05.422 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-10-16T17:41:06.028 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:06.043 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:06.043 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:06.483 INFO:teuthology.orchestra.run.smithi059.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:06.496 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/494 2023-10-16T17:41:06.497 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/494 2023-10-16T17:41:06.497 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:06.506 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:06.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:06.540 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-10-16T17:41:07.130 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:07.145 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:07.145 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:07.593 INFO:teuthology.orchestra.run.smithi059.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:07.604 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/495 2023-10-16T17:41:07.604 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/495 2023-10-16T17:41:07.604 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:07.613 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:07.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:07.646 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-10-16T17:41:08.236 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:08.248 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:08.249 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:08.674 INFO:teuthology.orchestra.run.smithi059.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:08.688 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/496 2023-10-16T17:41:08.688 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/496 2023-10-16T17:41:08.689 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:08.700 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:08.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:08.731 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-10-16T17:41:09.306 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:09.319 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:09.320 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:09.751 INFO:teuthology.orchestra.run.smithi059.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:09.761 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/497 2023-10-16T17:41:09.761 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/497 2023-10-16T17:41:09.761 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:09.769 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:09.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:09.799 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-10-16T17:41:10.393 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:10.407 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:10.407 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:10.902 INFO:teuthology.orchestra.run.smithi059.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:10.917 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/498 2023-10-16T17:41:10.917 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/498 2023-10-16T17:41:10.918 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:10.930 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:10.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:10.969 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-10-16T17:41:11.605 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:11.621 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:11.621 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:12.083 INFO:teuthology.orchestra.run.smithi059.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:12.097 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/499 2023-10-16T17:41:12.098 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/499 2023-10-16T17:41:12.098 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:12.110 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:12.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:12.146 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-10-16T17:41:12.736 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:12.750 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:12.750 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:13.329 INFO:teuthology.orchestra.run.smithi059.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:13.342 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/500 2023-10-16T17:41:13.343 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/500 2023-10-16T17:41:13.343 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:13.353 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:13.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:13.384 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-10-16T17:41:13.868 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:41:13.873 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:41:13.965 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:13.977 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:13.977 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:14.451 INFO:teuthology.orchestra.run.smithi059.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:14.463 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/501 2023-10-16T17:41:14.464 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/501 2023-10-16T17:41:14.464 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:14.474 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:14.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:14.506 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-10-16T17:41:15.154 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:15.169 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:15.169 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:15.664 INFO:teuthology.orchestra.run.smithi059.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:15.680 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/502 2023-10-16T17:41:15.680 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/502 2023-10-16T17:41:15.680 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:15.695 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:15.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:15.730 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-10-16T17:41:16.348 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:16.360 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:16.361 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:16.816 INFO:teuthology.orchestra.run.smithi059.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:16.828 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/503 2023-10-16T17:41:16.828 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/503 2023-10-16T17:41:16.828 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:16.838 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:16.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:16.871 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-10-16T17:41:17.458 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:17.471 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:17.471 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:18.034 INFO:teuthology.orchestra.run.smithi059.stdout:generic/504 - output mismatch (see /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/504.out.bad) 2023-10-16T17:41:18.042 INFO:teuthology.orchestra.run.smithi059.stdout: --- tests/generic/504.out 2023-10-16 14:27:43.372521576 +0000 2023-10-16T17:41:18.042 INFO:teuthology.orchestra.run.smithi059.stdout: +++ /tmp/tmp.AzguH69EDZxfstests-dev/results//generic/504.out.bad 2023-10-16 17:41:18.029480752 +0000 2023-10-16T17:41:18.042 INFO:teuthology.orchestra.run.smithi059.stdout: @@ -1,2 +1,3 @@ 2023-10-16T17:41:18.043 INFO:teuthology.orchestra.run.smithi059.stdout: QA output created by 504 2023-10-16T17:41:18.043 INFO:teuthology.orchestra.run.smithi059.stdout: +lock info not found 2023-10-16T17:41:18.043 INFO:teuthology.orchestra.run.smithi059.stdout: Silence is golden 2023-10-16T17:41:18.050 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/504 2023-10-16T17:41:18.050 INFO:teuthology.orchestra.run.smithi059.stdout:Failures: generic/504 2023-10-16T17:41:18.050 INFO:teuthology.orchestra.run.smithi059.stdout:Failed 1 of 1 tests 2023-10-16T17:41:18.059 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:18.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T17:41:18.091 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T17:41:18.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-16T17:41:18.091 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-10-16T17:41:18.687 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:18.704 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:18.704 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:19.177 INFO:teuthology.orchestra.run.smithi059.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:19.191 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/505 2023-10-16T17:41:19.191 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/505 2023-10-16T17:41:19.191 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:19.202 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:19.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:19.235 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-10-16T17:41:19.839 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:19.852 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:19.852 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:20.278 INFO:teuthology.orchestra.run.smithi059.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:20.290 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/506 2023-10-16T17:41:20.290 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/506 2023-10-16T17:41:20.291 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:20.300 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:20.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:20.335 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-10-16T17:41:20.913 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:20.929 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:20.929 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:21.543 INFO:teuthology.orchestra.run.smithi059.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-10-16T17:41:21.558 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/507 2023-10-16T17:41:21.558 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/507 2023-10-16T17:41:21.558 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:21.567 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:21.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:21.600 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-10-16T17:41:22.177 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:22.192 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:22.192 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:22.671 INFO:teuthology.orchestra.run.smithi059.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2023-10-16T17:41:22.684 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/508 2023-10-16T17:41:22.684 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/508 2023-10-16T17:41:22.685 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:22.696 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:22.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:22.731 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-10-16T17:41:23.298 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:23.313 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:23.313 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:23.794 INFO:teuthology.orchestra.run.smithi059.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:23.805 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/509 2023-10-16T17:41:23.806 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/509 2023-10-16T17:41:23.806 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:23.814 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:23.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:23.846 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-10-16T17:41:24.417 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:24.432 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:24.432 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:24.935 INFO:teuthology.orchestra.run.smithi059.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:24.951 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/510 2023-10-16T17:41:24.951 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/510 2023-10-16T17:41:24.951 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:24.964 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:25.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:25.001 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-10-16T17:41:25.571 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:25.586 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:25.587 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:26.057 INFO:teuthology.orchestra.run.smithi059.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:26.070 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/511 2023-10-16T17:41:26.070 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/511 2023-10-16T17:41:26.071 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:26.079 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:26.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:26.110 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-10-16T17:41:26.678 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:26.691 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:26.691 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:27.182 INFO:teuthology.orchestra.run.smithi059.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:27.194 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/512 2023-10-16T17:41:27.194 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/512 2023-10-16T17:41:27.194 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:27.203 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:27.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:27.240 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-10-16T17:41:27.825 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:27.840 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:27.840 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:28.270 INFO:teuthology.orchestra.run.smithi059.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:28.286 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/513 2023-10-16T17:41:28.287 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/513 2023-10-16T17:41:28.287 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:28.298 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:28.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:28.337 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-10-16T17:41:28.988 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:29.004 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:29.004 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:29.460 INFO:teuthology.orchestra.run.smithi059.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:29.473 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/514 2023-10-16T17:41:29.473 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/514 2023-10-16T17:41:29.473 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:29.483 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:29.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:29.517 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-10-16T17:41:30.094 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:30.109 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:30.109 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:30.545 INFO:teuthology.orchestra.run.smithi059.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:30.557 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/515 2023-10-16T17:41:30.558 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/515 2023-10-16T17:41:30.558 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:30.567 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:30.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:30.597 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-10-16T17:41:31.175 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:31.190 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:31.190 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:31.827 INFO:teuthology.orchestra.run.smithi059.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-16T17:41:31.838 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/516 2023-10-16T17:41:31.838 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/516 2023-10-16T17:41:31.838 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:31.847 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:31.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:31.878 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-10-16T17:41:32.627 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:32.640 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:32.640 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:33.083 INFO:teuthology.orchestra.run.smithi059.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:33.095 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/517 2023-10-16T17:41:33.096 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/517 2023-10-16T17:41:33.096 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:33.105 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:33.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:33.138 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-10-16T17:41:33.736 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:33.751 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:33.751 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:34.183 INFO:teuthology.orchestra.run.smithi059.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:34.194 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/518 2023-10-16T17:41:34.195 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/518 2023-10-16T17:41:34.195 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:34.204 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:34.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:34.233 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-10-16T17:41:34.831 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:34.846 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:34.847 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:35.281 INFO:teuthology.orchestra.run.smithi059.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:35.293 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/519 2023-10-16T17:41:35.293 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/519 2023-10-16T17:41:35.294 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:35.306 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:35.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:35.340 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-10-16T17:41:35.956 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:35.969 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:35.969 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:36.447 INFO:teuthology.orchestra.run.smithi059.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2023-10-16T17:41:36.463 INFO:teuthology.orchestra.run.smithi059.stdout:Ran: generic/520 2023-10-16T17:41:36.463 INFO:teuthology.orchestra.run.smithi059.stdout:Not run: generic/520 2023-10-16T17:41:36.463 INFO:teuthology.orchestra.run.smithi059.stdout:Passed all 1 tests 2023-10-16T17:41:36.477 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:36.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-16T17:41:36.510 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-10-16T17:41:37.104 INFO:teuthology.orchestra.run.smithi059.stdout:FSTYP -- ceph-fuse 2023-10-16T17:41:37.119 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM -- Linux/x86_64 smithi059 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-16T17:41:37.119 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-16T17:41:44.034 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:41:44.047 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:42:14.205 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:42:14.219 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:42:44.358 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:42:44.369 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:43:14.565 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:43:14.579 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:43:44.763 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:43:44.794 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:44:14.917 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:44:14.927 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:44:45.058 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:44:45.072 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:45:15.342 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:45:15.354 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:45:45.489 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:45:45.500 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:46:15.666 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:46:15.679 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:46:45.822 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:46:45.834 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:47:15.960 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:47:15.972 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:47:46.157 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:47:46.168 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:48:16.599 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:48:16.609 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:48:46.742 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:48:46.755 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:48:46.875 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-10-16T17:48:46.873+0000 7efc1aede640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100127) UID: 0 2023-10-16T17:48:46.875 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-10-16T17:48:46.874+0000 7f9061646640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100127) UID: 0 2023-10-16T17:48:46.876 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-10-16T17:48:46.874+0000 7f104c58c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100127) UID: 0 2023-10-16T17:48:46.876 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-10-16T17:48:46.874+0000 7f977ef33640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100127) UID: 0 2023-10-16T17:51:08.592 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:51:08.606 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:51:38.736 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:51:38.747 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:52:08.892 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:52:08.902 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:52:39.040 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:52:39.052 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:53:09.199 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:53:09.213 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:53:39.346 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:53:39.357 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:54:09.476 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:54:09.487 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:54:39.636 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:54:39.647 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:55:10.317 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:55:10.327 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:55:40.447 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:55:40.458 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:56:10.600 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:56:10.610 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:56:40.790 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:56:40.799 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:57:11.020 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:57:11.030 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:57:41.157 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:57:41.167 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:58:11.314 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:58:11.325 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:58:41.463 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:58:41.474 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:59:11.633 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:59:11.643 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:59:41.779 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T17:59:41.790 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:00:11.916 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:00:11.928 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:00:42.065 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:00:42.078 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:01:12.212 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:01:12.222 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:01:42.360 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:01:42.373 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:02:12.523 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:02:12.536 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:02:42.669 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:02:42.680 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:03:12.800 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:03:12.809 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:03:42.938 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:03:42.950 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:04:13.079 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:04:13.091 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:04:43.225 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:04:43.234 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:05:13.842 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:05:13.853 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:05:43.998 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:05:44.009 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:06:14.143 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:06:14.154 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:06:44.291 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:06:44.302 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:06:44.450 INFO:tasks.ceph.osd.1.smithi059.stderr:2023-10-16T18:06:44.450+0000 7f91056c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462488) UID: 0 2023-10-16T18:06:44.450 INFO:tasks.ceph.osd.2.smithi059.stderr:2023-10-16T18:06:44.450+0000 7f33baba1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462488) UID: 0 2023-10-16T18:06:44.451 INFO:tasks.ceph.osd.3.smithi059.stderr:2023-10-16T18:06:44.450+0000 7f98840e9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462488) UID: 0 2023-10-16T18:06:44.451 INFO:tasks.ceph.osd.0.smithi059.stderr:2023-10-16T18:06:44.450+0000 7f5953fdd640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462488) UID: 0 2023-10-16T18:10:03.244 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:10:03.254 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:10:33.444 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:10:33.456 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:11:03.585 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:11:03.596 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:11:34.134 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:11:34.145 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:12:04.276 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:12:04.286 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:12:34.460 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:12:34.471 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:13:04.674 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:13:04.687 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:13:34.820 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:13:34.831 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:14:05.026 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:14:05.036 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:14:35.248 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:14:35.260 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:15:05.480 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:15:05.491 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:15:35.634 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:15:35.646 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:16:05.839 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:16:05.850 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:16:35.986 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:16:35.998 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:17:06.153 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:17:06.163 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:17:36.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:17:36.317 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:18:06.503 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:18:06.513 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:18:36.658 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:18:36.670 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:19:06.803 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:19:06.814 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:19:36.946 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:19:36.960 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:20:07.124 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:20:07.135 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:20:37.320 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:20:37.330 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:21:07.475 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:21:07.487 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:21:37.790 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:21:37.801 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:22:07.960 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:22:07.970 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:22:38.115 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:22:38.126 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:23:08.250 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:23:08.263 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:23:38.476 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:23:38.486 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:24:08.650 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:24:08.661 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:24:38.794 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:24:38.804 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:25:08.942 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:25:08.953 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:25:39.131 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:25:39.142 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:26:09.344 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:26:09.355 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:26:39.511 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:26:39.522 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:27:09.721 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:27:09.732 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:27:39.911 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:27:39.921 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:28:10.091 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:28:10.103 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:28:40.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:28:40.311 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:29:10.426 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:29:10.437 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:29:40.598 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:29:40.610 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:30:10.821 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:30:10.831 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:30:40.967 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:30:40.978 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:31:11.122 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:31:11.134 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:31:41.587 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:31:41.599 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:32:11.742 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:32:11.754 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:32:41.930 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:32:41.940 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:33:12.078 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:33:12.091 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:33:42.275 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:33:42.286 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:34:12.430 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:34:12.441 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:34:42.570 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:34:42.584 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:35:12.708 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:35:12.720 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:35:42.874 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:35:42.887 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:36:13.036 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:36:13.048 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:36:43.190 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:36:43.200 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:37:13.329 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:37:13.341 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:37:43.493 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:37:43.505 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:38:13.680 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:38:13.692 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:38:13.807 INFO:tasks.ceph.mds.c.smithi059.stderr:2023-10-16T18:38:13.806+0000 7fbf1e8d8640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 463556) UID: 0 2023-10-16T18:38:13.808 INFO:tasks.ceph.mds.a.smithi059.stderr:2023-10-16T18:38:13.806+0000 7fc73a4b6640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 463556) UID: 0 2023-10-16T18:41:15.864 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:41:15.875 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:41:46.370 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:41:46.382 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:42:16.524 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:42:16.534 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:42:46.663 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:42:46.673 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:43:16.814 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:43:16.825 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:43:46.969 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:43:46.981 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:44:17.109 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:44:17.120 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:44:47.275 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:44:47.287 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:45:17.462 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:45:17.473 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:45:47.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:45:47.664 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:46:18.040 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:46:18.051 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:46:48.177 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:46:48.189 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:47:18.374 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:47:18.385 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:47:48.562 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:47:48.575 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:48:18.709 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:48:18.721 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:48:48.873 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:48:48.888 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:49:19.136 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:49:19.147 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:49:49.275 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:49:49.288 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:50:19.448 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:50:19.458 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:50:49.589 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:50:49.601 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:51:19.796 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:51:19.806 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:51:35.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-16T18:51:35.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-16T18:51:35.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-10-16T18:51:35.025 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T18:51:35.026 INFO:teuthology.orchestra.run.smithi059.stdout:generic/521 2023-10-16T18:51:35.026 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T18:51:35.027 INFO:tasks.cephfs.xfstests_dev:Command return value: -1 2023-10-16T18:51:35.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-16T18:51:35.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:51:36.659 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-10-16T18:51:36.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-16T18:51:36.873 DEBUG:teuthology.orchestra.run.smithi059:> (cd /tmp/tmp.AzguH69EDZxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-10-16T18:51:40.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-10-16T18:51:40.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-10-16T18:51:40.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-10-16T18:51:40.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-16T18:51:40.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-10-16T18:51:40.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-16T18:51:40.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-16T18:51:40.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-16T18:51:40.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-10-16T18:51:40.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-10-16T18:51:40.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-10-16T18:51:40.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-16T18:51:40.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-16T18:51:40.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~6s 2023-10-16T18:51:40.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~6s 2023-10-16T18:51:40.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-10-16T18:51:40.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~6s 2023-10-16T18:51:45.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~5s 2023-10-16T18:51:45.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~5s 2023-10-16T18:51:45.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~5s 2023-10-16T18:51:45.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~5s 2023-10-16T18:51:45.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~5s 2023-10-16T18:51:45.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~5s 2023-10-16T18:51:45.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~5s 2023-10-16T18:51:45.026 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~5s 2023-10-16T18:51:45.026 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~5s 2023-10-16T18:51:45.026 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~5s 2023-10-16T18:51:45.026 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~5s 2023-10-16T18:51:45.026 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~5s 2023-10-16T18:51:45.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~5s 2023-10-16T18:51:45.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~11s 2023-10-16T18:51:45.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~11s 2023-10-16T18:51:45.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~5s 2023-10-16T18:51:45.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~11s 2023-10-16T18:51:49.990 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:51:50.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~10s 2023-10-16T18:51:50.029 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~10s 2023-10-16T18:51:50.029 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~10s 2023-10-16T18:51:50.029 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~10s 2023-10-16T18:51:50.029 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~10s 2023-10-16T18:51:50.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~10s 2023-10-16T18:51:50.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~10s 2023-10-16T18:51:50.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~10s 2023-10-16T18:51:50.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~10s 2023-10-16T18:51:50.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~10s 2023-10-16T18:51:50.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~10s 2023-10-16T18:51:50.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~10s 2023-10-16T18:51:50.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~10s 2023-10-16T18:51:50.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~16s 2023-10-16T18:51:50.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~16s 2023-10-16T18:51:50.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~10s 2023-10-16T18:51:50.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~16s 2023-10-16T18:51:55.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~15s 2023-10-16T18:51:55.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~15s 2023-10-16T18:51:55.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~15s 2023-10-16T18:51:55.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~15s 2023-10-16T18:51:55.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~15s 2023-10-16T18:51:55.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~15s 2023-10-16T18:51:55.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~15s 2023-10-16T18:51:55.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~15s 2023-10-16T18:51:55.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~15s 2023-10-16T18:51:55.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~15s 2023-10-16T18:51:55.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~15s 2023-10-16T18:51:55.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~15s 2023-10-16T18:51:55.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~15s 2023-10-16T18:51:55.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~21s 2023-10-16T18:51:55.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~21s 2023-10-16T18:51:55.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~15s 2023-10-16T18:51:55.038 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~21s 2023-10-16T18:52:00.040 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~20s 2023-10-16T18:52:00.040 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~20s 2023-10-16T18:52:00.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~20s 2023-10-16T18:52:00.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~20s 2023-10-16T18:52:00.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~20s 2023-10-16T18:52:00.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~20s 2023-10-16T18:52:00.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~20s 2023-10-16T18:52:00.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~20s 2023-10-16T18:52:00.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~20s 2023-10-16T18:52:00.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~20s 2023-10-16T18:52:00.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~20s 2023-10-16T18:52:00.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~20s 2023-10-16T18:52:00.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~20s 2023-10-16T18:52:00.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~26s 2023-10-16T18:52:00.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~26s 2023-10-16T18:52:00.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~20s 2023-10-16T18:52:00.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~26s 2023-10-16T18:52:05.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~25s 2023-10-16T18:52:05.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~25s 2023-10-16T18:52:05.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~25s 2023-10-16T18:52:05.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~25s 2023-10-16T18:52:05.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~25s 2023-10-16T18:52:05.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~25s 2023-10-16T18:52:05.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~25s 2023-10-16T18:52:05.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~25s 2023-10-16T18:52:05.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~25s 2023-10-16T18:52:05.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~25s 2023-10-16T18:52:05.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~25s 2023-10-16T18:52:05.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~25s 2023-10-16T18:52:05.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~25s 2023-10-16T18:52:05.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~31s 2023-10-16T18:52:05.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~31s 2023-10-16T18:52:05.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~25s 2023-10-16T18:52:05.048 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~31s 2023-10-16T18:52:10.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~30s 2023-10-16T18:52:10.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~30s 2023-10-16T18:52:10.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~30s 2023-10-16T18:52:10.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~30s 2023-10-16T18:52:10.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~30s 2023-10-16T18:52:10.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~30s 2023-10-16T18:52:10.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~30s 2023-10-16T18:52:10.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~30s 2023-10-16T18:52:10.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~30s 2023-10-16T18:52:10.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~30s 2023-10-16T18:52:10.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~30s 2023-10-16T18:52:10.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~30s 2023-10-16T18:52:10.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~30s 2023-10-16T18:52:10.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~36s 2023-10-16T18:52:10.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~36s 2023-10-16T18:52:10.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~30s 2023-10-16T18:52:10.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~36s 2023-10-16T18:52:15.055 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~35s 2023-10-16T18:52:15.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2023-10-16T18:52:15.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~35s 2023-10-16T18:52:15.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~35s 2023-10-16T18:52:15.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~35s 2023-10-16T18:52:15.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~35s 2023-10-16T18:52:15.057 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~35s 2023-10-16T18:52:15.057 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~35s 2023-10-16T18:52:15.057 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~35s 2023-10-16T18:52:15.057 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~35s 2023-10-16T18:52:15.057 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~35s 2023-10-16T18:52:15.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~35s 2023-10-16T18:52:15.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~35s 2023-10-16T18:52:15.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~41s 2023-10-16T18:52:15.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~41s 2023-10-16T18:52:15.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~35s 2023-10-16T18:52:15.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~41s 2023-10-16T18:52:20.060 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~40s 2023-10-16T18:52:20.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~40s 2023-10-16T18:52:20.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~40s 2023-10-16T18:52:20.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~40s 2023-10-16T18:52:20.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~40s 2023-10-16T18:52:20.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~40s 2023-10-16T18:52:20.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~40s 2023-10-16T18:52:20.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~40s 2023-10-16T18:52:20.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~40s 2023-10-16T18:52:20.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~40s 2023-10-16T18:52:20.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~40s 2023-10-16T18:52:20.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~40s 2023-10-16T18:52:20.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~40s 2023-10-16T18:52:20.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~46s 2023-10-16T18:52:20.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~46s 2023-10-16T18:52:20.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~40s 2023-10-16T18:52:20.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~46s 2023-10-16T18:52:25.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~45s 2023-10-16T18:52:25.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~45s 2023-10-16T18:52:25.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~45s 2023-10-16T18:52:25.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~45s 2023-10-16T18:52:25.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~45s 2023-10-16T18:52:25.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~45s 2023-10-16T18:52:25.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~45s 2023-10-16T18:52:25.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~45s 2023-10-16T18:52:25.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~45s 2023-10-16T18:52:25.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~45s 2023-10-16T18:52:25.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~45s 2023-10-16T18:52:25.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~45s 2023-10-16T18:52:25.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~45s 2023-10-16T18:52:25.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~51s 2023-10-16T18:52:25.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~51s 2023-10-16T18:52:25.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~45s 2023-10-16T18:52:25.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~51s 2023-10-16T18:52:30.070 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~50s 2023-10-16T18:52:30.070 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~50s 2023-10-16T18:52:30.071 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~50s 2023-10-16T18:52:30.071 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~50s 2023-10-16T18:52:30.071 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~50s 2023-10-16T18:52:30.071 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~50s 2023-10-16T18:52:30.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~50s 2023-10-16T18:52:30.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~50s 2023-10-16T18:52:30.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~50s 2023-10-16T18:52:30.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~50s 2023-10-16T18:52:30.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~50s 2023-10-16T18:52:30.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~50s 2023-10-16T18:52:30.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~50s 2023-10-16T18:52:30.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~56s 2023-10-16T18:52:30.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~56s 2023-10-16T18:52:30.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~50s 2023-10-16T18:52:30.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~56s 2023-10-16T18:52:35.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~55s 2023-10-16T18:52:35.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~55s 2023-10-16T18:52:35.076 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~55s 2023-10-16T18:52:35.076 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~55s 2023-10-16T18:52:35.076 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~55s 2023-10-16T18:52:35.076 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~55s 2023-10-16T18:52:35.076 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~55s 2023-10-16T18:52:35.076 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~55s 2023-10-16T18:52:35.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~55s 2023-10-16T18:52:35.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~55s 2023-10-16T18:52:35.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~55s 2023-10-16T18:52:35.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~55s 2023-10-16T18:52:35.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~55s 2023-10-16T18:52:35.078 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~61s 2023-10-16T18:52:35.078 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~61s 2023-10-16T18:52:35.078 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~55s 2023-10-16T18:52:35.078 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~61s 2023-10-16T18:52:40.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~60s 2023-10-16T18:52:40.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~60s 2023-10-16T18:52:40.081 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~60s 2023-10-16T18:52:40.081 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~60s 2023-10-16T18:52:40.081 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~60s 2023-10-16T18:52:40.081 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~60s 2023-10-16T18:52:40.081 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~60s 2023-10-16T18:52:40.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~60s 2023-10-16T18:52:40.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~60s 2023-10-16T18:52:40.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~60s 2023-10-16T18:52:40.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~60s 2023-10-16T18:52:40.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~60s 2023-10-16T18:52:40.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~60s 2023-10-16T18:52:40.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~66s 2023-10-16T18:52:40.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~66s 2023-10-16T18:52:40.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~60s 2023-10-16T18:52:40.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~66s 2023-10-16T18:52:45.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~65s 2023-10-16T18:52:45.086 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~65s 2023-10-16T18:52:45.086 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~65s 2023-10-16T18:52:45.086 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~65s 2023-10-16T18:52:45.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~65s 2023-10-16T18:52:45.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~65s 2023-10-16T18:52:45.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~65s 2023-10-16T18:52:45.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~65s 2023-10-16T18:52:45.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~65s 2023-10-16T18:52:45.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~65s 2023-10-16T18:52:45.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~65s 2023-10-16T18:52:45.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~65s 2023-10-16T18:52:45.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~65s 2023-10-16T18:52:45.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~71s 2023-10-16T18:52:45.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~71s 2023-10-16T18:52:45.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~65s 2023-10-16T18:52:45.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~71s 2023-10-16T18:52:50.090 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~70s 2023-10-16T18:52:50.091 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~70s 2023-10-16T18:52:50.091 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~70s 2023-10-16T18:52:50.091 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~70s 2023-10-16T18:52:50.091 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~70s 2023-10-16T18:52:50.091 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~70s 2023-10-16T18:52:50.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~70s 2023-10-16T18:52:50.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~70s 2023-10-16T18:52:50.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~70s 2023-10-16T18:52:50.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~70s 2023-10-16T18:52:50.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~70s 2023-10-16T18:52:50.093 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~70s 2023-10-16T18:52:50.093 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~70s 2023-10-16T18:52:50.093 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~76s 2023-10-16T18:52:50.093 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~76s 2023-10-16T18:52:50.093 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~70s 2023-10-16T18:52:50.093 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~76s 2023-10-16T18:52:55.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~75s 2023-10-16T18:52:55.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~75s 2023-10-16T18:52:55.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~75s 2023-10-16T18:52:55.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~75s 2023-10-16T18:52:55.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~75s 2023-10-16T18:52:55.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~75s 2023-10-16T18:52:55.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~75s 2023-10-16T18:52:55.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~75s 2023-10-16T18:52:55.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~75s 2023-10-16T18:52:55.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~75s 2023-10-16T18:52:55.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~75s 2023-10-16T18:52:55.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~75s 2023-10-16T18:52:55.098 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~75s 2023-10-16T18:52:55.098 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~81s 2023-10-16T18:52:55.098 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~81s 2023-10-16T18:52:55.098 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~75s 2023-10-16T18:52:55.098 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~81s 2023-10-16T18:53:00.100 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~80s 2023-10-16T18:53:00.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~80s 2023-10-16T18:53:00.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~80s 2023-10-16T18:53:00.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~80s 2023-10-16T18:53:00.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~80s 2023-10-16T18:53:00.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~80s 2023-10-16T18:53:00.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~80s 2023-10-16T18:53:00.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~80s 2023-10-16T18:53:00.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~80s 2023-10-16T18:53:00.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~80s 2023-10-16T18:53:00.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~80s 2023-10-16T18:53:00.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~80s 2023-10-16T18:53:00.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~80s 2023-10-16T18:53:00.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~86s 2023-10-16T18:53:00.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~86s 2023-10-16T18:53:00.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~80s 2023-10-16T18:53:00.104 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~86s 2023-10-16T18:53:05.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~85s 2023-10-16T18:53:05.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~85s 2023-10-16T18:53:05.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~85s 2023-10-16T18:53:05.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~85s 2023-10-16T18:53:05.106 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~85s 2023-10-16T18:53:05.106 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~85s 2023-10-16T18:53:05.106 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~85s 2023-10-16T18:53:05.106 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~85s 2023-10-16T18:53:05.106 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~85s 2023-10-16T18:53:05.107 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~85s 2023-10-16T18:53:05.107 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~85s 2023-10-16T18:53:05.107 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~85s 2023-10-16T18:53:05.107 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~85s 2023-10-16T18:53:05.107 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~91s 2023-10-16T18:53:05.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~91s 2023-10-16T18:53:05.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~85s 2023-10-16T18:53:05.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~91s 2023-10-16T18:53:10.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~90s 2023-10-16T18:53:10.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~90s 2023-10-16T18:53:10.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~90s 2023-10-16T18:53:10.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~90s 2023-10-16T18:53:10.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~90s 2023-10-16T18:53:10.111 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~90s 2023-10-16T18:53:10.111 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~90s 2023-10-16T18:53:10.111 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~90s 2023-10-16T18:53:10.111 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~90s 2023-10-16T18:53:10.111 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~90s 2023-10-16T18:53:10.111 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~90s 2023-10-16T18:53:10.112 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~90s 2023-10-16T18:53:10.112 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~90s 2023-10-16T18:53:10.112 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~97s 2023-10-16T18:53:10.112 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~97s 2023-10-16T18:53:10.112 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~90s 2023-10-16T18:53:10.112 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~97s 2023-10-16T18:53:15.113 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~95s 2023-10-16T18:53:15.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~95s 2023-10-16T18:53:15.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~95s 2023-10-16T18:53:15.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~95s 2023-10-16T18:53:15.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~95s 2023-10-16T18:53:15.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~95s 2023-10-16T18:53:15.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~95s 2023-10-16T18:53:15.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~95s 2023-10-16T18:53:15.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~95s 2023-10-16T18:53:15.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~95s 2023-10-16T18:53:15.116 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~95s 2023-10-16T18:53:15.116 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~95s 2023-10-16T18:53:15.116 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~95s 2023-10-16T18:53:15.116 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~102s 2023-10-16T18:53:15.116 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~102s 2023-10-16T18:53:15.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~95s 2023-10-16T18:53:15.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~102s 2023-10-16T18:53:20.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~100s 2023-10-16T18:53:20.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~100s 2023-10-16T18:53:20.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~100s 2023-10-16T18:53:20.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~100s 2023-10-16T18:53:20.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~100s 2023-10-16T18:53:20.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~100s 2023-10-16T18:53:20.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~100s 2023-10-16T18:53:20.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~100s 2023-10-16T18:53:20.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~100s 2023-10-16T18:53:20.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~100s 2023-10-16T18:53:20.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~100s 2023-10-16T18:53:20.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~100s 2023-10-16T18:53:20.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~100s 2023-10-16T18:53:20.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~107s 2023-10-16T18:53:20.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~107s 2023-10-16T18:53:20.122 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~100s 2023-10-16T18:53:20.122 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~107s 2023-10-16T18:53:25.124 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~105s 2023-10-16T18:53:25.124 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~105s 2023-10-16T18:53:25.124 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~105s 2023-10-16T18:53:25.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~105s 2023-10-16T18:53:25.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~105s 2023-10-16T18:53:25.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~105s 2023-10-16T18:53:25.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~105s 2023-10-16T18:53:25.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~105s 2023-10-16T18:53:25.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~105s 2023-10-16T18:53:25.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~105s 2023-10-16T18:53:25.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~105s 2023-10-16T18:53:25.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~105s 2023-10-16T18:53:25.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~105s 2023-10-16T18:53:25.127 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~112s 2023-10-16T18:53:25.127 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~112s 2023-10-16T18:53:25.127 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~105s 2023-10-16T18:53:25.127 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~112s 2023-10-16T18:53:30.128 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~110s 2023-10-16T18:53:30.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~110s 2023-10-16T18:53:30.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~110s 2023-10-16T18:53:30.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~110s 2023-10-16T18:53:30.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~110s 2023-10-16T18:53:30.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~110s 2023-10-16T18:53:30.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~110s 2023-10-16T18:53:30.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~110s 2023-10-16T18:53:30.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~110s 2023-10-16T18:53:30.131 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~110s 2023-10-16T18:53:30.131 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~110s 2023-10-16T18:53:30.131 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~110s 2023-10-16T18:53:30.131 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~110s 2023-10-16T18:53:30.131 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~117s 2023-10-16T18:53:30.132 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~117s 2023-10-16T18:53:30.132 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~110s 2023-10-16T18:53:30.132 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~117s 2023-10-16T18:53:35.134 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~115s 2023-10-16T18:53:35.134 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~115s 2023-10-16T18:53:35.134 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~115s 2023-10-16T18:53:35.134 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~115s 2023-10-16T18:53:35.135 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~115s 2023-10-16T18:53:35.135 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~115s 2023-10-16T18:53:35.135 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~115s 2023-10-16T18:53:35.135 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~115s 2023-10-16T18:53:35.135 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~115s 2023-10-16T18:53:35.135 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~115s 2023-10-16T18:53:35.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~115s 2023-10-16T18:53:35.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~115s 2023-10-16T18:53:35.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~115s 2023-10-16T18:53:35.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~122s 2023-10-16T18:53:35.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~122s 2023-10-16T18:53:35.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~115s 2023-10-16T18:53:35.137 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~122s 2023-10-16T18:53:40.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~120s 2023-10-16T18:53:40.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~120s 2023-10-16T18:53:40.139 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~120s 2023-10-16T18:53:40.139 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~120s 2023-10-16T18:53:40.139 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~120s 2023-10-16T18:53:40.139 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~120s 2023-10-16T18:53:40.140 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~120s 2023-10-16T18:53:40.140 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~120s 2023-10-16T18:53:40.140 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~120s 2023-10-16T18:53:40.140 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~120s 2023-10-16T18:53:40.141 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~120s 2023-10-16T18:53:40.141 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~120s 2023-10-16T18:53:40.141 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~120s 2023-10-16T18:53:40.141 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~127s 2023-10-16T18:53:40.141 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~127s 2023-10-16T18:53:40.142 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~120s 2023-10-16T18:53:40.142 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~127s 2023-10-16T18:53:45.143 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~125s 2023-10-16T18:53:45.144 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~125s 2023-10-16T18:53:45.144 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~125s 2023-10-16T18:53:45.144 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~125s 2023-10-16T18:53:45.144 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~125s 2023-10-16T18:53:45.144 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~125s 2023-10-16T18:53:45.145 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~125s 2023-10-16T18:53:45.145 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~125s 2023-10-16T18:53:45.145 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~125s 2023-10-16T18:53:45.145 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~125s 2023-10-16T18:53:45.145 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~125s 2023-10-16T18:53:45.145 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~125s 2023-10-16T18:53:45.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~125s 2023-10-16T18:53:45.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~132s 2023-10-16T18:53:45.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~132s 2023-10-16T18:53:45.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~125s 2023-10-16T18:53:45.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~132s 2023-10-16T18:53:50.148 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~130s 2023-10-16T18:53:50.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~130s 2023-10-16T18:53:50.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~130s 2023-10-16T18:53:50.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~130s 2023-10-16T18:53:50.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~130s 2023-10-16T18:53:50.150 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~130s 2023-10-16T18:53:50.150 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~130s 2023-10-16T18:53:50.150 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~130s 2023-10-16T18:53:50.150 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~130s 2023-10-16T18:53:50.150 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~130s 2023-10-16T18:53:50.151 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~130s 2023-10-16T18:53:50.151 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~130s 2023-10-16T18:53:50.151 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~130s 2023-10-16T18:53:50.151 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~137s 2023-10-16T18:53:50.152 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~137s 2023-10-16T18:53:50.152 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~130s 2023-10-16T18:53:50.152 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~137s 2023-10-16T18:53:55.153 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~135s 2023-10-16T18:53:55.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~135s 2023-10-16T18:53:55.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~135s 2023-10-16T18:53:55.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~135s 2023-10-16T18:53:55.155 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~135s 2023-10-16T18:53:55.155 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~135s 2023-10-16T18:53:55.155 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~135s 2023-10-16T18:53:55.155 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~135s 2023-10-16T18:53:55.155 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~135s 2023-10-16T18:53:55.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~135s 2023-10-16T18:53:55.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~135s 2023-10-16T18:53:55.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~135s 2023-10-16T18:53:55.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~135s 2023-10-16T18:53:55.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~142s 2023-10-16T18:53:55.157 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~142s 2023-10-16T18:53:55.157 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~135s 2023-10-16T18:53:55.157 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~142s 2023-10-16T18:54:00.158 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~140s 2023-10-16T18:54:00.159 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~140s 2023-10-16T18:54:00.159 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~140s 2023-10-16T18:54:00.159 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~140s 2023-10-16T18:54:00.159 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~140s 2023-10-16T18:54:00.159 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~140s 2023-10-16T18:54:00.160 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~140s 2023-10-16T18:54:00.160 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~140s 2023-10-16T18:54:00.160 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~140s 2023-10-16T18:54:00.160 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~140s 2023-10-16T18:54:00.161 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~140s 2023-10-16T18:54:00.161 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~140s 2023-10-16T18:54:00.161 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~140s 2023-10-16T18:54:00.161 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~147s 2023-10-16T18:54:00.161 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~147s 2023-10-16T18:54:00.161 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~140s 2023-10-16T18:54:00.162 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~147s 2023-10-16T18:54:05.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~145s 2023-10-16T18:54:05.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~145s 2023-10-16T18:54:05.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~145s 2023-10-16T18:54:05.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~145s 2023-10-16T18:54:05.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~145s 2023-10-16T18:54:05.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~145s 2023-10-16T18:54:05.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~145s 2023-10-16T18:54:05.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~145s 2023-10-16T18:54:05.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~145s 2023-10-16T18:54:05.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~145s 2023-10-16T18:54:05.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~145s 2023-10-16T18:54:05.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~145s 2023-10-16T18:54:05.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~145s 2023-10-16T18:54:05.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~152s 2023-10-16T18:54:05.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~152s 2023-10-16T18:54:05.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~145s 2023-10-16T18:54:05.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~152s 2023-10-16T18:54:10.168 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~150s 2023-10-16T18:54:10.168 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~150s 2023-10-16T18:54:10.168 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~150s 2023-10-16T18:54:10.169 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~150s 2023-10-16T18:54:10.169 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~150s 2023-10-16T18:54:10.169 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~150s 2023-10-16T18:54:10.169 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~150s 2023-10-16T18:54:10.169 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~150s 2023-10-16T18:54:10.170 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~150s 2023-10-16T18:54:10.170 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~150s 2023-10-16T18:54:10.170 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~150s 2023-10-16T18:54:10.170 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~150s 2023-10-16T18:54:10.170 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~150s 2023-10-16T18:54:10.171 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~157s 2023-10-16T18:54:10.171 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~157s 2023-10-16T18:54:10.171 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~150s 2023-10-16T18:54:10.171 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~157s 2023-10-16T18:54:15.173 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~155s 2023-10-16T18:54:15.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~155s 2023-10-16T18:54:15.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~155s 2023-10-16T18:54:15.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~155s 2023-10-16T18:54:15.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~155s 2023-10-16T18:54:15.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~155s 2023-10-16T18:54:15.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~155s 2023-10-16T18:54:15.176 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~155s 2023-10-16T18:54:15.176 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~155s 2023-10-16T18:54:15.176 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~155s 2023-10-16T18:54:15.177 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~155s 2023-10-16T18:54:15.177 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~155s 2023-10-16T18:54:15.178 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~155s 2023-10-16T18:54:15.178 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~162s 2023-10-16T18:54:15.178 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~162s 2023-10-16T18:54:15.179 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~155s 2023-10-16T18:54:15.179 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~162s 2023-10-16T18:54:20.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~160s 2023-10-16T18:54:20.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~160s 2023-10-16T18:54:20.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~160s 2023-10-16T18:54:20.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~160s 2023-10-16T18:54:20.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~160s 2023-10-16T18:54:20.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~160s 2023-10-16T18:54:20.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~160s 2023-10-16T18:54:20.183 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~160s 2023-10-16T18:54:20.183 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~160s 2023-10-16T18:54:20.183 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~160s 2023-10-16T18:54:20.183 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~160s 2023-10-16T18:54:20.183 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~160s 2023-10-16T18:54:20.184 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~160s 2023-10-16T18:54:20.184 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~167s 2023-10-16T18:54:20.184 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~167s 2023-10-16T18:54:20.184 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~160s 2023-10-16T18:54:20.184 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~167s 2023-10-16T18:54:25.186 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~165s 2023-10-16T18:54:25.186 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~165s 2023-10-16T18:54:25.186 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~165s 2023-10-16T18:54:25.187 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~165s 2023-10-16T18:54:25.187 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~165s 2023-10-16T18:54:25.187 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~165s 2023-10-16T18:54:25.187 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~165s 2023-10-16T18:54:25.187 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~165s 2023-10-16T18:54:25.187 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~165s 2023-10-16T18:54:25.188 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~165s 2023-10-16T18:54:25.188 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~165s 2023-10-16T18:54:25.188 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~165s 2023-10-16T18:54:25.188 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~165s 2023-10-16T18:54:25.188 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~172s 2023-10-16T18:54:25.188 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~172s 2023-10-16T18:54:25.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~165s 2023-10-16T18:54:25.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~172s 2023-10-16T18:54:30.190 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~170s 2023-10-16T18:54:30.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~170s 2023-10-16T18:54:30.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~170s 2023-10-16T18:54:30.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~170s 2023-10-16T18:54:30.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~170s 2023-10-16T18:54:30.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~170s 2023-10-16T18:54:30.192 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~170s 2023-10-16T18:54:30.192 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~170s 2023-10-16T18:54:30.192 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~170s 2023-10-16T18:54:30.192 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~170s 2023-10-16T18:54:30.192 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~170s 2023-10-16T18:54:30.193 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~170s 2023-10-16T18:54:30.193 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~170s 2023-10-16T18:54:30.193 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~177s 2023-10-16T18:54:30.193 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~177s 2023-10-16T18:54:30.193 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~170s 2023-10-16T18:54:30.194 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~177s 2023-10-16T18:54:35.195 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~175s 2023-10-16T18:54:35.195 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~175s 2023-10-16T18:54:35.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~175s 2023-10-16T18:54:35.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~175s 2023-10-16T18:54:35.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~175s 2023-10-16T18:54:35.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~175s 2023-10-16T18:54:35.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~175s 2023-10-16T18:54:35.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~175s 2023-10-16T18:54:35.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~175s 2023-10-16T18:54:35.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~175s 2023-10-16T18:54:35.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~175s 2023-10-16T18:54:35.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~175s 2023-10-16T18:54:35.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~175s 2023-10-16T18:54:35.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~182s 2023-10-16T18:54:35.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~182s 2023-10-16T18:54:35.199 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~175s 2023-10-16T18:54:35.199 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~182s 2023-10-16T18:54:40.200 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~180s 2023-10-16T18:54:40.201 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~180s 2023-10-16T18:54:40.201 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~180s 2023-10-16T18:54:40.201 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~180s 2023-10-16T18:54:40.201 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~180s 2023-10-16T18:54:40.202 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~180s 2023-10-16T18:54:40.202 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~180s 2023-10-16T18:54:40.202 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~180s 2023-10-16T18:54:40.202 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~180s 2023-10-16T18:54:40.202 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~180s 2023-10-16T18:54:40.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~180s 2023-10-16T18:54:40.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~180s 2023-10-16T18:54:40.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~180s 2023-10-16T18:54:40.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~187s 2023-10-16T18:54:40.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~187s 2023-10-16T18:54:40.204 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~180s 2023-10-16T18:54:40.204 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~187s 2023-10-16T18:54:45.205 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~185s 2023-10-16T18:54:45.206 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~185s 2023-10-16T18:54:45.206 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~185s 2023-10-16T18:54:45.207 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~185s 2023-10-16T18:54:45.207 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~185s 2023-10-16T18:54:45.207 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~185s 2023-10-16T18:54:45.207 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~185s 2023-10-16T18:54:45.207 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~185s 2023-10-16T18:54:45.208 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~185s 2023-10-16T18:54:45.208 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~185s 2023-10-16T18:54:45.208 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~185s 2023-10-16T18:54:45.208 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~185s 2023-10-16T18:54:45.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~185s 2023-10-16T18:54:45.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~192s 2023-10-16T18:54:45.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~192s 2023-10-16T18:54:45.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~185s 2023-10-16T18:54:45.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~192s 2023-10-16T18:54:50.211 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~190s 2023-10-16T18:54:50.211 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~190s 2023-10-16T18:54:50.211 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~190s 2023-10-16T18:54:50.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~190s 2023-10-16T18:54:50.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~190s 2023-10-16T18:54:50.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~190s 2023-10-16T18:54:50.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~190s 2023-10-16T18:54:50.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~190s 2023-10-16T18:54:50.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~190s 2023-10-16T18:54:50.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~190s 2023-10-16T18:54:50.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~190s 2023-10-16T18:54:50.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~190s 2023-10-16T18:54:50.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~190s 2023-10-16T18:54:50.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~197s 2023-10-16T18:54:50.214 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~197s 2023-10-16T18:54:50.214 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~190s 2023-10-16T18:54:50.214 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~197s 2023-10-16T18:54:55.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~195s 2023-10-16T18:54:55.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~195s 2023-10-16T18:54:55.217 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~195s 2023-10-16T18:54:55.217 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~195s 2023-10-16T18:54:55.217 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~195s 2023-10-16T18:54:55.217 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~195s 2023-10-16T18:54:55.217 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~195s 2023-10-16T18:54:55.218 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~195s 2023-10-16T18:54:55.218 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~195s 2023-10-16T18:54:55.218 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~195s 2023-10-16T18:54:55.218 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~195s 2023-10-16T18:54:55.218 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~195s 2023-10-16T18:54:55.219 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~195s 2023-10-16T18:54:55.219 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~202s 2023-10-16T18:54:55.219 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~202s 2023-10-16T18:54:55.219 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~195s 2023-10-16T18:54:55.219 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~202s 2023-10-16T18:55:00.220 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~200s 2023-10-16T18:55:00.221 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~200s 2023-10-16T18:55:00.221 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~200s 2023-10-16T18:55:00.221 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~200s 2023-10-16T18:55:00.222 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~200s 2023-10-16T18:55:00.222 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~200s 2023-10-16T18:55:00.222 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~200s 2023-10-16T18:55:00.222 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~200s 2023-10-16T18:55:00.222 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~200s 2023-10-16T18:55:00.223 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~200s 2023-10-16T18:55:00.223 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~200s 2023-10-16T18:55:00.223 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~200s 2023-10-16T18:55:00.223 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~200s 2023-10-16T18:55:00.223 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~207s 2023-10-16T18:55:00.224 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~207s 2023-10-16T18:55:00.224 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~200s 2023-10-16T18:55:00.224 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~207s 2023-10-16T18:55:05.226 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~205s 2023-10-16T18:55:05.226 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~205s 2023-10-16T18:55:05.227 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~205s 2023-10-16T18:55:05.227 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~205s 2023-10-16T18:55:05.227 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~205s 2023-10-16T18:55:05.227 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~205s 2023-10-16T18:55:05.227 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~205s 2023-10-16T18:55:05.228 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~205s 2023-10-16T18:55:05.228 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~205s 2023-10-16T18:55:05.228 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~205s 2023-10-16T18:55:05.228 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~205s 2023-10-16T18:55:05.228 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~205s 2023-10-16T18:55:05.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~205s 2023-10-16T18:55:05.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~212s 2023-10-16T18:55:05.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~212s 2023-10-16T18:55:05.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~205s 2023-10-16T18:55:05.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~212s 2023-10-16T18:55:10.230 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~210s 2023-10-16T18:55:10.231 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~210s 2023-10-16T18:55:10.231 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~210s 2023-10-16T18:55:10.231 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~210s 2023-10-16T18:55:10.231 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~210s 2023-10-16T18:55:10.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~210s 2023-10-16T18:55:10.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~210s 2023-10-16T18:55:10.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~210s 2023-10-16T18:55:10.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~210s 2023-10-16T18:55:10.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~210s 2023-10-16T18:55:10.233 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~210s 2023-10-16T18:55:10.233 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~210s 2023-10-16T18:55:10.233 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~210s 2023-10-16T18:55:10.233 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~217s 2023-10-16T18:55:10.233 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~217s 2023-10-16T18:55:10.234 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~210s 2023-10-16T18:55:10.234 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~217s 2023-10-16T18:55:10.463 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-10-16T18:55:10.465 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T18:55:10.466 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-16T18:55:10.466 INFO:tasks.cephfs.xfstests_dev:Command return value: -1 2023-10-16T18:55:10.467 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... ERROR 2023-10-16T18:55:10.468 INFO:tasks.cephfs_test_runner:ERROR 2023-10-16T18:55:10.468 INFO:tasks.cephfs_test_runner: 2023-10-16T18:55:10.469 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-16T18:55:10.469 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T18:55:10.470 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T18:55:10.470 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T18:55:10.470 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 436, in run 2023-10-16T18:55:10.470 INFO:tasks.cephfs_test_runner: (host, port) = transport.getpeername()[0:2] 2023-10-16T18:55:10.471 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1842, in getpeername 2023-10-16T18:55:10.471 INFO:tasks.cephfs_test_runner: return gp() 2023-10-16T18:55:10.471 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 560, in getpeername 2023-10-16T18:55:10.472 INFO:tasks.cephfs_test_runner: return self._sock.getpeername() 2023-10-16T18:55:10.472 INFO:tasks.cephfs_test_runner:OSError: [Errno 107] Transport endpoint is not connected 2023-10-16T18:55:10.472 INFO:tasks.cephfs_test_runner: 2023-10-16T18:55:10.472 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2023-10-16T18:55:10.473 INFO:tasks.cephfs_test_runner: 2023-10-16T18:55:10.473 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T18:55:10.473 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-10-16T18:55:10.473 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-10-16T18:55:10.474 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-10-16T18:55:10.474 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-10-16T18:55:10.474 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 373, in run_testdir 2023-10-16T18:55:10.475 INFO:tasks.cephfs_test_runner: self.run_testfile(testdir, testfile) 2023-10-16T18:55:10.475 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 363, in run_testfile 2023-10-16T18:55:10.475 INFO:tasks.cephfs_test_runner: return self.run_test(f'{testdir}/{testfile}', exit_on_err) 2023-10-16T18:55:10.475 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 337, in run_test 2023-10-16T18:55:10.476 INFO:tasks.cephfs_test_runner: p = self.mount_a.run_shell(args=cmd, cwd=self.xfstests_repo_path, 2023-10-16T18:55:10.476 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-10-16T18:55:10.476 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-10-16T18:55:10.476 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-16T18:55:10.477 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-16T18:55:10.477 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 440, in run 2023-10-16T18:55:10.477 INFO:tasks.cephfs_test_runner: raise ConnectionLostError(command=quote(args), node=name) 2023-10-16T18:55:10.478 INFO:tasks.cephfs_test_runner:teuthology.exceptions.ConnectionLostError: SSH connection to smithi059 was lost: 'sudo env DIFF_LENGTH=0 ./check generic/523' 2023-10-16T18:55:10.478 INFO:tasks.cephfs_test_runner: 2023-10-16T18:55:10.478 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-16T18:55:10.478 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T18:55:10.479 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T18:55:10.479 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T18:55:10.479 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 436, in run 2023-10-16T18:55:10.479 INFO:tasks.cephfs_test_runner: (host, port) = transport.getpeername()[0:2] 2023-10-16T18:55:10.479 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1842, in getpeername 2023-10-16T18:55:10.480 INFO:tasks.cephfs_test_runner: return gp() 2023-10-16T18:55:10.480 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 560, in getpeername 2023-10-16T18:55:10.480 INFO:tasks.cephfs_test_runner: return self._sock.getpeername() 2023-10-16T18:55:10.480 INFO:tasks.cephfs_test_runner:OSError: [Errno 107] Transport endpoint is not connected 2023-10-16T18:55:10.481 INFO:tasks.cephfs_test_runner: 2023-10-16T18:55:10.481 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2023-10-16T18:55:10.481 INFO:tasks.cephfs_test_runner: 2023-10-16T18:55:10.481 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T18:55:10.481 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 51, in tearDown 2023-10-16T18:55:10.482 INFO:tasks.cephfs_test_runner: self.del_users_and_groups() 2023-10-16T18:55:10.482 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 56, in del_users_and_groups 2023-10-16T18:55:10.482 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=['sudo', 'userdel', '--force', 2023-10-16T18:55:10.482 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-16T18:55:10.483 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-16T18:55:10.483 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 440, in run 2023-10-16T18:55:10.483 INFO:tasks.cephfs_test_runner: raise ConnectionLostError(command=quote(args), node=name) 2023-10-16T18:55:10.483 INFO:tasks.cephfs_test_runner:teuthology.exceptions.ConnectionLostError: SSH connection to smithi059 was lost: 'sudo userdel --force --remove fsgqa' 2023-10-16T18:55:10.484 INFO:tasks.cephfs_test_runner: 2023-10-16T18:55:10.484 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T18:55:10.484 INFO:tasks.cephfs_test_runner:Ran 1 test in 16104.099s 2023-10-16T18:55:10.484 INFO:tasks.cephfs_test_runner: 2023-10-16T18:55:10.485 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2023-10-16T18:55:10.485 INFO:tasks.cephfs_test_runner: 2023-10-16T18:55:10.485 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-16T18:55:10.485 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T18:55:10.486 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T18:55:10.486 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T18:55:10.486 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 436, in run 2023-10-16T18:55:10.486 INFO:tasks.cephfs_test_runner: (host, port) = transport.getpeername()[0:2] 2023-10-16T18:55:10.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1842, in getpeername 2023-10-16T18:55:10.487 INFO:tasks.cephfs_test_runner: return gp() 2023-10-16T18:55:10.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 560, in getpeername 2023-10-16T18:55:10.487 INFO:tasks.cephfs_test_runner: return self._sock.getpeername() 2023-10-16T18:55:10.488 INFO:tasks.cephfs_test_runner:OSError: [Errno 107] Transport endpoint is not connected 2023-10-16T18:55:10.488 INFO:tasks.cephfs_test_runner: 2023-10-16T18:55:10.488 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2023-10-16T18:55:10.488 INFO:tasks.cephfs_test_runner: 2023-10-16T18:55:10.489 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T18:55:10.489 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-10-16T18:55:10.489 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-10-16T18:55:10.489 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-10-16T18:55:10.490 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-10-16T18:55:10.490 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 373, in run_testdir 2023-10-16T18:55:10.490 INFO:tasks.cephfs_test_runner: self.run_testfile(testdir, testfile) 2023-10-16T18:55:10.490 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 363, in run_testfile 2023-10-16T18:55:10.490 INFO:tasks.cephfs_test_runner: return self.run_test(f'{testdir}/{testfile}', exit_on_err) 2023-10-16T18:55:10.491 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 337, in run_test 2023-10-16T18:55:10.491 INFO:tasks.cephfs_test_runner: p = self.mount_a.run_shell(args=cmd, cwd=self.xfstests_repo_path, 2023-10-16T18:55:10.491 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-10-16T18:55:10.491 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-10-16T18:55:10.492 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-16T18:55:10.492 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-16T18:55:10.492 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 440, in run 2023-10-16T18:55:10.492 INFO:tasks.cephfs_test_runner: raise ConnectionLostError(command=quote(args), node=name) 2023-10-16T18:55:10.493 INFO:tasks.cephfs_test_runner:teuthology.exceptions.ConnectionLostError: SSH connection to smithi059 was lost: 'sudo env DIFF_LENGTH=0 ./check generic/523' 2023-10-16T18:55:10.493 INFO:tasks.cephfs_test_runner: 2023-10-16T18:55:10.493 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-16T18:55:10.493 INFO:tasks.cephfs_test_runner:ERROR: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T18:55:10.494 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-16T18:55:10.494 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T18:55:10.494 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 436, in run 2023-10-16T18:55:10.494 INFO:tasks.cephfs_test_runner: (host, port) = transport.getpeername()[0:2] 2023-10-16T18:55:10.495 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1842, in getpeername 2023-10-16T18:55:10.495 INFO:tasks.cephfs_test_runner: return gp() 2023-10-16T18:55:10.495 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 560, in getpeername 2023-10-16T18:55:10.495 INFO:tasks.cephfs_test_runner: return self._sock.getpeername() 2023-10-16T18:55:10.495 INFO:tasks.cephfs_test_runner:OSError: [Errno 107] Transport endpoint is not connected 2023-10-16T18:55:10.496 INFO:tasks.cephfs_test_runner: 2023-10-16T18:55:10.496 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2023-10-16T18:55:10.496 INFO:tasks.cephfs_test_runner: 2023-10-16T18:55:10.496 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-16T18:55:10.497 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 51, in tearDown 2023-10-16T18:55:10.497 INFO:tasks.cephfs_test_runner: self.del_users_and_groups() 2023-10-16T18:55:10.497 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs/xfstests_dev.py", line 56, in del_users_and_groups 2023-10-16T18:55:10.497 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=['sudo', 'userdel', '--force', 2023-10-16T18:55:10.497 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run 2023-10-16T18:55:10.498 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-16T18:55:10.498 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 440, in run 2023-10-16T18:55:10.498 INFO:tasks.cephfs_test_runner: raise ConnectionLostError(command=quote(args), node=name) 2023-10-16T18:55:10.498 INFO:tasks.cephfs_test_runner:teuthology.exceptions.ConnectionLostError: SSH connection to smithi059 was lost: 'sudo userdel --force --remove fsgqa' 2023-10-16T18:55:10.499 INFO:tasks.cephfs_test_runner: 2023-10-16T18:55:10.499 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev), test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T18:55:10.569 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=e9aaee682b5543988c636aaee41b7e8d Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev), test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-16T18:55:10.571 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-16T18:55:10.582 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-16T18:55:10.637 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-16T18:55:10.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-16T18:55:10.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:55:10.642 DEBUG:tasks.ceph:Missed logrotate, host unreachable 2023-10-16T18:55:10.935 ERROR:teuthology.orchestra.connection:Error authenticating with smithi059.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-16T18:55:15.236 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~215s 2023-10-16T18:55:15.236 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~215s 2023-10-16T18:55:15.237 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~215s 2023-10-16T18:55:15.237 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~215s 2023-10-16T18:55:15.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~215s 2023-10-16T18:55:15.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~215s 2023-10-16T18:55:15.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~215s 2023-10-16T18:55:15.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~215s 2023-10-16T18:55:15.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~215s 2023-10-16T18:55:15.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~215s 2023-10-16T18:55:15.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~215s 2023-10-16T18:55:15.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~215s 2023-10-16T18:55:15.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~215s 2023-10-16T18:55:15.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~222s 2023-10-16T18:55:15.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~222s 2023-10-16T18:55:15.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~215s 2023-10-16T18:55:15.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~222s 2023-10-16T18:55:20.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~220s 2023-10-16T18:55:20.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~220s 2023-10-16T18:55:20.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~220s 2023-10-16T18:55:20.244 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~220s 2023-10-16T18:55:20.244 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~220s 2023-10-16T18:55:20.244 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~220s 2023-10-16T18:55:20.244 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~220s 2023-10-16T18:55:20.245 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~220s 2023-10-16T18:55:20.245 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~220s 2023-10-16T18:55:20.245 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~220s 2023-10-16T18:55:20.245 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~220s 2023-10-16T18:55:20.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~220s 2023-10-16T18:55:20.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~220s 2023-10-16T18:55:20.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~227s 2023-10-16T18:55:20.247 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~227s 2023-10-16T18:55:20.247 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~220s 2023-10-16T18:55:20.247 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~227s 2023-10-16T18:55:25.248 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~225s 2023-10-16T18:55:25.249 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~225s 2023-10-16T18:55:25.249 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~225s 2023-10-16T18:55:25.250 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~225s 2023-10-16T18:55:25.250 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~225s 2023-10-16T18:55:25.250 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~225s 2023-10-16T18:55:25.250 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~225s 2023-10-16T18:55:25.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~225s 2023-10-16T18:55:25.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~225s 2023-10-16T18:55:25.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~225s 2023-10-16T18:55:25.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~225s 2023-10-16T18:55:25.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~225s 2023-10-16T18:55:25.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~225s 2023-10-16T18:55:25.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~232s 2023-10-16T18:55:25.253 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~232s 2023-10-16T18:55:25.253 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~225s 2023-10-16T18:55:25.253 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~232s 2023-10-16T18:55:30.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~230s 2023-10-16T18:55:30.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~230s 2023-10-16T18:55:30.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~230s 2023-10-16T18:55:30.256 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~230s 2023-10-16T18:55:30.256 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~230s 2023-10-16T18:55:30.256 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~230s 2023-10-16T18:55:30.256 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~230s 2023-10-16T18:55:30.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~230s 2023-10-16T18:55:30.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~230s 2023-10-16T18:55:30.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~230s 2023-10-16T18:55:30.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~230s 2023-10-16T18:55:30.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~230s 2023-10-16T18:55:30.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~230s 2023-10-16T18:55:30.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~237s 2023-10-16T18:55:30.259 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~237s 2023-10-16T18:55:30.259 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~230s 2023-10-16T18:55:30.259 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~237s 2023-10-16T18:55:35.261 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~235s 2023-10-16T18:55:35.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~235s 2023-10-16T18:55:35.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~235s 2023-10-16T18:55:35.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~235s 2023-10-16T18:55:35.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~235s 2023-10-16T18:55:35.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~235s 2023-10-16T18:55:35.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~235s 2023-10-16T18:55:35.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~235s 2023-10-16T18:55:35.264 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~235s 2023-10-16T18:55:35.264 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~235s 2023-10-16T18:55:35.264 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~235s 2023-10-16T18:55:35.265 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~235s 2023-10-16T18:55:35.265 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~235s 2023-10-16T18:55:35.265 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~242s 2023-10-16T18:55:35.265 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~242s 2023-10-16T18:55:35.266 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~235s 2023-10-16T18:55:35.266 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~242s 2023-10-16T18:55:40.268 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~240s 2023-10-16T18:55:40.269 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~240s 2023-10-16T18:55:40.269 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~240s 2023-10-16T18:55:40.270 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~240s 2023-10-16T18:55:40.270 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~240s 2023-10-16T18:55:40.271 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~240s 2023-10-16T18:55:40.271 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~240s 2023-10-16T18:55:40.272 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~240s 2023-10-16T18:55:40.272 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~240s 2023-10-16T18:55:40.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~240s 2023-10-16T18:55:40.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~240s 2023-10-16T18:55:40.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~240s 2023-10-16T18:55:40.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~240s 2023-10-16T18:55:40.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~247s 2023-10-16T18:55:40.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~247s 2023-10-16T18:55:40.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~240s 2023-10-16T18:55:40.275 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~247s 2023-10-16T18:55:40.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-16T18:55:40.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:55:45.276 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~245s 2023-10-16T18:55:45.276 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~245s 2023-10-16T18:55:45.276 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~245s 2023-10-16T18:55:45.277 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~245s 2023-10-16T18:55:45.277 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~245s 2023-10-16T18:55:45.277 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~245s 2023-10-16T18:55:45.278 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~245s 2023-10-16T18:55:45.278 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~245s 2023-10-16T18:55:45.278 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~245s 2023-10-16T18:55:45.278 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~245s 2023-10-16T18:55:45.279 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~245s 2023-10-16T18:55:45.279 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~245s 2023-10-16T18:55:45.279 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~245s 2023-10-16T18:55:45.280 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~252s 2023-10-16T18:55:45.280 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~252s 2023-10-16T18:55:45.280 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~245s 2023-10-16T18:55:45.281 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~252s 2023-10-16T18:55:50.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~250s 2023-10-16T18:55:50.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~250s 2023-10-16T18:55:50.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~250s 2023-10-16T18:55:50.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~250s 2023-10-16T18:55:50.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~250s 2023-10-16T18:55:50.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~250s 2023-10-16T18:55:50.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~250s 2023-10-16T18:55:50.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~250s 2023-10-16T18:55:50.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~250s 2023-10-16T18:55:50.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~250s 2023-10-16T18:55:50.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~250s 2023-10-16T18:55:50.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~250s 2023-10-16T18:55:50.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~250s 2023-10-16T18:55:50.286 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~257s 2023-10-16T18:55:50.286 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~257s 2023-10-16T18:55:50.286 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~250s 2023-10-16T18:55:50.287 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~257s 2023-10-16T18:55:55.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~255s 2023-10-16T18:55:55.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~255s 2023-10-16T18:55:55.289 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~255s 2023-10-16T18:55:55.289 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~255s 2023-10-16T18:55:55.289 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~255s 2023-10-16T18:55:55.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~255s 2023-10-16T18:55:55.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~255s 2023-10-16T18:55:55.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~255s 2023-10-16T18:55:55.291 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~255s 2023-10-16T18:55:55.291 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~255s 2023-10-16T18:55:55.291 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~255s 2023-10-16T18:55:55.291 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~255s 2023-10-16T18:55:55.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~255s 2023-10-16T18:55:55.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~262s 2023-10-16T18:55:55.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~262s 2023-10-16T18:55:55.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~255s 2023-10-16T18:55:55.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~262s 2023-10-16T18:56:00.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~260s 2023-10-16T18:56:00.295 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~260s 2023-10-16T18:56:00.295 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~260s 2023-10-16T18:56:00.295 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~260s 2023-10-16T18:56:00.295 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~260s 2023-10-16T18:56:00.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~260s 2023-10-16T18:56:00.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~260s 2023-10-16T18:56:00.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~260s 2023-10-16T18:56:00.297 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~260s 2023-10-16T18:56:00.297 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~260s 2023-10-16T18:56:00.297 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~260s 2023-10-16T18:56:00.297 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~260s 2023-10-16T18:56:00.298 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~260s 2023-10-16T18:56:00.298 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~267s 2023-10-16T18:56:00.298 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~267s 2023-10-16T18:56:00.298 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~260s 2023-10-16T18:56:00.299 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~267s 2023-10-16T18:56:05.300 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~265s 2023-10-16T18:56:05.301 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~265s 2023-10-16T18:56:05.301 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~265s 2023-10-16T18:56:05.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~265s 2023-10-16T18:56:05.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~265s 2023-10-16T18:56:05.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~265s 2023-10-16T18:56:05.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~265s 2023-10-16T18:56:05.303 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~265s 2023-10-16T18:56:05.303 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~265s 2023-10-16T18:56:05.303 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~265s 2023-10-16T18:56:05.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~265s 2023-10-16T18:56:05.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~265s 2023-10-16T18:56:05.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~265s 2023-10-16T18:56:05.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~272s 2023-10-16T18:56:05.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~272s 2023-10-16T18:56:05.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~265s 2023-10-16T18:56:05.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~272s 2023-10-16T18:56:10.307 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~270s 2023-10-16T18:56:10.308 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~270s 2023-10-16T18:56:10.308 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~270s 2023-10-16T18:56:10.308 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~270s 2023-10-16T18:56:10.308 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~270s 2023-10-16T18:56:10.309 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~270s 2023-10-16T18:56:10.309 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~270s 2023-10-16T18:56:10.309 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~270s 2023-10-16T18:56:10.309 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~270s 2023-10-16T18:56:10.310 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~270s 2023-10-16T18:56:10.310 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~270s 2023-10-16T18:56:10.310 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~270s 2023-10-16T18:56:10.311 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~270s 2023-10-16T18:56:10.311 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~277s 2023-10-16T18:56:10.311 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~277s 2023-10-16T18:56:10.311 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~270s 2023-10-16T18:56:10.312 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~277s 2023-10-16T18:56:14.942 DEBUG:teuthology.orchestra.remote:timed out 2023-10-16T18:56:15.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~275s 2023-10-16T18:56:15.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~275s 2023-10-16T18:56:15.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~275s 2023-10-16T18:56:15.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~275s 2023-10-16T18:56:15.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~275s 2023-10-16T18:56:15.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~275s 2023-10-16T18:56:15.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~275s 2023-10-16T18:56:15.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~275s 2023-10-16T18:56:15.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~275s 2023-10-16T18:56:15.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~275s 2023-10-16T18:56:15.316 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~275s 2023-10-16T18:56:15.316 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~275s 2023-10-16T18:56:15.316 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~275s 2023-10-16T18:56:15.317 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~282s 2023-10-16T18:56:15.317 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~282s 2023-10-16T18:56:15.317 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~275s 2023-10-16T18:56:15.317 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~282s 2023-10-16T18:56:20.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~280s 2023-10-16T18:56:20.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~280s 2023-10-16T18:56:20.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~280s 2023-10-16T18:56:20.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~280s 2023-10-16T18:56:20.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~280s 2023-10-16T18:56:20.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~280s 2023-10-16T18:56:20.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~280s 2023-10-16T18:56:20.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~280s 2023-10-16T18:56:20.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~280s 2023-10-16T18:56:20.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~280s 2023-10-16T18:56:20.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~280s 2023-10-16T18:56:20.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~280s 2023-10-16T18:56:20.323 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~280s 2023-10-16T18:56:20.323 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~287s 2023-10-16T18:56:20.323 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~287s 2023-10-16T18:56:20.324 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~280s 2023-10-16T18:56:20.324 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~287s 2023-10-16T18:56:23.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-16T18:56:23.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:56:25.326 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~285s 2023-10-16T18:56:25.326 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~285s 2023-10-16T18:56:25.327 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~285s 2023-10-16T18:56:25.327 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~285s 2023-10-16T18:56:25.327 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~285s 2023-10-16T18:56:25.328 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~285s 2023-10-16T18:56:25.328 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~285s 2023-10-16T18:56:25.328 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~285s 2023-10-16T18:56:25.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~285s 2023-10-16T18:56:25.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~285s 2023-10-16T18:56:25.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~285s 2023-10-16T18:56:25.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~285s 2023-10-16T18:56:25.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~285s 2023-10-16T18:56:25.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~292s 2023-10-16T18:56:25.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~292s 2023-10-16T18:56:25.331 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~285s 2023-10-16T18:56:25.331 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~292s 2023-10-16T18:56:30.332 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~290s 2023-10-16T18:56:30.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~290s 2023-10-16T18:56:30.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~290s 2023-10-16T18:56:30.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~290s 2023-10-16T18:56:30.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~290s 2023-10-16T18:56:30.334 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~290s 2023-10-16T18:56:30.334 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~290s 2023-10-16T18:56:30.334 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~290s 2023-10-16T18:56:30.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~290s 2023-10-16T18:56:30.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~290s 2023-10-16T18:56:30.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~290s 2023-10-16T18:56:30.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~290s 2023-10-16T18:56:30.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~290s 2023-10-16T18:56:30.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~297s 2023-10-16T18:56:30.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~297s 2023-10-16T18:56:30.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~290s 2023-10-16T18:56:30.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~297s 2023-10-16T18:56:35.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~295s 2023-10-16T18:56:35.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~295s 2023-10-16T18:56:35.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~295s 2023-10-16T18:56:35.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~295s 2023-10-16T18:56:35.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~295s 2023-10-16T18:56:35.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~295s 2023-10-16T18:56:35.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~295s 2023-10-16T18:56:35.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~295s 2023-10-16T18:56:35.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~295s 2023-10-16T18:56:35.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~295s 2023-10-16T18:56:35.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~295s 2023-10-16T18:56:35.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~295s 2023-10-16T18:56:35.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~295s 2023-10-16T18:56:35.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~302s 2023-10-16T18:56:35.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~302s 2023-10-16T18:56:35.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~295s 2023-10-16T18:56:35.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~302s 2023-10-16T18:56:35.343 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-10-16T18:56:35.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-16T18:56:35.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:56:40.647 DEBUG:teuthology.orchestra.remote:timed out 2023-10-16T18:56:49.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-16T18:56:49.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:56:49.871 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-10-16T18:56:50.213 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-16T18:56:50.214 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:56:50.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-16T18:56:50.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T18:56:50.273 INFO:teuthology.orchestra.run.smithi059.stderr:error: cannot stat /etc/logrotate.d/ceph-test.conf: No such file or directory 2023-10-16T18:56:50.326 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-10-16T18:56:50.388 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-16T18:56:50.388 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-16T18:56:50.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:56:50.396 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-10-16T18:56:50.479 INFO:teuthology.orchestra.run.smithi151.stderr:error: cannot stat /etc/logrotate.d/ceph-test.conf: No such file or directory 2023-10-16T18:56:50.902 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-10-16T18:56:50.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-16T18:56:50.971 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T18:56:50.971 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T18:56:51.035 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055393,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6496528k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18624 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248264k,nr_inodes=812066,mode=700,uid=1000,gid=1301,inode64 0 0 2023-10-16T18:56:51.036 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi059.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-10-16T18:56:51.036 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-16T18:56:51.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T18:56:51.037 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-16T18:56:51.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:56:51.091 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: cd: /home/ubuntu/cephtest: No such file or directory 2023-10-16T18:56:51.091 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T18:56:51.092 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T18:56:51.146 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055393,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6496528k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18624 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248264k,nr_inodes=812066,mode=700,uid=1000,gid=1301,inode64 0 0 2023-10-16T18:56:51.146 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.2 is not mounted at ubuntu@smithi059.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2 2023-10-16T18:56:51.147 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-16T18:56:51.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T18:56:51.147 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-16T18:56:51.200 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:56:51.201 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: cd: /home/ubuntu/cephtest: No such file or directory 2023-10-16T18:56:51.201 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T18:56:51.202 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T18:56:51.232 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=39,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15795 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 2023-10-16T18:56:51.232 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.1 is not mounted at ubuntu@smithi151.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1 2023-10-16T18:56:51.233 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-16T18:56:51.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T18:56:51.233 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-16T18:56:51.288 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:56:51.289 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 0: cd: /home/ubuntu/cephtest: No such file or directory 2023-10-16T18:56:51.289 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T18:56:51.289 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T18:56:51.346 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=39,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15795 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 2023-10-16T18:56:51.346 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.3 is not mounted at ubuntu@smithi151.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3 2023-10-16T18:56:51.347 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-16T18:56:51.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T18:56:51.347 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-16T18:56:51.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:56:51.403 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 0: cd: /home/ubuntu/cephtest: No such file or directory 2023-10-16T18:56:55.511 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-10-16T18:56:55.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-16T18:56:55.583 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T18:56:55.583 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T18:56:55.638 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055393,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6496528k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18624 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248264k,nr_inodes=812066,mode=700,uid=1000,gid=1301,inode64 0 0 2023-10-16T18:56:55.638 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-16T18:56:55.639 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T18:56:55.693 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055393,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6496528k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18624 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248264k,nr_inodes=812066,mode=700,uid=1000,gid=1301,inode64 0 0 2023-10-16T18:56:55.693 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T18:56:55.694 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T18:56:55.713 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=39,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15795 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 2023-10-16T18:56:55.713 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-16T18:56:55.714 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-16T18:56:55.775 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=39,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15795 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 2023-10-16T18:56:55.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T18:56:55.776 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-10-16T18:56:55.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T18:56:55.836 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2023-10-16T18:56:55.910 INFO:teuthology.orchestra.run.smithi151.stderr:Cannot find device "ceph-brx" 2023-10-16T18:56:55.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:56:55.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T18:56:55.912 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-16T18:56:55.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-16T18:56:55.956 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2023-10-16T18:56:56.030 INFO:teuthology.orchestra.run.smithi059.stderr:Cannot find device "ceph-brx" 2023-10-16T18:56:56.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:56:56.032 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-16T18:56:56.042 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-16T18:56:56.043 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-16T18:56:56.101 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: adjust-ulimits: command not found 2023-10-16T18:56:56.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:56:56.103 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-16T18:56:56.112 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-16T18:56:56.112 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-16T18:56:56.113 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:56:56.115 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T18:56:56.115 ERROR:teuthology.misc:Saw exception from ceph.mds.a Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi059 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-10-16T18:56:56.126 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-16T18:56:56.126 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:56:56.127 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T18:56:56.127 ERROR:teuthology.misc:Saw exception from ceph.mds.c Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi059 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-10-16T18:56:56.137 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-16T18:56:56.138 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:56:56.138 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T18:56:56.139 ERROR:teuthology.misc:Saw exception from ceph.mds.b Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2023-10-16T18:56:56.148 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-16T18:56:56.149 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:56:56.149 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T18:56:56.150 ERROR:teuthology.misc:Saw exception from ceph.mds.d Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2023-10-16T18:56:56.160 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-16T18:56:56.161 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-16T18:56:56.161 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:56:56.162 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T18:56:56.162 ERROR:teuthology.misc:Saw exception from ceph.osd.0 Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi059 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' 2023-10-16T18:56:56.177 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-16T18:56:56.177 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:56:56.178 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T18:56:56.178 ERROR:teuthology.misc:Saw exception from ceph.osd.1 Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi059 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1' 2023-10-16T18:56:56.193 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-16T18:56:56.193 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:56:56.194 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T18:56:56.194 ERROR:teuthology.misc:Saw exception from ceph.osd.2 Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi059 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2' 2023-10-16T18:56:56.209 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-16T18:56:56.209 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:56:56.210 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T18:56:56.210 ERROR:teuthology.misc:Saw exception from ceph.osd.3 Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi059 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3' 2023-10-16T18:56:56.224 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-16T18:56:56.225 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:56:56.225 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T18:56:56.226 ERROR:teuthology.misc:Saw exception from ceph.osd.4 Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4' 2023-10-16T18:56:56.242 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-16T18:56:56.242 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:56:56.243 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T18:56:56.243 ERROR:teuthology.misc:Saw exception from ceph.osd.5 Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5' 2023-10-16T18:56:56.258 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-16T18:56:56.304 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:56:56.305 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T18:56:56.306 ERROR:teuthology.misc:Saw exception from ceph.osd.6 Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6' 2023-10-16T18:56:56.321 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-16T18:56:56.321 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:56:56.322 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T18:56:56.323 ERROR:teuthology.misc:Saw exception from ceph.osd.7 Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' 2023-10-16T18:56:56.337 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-16T18:56:56.338 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-16T18:56:56.339 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:56:56.340 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T18:56:56.341 ERROR:teuthology.misc:Saw exception from ceph.mgr.y Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi059 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y' 2023-10-16T18:56:56.359 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-16T18:56:56.360 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:56:56.361 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T18:56:56.362 ERROR:teuthology.misc:Saw exception from ceph.mgr.x Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-10-16T18:56:56.380 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-16T18:56:56.381 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-16T18:56:56.382 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:56:56.382 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T18:56:56.383 ERROR:teuthology.misc:Saw exception from ceph.mon.a Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi059 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a' 2023-10-16T18:56:56.405 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-16T18:56:56.406 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:56:56.407 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T18:56:56.407 ERROR:teuthology.misc:Saw exception from ceph.mon.b Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b' 2023-10-16T18:56:56.430 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-16T18:56:56.431 INFO:teuthology.orchestra.run:waiting for 300 2023-10-16T18:56:56.432 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-16T18:56:56.432 ERROR:teuthology.misc:Saw exception from ceph.mon.c Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi151 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c' 2023-10-16T18:56:56.455 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-16T18:56:56.456 DEBUG:teuthology.orchestra.run.smithi059:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-16T18:56:56.493 INFO:teuthology.orchestra.run.smithi059.stderr:grep: /var/log/ceph/ceph.log: No such file or directory 2023-10-16T18:56:56.494 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-16T18:56:56.494 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-16T18:56:57.042 INFO:teuthology.orchestra.run.smithi059.stderr:umount: /var/lib/ceph/osd/ceph-0: no mount point specified. 2023-10-16T18:56:57.043 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-16T18:56:57.044 DEBUG:teuthology.orchestra.run.smithi059:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-10-16T18:56:57.289 INFO:teuthology.orchestra.run.smithi059.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-10-16T18:56:57.290 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.290 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.291 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-10-16T18:56:57.291 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 595024 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-16T18:56:57.291 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.291 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.292 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.292 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.292 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.293 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.293 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-10-16T18:56:57.293 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.293 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.294 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:57.294 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.294 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.294 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.295 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-16T18:56:57.295 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.295 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.296 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-10-16T18:56:57.296 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:57.297 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-16T18:56:57.297 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.297 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.299 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-10-16T18:56:57.300 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:57.300 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-10-16T18:56:57.300 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-10-16T18:56:57.301 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-16T18:56:57.301 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T18:56:57.301 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.301 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 21219 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-16T18:56:57.302 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.302 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-16T18:56:57.302 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.303 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.303 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.303 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 3w CHR 1,11 0t0 10 /dev/kmsg 2023-10-16T18:56:57.303 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 4u a_inode 0,14 0 1053 [eventpoll:5,6,8,9,11,14,15,16,18,19,28,29,30,31,33,38,40,41,44,45,47,48,56,57,59,60,66,67,68,76,77,78...] 2023-10-16T18:56:57.304 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 5u a_inode 0,14 0 1053 [signalfd] 2023-10-16T18:56:57.304 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 6r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.304 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 7r DIR 0,25 0 1 /sys/fs/cgroup 2023-10-16T18:56:57.304 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 8u a_inode 0,14 0 1053 [timerfd] 2023-10-16T18:56:57.305 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 9u a_inode 0,14 0 1053 [eventpoll:10,13] 2023-10-16T18:56:57.305 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 10r REG 0,20 0 15632 /proc/1/mountinfo 2023-10-16T18:56:57.305 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 11r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.306 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 12u netlink 0t0 19889 AUDIT 2023-10-16T18:56:57.306 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 13r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.306 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 14r REG 0,20 0 4026532076 /proc/swaps 2023-10-16T18:56:57.306 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 15u netlink 0t0 19881 KOBJECT_UEVENT 2023-10-16T18:56:57.307 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 16u unix 0xffff8ed49038d500 0t0 19883 /run/systemd/private type=STREAM (LISTEN) 2023-10-16T18:56:57.307 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 17r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.307 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 18u a_inode 0,14 0 1053 [timerfd] 2023-10-16T18:56:57.307 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 19r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.308 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 20r FIFO 0,13 0t0 19886 pipe 2023-10-16T18:56:57.308 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 21w FIFO 0,13 0t0 19886 pipe 2023-10-16T18:56:57.308 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 22r FIFO 0,13 0t0 19887 pipe 2023-10-16T18:56:57.309 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 23w FIFO 0,13 0t0 19887 pipe 2023-10-16T18:56:57.309 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 24r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.309 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 25u unix 0xffff8ed488c3d940 0t0 18699 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.309 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 26u a_inode 0,14 0 1053 bpf-prog 2023-10-16T18:56:57.310 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 27r CHR 10,235 0t0 111 /dev/autofs 2023-10-16T18:56:57.310 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 28r FIFO 0,13 0t0 18624 pipe 2023-10-16T18:56:57.310 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 29u FIFO 0,24 0t0 433 /run/dmeventd-server 2023-10-16T18:56:57.310 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 30u FIFO 0,24 0t0 434 /run/dmeventd-client 2023-10-16T18:56:57.311 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 31u unix 0xffff8ed486c15940 0t0 18627 /run/lvm/lvmpolld.socket type=STREAM (LISTEN) 2023-10-16T18:56:57.311 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 32u unix 0xffff8ed486c172c0 0t0 18629 /run/rpcbind.sock type=STREAM (LISTEN) 2023-10-16T18:56:57.311 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 33u unix 0xffff8ed488c38cc0 0t0 18639 /run/systemd/coredump type=SEQPACKET (LISTEN) 2023-10-16T18:56:57.312 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 34u IPv4 14717 0t0 TCP *:sunrpc (LISTEN) 2023-10-16T18:56:57.312 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 35u IPv4 14301 0t0 UDP *:sunrpc 2023-10-16T18:56:57.312 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 36u IPv6 14723 0t0 TCP *:sunrpc (LISTEN) 2023-10-16T18:56:57.312 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 37u IPv6 14729 0t0 UDP *:sunrpc 2023-10-16T18:56:57.313 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 38u FIFO 0,24 0t0 439 /run/initctl 2023-10-16T18:56:57.313 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 39u unix 0xffff8ed488c3ee80 0t0 18641 /run/udev/control type=SEQPACKET (LISTEN) 2023-10-16T18:56:57.313 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 40u unix 0xffff8ed4884b9100 0t0 15634 /run/systemd/notify type=DGRAM (CONNECTED) 2023-10-16T18:56:57.313 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 41u unix 0xffff8ed4884bc840 0t0 15635 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.314 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 42u unix 0xffff8ed4884baec0 0t0 15636 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.314 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 43u netlink 0t0 18643 KOBJECT_UEVENT 2023-10-16T18:56:57.314 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 44u unix 0xffff8ed4884c6a40 0t0 15640 /run/systemd/io.system.ManagedOOM type=STREAM (LISTEN) 2023-10-16T18:56:57.314 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 45u unix 0xffff8ed4884c5940 0t0 15639 /run/systemd/userdb/io.systemd.DynamicUser type=STREAM (LISTEN) 2023-10-16T18:56:57.315 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 46u unix 0xffff8ed490149100 0t0 49 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2023-10-16T18:56:57.315 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 47u unix 0xffff8ed489ad0440 0t0 20488 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.315 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 48u a_inode 0,14 0 1053 [timerfd] 2023-10-16T18:56:57.315 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 49u a_inode 0,14 0 1053 bpf-prog 2023-10-16T18:56:57.316 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 50u a_inode 0,14 0 1053 bpf-prog 2023-10-16T18:56:57.316 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 51u a_inode 0,14 0 1053 bpf-prog 2023-10-16T18:56:57.316 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 52u a_inode 0,14 0 1053 bpf-prog 2023-10-16T18:56:57.317 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 53u unix 0xffff8ed49014c840 0t0 51 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2023-10-16T18:56:57.317 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 54u unix 0xffff8ed490140880 0t0 53 /run/systemd/journal/stdout type=STREAM (LISTEN) 2023-10-16T18:56:57.317 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 55u unix 0xffff8ed49038fb40 0t0 20049 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-10-16T18:56:57.317 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 56u unix 0xffff8ed49038a640 0t0 20051 /run/.heim_org.h5l.kcm-socket type=STREAM (LISTEN) 2023-10-16T18:56:57.318 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 57u unix 0xffff8ed489ad6600 0t0 275 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.318 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 58u a_inode 0,14 0 1053 bpf-prog 2023-10-16T18:56:57.318 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 59u unix 0xffff8ed489ad7700 0t0 21668 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.318 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 60u unix 0xffff8ed49038e1c0 0t0 20058 type=STREAM (CONNECTED) 2023-10-16T18:56:57.319 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 61u a_inode 0,14 0 1053 bpf-prog 2023-10-16T18:56:57.319 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 62u a_inode 0,14 0 1053 bpf-prog 2023-10-16T18:56:57.319 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 63u a_inode 0,14 0 1053 bpf-prog 2023-10-16T18:56:57.319 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 64u a_inode 0,14 0 1053 bpf-prog 2023-10-16T18:56:57.320 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 65u a_inode 0,14 0 1053 bpf-prog 2023-10-16T18:56:57.320 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 66u unix 0xffff8ed4902bdd80 0t0 22650 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.320 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 67u unix 0xffff8ed489ad1540 0t0 22672 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.320 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 68u unix 0xffff8ed486c13b80 0t0 16004 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.321 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 69u unix 0xffff8ed4902bea40 0t0 14940 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.321 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 70u a_inode 0,14 0 1053 bpf-prog 2023-10-16T18:56:57.321 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 71u unix 0xffff8ed4884bd0c0 0t0 15869 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.321 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 72u unix 0xffff8ed4902bbfc0 0t0 14949 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.322 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 73u unix 0xffff8ed490144400 0t0 14950 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.322 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 74u unix 0xffff8ed490141100 0t0 14951 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.322 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 75u unix 0xffff8ed4884bbfc0 0t0 15870 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.323 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 76u unix 0xffff8ed4902bd500 0t0 22564 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.323 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 77u CHR 10,242 0t0 165 /dev/rfkill 2023-10-16T18:56:57.323 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 78u unix 0xffff8ed4902b9100 0t0 15875 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.323 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 80u unix 0xffff8ed490144c80 0t0 21865 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.324 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 81u unix 0xffff8ed489ad2200 0t0 14958 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.324 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 82u unix 0xffff8ed486c11980 0t0 21866 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.324 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 84u unix 0xffff8ed490146e80 0t0 21867 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.324 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 1 root 86u unix 0xffff8ed490145940 0t0 21885 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.325 INFO:teuthology.orchestra.run.smithi059.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.325 INFO:teuthology.orchestra.run.smithi059.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.325 INFO:teuthology.orchestra.run.smithi059.stdout:kthreadd 2 root txt unknown /proc/2/exe 2023-10-16T18:56:57.325 INFO:teuthology.orchestra.run.smithi059.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.326 INFO:teuthology.orchestra.run.smithi059.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.326 INFO:teuthology.orchestra.run.smithi059.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2023-10-16T18:56:57.326 INFO:teuthology.orchestra.run.smithi059.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.327 INFO:teuthology.orchestra.run.smithi059.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.327 INFO:teuthology.orchestra.run.smithi059.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2023-10-16T18:56:57.327 INFO:teuthology.orchestra.run.smithi059.stdout:slub_flus 5 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.327 INFO:teuthology.orchestra.run.smithi059.stdout:slub_flus 5 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.328 INFO:teuthology.orchestra.run.smithi059.stdout:slub_flus 5 root txt unknown /proc/5/exe 2023-10-16T18:56:57.328 INFO:teuthology.orchestra.run.smithi059.stdout:netns 6 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.328 INFO:teuthology.orchestra.run.smithi059.stdout:netns 6 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.329 INFO:teuthology.orchestra.run.smithi059.stdout:netns 6 root txt unknown /proc/6/exe 2023-10-16T18:56:57.329 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/0 7 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.329 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/0 7 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.329 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/0 7 root txt unknown /proc/7/exe 2023-10-16T18:56:57.330 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/0 8 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.330 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/0 8 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.330 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/0 8 root txt unknown /proc/8/exe 2023-10-16T18:56:57.330 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 9 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.331 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 9 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.331 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 9 root txt unknown /proc/9/exe 2023-10-16T18:56:57.331 INFO:teuthology.orchestra.run.smithi059.stdout:mm_percpu 10 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.331 INFO:teuthology.orchestra.run.smithi059.stdout:mm_percpu 10 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.332 INFO:teuthology.orchestra.run.smithi059.stdout:mm_percpu 10 root txt unknown /proc/10/exe 2023-10-16T18:56:57.332 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 11 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.332 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 11 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.332 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 11 root txt unknown /proc/11/exe 2023-10-16T18:56:57.333 INFO:teuthology.orchestra.run.smithi059.stdout:rcu_tasks 12 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.333 INFO:teuthology.orchestra.run.smithi059.stdout:rcu_tasks 12 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.333 INFO:teuthology.orchestra.run.smithi059.stdout:rcu_tasks 12 root txt unknown /proc/12/exe 2023-10-16T18:56:57.333 INFO:teuthology.orchestra.run.smithi059.stdout:rcu_tasks 13 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.334 INFO:teuthology.orchestra.run.smithi059.stdout:rcu_tasks 13 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.334 INFO:teuthology.orchestra.run.smithi059.stdout:rcu_tasks 13 root txt unknown /proc/13/exe 2023-10-16T18:56:57.334 INFO:teuthology.orchestra.run.smithi059.stdout:rcu_tasks 14 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.335 INFO:teuthology.orchestra.run.smithi059.stdout:rcu_tasks 14 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.335 INFO:teuthology.orchestra.run.smithi059.stdout:rcu_tasks 14 root txt unknown /proc/14/exe 2023-10-16T18:56:57.335 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 15 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.335 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 15 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.336 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 15 root txt unknown /proc/15/exe 2023-10-16T18:56:57.336 INFO:teuthology.orchestra.run.smithi059.stdout:pr/ttyS1 16 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.336 INFO:teuthology.orchestra.run.smithi059.stdout:pr/ttyS1 16 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.336 INFO:teuthology.orchestra.run.smithi059.stdout:pr/ttyS1 16 root txt unknown /proc/16/exe 2023-10-16T18:56:57.337 INFO:teuthology.orchestra.run.smithi059.stdout:rcu_preem 17 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.337 INFO:teuthology.orchestra.run.smithi059.stdout:rcu_preem 17 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.337 INFO:teuthology.orchestra.run.smithi059.stdout:rcu_preem 17 root txt unknown /proc/17/exe 2023-10-16T18:56:57.338 INFO:teuthology.orchestra.run.smithi059.stdout:migration 18 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.338 INFO:teuthology.orchestra.run.smithi059.stdout:migration 18 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.338 INFO:teuthology.orchestra.run.smithi059.stdout:migration 18 root txt unknown /proc/18/exe 2023-10-16T18:56:57.338 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 19 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.339 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 19 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.339 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 19 root txt unknown /proc/19/exe 2023-10-16T18:56:57.339 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/0 20 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.339 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/0 20 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.340 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/0 20 root txt unknown /proc/20/exe 2023-10-16T18:56:57.340 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/0 21 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.340 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/0 21 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.340 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/0 21 root txt unknown /proc/21/exe 2023-10-16T18:56:57.341 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/1 22 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.341 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/1 22 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.341 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/1 22 root txt unknown /proc/22/exe 2023-10-16T18:56:57.342 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 23 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.342 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 23 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.342 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 23 root txt unknown /proc/23/exe 2023-10-16T18:56:57.342 INFO:teuthology.orchestra.run.smithi059.stdout:migration 24 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.343 INFO:teuthology.orchestra.run.smithi059.stdout:migration 24 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.343 INFO:teuthology.orchestra.run.smithi059.stdout:migration 24 root txt unknown /proc/24/exe 2023-10-16T18:56:57.343 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 25 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.343 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 25 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.344 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 25 root txt unknown /proc/25/exe 2023-10-16T18:56:57.344 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/1 26 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.344 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/1 26 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.344 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/1 26 root txt unknown /proc/26/exe 2023-10-16T18:56:57.345 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/1 27 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.345 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/1 27 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.345 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/1 27 root txt unknown /proc/27/exe 2023-10-16T18:56:57.345 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/2 28 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.346 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/2 28 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.346 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/2 28 root txt unknown /proc/28/exe 2023-10-16T18:56:57.346 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 29 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.347 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 29 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.347 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 29 root txt unknown /proc/29/exe 2023-10-16T18:56:57.347 INFO:teuthology.orchestra.run.smithi059.stdout:migration 30 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.347 INFO:teuthology.orchestra.run.smithi059.stdout:migration 30 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.348 INFO:teuthology.orchestra.run.smithi059.stdout:migration 30 root txt unknown /proc/30/exe 2023-10-16T18:56:57.348 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 31 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.348 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 31 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.348 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 31 root txt unknown /proc/31/exe 2023-10-16T18:56:57.349 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/2 32 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.349 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/2 32 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.349 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/2 32 root txt unknown /proc/32/exe 2023-10-16T18:56:57.349 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/2 33 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.350 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/2 33 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.350 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/2 33 root txt unknown /proc/33/exe 2023-10-16T18:56:57.350 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/3 34 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.351 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/3 34 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.351 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/3 34 root txt unknown /proc/34/exe 2023-10-16T18:56:57.351 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 35 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.351 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 35 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.352 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 35 root txt unknown /proc/35/exe 2023-10-16T18:56:57.352 INFO:teuthology.orchestra.run.smithi059.stdout:migration 36 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.352 INFO:teuthology.orchestra.run.smithi059.stdout:migration 36 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.352 INFO:teuthology.orchestra.run.smithi059.stdout:migration 36 root txt unknown /proc/36/exe 2023-10-16T18:56:57.353 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 37 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.353 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 37 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.353 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 37 root txt unknown /proc/37/exe 2023-10-16T18:56:57.353 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/3 38 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.354 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/3 38 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.354 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/3 38 root txt unknown /proc/38/exe 2023-10-16T18:56:57.354 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/3 39 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.355 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/3 39 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.355 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/3 39 root txt unknown /proc/39/exe 2023-10-16T18:56:57.355 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/4 40 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.355 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/4 40 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.356 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/4 40 root txt unknown /proc/40/exe 2023-10-16T18:56:57.356 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 41 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.356 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 41 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.357 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 41 root txt unknown /proc/41/exe 2023-10-16T18:56:57.357 INFO:teuthology.orchestra.run.smithi059.stdout:migration 42 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.357 INFO:teuthology.orchestra.run.smithi059.stdout:migration 42 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.357 INFO:teuthology.orchestra.run.smithi059.stdout:migration 42 root txt unknown /proc/42/exe 2023-10-16T18:56:57.358 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 43 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.358 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 43 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.358 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 43 root txt unknown /proc/43/exe 2023-10-16T18:56:57.358 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/4 44 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.359 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/4 44 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.359 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/4 44 root txt unknown /proc/44/exe 2023-10-16T18:56:57.359 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/4 45 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.360 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/4 45 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.360 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/4 45 root txt unknown /proc/45/exe 2023-10-16T18:56:57.360 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/5 46 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.360 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/5 46 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.361 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/5 46 root txt unknown /proc/46/exe 2023-10-16T18:56:57.361 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 47 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.361 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 47 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.361 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 47 root txt unknown /proc/47/exe 2023-10-16T18:56:57.362 INFO:teuthology.orchestra.run.smithi059.stdout:migration 48 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.362 INFO:teuthology.orchestra.run.smithi059.stdout:migration 48 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.362 INFO:teuthology.orchestra.run.smithi059.stdout:migration 48 root txt unknown /proc/48/exe 2023-10-16T18:56:57.362 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 49 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.363 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 49 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.363 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 49 root txt unknown /proc/49/exe 2023-10-16T18:56:57.363 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/5 50 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.363 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/5 50 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.364 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/5 50 root txt unknown /proc/50/exe 2023-10-16T18:56:57.364 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/5 51 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.364 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/5 51 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.365 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/5 51 root txt unknown /proc/51/exe 2023-10-16T18:56:57.365 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/6 52 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.365 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/6 52 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.365 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/6 52 root txt unknown /proc/52/exe 2023-10-16T18:56:57.366 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 53 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.366 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 53 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.366 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 53 root txt unknown /proc/53/exe 2023-10-16T18:56:57.366 INFO:teuthology.orchestra.run.smithi059.stdout:migration 54 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.367 INFO:teuthology.orchestra.run.smithi059.stdout:migration 54 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.367 INFO:teuthology.orchestra.run.smithi059.stdout:migration 54 root txt unknown /proc/54/exe 2023-10-16T18:56:57.367 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 55 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.368 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 55 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.368 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 55 root txt unknown /proc/55/exe 2023-10-16T18:56:57.368 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/6 56 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.368 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/6 56 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.369 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/6 56 root txt unknown /proc/56/exe 2023-10-16T18:56:57.369 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/6 57 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.369 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/6 57 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.369 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/6 57 root txt unknown /proc/57/exe 2023-10-16T18:56:57.370 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/7 58 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.370 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/7 58 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.370 INFO:teuthology.orchestra.run.smithi059.stdout:cpuhp/7 58 root txt unknown /proc/58/exe 2023-10-16T18:56:57.371 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 59 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.371 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 59 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.371 INFO:teuthology.orchestra.run.smithi059.stdout:idle_inje 59 root txt unknown /proc/59/exe 2023-10-16T18:56:57.371 INFO:teuthology.orchestra.run.smithi059.stdout:migration 60 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.372 INFO:teuthology.orchestra.run.smithi059.stdout:migration 60 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.372 INFO:teuthology.orchestra.run.smithi059.stdout:migration 60 root txt unknown /proc/60/exe 2023-10-16T18:56:57.372 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 61 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.372 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 61 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.373 INFO:teuthology.orchestra.run.smithi059.stdout:ksoftirqd 61 root txt unknown /proc/61/exe 2023-10-16T18:56:57.373 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/7 62 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.373 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/7 62 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.373 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/7 62 root txt unknown /proc/62/exe 2023-10-16T18:56:57.374 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/7 63 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.374 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/7 63 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.374 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/7 63 root txt unknown /proc/63/exe 2023-10-16T18:56:57.374 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 65 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.375 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 65 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.375 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 65 root txt unknown /proc/65/exe 2023-10-16T18:56:57.375 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 66 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.375 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 66 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.376 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 66 root txt unknown /proc/66/exe 2023-10-16T18:56:57.376 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 67 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.376 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 67 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.377 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 67 root txt unknown /proc/67/exe 2023-10-16T18:56:57.377 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 68 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.377 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 68 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.377 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 68 root txt unknown /proc/68/exe 2023-10-16T18:56:57.378 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 69 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.378 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 69 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.378 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 69 root txt unknown /proc/69/exe 2023-10-16T18:56:57.378 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 70 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.379 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 70 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.379 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 70 root txt unknown /proc/70/exe 2023-10-16T18:56:57.379 INFO:teuthology.orchestra.run.smithi059.stdout:kdevtmpfs 71 root cwd DIR 0,5 3380 1 / 2023-10-16T18:56:57.380 INFO:teuthology.orchestra.run.smithi059.stdout:kdevtmpfs 71 root rtd DIR 0,5 3380 1 / 2023-10-16T18:56:57.380 INFO:teuthology.orchestra.run.smithi059.stdout:kdevtmpfs 71 root txt unknown /proc/71/exe 2023-10-16T18:56:57.380 INFO:teuthology.orchestra.run.smithi059.stdout:inet_frag 72 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.380 INFO:teuthology.orchestra.run.smithi059.stdout:inet_frag 72 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.381 INFO:teuthology.orchestra.run.smithi059.stdout:inet_frag 72 root txt unknown /proc/72/exe 2023-10-16T18:56:57.381 INFO:teuthology.orchestra.run.smithi059.stdout:kauditd 73 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.381 INFO:teuthology.orchestra.run.smithi059.stdout:kauditd 73 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.381 INFO:teuthology.orchestra.run.smithi059.stdout:kauditd 73 root txt unknown /proc/73/exe 2023-10-16T18:56:57.382 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/5 74 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.382 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/5 74 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.382 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/5 74 root txt unknown /proc/74/exe 2023-10-16T18:56:57.382 INFO:teuthology.orchestra.run.smithi059.stdout:khungtask 75 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.383 INFO:teuthology.orchestra.run.smithi059.stdout:khungtask 75 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.383 INFO:teuthology.orchestra.run.smithi059.stdout:khungtask 75 root txt unknown /proc/75/exe 2023-10-16T18:56:57.383 INFO:teuthology.orchestra.run.smithi059.stdout:oom_reape 76 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.383 INFO:teuthology.orchestra.run.smithi059.stdout:oom_reape 76 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.384 INFO:teuthology.orchestra.run.smithi059.stdout:oom_reape 76 root txt unknown /proc/76/exe 2023-10-16T18:56:57.384 INFO:teuthology.orchestra.run.smithi059.stdout:writeback 77 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.384 INFO:teuthology.orchestra.run.smithi059.stdout:writeback 77 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.385 INFO:teuthology.orchestra.run.smithi059.stdout:writeback 77 root txt unknown /proc/77/exe 2023-10-16T18:56:57.385 INFO:teuthology.orchestra.run.smithi059.stdout:kcompactd 78 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.385 INFO:teuthology.orchestra.run.smithi059.stdout:kcompactd 78 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.385 INFO:teuthology.orchestra.run.smithi059.stdout:kcompactd 78 root txt unknown /proc/78/exe 2023-10-16T18:56:57.386 INFO:teuthology.orchestra.run.smithi059.stdout:ksmd 79 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.386 INFO:teuthology.orchestra.run.smithi059.stdout:ksmd 79 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.386 INFO:teuthology.orchestra.run.smithi059.stdout:ksmd 79 root txt unknown /proc/79/exe 2023-10-16T18:56:57.387 INFO:teuthology.orchestra.run.smithi059.stdout:khugepage 80 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.387 INFO:teuthology.orchestra.run.smithi059.stdout:khugepage 80 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.387 INFO:teuthology.orchestra.run.smithi059.stdout:khugepage 80 root txt unknown /proc/80/exe 2023-10-16T18:56:57.387 INFO:teuthology.orchestra.run.smithi059.stdout:cryptd 81 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.388 INFO:teuthology.orchestra.run.smithi059.stdout:cryptd 81 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.388 INFO:teuthology.orchestra.run.smithi059.stdout:cryptd 81 root txt unknown /proc/81/exe 2023-10-16T18:56:57.388 INFO:teuthology.orchestra.run.smithi059.stdout:kintegrit 82 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.388 INFO:teuthology.orchestra.run.smithi059.stdout:kintegrit 82 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.389 INFO:teuthology.orchestra.run.smithi059.stdout:kintegrit 82 root txt unknown /proc/82/exe 2023-10-16T18:56:57.389 INFO:teuthology.orchestra.run.smithi059.stdout:kblockd 83 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.389 INFO:teuthology.orchestra.run.smithi059.stdout:kblockd 83 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.389 INFO:teuthology.orchestra.run.smithi059.stdout:kblockd 83 root txt unknown /proc/83/exe 2023-10-16T18:56:57.390 INFO:teuthology.orchestra.run.smithi059.stdout:blkcg_pun 84 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.390 INFO:teuthology.orchestra.run.smithi059.stdout:blkcg_pun 84 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.390 INFO:teuthology.orchestra.run.smithi059.stdout:blkcg_pun 84 root txt unknown /proc/84/exe 2023-10-16T18:56:57.390 INFO:teuthology.orchestra.run.smithi059.stdout:tpm_dev_w 85 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.391 INFO:teuthology.orchestra.run.smithi059.stdout:tpm_dev_w 85 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.391 INFO:teuthology.orchestra.run.smithi059.stdout:tpm_dev_w 85 root txt unknown /proc/85/exe 2023-10-16T18:56:57.391 INFO:teuthology.orchestra.run.smithi059.stdout:md 86 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.392 INFO:teuthology.orchestra.run.smithi059.stdout:md 86 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.392 INFO:teuthology.orchestra.run.smithi059.stdout:md 86 root txt unknown /proc/86/exe 2023-10-16T18:56:57.392 INFO:teuthology.orchestra.run.smithi059.stdout:edac-poll 87 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.392 INFO:teuthology.orchestra.run.smithi059.stdout:edac-poll 87 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.393 INFO:teuthology.orchestra.run.smithi059.stdout:edac-poll 87 root txt unknown /proc/87/exe 2023-10-16T18:56:57.393 INFO:teuthology.orchestra.run.smithi059.stdout:watchdogd 88 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.393 INFO:teuthology.orchestra.run.smithi059.stdout:watchdogd 88 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.393 INFO:teuthology.orchestra.run.smithi059.stdout:watchdogd 88 root txt unknown /proc/88/exe 2023-10-16T18:56:57.394 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/3 89 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.394 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/3 89 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.394 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/3 89 root txt unknown /proc/89/exe 2023-10-16T18:56:57.395 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/5 90 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.395 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/5 90 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.395 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/5 90 root txt unknown /proc/90/exe 2023-10-16T18:56:57.396 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/6 91 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.396 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/6 91 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.396 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/6 91 root txt unknown /proc/91/exe 2023-10-16T18:56:57.397 INFO:teuthology.orchestra.run.smithi059.stdout:kswapd0 92 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.397 INFO:teuthology.orchestra.run.smithi059.stdout:kswapd0 92 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.397 INFO:teuthology.orchestra.run.smithi059.stdout:kswapd0 92 root txt unknown /proc/92/exe 2023-10-16T18:56:57.397 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/1 94 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.398 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/1 94 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.398 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/1 94 root txt unknown /proc/94/exe 2023-10-16T18:56:57.398 INFO:teuthology.orchestra.run.smithi059.stdout:kthrotld 98 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.398 INFO:teuthology.orchestra.run.smithi059.stdout:kthrotld 98 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.399 INFO:teuthology.orchestra.run.smithi059.stdout:kthrotld 98 root txt unknown /proc/98/exe 2023-10-16T18:56:57.399 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/3 99 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.399 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/3 99 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.399 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/3 99 root txt unknown /proc/99/exe 2023-10-16T18:56:57.400 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/0 102 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.400 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/0 102 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.400 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/0 102 root txt unknown /proc/102/exe 2023-10-16T18:56:57.401 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/0 103 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.401 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/0 103 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.401 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/0 103 root txt unknown /proc/103/exe 2023-10-16T18:56:57.401 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/2 105 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.402 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/2 105 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.402 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/2 105 root txt unknown /proc/105/exe 2023-10-16T18:56:57.402 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/4 106 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.402 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/4 106 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.403 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/4 106 root txt unknown /proc/106/exe 2023-10-16T18:56:57.403 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/7 107 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.403 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/7 107 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.404 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/7 107 root txt unknown /proc/107/exe 2023-10-16T18:56:57.404 INFO:teuthology.orchestra.run.smithi059.stdout:acpi_ther 108 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.404 INFO:teuthology.orchestra.run.smithi059.stdout:acpi_ther 108 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.404 INFO:teuthology.orchestra.run.smithi059.stdout:acpi_ther 108 root txt unknown /proc/108/exe 2023-10-16T18:56:57.405 INFO:teuthology.orchestra.run.smithi059.stdout:kmpath_rd 109 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.405 INFO:teuthology.orchestra.run.smithi059.stdout:kmpath_rd 109 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.405 INFO:teuthology.orchestra.run.smithi059.stdout:kmpath_rd 109 root txt unknown /proc/109/exe 2023-10-16T18:56:57.405 INFO:teuthology.orchestra.run.smithi059.stdout:kaluad 110 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.406 INFO:teuthology.orchestra.run.smithi059.stdout:kaluad 110 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.406 INFO:teuthology.orchestra.run.smithi059.stdout:kaluad 110 root txt unknown /proc/110/exe 2023-10-16T18:56:57.406 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/1 111 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.407 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/1 111 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.407 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/1 111 root txt unknown /proc/111/exe 2023-10-16T18:56:57.407 INFO:teuthology.orchestra.run.smithi059.stdout:mld 112 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.407 INFO:teuthology.orchestra.run.smithi059.stdout:mld 112 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.408 INFO:teuthology.orchestra.run.smithi059.stdout:mld 112 root txt unknown /proc/112/exe 2023-10-16T18:56:57.408 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/4 113 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.408 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/4 113 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.408 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/4 113 root txt unknown /proc/113/exe 2023-10-16T18:56:57.409 INFO:teuthology.orchestra.run.smithi059.stdout:ipv6_addr 114 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.409 INFO:teuthology.orchestra.run.smithi059.stdout:ipv6_addr 114 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.409 INFO:teuthology.orchestra.run.smithi059.stdout:ipv6_addr 114 root txt unknown /proc/114/exe 2023-10-16T18:56:57.409 INFO:teuthology.orchestra.run.smithi059.stdout:kstrp 123 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.410 INFO:teuthology.orchestra.run.smithi059.stdout:kstrp 123 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.410 INFO:teuthology.orchestra.run.smithi059.stdout:kstrp 123 root txt unknown /proc/123/exe 2023-10-16T18:56:57.410 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/7 124 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.411 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/7 124 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.411 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/7 124 root txt unknown /proc/124/exe 2023-10-16T18:56:57.411 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/4 132 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.411 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/4 132 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.412 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/4 132 root txt unknown /proc/132/exe 2023-10-16T18:56:57.412 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/5 133 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.412 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/5 133 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.413 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/5 133 root txt unknown /proc/133/exe 2023-10-16T18:56:57.413 INFO:teuthology.orchestra.run.smithi059.stdout:zswap-shr 138 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.413 INFO:teuthology.orchestra.run.smithi059.stdout:zswap-shr 138 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.413 INFO:teuthology.orchestra.run.smithi059.stdout:zswap-shr 138 root txt unknown /proc/138/exe 2023-10-16T18:56:57.414 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/7 252 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.414 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/7 252 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.414 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/7 252 root txt unknown /proc/252/exe 2023-10-16T18:56:57.414 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 253 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.415 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 253 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.415 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 253 root txt unknown /proc/253/exe 2023-10-16T18:56:57.415 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/0 292 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.416 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/0 292 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.416 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/0 292 root txt unknown /proc/292/exe 2023-10-16T18:56:57.416 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/2 295 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.416 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/2 295 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.417 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/2 295 root txt unknown /proc/295/exe 2023-10-16T18:56:57.417 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/1 305 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.417 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/1 305 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.417 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/1 305 root txt unknown /proc/305/exe 2023-10-16T18:56:57.418 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/3 306 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.418 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/3 306 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.418 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/3 306 root txt unknown /proc/306/exe 2023-10-16T18:56:57.419 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/2 309 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.419 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/2 309 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.419 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/2 309 root txt unknown /proc/309/exe 2023-10-16T18:56:57.419 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.420 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.420 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root txt REG 0,2 156280 14053 /usr/sbin/plymouthd (deleted) 2023-10-16T18:56:57.420 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:57.420 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:57.421 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:57.421 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:57.421 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:57.422 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:57.422 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:57.422 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:57.422 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:57.423 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.423 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root DEL REG 0,2 13888 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.423 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root DEL REG 0,2 14009 /usr/lib64/libudev.so.1.7.5 2023-10-16T18:56:57.423 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root DEL REG 0,2 13933 /usr/lib64/libm.so.6 2023-10-16T18:56:57.424 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root DEL REG 0,2 13853 /usr/lib64/libc.so.6 2023-10-16T18:56:57.424 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root DEL REG 0,2 13974 /usr/lib64/libply-splash-core.so.4.0.0 2023-10-16T18:56:57.424 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root DEL REG 0,2 13976 /usr/lib64/libply.so.4.0.0 2023-10-16T18:56:57.424 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:57.425 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:57.425 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root DEL REG 0,2 13837 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.425 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:57.426 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.426 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.426 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.426 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root 3u a_inode 0,14 0 1053 [eventpoll:4,6,7,8] 2023-10-16T18:56:57.427 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root 4r FIFO 0,13 0t0 14505 pipe 2023-10-16T18:56:57.427 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root 5w FIFO 0,13 0t0 14505 pipe 2023-10-16T18:56:57.427 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root 6u unix 0xffff8ed489ad2a80 0t0 17719 @/org/freedesktop/plymouthd type=STREAM (LISTEN) 2023-10-16T18:56:57.427 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root 7u CHR 4,65 0t0 114 /dev/ttyS1 2023-10-16T18:56:57.428 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root 8u CHR 5,2 0t0 112 /dev/ptmx 2023-10-16T18:56:57.428 INFO:teuthology.orchestra.run.smithi059.stdout:plymouthd 429 root 10w REG 8,1 178067 1203 /var/log/boot.log 2023-10-16T18:56:57.428 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/7 437 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.428 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/7 437 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.429 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/7 437 root txt unknown /proc/437/exe 2023-10-16T18:56:57.429 INFO:teuthology.orchestra.run.smithi059.stdout:nvme-wq 441 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.429 INFO:teuthology.orchestra.run.smithi059.stdout:nvme-wq 441 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.429 INFO:teuthology.orchestra.run.smithi059.stdout:nvme-wq 441 root txt unknown /proc/441/exe 2023-10-16T18:56:57.430 INFO:teuthology.orchestra.run.smithi059.stdout:nvme-rese 442 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.430 INFO:teuthology.orchestra.run.smithi059.stdout:nvme-rese 442 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.430 INFO:teuthology.orchestra.run.smithi059.stdout:nvme-rese 442 root txt unknown /proc/442/exe 2023-10-16T18:56:57.431 INFO:teuthology.orchestra.run.smithi059.stdout:nvme-dele 443 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.431 INFO:teuthology.orchestra.run.smithi059.stdout:nvme-dele 443 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.431 INFO:teuthology.orchestra.run.smithi059.stdout:nvme-dele 443 root txt unknown /proc/443/exe 2023-10-16T18:56:57.431 INFO:teuthology.orchestra.run.smithi059.stdout:nvme-auth 444 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.432 INFO:teuthology.orchestra.run.smithi059.stdout:nvme-auth 444 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.432 INFO:teuthology.orchestra.run.smithi059.stdout:nvme-auth 444 root txt unknown /proc/444/exe 2023-10-16T18:56:57.432 INFO:teuthology.orchestra.run.smithi059.stdout:ata_sff 451 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.432 INFO:teuthology.orchestra.run.smithi059.stdout:ata_sff 451 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.433 INFO:teuthology.orchestra.run.smithi059.stdout:ata_sff 451 root txt unknown /proc/451/exe 2023-10-16T18:56:57.433 INFO:teuthology.orchestra.run.smithi059.stdout:ixgbe 453 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.433 INFO:teuthology.orchestra.run.smithi059.stdout:ixgbe 453 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.433 INFO:teuthology.orchestra.run.smithi059.stdout:ixgbe 453 root txt unknown /proc/453/exe 2023-10-16T18:56:57.434 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/4 461 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.434 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/4 461 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.434 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/4 461 root txt unknown /proc/461/exe 2023-10-16T18:56:57.434 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_0 462 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.435 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_0 462 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.435 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_0 462 root txt unknown /proc/462/exe 2023-10-16T18:56:57.435 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 463 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.436 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 463 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.436 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 463 root txt unknown /proc/463/exe 2023-10-16T18:56:57.436 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_1 464 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.436 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_1 464 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.437 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_1 464 root txt unknown /proc/464/exe 2023-10-16T18:56:57.437 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 465 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.437 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 465 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.437 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 465 root txt unknown /proc/465/exe 2023-10-16T18:56:57.438 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_2 466 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.438 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_2 466 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.438 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_2 466 root txt unknown /proc/466/exe 2023-10-16T18:56:57.439 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 467 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.439 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 467 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.439 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 467 root txt unknown /proc/467/exe 2023-10-16T18:56:57.439 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_3 468 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.440 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_3 468 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.440 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_3 468 root txt unknown /proc/468/exe 2023-10-16T18:56:57.440 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 469 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.440 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 469 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.441 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 469 root txt unknown /proc/469/exe 2023-10-16T18:56:57.441 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_4 470 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.441 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_4 470 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.441 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_4 470 root txt unknown /proc/470/exe 2023-10-16T18:56:57.442 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 471 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.442 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 471 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.442 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 471 root txt unknown /proc/471/exe 2023-10-16T18:56:57.442 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_5 472 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.443 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_5 472 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.443 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_5 472 root txt unknown /proc/472/exe 2023-10-16T18:56:57.443 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 473 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.444 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 473 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.444 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 473 root txt unknown /proc/473/exe 2023-10-16T18:56:57.444 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_6 474 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.444 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_6 474 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.445 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_6 474 root txt unknown /proc/474/exe 2023-10-16T18:56:57.445 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 475 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.445 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 475 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.445 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 475 root txt unknown /proc/475/exe 2023-10-16T18:56:57.446 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_7 476 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.446 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_7 476 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.446 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_7 476 root txt unknown /proc/476/exe 2023-10-16T18:56:57.447 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 477 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.447 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 477 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.447 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 477 root txt unknown /proc/477/exe 2023-10-16T18:56:57.447 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_8 478 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.448 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_8 478 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.448 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_8 478 root txt unknown /proc/478/exe 2023-10-16T18:56:57.448 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 479 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.448 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 479 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.449 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 479 root txt unknown /proc/479/exe 2023-10-16T18:56:57.449 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_9 480 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.449 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_9 480 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.449 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_eh_9 480 root txt unknown /proc/480/exe 2023-10-16T18:56:57.450 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 481 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.450 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 481 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.450 INFO:teuthology.orchestra.run.smithi059.stdout:scsi_tmf_ 481 root txt unknown /proc/481/exe 2023-10-16T18:56:57.451 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 482 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.451 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 482 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.451 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 482 root txt unknown /proc/482/exe 2023-10-16T18:56:57.451 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 483 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.452 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 483 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.452 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 483 root txt unknown /proc/483/exe 2023-10-16T18:56:57.452 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 484 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.452 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 484 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.453 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 484 root txt unknown /proc/484/exe 2023-10-16T18:56:57.453 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 485 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.453 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 485 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.454 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/u 485 root txt unknown /proc/485/exe 2023-10-16T18:56:57.454 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/6 490 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.454 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/6 490 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.454 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/6 490 root txt unknown /proc/490/exe 2023-10-16T18:56:57.455 INFO:teuthology.orchestra.run.smithi059.stdout:jbd2/sda1 505 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.455 INFO:teuthology.orchestra.run.smithi059.stdout:jbd2/sda1 505 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.455 INFO:teuthology.orchestra.run.smithi059.stdout:jbd2/sda1 505 root txt unknown /proc/505/exe 2023-10-16T18:56:57.455 INFO:teuthology.orchestra.run.smithi059.stdout:ext4-rsv- 506 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.456 INFO:teuthology.orchestra.run.smithi059.stdout:ext4-rsv- 506 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.456 INFO:teuthology.orchestra.run.smithi059.stdout:ext4-rsv- 506 root txt unknown /proc/506/exe 2023-10-16T18:56:57.456 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.456 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.457 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root txt REG 8,1 185496 20360 /usr/lib/systemd/systemd-journald 2023-10-16T18:56:57.457 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-10-16T18:56:57.457 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:57.458 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.458 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.458 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.458 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.459 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:57.459 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-16T18:56:57.459 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.459 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.460 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.460 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.460 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:57.461 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.461 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T18:56:57.461 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-16T18:56:57.461 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.462 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.462 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-10-16T18:56:57.462 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.462 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-10-16T18:56:57.463 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-10-16T18:56:57.463 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-16T18:56:57.463 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.464 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.464 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-10-16T18:56:57.464 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.464 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.465 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.465 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root mem REG 0,24 8 55 /run/systemd/journal/kernel-seqnum 2023-10-16T18:56:57.465 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.465 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 1w CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.466 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 2w CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.466 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 3u unix 0xffff8ed49014c840 0t0 51 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2023-10-16T18:56:57.466 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 4u unix 0xffff8ed490140880 0t0 53 /run/systemd/journal/stdout type=STREAM (LISTEN) 2023-10-16T18:56:57.467 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 5u unix 0xffff8ed490149100 0t0 49 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2023-10-16T18:56:57.467 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 6w CHR 1,11 0t0 10 /dev/kmsg 2023-10-16T18:56:57.467 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 7u a_inode 0,14 0 1053 [eventpoll:3,4,5,8,9,10,11,12,13,15,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33] 2023-10-16T18:56:57.467 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 8u CHR 1,11 0t0 10 /dev/kmsg 2023-10-16T18:56:57.468 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 9u unix 0xffff8ed49038a200 0t0 19898 /run/systemd/journal/io.systemd.journal type=STREAM (LISTEN) 2023-10-16T18:56:57.468 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 10r REG 0,20 0 14421 /proc/sys/kernel/hostname 2023-10-16T18:56:57.468 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 11u a_inode 0,14 0 1053 [signalfd] 2023-10-16T18:56:57.468 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 12u a_inode 0,14 0 1053 [signalfd] 2023-10-16T18:56:57.469 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 13u a_inode 0,14 0 1053 [signalfd] 2023-10-16T18:56:57.469 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 14u unix 0xffff8ed490392640 0t0 19899 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.469 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 15u a_inode 0,14 0 1053 [timerfd] 2023-10-16T18:56:57.469 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 16u REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-10-16T18:56:57.470 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 17u unix 0xffff8ed489ad0440 0t0 20488 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.470 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 18u unix 0xffff8ed489ad7700 0t0 21668 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.470 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 19u unix 0xffff8ed4902bea40 0t0 14940 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.470 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 20u unix 0xffff8ed4902bd500 0t0 22564 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.471 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 21u unix 0xffff8ed489ad6600 0t0 275 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.471 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 22u unix 0xffff8ed4902b9100 0t0 15875 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.471 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 23u unix 0xffff8ed4902bbfc0 0t0 14949 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.472 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 24u unix 0xffff8ed490144400 0t0 14950 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.472 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 25u unix 0xffff8ed490141100 0t0 14951 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.472 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 26u unix 0xffff8ed489ad1540 0t0 22672 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.472 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 27u unix 0xffff8ed490144c80 0t0 21865 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.473 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 28u unix 0xffff8ed486c11980 0t0 21866 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.473 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 29u unix 0xffff8ed490146e80 0t0 21867 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.473 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 30u unix 0xffff8ed4902bdd80 0t0 22650 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.473 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 31u unix 0xffff8ed489ad2200 0t0 14958 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.474 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 32u unix 0xffff8ed490145940 0t0 21885 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.474 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-j 581 root 33u unix 0xffff8ed486c13b80 0t0 16004 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-16T18:56:57.474 INFO:teuthology.orchestra.run.smithi059.stdout:ext4lazyi 587 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.475 INFO:teuthology.orchestra.run.smithi059.stdout:ext4lazyi 587 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.475 INFO:teuthology.orchestra.run.smithi059.stdout:ext4lazyi 587 root txt unknown /proc/587/exe 2023-10-16T18:56:57.475 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.475 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.476 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root txt REG 8,1 597744 11595 /usr/bin/udevadm 2023-10-16T18:56:57.476 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2023-10-16T18:56:57.476 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 561841 62217 /usr/lib/modules/5.14.0-361.el9.x86_64/modules.symbols.bin 2023-10-16T18:56:57.476 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 11772 62218 /usr/lib/modules/5.14.0-361.el9.x86_64/modules.builtin.bin 2023-10-16T18:56:57.477 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 815256 59736 /usr/lib/modules/5.14.0-361.el9.x86_64/modules.alias.bin 2023-10-16T18:56:57.477 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 380439 62222 /usr/lib/modules/5.14.0-361.el9.x86_64/modules.dep.bin 2023-10-16T18:56:57.477 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 595024 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-16T18:56:57.477 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:57.478 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.478 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-16T18:56:57.478 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:57.479 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.479 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.479 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.479 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.480 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.480 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.480 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.480 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.481 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T18:56:57.481 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-16T18:56:57.481 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:57.481 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.482 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.482 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.482 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-10-16T18:56:57.482 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.483 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-16T18:56:57.483 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.483 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.484 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.484 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-10-16T18:56:57.484 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-10-16T18:56:57.484 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-10-16T18:56:57.485 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 21219 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-16T18:56:57.485 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.485 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-16T18:56:57.485 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.486 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root 1u unix 0xffff8ed489ad5500 0t0 17851 type=STREAM (CONNECTED) 2023-10-16T18:56:57.486 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root 2u unix 0xffff8ed489ad5500 0t0 17851 type=STREAM (CONNECTED) 2023-10-16T18:56:57.486 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root 3u netlink 0t0 18643 KOBJECT_UEVENT 2023-10-16T18:56:57.486 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root 4u unix 0xffff8ed488c3ee80 0t0 18641 /run/udev/control type=SEQPACKET (LISTEN) 2023-10-16T18:56:57.487 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root 5u unix 0xffff8ed48b9d4840 0t0 17863 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.487 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root 6u unix 0xffff8ed48b9d2ec0 0t0 17867 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.487 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root 7u unix 0xffff8ed48b9d0440 0t0 17868 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.487 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root 8r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.488 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root 9u a_inode 0,14 0 1053 [eventpoll:3,4,6,8,10,11,14] 2023-10-16T18:56:57.488 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root 10u a_inode 0,14 0 1053 [signalfd] 2023-10-16T18:56:57.488 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root 11u a_inode 0,14 0 1053 [timerfd] 2023-10-16T18:56:57.488 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root 12r REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2023-10-16T18:56:57.489 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-u 599 root 14u a_inode 0,14 0 1053 [timerfd] 2023-10-16T18:56:57.489 INFO:teuthology.orchestra.run.smithi059.stdout:ipmi-msgh 652 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.489 INFO:teuthology.orchestra.run.smithi059.stdout:ipmi-msgh 652 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.490 INFO:teuthology.orchestra.run.smithi059.stdout:ipmi-msgh 652 root txt unknown /proc/652/exe 2023-10-16T18:56:57.490 INFO:teuthology.orchestra.run.smithi059.stdout:kipmi0 663 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.490 INFO:teuthology.orchestra.run.smithi059.stdout:kipmi0 663 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.490 INFO:teuthology.orchestra.run.smithi059.stdout:kipmi0 663 root txt unknown /proc/663/exe 2023-10-16T18:56:57.491 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.491 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.491 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc txt REG 8,1 61200 14999 /usr/bin/rpcbind 2023-10-16T18:56:57.491 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.492 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.492 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.492 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.493 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.493 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:57.493 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:57.493 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.494 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.494 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.494 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.494 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:57.495 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.495 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:57.495 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.495 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.496 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:57.496 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:57.496 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:57.497 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.497 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T18:56:57.497 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.497 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.498 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc 1u unix 0xffff8ed489ad1100 0t0 17926 type=STREAM (CONNECTED) 2023-10-16T18:56:57.498 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc 2u unix 0xffff8ed489ad1100 0t0 17926 type=STREAM (CONNECTED) 2023-10-16T18:56:57.498 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc 3u unix 0xffff8ed486c172c0 0t0 18629 /run/rpcbind.sock type=STREAM (LISTEN) 2023-10-16T18:56:57.498 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc 4u IPv4 14717 0t0 TCP *:sunrpc (LISTEN) 2023-10-16T18:56:57.499 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc 5u IPv4 14301 0t0 UDP *:sunrpc 2023-10-16T18:56:57.499 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc 6u IPv6 14723 0t0 TCP *:sunrpc (LISTEN) 2023-10-16T18:56:57.499 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc 7u IPv6 14729 0t0 UDP *:sunrpc 2023-10-16T18:56:57.500 INFO:teuthology.orchestra.run.smithi059.stdout:rpcbind 668 rpc 8rW REG 0,24 0 1177 /run/rpcbind/rpcbind.lock 2023-10-16T18:56:57.500 INFO:teuthology.orchestra.run.smithi059.stdout:rpciod 673 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.500 INFO:teuthology.orchestra.run.smithi059.stdout:rpciod 673 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.500 INFO:teuthology.orchestra.run.smithi059.stdout:rpciod 673 root txt unknown /proc/673/exe 2023-10-16T18:56:57.501 INFO:teuthology.orchestra.run.smithi059.stdout:xprtiod 674 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.501 INFO:teuthology.orchestra.run.smithi059.stdout:xprtiod 674 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.501 INFO:teuthology.orchestra.run.smithi059.stdout:xprtiod 674 root txt unknown /proc/674/exe 2023-10-16T18:56:57.501 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.502 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.502 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-10-16T18:56:57.502 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.502 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.503 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.503 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.503 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.504 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:57.504 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:57.504 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:57.504 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:57.505 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:57.505 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:57.505 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:57.505 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:57.506 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-10-16T18:56:57.506 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:57.506 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.507 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.507 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.507 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.507 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root 3u netlink 0t0 14894 AUDIT 2023-10-16T18:56:57.508 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root 5w REG 8,1 2858405 1205 /var/log/audit/audit.log 2023-10-16T18:56:57.508 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root 6u unix 0xffff8ed4886be1c0 0t0 14897 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.508 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root 7u unix 0xffff8ed4884e6600 0t0 14896 type=STREAM (CONNECTED) 2023-10-16T18:56:57.508 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root 8u unix 0xffff8ed4884e1100 0t0 14898 type=STREAM (CONNECTED) 2023-10-16T18:56:57.509 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root 9u unix 0xffff8ed4884e0440 0t0 14899 type=STREAM (CONNECTED) 2023-10-16T18:56:57.509 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 root 10u a_inode 0,14 0 1053 [eventfd:0] 2023-10-16T18:56:57.509 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.510 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.510 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-10-16T18:56:57.510 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.510 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.511 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.513 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.513 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.514 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:57.514 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:57.514 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:57.515 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:57.515 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:57.515 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:57.515 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:57.516 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:57.516 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-10-16T18:56:57.516 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:57.516 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.517 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.517 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.517 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.517 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root 3u netlink 0t0 14894 AUDIT 2023-10-16T18:56:57.518 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root 5w REG 8,1 2858405 1205 /var/log/audit/audit.log 2023-10-16T18:56:57.518 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root 6u unix 0xffff8ed4886be1c0 0t0 14897 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.518 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root 7u unix 0xffff8ed4884e6600 0t0 14896 type=STREAM (CONNECTED) 2023-10-16T18:56:57.519 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root 8u unix 0xffff8ed4884e1100 0t0 14898 type=STREAM (CONNECTED) 2023-10-16T18:56:57.519 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root 9u unix 0xffff8ed4884e0440 0t0 14899 type=STREAM (CONNECTED) 2023-10-16T18:56:57.519 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 682 auditd root 10u a_inode 0,14 0 1053 [eventfd:0] 2023-10-16T18:56:57.519 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.520 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.520 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-10-16T18:56:57.520 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.520 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.521 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.521 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.521 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.521 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:57.522 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:57.522 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:57.522 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:57.522 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:57.523 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:57.523 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:57.523 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:57.524 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-10-16T18:56:57.524 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:57.524 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.524 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.525 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.525 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.525 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root 3u netlink 0t0 14894 AUDIT 2023-10-16T18:56:57.525 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root 5w REG 8,1 2858405 1205 /var/log/audit/audit.log 2023-10-16T18:56:57.526 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root 6u unix 0xffff8ed4886be1c0 0t0 14897 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.526 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root 7u unix 0xffff8ed4884e6600 0t0 14896 type=STREAM (CONNECTED) 2023-10-16T18:56:57.526 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root 8u unix 0xffff8ed4884e1100 0t0 14898 type=STREAM (CONNECTED) 2023-10-16T18:56:57.526 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root 9u unix 0xffff8ed4884e0440 0t0 14899 type=STREAM (CONNECTED) 2023-10-16T18:56:57.527 INFO:teuthology.orchestra.run.smithi059.stdout:auditd 681 684 auditd root 10u a_inode 0,14 0 1053 [eventfd:0] 2023-10-16T18:56:57.527 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.527 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.528 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root txt REG 8,1 19624 11914 /usr/sbin/sedispatch 2023-10-16T18:56:57.528 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.528 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.528 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.529 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.529 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.529 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.529 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:57.530 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.530 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.530 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.531 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.531 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.531 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-10-16T18:56:57.531 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-10-16T18:56:57.532 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:57.532 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.532 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root 0u unix 0xffff8ed4884e4400 0t0 14895 type=STREAM (CONNECTED) 2023-10-16T18:56:57.532 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.533 INFO:teuthology.orchestra.run.smithi059.stdout:sedispatc 683 root 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.533 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/6 720 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.533 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/6 720 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.533 INFO:teuthology.orchestra.run.smithi059.stdout:kworker/6 720 root txt unknown /proc/720/exe 2023-10-16T18:56:57.534 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.534 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.534 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus txt REG 8,1 131896 11213 /usr/bin/dbus-broker-launch 2023-10-16T18:56:57.535 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus DEL REG 0,1 3072 /memfd:dbus-broker-log 2023-10-16T18:56:57.535 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.535 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.535 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.536 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.536 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.536 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.536 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.537 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.537 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.537 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.537 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.538 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.538 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-16T18:56:57.538 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:57.539 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:57.539 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.539 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.539 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus 1u unix 0xffff8ed489ad0880 0t0 17966 type=STREAM (CONNECTED) 2023-10-16T18:56:57.540 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus 2u unix 0xffff8ed489ad0880 0t0 17966 type=STREAM (CONNECTED) 2023-10-16T18:56:57.540 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus 3u unix 0xffff8ed49038fb40 0t0 20049 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-10-16T18:56:57.540 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus 4u unix 0xffff8ed48b9d72c0 0t0 17976 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.540 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus 5u a_inode 0,14 0 1053 [eventpoll:6,7,8,9,10,11] 2023-10-16T18:56:57.541 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus 6u a_inode 0,14 0 1053 [signalfd] 2023-10-16T18:56:57.541 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus 7r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.541 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus 8u unix 0xffff8ed489ad3300 0t0 17978 type=STREAM (CONNECTED) 2023-10-16T18:56:57.542 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus 9u unix 0xffff8ed486c161c0 0t0 18829 type=STREAM (CONNECTED) 2023-10-16T18:56:57.542 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus 10u a_inode 0,14 0 1053 [pidfd:723] 2023-10-16T18:56:57.542 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus 11u a_inode 0,14 0 1053 [timerfd] 2023-10-16T18:56:57.542 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 722 dbus 12u REG 0,1 2097152 3072 /memfd:dbus-broker-log (deleted) 2023-10-16T18:56:57.543 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.543 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.543 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus txt REG 8,1 236336 11212 /usr/bin/dbus-broker 2023-10-16T18:56:57.543 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.544 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.544 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.544 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.545 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:57.545 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:57.545 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.545 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.546 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-16T18:56:57.546 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.546 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus 1u unix 0xffff8ed489ad0880 0t0 17966 type=STREAM (CONNECTED) 2023-10-16T18:56:57.546 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus 2u unix 0xffff8ed489ad0880 0t0 17966 type=STREAM (CONNECTED) 2023-10-16T18:56:57.547 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus 3u sock 0,8 0t0 314 protocol: NETLINK 2023-10-16T18:56:57.547 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus 4u unix 0xffff8ed48b9d72c0 0t0 17976 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.547 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus 5u a_inode 0,14 0 1053 [eventpoll:6,7,8,9,10,11,12,13,14,15,16,18,20] 2023-10-16T18:56:57.548 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus 6u a_inode 0,14 0 1053 [signalfd] 2023-10-16T18:56:57.548 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus 7u unix 0xffff8ed49038fb40 0t0 20049 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-10-16T18:56:57.548 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus 8u unix 0xffff8ed490388000 0t0 315 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-10-16T18:56:57.548 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus 9u unix 0xffff8ed489ad2ec0 0t0 17979 type=STREAM (CONNECTED) 2023-10-16T18:56:57.549 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus 10u unix 0xffff8ed486c10000 0t0 317 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-10-16T18:56:57.549 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus 11u unix 0xffff8ed489ad3740 0t0 14962 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-10-16T18:56:57.549 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus 12u unix 0xffff8ed490388440 0t0 15853 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-10-16T18:56:57.549 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus 13u unix 0xffff8ed49038bb80 0t0 18930 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-10-16T18:56:57.550 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus 14u sock 0,8 0t0 18932 protocol: UNIX-STREAM 2023-10-16T18:56:57.550 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus 15u unix 0xffff8ed490388880 0t0 22566 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-10-16T18:56:57.550 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus 16u unix 0xffff8ed490141540 0t0 22568 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-10-16T18:56:57.550 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus 18u unix 0xffff8ed490142640 0t0 22628 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-10-16T18:56:57.551 INFO:teuthology.orchestra.run.smithi059.stdout:dbus-brok 723 dbus 20u unix 0xffff8ed486c17700 0t0 453 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-10-16T18:56:57.551 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.551 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.552 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2023-10-16T18:56:57.552 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:57.552 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-10-16T18:56:57.552 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-10-16T18:56:57.553 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-10-16T18:56:57.553 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-10-16T18:56:57.553 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-10-16T18:56:57.553 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:57.554 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:57.554 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.554 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-16T18:56:57.555 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.555 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-10-16T18:56:57.555 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-10-16T18:56:57.555 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-10-16T18:56:57.556 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:57.556 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:57.556 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:57.556 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.557 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.557 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.557 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.558 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.558 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-10-16T18:56:57.558 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.558 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-10-16T18:56:57.559 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-10-16T18:56:57.559 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:57.559 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:57.559 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:57.560 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:57.560 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-10-16T18:56:57.560 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-10-16T18:56:57.561 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-10-16T18:56:57.561 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-10-16T18:56:57.561 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:57.561 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.562 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.562 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.562 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.562 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.563 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-10-16T18:56:57.563 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-10-16T18:56:57.563 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:57.564 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:57.564 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.564 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:57.564 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.565 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-10-16T18:56:57.565 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-10-16T18:56:57.565 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.565 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.566 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-10-16T18:56:57.566 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-10-16T18:56:57.566 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:57.566 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.567 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.567 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.567 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:57.567 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.568 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-10-16T18:56:57.568 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.568 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-10-16T18:56:57.569 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:57.569 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:57.569 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:57.569 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:57.570 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:57.570 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:57.570 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.570 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:57.571 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.571 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 1u unix 0xffff8ed4902bd940 0t0 21669 type=STREAM (CONNECTED) 2023-10-16T18:56:57.571 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 2u unix 0xffff8ed4902bd940 0t0 21669 type=STREAM (CONNECTED) 2023-10-16T18:56:57.571 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 3u a_inode 0,14 0 1053 [eventfd:3] 2023-10-16T18:56:57.572 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 4u a_inode 0,14 0 1053 [eventfd:4] 2023-10-16T18:56:57.572 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 5u unix 0xffff8ed490394c80 0t0 20113 type=DGRAM (UNCONNECTED) 2023-10-16T18:56:57.572 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 6u unix 0xffff8ed49038c400 0t0 20114 type=STREAM (CONNECTED) 2023-10-16T18:56:57.573 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 7u a_inode 0,14 0 1053 [eventfd:5] 2023-10-16T18:56:57.573 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 8r REG 0,4 0 4026531840 net 2023-10-16T18:56:57.573 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 9r REG 0,4 0 4026532495 mnt 2023-10-16T18:56:57.573 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 10u netlink 0t0 15858 KOBJECT_UEVENT 2023-10-16T18:56:57.574 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 11u netlink 0t0 15859 GENERIC 2023-10-16T18:56:57.574 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 12u netlink 0t0 15860 GENERIC 2023-10-16T18:56:57.574 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 13u netlink 0t0 15861 ROUTE 2023-10-16T18:56:57.574 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 14r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.575 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 15r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.575 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 16u netlink 0t0 22565 KOBJECT_UEVENT 2023-10-16T18:56:57.575 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 17u a_inode 0,14 0 1053 [eventpoll] 2023-10-16T18:56:57.575 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 18u unix 0xffff8ed49038f700 0t0 20121 type=STREAM (CONNECTED) 2023-10-16T18:56:57.576 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 19u a_inode 0,14 0 1053 [eventpoll:21,22,27] 2023-10-16T18:56:57.576 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 20w FIFO 0,24 0t0 1312 /run/systemd/inhibit/1.ref 2023-10-16T18:56:57.576 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 21u a_inode 0,14 0 1053 [timerfd] 2023-10-16T18:56:57.576 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 22u pack 20140 0t0 IP type=SOCK_DGRAM 2023-10-16T18:56:57.577 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 23u raw6 0t0 20162 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-10-16T18:56:57.577 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 root 27u IPv4 20164 0t0 UDP smithi059.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-10-16T18:56:57.577 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.577 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.578 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2023-10-16T18:56:57.578 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:57.578 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-10-16T18:56:57.579 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-10-16T18:56:57.579 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-10-16T18:56:57.579 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-10-16T18:56:57.579 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-10-16T18:56:57.580 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:57.580 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:57.580 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.580 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-16T18:56:57.581 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.581 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-10-16T18:56:57.581 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-10-16T18:56:57.581 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-10-16T18:56:57.582 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:57.582 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:57.582 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:57.583 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.583 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.583 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.583 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.584 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.584 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-10-16T18:56:57.584 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.584 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-10-16T18:56:57.585 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-10-16T18:56:57.585 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:57.585 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:57.586 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:57.586 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:57.586 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-10-16T18:56:57.586 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-10-16T18:56:57.587 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-10-16T18:56:57.587 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-10-16T18:56:57.587 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:57.587 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.588 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.588 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.588 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.588 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.589 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-10-16T18:56:57.589 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-10-16T18:56:57.589 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:57.590 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:57.590 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.590 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:57.590 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.591 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-10-16T18:56:57.591 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-10-16T18:56:57.591 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.591 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.592 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-10-16T18:56:57.592 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-10-16T18:56:57.592 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:57.592 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.593 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.593 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.593 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:57.593 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.594 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-10-16T18:56:57.594 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.594 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-10-16T18:56:57.595 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:57.595 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:57.595 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:57.595 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:57.596 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:57.596 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:57.596 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.596 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:57.597 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.597 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 1u unix 0xffff8ed4902bd940 0t0 21669 type=STREAM (CONNECTED) 2023-10-16T18:56:57.597 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 2u unix 0xffff8ed4902bd940 0t0 21669 type=STREAM (CONNECTED) 2023-10-16T18:56:57.598 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 3u a_inode 0,14 0 1053 [eventfd:3] 2023-10-16T18:56:57.598 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 4u a_inode 0,14 0 1053 [eventfd:4] 2023-10-16T18:56:57.598 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 5u unix 0xffff8ed490394c80 0t0 20113 type=DGRAM (UNCONNECTED) 2023-10-16T18:56:57.598 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 6u unix 0xffff8ed49038c400 0t0 20114 type=STREAM (CONNECTED) 2023-10-16T18:56:57.599 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 7u a_inode 0,14 0 1053 [eventfd:5] 2023-10-16T18:56:57.599 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 8r REG 0,4 0 4026531840 net 2023-10-16T18:56:57.599 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 9r REG 0,4 0 4026532495 mnt 2023-10-16T18:56:57.599 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 10u netlink 0t0 15858 KOBJECT_UEVENT 2023-10-16T18:56:57.600 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 11u netlink 0t0 15859 GENERIC 2023-10-16T18:56:57.600 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 12u netlink 0t0 15860 GENERIC 2023-10-16T18:56:57.600 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 13u netlink 0t0 15861 ROUTE 2023-10-16T18:56:57.600 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 14r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.601 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 15r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.601 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 16u netlink 0t0 22565 KOBJECT_UEVENT 2023-10-16T18:56:57.601 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 17u a_inode 0,14 0 1053 [eventpoll] 2023-10-16T18:56:57.602 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 18u unix 0xffff8ed49038f700 0t0 20121 type=STREAM (CONNECTED) 2023-10-16T18:56:57.602 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 19u a_inode 0,14 0 1053 [eventpoll:21,22,27] 2023-10-16T18:56:57.602 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 20w FIFO 0,24 0t0 1312 /run/systemd/inhibit/1.ref 2023-10-16T18:56:57.602 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 21u a_inode 0,14 0 1053 [timerfd] 2023-10-16T18:56:57.603 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 22u pack 20140 0t0 IP type=SOCK_DGRAM 2023-10-16T18:56:57.603 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 23u raw6 0t0 20162 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-10-16T18:56:57.603 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 763 gmain root 27u IPv4 20164 0t0 UDP smithi059.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-10-16T18:56:57.603 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.604 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.604 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2023-10-16T18:56:57.604 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:57.604 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-10-16T18:56:57.605 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-10-16T18:56:57.605 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-10-16T18:56:57.605 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-10-16T18:56:57.606 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-10-16T18:56:57.606 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:57.606 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:57.606 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.607 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-16T18:56:57.607 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.607 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-10-16T18:56:57.607 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-10-16T18:56:57.608 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-10-16T18:56:57.608 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:57.608 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:57.609 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:57.609 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.609 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.609 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.610 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.610 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.610 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-10-16T18:56:57.610 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.611 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-10-16T18:56:57.611 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-10-16T18:56:57.611 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:57.612 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:57.612 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:57.612 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:57.612 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-10-16T18:56:57.613 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-10-16T18:56:57.613 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-10-16T18:56:57.613 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-10-16T18:56:57.613 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:57.614 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.614 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.614 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.615 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.615 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.615 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-10-16T18:56:57.615 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-10-16T18:56:57.616 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:57.616 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:57.616 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.616 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:57.617 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.617 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-10-16T18:56:57.617 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-10-16T18:56:57.617 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.618 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.618 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-10-16T18:56:57.618 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-10-16T18:56:57.619 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:57.619 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.619 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.619 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.620 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:57.620 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.620 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-10-16T18:56:57.620 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.621 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-10-16T18:56:57.621 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:57.621 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:57.621 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:57.622 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:57.622 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:57.622 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:57.623 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.623 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:57.623 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.623 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 1u unix 0xffff8ed4902bd940 0t0 21669 type=STREAM (CONNECTED) 2023-10-16T18:56:57.624 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 2u unix 0xffff8ed4902bd940 0t0 21669 type=STREAM (CONNECTED) 2023-10-16T18:56:57.624 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 3u a_inode 0,14 0 1053 [eventfd:3] 2023-10-16T18:56:57.624 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 4u a_inode 0,14 0 1053 [eventfd:4] 2023-10-16T18:56:57.624 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 5u unix 0xffff8ed490394c80 0t0 20113 type=DGRAM (UNCONNECTED) 2023-10-16T18:56:57.625 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 6u unix 0xffff8ed49038c400 0t0 20114 type=STREAM (CONNECTED) 2023-10-16T18:56:57.625 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 7u a_inode 0,14 0 1053 [eventfd:5] 2023-10-16T18:56:57.625 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 8r REG 0,4 0 4026531840 net 2023-10-16T18:56:57.625 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 9r REG 0,4 0 4026532495 mnt 2023-10-16T18:56:57.626 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 10u netlink 0t0 15858 KOBJECT_UEVENT 2023-10-16T18:56:57.626 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 11u netlink 0t0 15859 GENERIC 2023-10-16T18:56:57.626 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 12u netlink 0t0 15860 GENERIC 2023-10-16T18:56:57.627 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 13u netlink 0t0 15861 ROUTE 2023-10-16T18:56:57.627 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 14r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.627 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 15r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.627 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 16u netlink 0t0 22565 KOBJECT_UEVENT 2023-10-16T18:56:57.628 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 17u a_inode 0,14 0 1053 [eventpoll] 2023-10-16T18:56:57.628 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 18u unix 0xffff8ed49038f700 0t0 20121 type=STREAM (CONNECTED) 2023-10-16T18:56:57.628 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 19u a_inode 0,14 0 1053 [eventpoll:21,22,27] 2023-10-16T18:56:57.628 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 20w FIFO 0,24 0t0 1312 /run/systemd/inhibit/1.ref 2023-10-16T18:56:57.629 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 21u a_inode 0,14 0 1053 [timerfd] 2023-10-16T18:56:57.629 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 22u pack 20140 0t0 IP type=SOCK_DGRAM 2023-10-16T18:56:57.629 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 23u raw6 0t0 20162 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-10-16T18:56:57.629 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 764 gdbus root 27u IPv4 20164 0t0 UDP smithi059.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-10-16T18:56:57.630 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.630 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.630 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2023-10-16T18:56:57.631 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:57.631 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-10-16T18:56:57.631 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-10-16T18:56:57.631 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-10-16T18:56:57.632 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-10-16T18:56:57.632 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-10-16T18:56:57.632 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:57.632 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:57.633 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.633 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-16T18:56:57.633 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.633 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-10-16T18:56:57.634 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-10-16T18:56:57.634 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-10-16T18:56:57.634 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:57.635 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:57.635 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:57.635 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.635 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.636 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.636 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.636 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.636 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-10-16T18:56:57.637 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.637 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-10-16T18:56:57.637 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-10-16T18:56:57.638 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:57.638 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:57.638 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:57.638 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:57.639 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-10-16T18:56:57.639 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-10-16T18:56:57.639 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-10-16T18:56:57.639 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-10-16T18:56:57.640 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:57.640 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.640 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.640 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.641 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.641 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.641 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-10-16T18:56:57.642 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-10-16T18:56:57.642 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:57.642 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:57.642 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.643 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:57.643 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.643 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-10-16T18:56:57.643 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-10-16T18:56:57.644 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.644 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.644 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-10-16T18:56:57.644 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-10-16T18:56:57.645 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:57.645 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.645 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.645 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.646 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:57.646 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.646 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-10-16T18:56:57.647 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.647 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-10-16T18:56:57.647 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:57.647 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:57.648 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:57.648 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:57.648 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:57.648 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:57.649 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.649 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:57.649 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.650 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 1u unix 0xffff8ed4902bd940 0t0 21669 type=STREAM (CONNECTED) 2023-10-16T18:56:57.650 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 2u unix 0xffff8ed4902bd940 0t0 21669 type=STREAM (CONNECTED) 2023-10-16T18:56:57.650 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 3u a_inode 0,14 0 1053 [eventfd:3] 2023-10-16T18:56:57.650 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 4u a_inode 0,14 0 1053 [eventfd:4] 2023-10-16T18:56:57.651 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 5u unix 0xffff8ed490394c80 0t0 20113 type=DGRAM (UNCONNECTED) 2023-10-16T18:56:57.651 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 6u unix 0xffff8ed49038c400 0t0 20114 type=STREAM (CONNECTED) 2023-10-16T18:56:57.651 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 7u a_inode 0,14 0 1053 [eventfd:5] 2023-10-16T18:56:57.651 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 8r REG 0,4 0 4026531840 net 2023-10-16T18:56:57.652 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 9r REG 0,4 0 4026532495 mnt 2023-10-16T18:56:57.652 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 10u netlink 0t0 15858 KOBJECT_UEVENT 2023-10-16T18:56:57.652 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 11u netlink 0t0 15859 GENERIC 2023-10-16T18:56:57.653 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 12u netlink 0t0 15860 GENERIC 2023-10-16T18:56:57.653 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 13u netlink 0t0 15861 ROUTE 2023-10-16T18:56:57.653 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 14r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.653 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 15r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.654 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 16u netlink 0t0 22565 KOBJECT_UEVENT 2023-10-16T18:56:57.654 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 17u a_inode 0,14 0 1053 [eventpoll] 2023-10-16T18:56:57.654 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 18u unix 0xffff8ed49038f700 0t0 20121 type=STREAM (CONNECTED) 2023-10-16T18:56:57.654 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 19u a_inode 0,14 0 1053 [eventpoll:21,22,27] 2023-10-16T18:56:57.655 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 20w FIFO 0,24 0t0 1312 /run/systemd/inhibit/1.ref 2023-10-16T18:56:57.655 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 21u a_inode 0,14 0 1053 [timerfd] 2023-10-16T18:56:57.655 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 22u pack 20140 0t0 IP type=SOCK_DGRAM 2023-10-16T18:56:57.656 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 23u raw6 0t0 20162 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-10-16T18:56:57.656 INFO:teuthology.orchestra.run.smithi059.stdout:NetworkMa 724 769 pool-Netw root 27u IPv4 20164 0t0 UDP smithi059.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-10-16T18:56:57.656 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.656 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.657 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2023-10-16T18:56:57.657 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.657 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.657 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.658 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 root mem REG 8,1 54392 9998 /usr/lib64/libnuma.so.1.0.0 2023-10-16T18:56:57.658 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.658 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:57.659 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.659 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.659 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 root 1u unix 0xffff8ed4902bee80 0t0 21678 type=STREAM (CONNECTED) 2023-10-16T18:56:57.659 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 root 2u unix 0xffff8ed4902bee80 0t0 21678 type=STREAM (CONNECTED) 2023-10-16T18:56:57.660 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 root 3u a_inode 0,14 0 1053 [eventfd:1] 2023-10-16T18:56:57.660 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 root 4u a_inode 0,14 0 1053 [eventfd:2] 2023-10-16T18:56:57.660 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 root 5u unix 0xffff8ed4902bcc80 0t0 21688 /run/irqbalance/irqbalance727.sock type=STREAM (LISTEN) 2023-10-16T18:56:57.660 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 root 6u unix 0xffff8ed490393b80 0t0 23827 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.661 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 732 gmain root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.661 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 732 gmain root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.661 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 732 gmain root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2023-10-16T18:56:57.661 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 732 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.662 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 732 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.662 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 732 gmain root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.662 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 732 gmain root mem REG 8,1 54392 9998 /usr/lib64/libnuma.so.1.0.0 2023-10-16T18:56:57.663 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 732 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.663 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 732 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:57.663 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 732 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.663 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 732 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.664 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 732 gmain root 1u unix 0xffff8ed4902bee80 0t0 21678 type=STREAM (CONNECTED) 2023-10-16T18:56:57.664 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 732 gmain root 2u unix 0xffff8ed4902bee80 0t0 21678 type=STREAM (CONNECTED) 2023-10-16T18:56:57.664 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 732 gmain root 3u a_inode 0,14 0 1053 [eventfd:1] 2023-10-16T18:56:57.664 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 732 gmain root 4u a_inode 0,14 0 1053 [eventfd:2] 2023-10-16T18:56:57.665 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 732 gmain root 5u unix 0xffff8ed4902bcc80 0t0 21688 /run/irqbalance/irqbalance727.sock type=STREAM (LISTEN) 2023-10-16T18:56:57.665 INFO:teuthology.orchestra.run.smithi059.stdout:irqbalanc 727 732 gmain root 6u unix 0xffff8ed490393b80 0t0 23827 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.665 INFO:teuthology.orchestra.run.smithi059.stdout:lsmd 728 libstoragemgmt cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.665 INFO:teuthology.orchestra.run.smithi059.stdout:lsmd 728 libstoragemgmt rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.666 INFO:teuthology.orchestra.run.smithi059.stdout:lsmd 728 libstoragemgmt txt REG 8,1 32280 11292 /usr/bin/lsmd 2023-10-16T18:56:57.666 INFO:teuthology.orchestra.run.smithi059.stdout:lsmd 728 libstoragemgmt mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.666 INFO:teuthology.orchestra.run.smithi059.stdout:lsmd 728 libstoragemgmt mem REG 8,1 56912 10811 /usr/lib64/libconfig.so.11.0.2 2023-10-16T18:56:57.667 INFO:teuthology.orchestra.run.smithi059.stdout:lsmd 728 libstoragemgmt mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.667 INFO:teuthology.orchestra.run.smithi059.stdout:lsmd 728 libstoragemgmt 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.667 INFO:teuthology.orchestra.run.smithi059.stdout:lsmd 728 libstoragemgmt 1u unix 0xffff8ed490140440 0t0 319 type=STREAM (CONNECTED) 2023-10-16T18:56:57.667 INFO:teuthology.orchestra.run.smithi059.stdout:lsmd 728 libstoragemgmt 2u unix 0xffff8ed490140440 0t0 319 type=STREAM (CONNECTED) 2023-10-16T18:56:57.668 INFO:teuthology.orchestra.run.smithi059.stdout:lsmd 728 libstoragemgmt 3uW REG 0,24 0 1250 /run/lsm/ipc/.lsmd-ipc-lock 2023-10-16T18:56:57.668 INFO:teuthology.orchestra.run.smithi059.stdout:lsmd 728 libstoragemgmt 5u unix 0xffff8ed4884c50c0 0t0 15838 /var/run/lsm/ipc/simc type=STREAM (LISTEN) 2023-10-16T18:56:57.668 INFO:teuthology.orchestra.run.smithi059.stdout:lsmd 728 libstoragemgmt 6u unix 0xffff8ed4884c1980 0t0 15839 /var/run/lsm/ipc/sim type=STREAM (LISTEN) 2023-10-16T18:56:57.668 INFO:teuthology.orchestra.run.smithi059.stdout:mcelog 729 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.669 INFO:teuthology.orchestra.run.smithi059.stdout:mcelog 729 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.669 INFO:teuthology.orchestra.run.smithi059.stdout:mcelog 729 root txt REG 8,1 194568 12461 /usr/sbin/mcelog 2023-10-16T18:56:57.669 INFO:teuthology.orchestra.run.smithi059.stdout:mcelog 729 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.670 INFO:teuthology.orchestra.run.smithi059.stdout:mcelog 729 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.670 INFO:teuthology.orchestra.run.smithi059.stdout:mcelog 729 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.670 INFO:teuthology.orchestra.run.smithi059.stdout:mcelog 729 root 1u unix 0xffff8ed490142200 0t0 322 type=STREAM (CONNECTED) 2023-10-16T18:56:57.670 INFO:teuthology.orchestra.run.smithi059.stdout:mcelog 729 root 2u unix 0xffff8ed490142200 0t0 322 type=STREAM (CONNECTED) 2023-10-16T18:56:57.671 INFO:teuthology.orchestra.run.smithi059.stdout:mcelog 729 root 3r CHR 10,227 0t0 142 /dev/mcelog 2023-10-16T18:56:57.671 INFO:teuthology.orchestra.run.smithi059.stdout:mcelog 729 root 4u unix 0xffff8ed4902bc840 0t0 21691 /var/run/mcelog-client type=STREAM (LISTEN) 2023-10-16T18:56:57.671 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.671 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.672 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:57.672 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.672 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.672 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.673 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.673 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.673 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-16T18:56:57.674 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.674 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.674 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.674 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-16T18:56:57.675 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.675 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.675 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.675 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.676 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.676 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.676 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.676 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.677 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.677 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.677 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-16T18:56:57.678 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.678 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.678 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.678 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.679 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:57.679 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.679 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.680 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.680 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.680 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd 3r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.680 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd 4u a_inode 0,14 0 1053 [eventfd:7] 2023-10-16T18:56:57.681 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd 5u a_inode 0,14 0 1053 [eventfd:8] 2023-10-16T18:56:57.681 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd 6u unix 0xffff8ed490388cc0 0t0 20117 type=STREAM (CONNECTED) 2023-10-16T18:56:57.681 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd 7u a_inode 0,14 0 1053 [eventfd:9] 2023-10-16T18:56:57.681 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd 8r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.682 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd 9u a_inode 0,14 0 1053 [eventfd:12] 2023-10-16T18:56:57.682 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 polkitd 10u unix 0xffff8ed49023bb80 0t0 21808 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.682 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.682 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.683 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:57.683 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.683 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.684 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.684 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.684 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.684 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-16T18:56:57.685 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.685 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.685 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.685 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-16T18:56:57.686 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.686 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.686 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.687 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.687 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.687 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.687 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.688 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.688 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.688 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.688 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-16T18:56:57.689 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.689 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.689 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.689 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.690 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:57.690 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.690 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.691 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.691 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.691 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd 3r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.691 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd 4u a_inode 0,14 0 1053 [eventfd:7] 2023-10-16T18:56:57.692 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd 5u a_inode 0,14 0 1053 [eventfd:8] 2023-10-16T18:56:57.692 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd 6u unix 0xffff8ed490388cc0 0t0 20117 type=STREAM (CONNECTED) 2023-10-16T18:56:57.692 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd 7u a_inode 0,14 0 1053 [eventfd:9] 2023-10-16T18:56:57.692 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd 8r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.693 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd 9u a_inode 0,14 0 1053 [eventfd:12] 2023-10-16T18:56:57.693 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 771 gmain polkitd 10u unix 0xffff8ed49023bb80 0t0 21808 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.693 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.693 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.694 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:57.694 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.694 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.695 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.695 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.695 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.695 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-16T18:56:57.696 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.696 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.696 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.696 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-16T18:56:57.697 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.697 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.697 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.697 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.698 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.698 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.698 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.699 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.699 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.699 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.699 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-16T18:56:57.700 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.700 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.700 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.701 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.701 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:57.701 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.701 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.702 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.702 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.702 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd 3r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.702 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd 4u a_inode 0,14 0 1053 [eventfd:7] 2023-10-16T18:56:57.703 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd 5u a_inode 0,14 0 1053 [eventfd:8] 2023-10-16T18:56:57.703 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd 6u unix 0xffff8ed490388cc0 0t0 20117 type=STREAM (CONNECTED) 2023-10-16T18:56:57.703 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd 7u a_inode 0,14 0 1053 [eventfd:9] 2023-10-16T18:56:57.703 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd 8r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.704 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd 9u a_inode 0,14 0 1053 [eventfd:12] 2023-10-16T18:56:57.704 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 772 gdbus polkitd 10u unix 0xffff8ed49023bb80 0t0 21808 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.704 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.705 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.705 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:57.705 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.705 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.706 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.706 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.706 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.706 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-16T18:56:57.707 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.707 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.707 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.708 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-16T18:56:57.708 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.708 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.708 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.709 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.709 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.709 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.709 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.710 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.710 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.710 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.711 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-16T18:56:57.711 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.711 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.711 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.712 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.712 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:57.712 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.712 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.713 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.713 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.713 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd 3r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.713 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd 4u a_inode 0,14 0 1053 [eventfd:7] 2023-10-16T18:56:57.714 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd 5u a_inode 0,14 0 1053 [eventfd:8] 2023-10-16T18:56:57.714 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd 6u unix 0xffff8ed490388cc0 0t0 20117 type=STREAM (CONNECTED) 2023-10-16T18:56:57.714 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd 7u a_inode 0,14 0 1053 [eventfd:9] 2023-10-16T18:56:57.717 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd 8r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.717 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd 9u a_inode 0,14 0 1053 [eventfd:12] 2023-10-16T18:56:57.718 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 773 JS\x20Hel polkitd 10u unix 0xffff8ed49023bb80 0t0 21808 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.718 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.718 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.718 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:57.719 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.719 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.719 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.720 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.720 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.720 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-16T18:56:57.720 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.721 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.721 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.721 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-16T18:56:57.721 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.722 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.722 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.722 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.723 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.723 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.723 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.723 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.724 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.724 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.724 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-16T18:56:57.724 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.725 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.725 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.725 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.726 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:57.726 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.726 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.726 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.727 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.727 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd 3r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.727 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd 4u a_inode 0,14 0 1053 [eventfd:7] 2023-10-16T18:56:57.728 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd 5u a_inode 0,14 0 1053 [eventfd:8] 2023-10-16T18:56:57.728 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd 6u unix 0xffff8ed490388cc0 0t0 20117 type=STREAM (CONNECTED) 2023-10-16T18:56:57.728 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd 7u a_inode 0,14 0 1053 [eventfd:9] 2023-10-16T18:56:57.728 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd 8r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.729 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd 9u a_inode 0,14 0 1053 [eventfd:12] 2023-10-16T18:56:57.729 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 774 JS\x20Hel polkitd 10u unix 0xffff8ed49023bb80 0t0 21808 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.729 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.729 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.730 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:57.730 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.730 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.730 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.731 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.731 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.731 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-16T18:56:57.732 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.732 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.732 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.732 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-16T18:56:57.733 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.733 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.733 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.733 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.734 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.734 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.734 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.735 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.735 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.735 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.735 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-16T18:56:57.736 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.736 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.736 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.736 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.737 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:57.737 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.737 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.737 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.738 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.738 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd 3r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.738 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd 4u a_inode 0,14 0 1053 [eventfd:7] 2023-10-16T18:56:57.739 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd 5u a_inode 0,14 0 1053 [eventfd:8] 2023-10-16T18:56:57.739 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd 6u unix 0xffff8ed490388cc0 0t0 20117 type=STREAM (CONNECTED) 2023-10-16T18:56:57.739 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd 7u a_inode 0,14 0 1053 [eventfd:9] 2023-10-16T18:56:57.739 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd 8r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.740 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd 9u a_inode 0,14 0 1053 [eventfd:12] 2023-10-16T18:56:57.740 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 775 JS\x20Hel polkitd 10u unix 0xffff8ed49023bb80 0t0 21808 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.740 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.740 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.741 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:57.741 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.741 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.742 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.742 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.742 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.742 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-16T18:56:57.743 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.743 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.743 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.743 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-16T18:56:57.744 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.744 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.744 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.745 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.745 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.745 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.745 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.746 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.746 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.746 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.746 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-16T18:56:57.747 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.747 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.747 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.748 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.748 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:57.748 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.748 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.749 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.749 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.749 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd 3r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.749 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd 4u a_inode 0,14 0 1053 [eventfd:7] 2023-10-16T18:56:57.750 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd 5u a_inode 0,14 0 1053 [eventfd:8] 2023-10-16T18:56:57.750 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd 6u unix 0xffff8ed490388cc0 0t0 20117 type=STREAM (CONNECTED) 2023-10-16T18:56:57.750 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd 7u a_inode 0,14 0 1053 [eventfd:9] 2023-10-16T18:56:57.750 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd 8r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.751 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd 9u a_inode 0,14 0 1053 [eventfd:12] 2023-10-16T18:56:57.751 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 776 JS\x20Hel polkitd 10u unix 0xffff8ed49023bb80 0t0 21808 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.751 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.752 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.752 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:57.752 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.752 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.753 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.753 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.753 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.753 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-16T18:56:57.754 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.754 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.754 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.755 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-16T18:56:57.755 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.755 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.755 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.756 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.756 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.756 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.756 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.757 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.757 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.757 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.758 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-16T18:56:57.758 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.758 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.758 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.759 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.759 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:57.759 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.760 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.760 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.760 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.760 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd 3r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.761 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd 4u a_inode 0,14 0 1053 [eventfd:7] 2023-10-16T18:56:57.761 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd 5u a_inode 0,14 0 1053 [eventfd:8] 2023-10-16T18:56:57.761 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd 6u unix 0xffff8ed490388cc0 0t0 20117 type=STREAM (CONNECTED) 2023-10-16T18:56:57.762 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd 7u a_inode 0,14 0 1053 [eventfd:9] 2023-10-16T18:56:57.762 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd 8r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.762 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd 9u a_inode 0,14 0 1053 [eventfd:12] 2023-10-16T18:56:57.762 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 777 JS\x20Hel polkitd 10u unix 0xffff8ed49023bb80 0t0 21808 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.763 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.763 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.763 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:57.763 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.764 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.764 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.764 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.765 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.765 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-16T18:56:57.765 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.765 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.766 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.766 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-16T18:56:57.766 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.766 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.767 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.767 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.767 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.768 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.768 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.768 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.768 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.769 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.769 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-16T18:56:57.769 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.769 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.770 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.770 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.770 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:57.771 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.771 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.771 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.771 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.772 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd 3r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.772 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd 4u a_inode 0,14 0 1053 [eventfd:7] 2023-10-16T18:56:57.772 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd 5u a_inode 0,14 0 1053 [eventfd:8] 2023-10-16T18:56:57.772 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd 6u unix 0xffff8ed490388cc0 0t0 20117 type=STREAM (CONNECTED) 2023-10-16T18:56:57.773 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd 7u a_inode 0,14 0 1053 [eventfd:9] 2023-10-16T18:56:57.773 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd 8r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.773 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd 9u a_inode 0,14 0 1053 [eventfd:12] 2023-10-16T18:56:57.774 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 778 JS\x20Hel polkitd 10u unix 0xffff8ed49023bb80 0t0 21808 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.774 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.774 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.774 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:57.775 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.775 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.775 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.775 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.776 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.776 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-16T18:56:57.776 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.777 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.777 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.777 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-16T18:56:57.777 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.778 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.778 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.778 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.779 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.779 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.779 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.779 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.780 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.780 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.780 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-16T18:56:57.780 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.781 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.781 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.781 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.781 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:57.782 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.782 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.782 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.783 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.783 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd 3r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.783 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd 4u a_inode 0,14 0 1053 [eventfd:7] 2023-10-16T18:56:57.783 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd 5u a_inode 0,14 0 1053 [eventfd:8] 2023-10-16T18:56:57.784 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd 6u unix 0xffff8ed490388cc0 0t0 20117 type=STREAM (CONNECTED) 2023-10-16T18:56:57.784 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd 7u a_inode 0,14 0 1053 [eventfd:9] 2023-10-16T18:56:57.784 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd 8r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.784 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd 9u a_inode 0,14 0 1053 [eventfd:12] 2023-10-16T18:56:57.785 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 779 JS\x20Hel polkitd 10u unix 0xffff8ed49023bb80 0t0 21808 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.785 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.785 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.785 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:57.786 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.786 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.786 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.787 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.787 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.787 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-16T18:56:57.787 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.788 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.788 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.788 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-16T18:56:57.789 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.789 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.789 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.789 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.790 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.790 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.790 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.790 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.791 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.791 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.791 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-16T18:56:57.792 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.792 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.792 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.792 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.793 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:57.793 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.793 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.793 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.794 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.794 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd 3r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.794 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd 4u a_inode 0,14 0 1053 [eventfd:7] 2023-10-16T18:56:57.794 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd 5u a_inode 0,14 0 1053 [eventfd:8] 2023-10-16T18:56:57.795 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd 6u unix 0xffff8ed490388cc0 0t0 20117 type=STREAM (CONNECTED) 2023-10-16T18:56:57.795 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd 7u a_inode 0,14 0 1053 [eventfd:9] 2023-10-16T18:56:57.795 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd 8r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.796 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd 9u a_inode 0,14 0 1053 [eventfd:12] 2023-10-16T18:56:57.796 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 780 JS\x20Hel polkitd 10u unix 0xffff8ed49023bb80 0t0 21808 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.796 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.796 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.797 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:57.797 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.797 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.798 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.798 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.798 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.798 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-16T18:56:57.799 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.799 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.799 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.800 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-16T18:56:57.800 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.800 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.800 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.801 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.801 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.801 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.801 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.802 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.802 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.802 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.802 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-16T18:56:57.803 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.803 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.803 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.803 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.804 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:57.804 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.804 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.805 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.805 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.805 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd 3r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.805 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd 4u a_inode 0,14 0 1053 [eventfd:7] 2023-10-16T18:56:57.806 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd 5u a_inode 0,14 0 1053 [eventfd:8] 2023-10-16T18:56:57.806 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd 6u unix 0xffff8ed490388cc0 0t0 20117 type=STREAM (CONNECTED) 2023-10-16T18:56:57.806 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd 7u a_inode 0,14 0 1053 [eventfd:9] 2023-10-16T18:56:57.806 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd 8r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.807 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd 9u a_inode 0,14 0 1053 [eventfd:12] 2023-10-16T18:56:57.807 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 787 polkitd polkitd 10u unix 0xffff8ed49023bb80 0t0 21808 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.807 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.807 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.808 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-16T18:56:57.808 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.808 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.808 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.809 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.809 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.809 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-16T18:56:57.809 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.810 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.810 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.810 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-16T18:56:57.811 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.811 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.811 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.811 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.812 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.812 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.812 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.812 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.813 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.813 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.813 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-16T18:56:57.814 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.814 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.814 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.814 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.815 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-16T18:56:57.815 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.815 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.815 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.816 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.816 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd 3r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.816 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd 4u a_inode 0,14 0 1053 [eventfd:7] 2023-10-16T18:56:57.817 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd 5u a_inode 0,14 0 1053 [eventfd:8] 2023-10-16T18:56:57.817 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd 6u unix 0xffff8ed490388cc0 0t0 20117 type=STREAM (CONNECTED) 2023-10-16T18:56:57.817 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd 7u a_inode 0,14 0 1053 [eventfd:9] 2023-10-16T18:56:57.817 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd 8r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.818 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd 9u a_inode 0,14 0 1053 [eventfd:12] 2023-10-16T18:56:57.818 INFO:teuthology.orchestra.run.smithi059.stdout:polkitd 730 794 pool-polk polkitd 10u unix 0xffff8ed49023bb80 0t0 21808 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.818 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.818 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.819 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root txt REG 8,1 622048 12498 /usr/sbin/smartd 2023-10-16T18:56:57.819 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.819 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.820 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.820 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.820 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.820 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.821 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.821 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.821 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-16T18:56:57.821 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.822 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.822 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.822 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.822 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:57.823 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.823 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.823 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.824 INFO:teuthology.orchestra.run.smithi059.stdout:smartd 731 root 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.824 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.824 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.824 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root txt REG 8,1 306896 20362 /usr/lib/systemd/systemd-logind 2023-10-16T18:56:57.825 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:57.825 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 595024 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-16T18:56:57.825 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.825 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-16T18:56:57.826 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:57.826 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.826 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.827 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.827 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.827 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.827 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.828 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.828 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.828 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T18:56:57.828 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:57.829 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.829 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:57.829 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-16T18:56:57.830 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.830 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.830 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.830 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-16T18:56:57.831 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-10-16T18:56:57.831 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-10-16T18:56:57.831 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-10-16T18:56:57.831 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.832 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.832 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-10-16T18:56:57.832 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.832 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 21219 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-16T18:56:57.833 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.833 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-16T18:56:57.833 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.833 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 1u unix 0xffff8ed489ad3b80 0t0 17996 type=STREAM (CONNECTED) 2023-10-16T18:56:57.834 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 2u unix 0xffff8ed489ad3b80 0t0 17996 type=STREAM (CONNECTED) 2023-10-16T18:56:57.834 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 3u unix 0xffff8ed48b9d3740 0t0 18021 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.834 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 4u a_inode 0,14 0 1053 [eventpoll:5,6,7,8,9,10,11,12,13,14,15,16,17,18,20,21,22] 2023-10-16T18:56:57.835 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 5u a_inode 0,14 0 1053 [signalfd] 2023-10-16T18:56:57.835 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 6u a_inode 0,14 0 1053 [timerfd] 2023-10-16T18:56:57.835 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 7r REG 0,21 4096 22178 /sys/devices/virtual/tty/tty0/active 2023-10-16T18:56:57.835 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 8u netlink 0t0 18032 KOBJECT_UEVENT 2023-10-16T18:56:57.836 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 9r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:57.836 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 10r FIFO 0,24 0t0 1312 /run/systemd/inhibit/1.ref 2023-10-16T18:56:57.836 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 11u netlink 0t0 18033 KOBJECT_UEVENT 2023-10-16T18:56:57.836 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 12u netlink 0t0 18034 KOBJECT_UEVENT 2023-10-16T18:56:57.837 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 13u netlink 0t0 18035 KOBJECT_UEVENT 2023-10-16T18:56:57.837 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 14u unix 0xffff8ed489ad4400 0t0 18036 type=STREAM (CONNECTED) 2023-10-16T18:56:57.837 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 15u a_inode 0,14 0 1053 [timerfd] 2023-10-16T18:56:57.838 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 16u CHR 13,65 0t0 138 /dev/input/event1 2023-10-16T18:56:57.838 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 17u CHR 13,64 0t0 137 /dev/input/event0 2023-10-16T18:56:57.838 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 18u CHR 13,66 0t0 148 /dev/input/event2 2023-10-16T18:56:57.838 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 19u CHR 4,6 0t0 25 /dev/tty6 2023-10-16T18:56:57.839 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 20r FIFO 0,24 0t0 1361 /run/systemd/sessions/1.ref 2023-10-16T18:56:57.839 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 21r FIFO 0,24 0t0 1389 /run/systemd/sessions/3.ref 2023-10-16T18:56:57.839 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-l 737 root 22r FIFO 0,24 0t0 1402 /run/systemd/sessions/4.ref 2023-10-16T18:56:57.839 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.840 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.840 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony txt REG 8,1 353408 12490 /usr/sbin/chronyd 2023-10-16T18:56:57.840 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.840 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony mem REG 8,1 157072 13149 /usr/lib64/libnss_myhostname.so.2 2023-10-16T18:56:57.841 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.841 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-10-16T18:56:57.841 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.841 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-10-16T18:56:57.842 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-10-16T18:56:57.842 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:57.842 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-10-16T18:56:57.842 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-10-16T18:56:57.843 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:57.843 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T18:56:57.843 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.844 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.844 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.844 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.844 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony 1w CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.845 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.845 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony 3u unix 0xffff8ed4935fd0c0 0t0 22547 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.845 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony 4u IPv4 805 0t0 UDP smithi059.front.sepia.ceph.com:45082->hv04.front.sepia.ceph.com:ntp 2023-10-16T18:56:57.845 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony 5u IPv4 22552 0t0 UDP localhost:323 2023-10-16T18:56:57.846 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony 6u IPv6 22553 0t0 UDP localhost:323 2023-10-16T18:56:57.846 INFO:teuthology.orchestra.run.smithi059.stdout:chronyd 751 chrony 7u unix 0xffff8ed4935fbfc0 0t0 22554 /run/chrony/chronyd.sock type=DGRAM (CONNECTED) 2023-10-16T18:56:57.846 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.847 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.847 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root txt REG 8,1 53128 20358 /usr/lib/systemd/systemd-hostnamed 2023-10-16T18:56:57.847 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 595024 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-16T18:56:57.847 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.848 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.848 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.848 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.848 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:57.849 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-16T18:56:57.849 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:57.849 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.850 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.850 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.850 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:57.850 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.851 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.851 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.851 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T18:56:57.851 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.852 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.852 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-10-16T18:56:57.852 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-10-16T18:56:57.853 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-16T18:56:57.853 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.853 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-10-16T18:56:57.853 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-16T18:56:57.854 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.854 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.854 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-10-16T18:56:57.855 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.855 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 21219 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-16T18:56:57.855 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.855 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-16T18:56:57.856 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.856 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root 1u unix 0xffff8ed4902bb740 0t0 21744 type=STREAM (CONNECTED) 2023-10-16T18:56:57.856 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root 2u unix 0xffff8ed4902bb740 0t0 21744 type=STREAM (CONNECTED) 2023-10-16T18:56:57.856 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root 3u sock 0,8 0t0 21798 protocol: UNIX 2023-10-16T18:56:57.857 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root 4u a_inode 0,14 0 1053 [eventpoll:5,6,7,8] 2023-10-16T18:56:57.857 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root 5u a_inode 0,14 0 1053 [timerfd] 2023-10-16T18:56:57.857 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root 6u a_inode 0,14 0 1053 [signalfd] 2023-10-16T18:56:57.857 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root 7u sock 0,8 0t0 21802 protocol: UNIX-STREAM 2023-10-16T18:56:57.858 INFO:teuthology.orchestra.run.smithi059.stdout:systemd-h 770 root 8u a_inode 0,14 0 1053 [timerfd] 2023-10-16T18:56:57.858 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.858 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.859 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root txt REG 8,1 61696 20956 /usr/libexec/nm-dispatcher 2023-10-16T18:56:57.859 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.859 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.859 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-10-16T18:56:57.860 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:57.860 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-10-16T18:56:57.860 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-10-16T18:56:57.861 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-10-16T18:56:57.861 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-10-16T18:56:57.861 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:57.861 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.862 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.862 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.862 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.862 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.863 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.863 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-10-16T18:56:57.863 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.864 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.864 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.864 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.864 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.864 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 1550504 10190 /usr/lib64/libnm.so.0.1.0 2023-10-16T18:56:57.865 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.865 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.865 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root 1u unix 0xffff8ed4902ba200 0t0 21805 type=STREAM (CONNECTED) 2023-10-16T18:56:57.866 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root 2u unix 0xffff8ed4902ba200 0t0 21805 type=STREAM (CONNECTED) 2023-10-16T18:56:57.866 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root 3u a_inode 0,14 0 1053 [eventfd:6] 2023-10-16T18:56:57.866 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root 4u a_inode 0,14 0 1053 [eventfd:10] 2023-10-16T18:56:57.866 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root 5u unix 0xffff8ed490141dc0 0t0 367 type=STREAM (CONNECTED) 2023-10-16T18:56:57.867 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 root 6u a_inode 0,14 0 1053 [eventfd:11] 2023-10-16T18:56:57.867 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.867 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.867 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root txt REG 8,1 61696 20956 /usr/libexec/nm-dispatcher 2023-10-16T18:56:57.868 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.868 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.868 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-10-16T18:56:57.868 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:57.869 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-10-16T18:56:57.869 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-10-16T18:56:57.869 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-10-16T18:56:57.869 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-10-16T18:56:57.870 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:57.870 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.870 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.871 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.871 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.871 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.871 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.872 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-10-16T18:56:57.872 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.872 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.872 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.873 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.873 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.873 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 1550504 10190 /usr/lib64/libnm.so.0.1.0 2023-10-16T18:56:57.874 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.874 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.874 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root 1u unix 0xffff8ed4902ba200 0t0 21805 type=STREAM (CONNECTED) 2023-10-16T18:56:57.874 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root 2u unix 0xffff8ed4902ba200 0t0 21805 type=STREAM (CONNECTED) 2023-10-16T18:56:57.875 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root 3u a_inode 0,14 0 1053 [eventfd:6] 2023-10-16T18:56:57.875 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root 4u a_inode 0,14 0 1053 [eventfd:10] 2023-10-16T18:56:57.875 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root 5u unix 0xffff8ed490141dc0 0t0 367 type=STREAM (CONNECTED) 2023-10-16T18:56:57.875 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 783 gmain root 6u a_inode 0,14 0 1053 [eventfd:11] 2023-10-16T18:56:57.876 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.876 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.876 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root txt REG 8,1 61696 20956 /usr/libexec/nm-dispatcher 2023-10-16T18:56:57.877 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.877 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.877 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-10-16T18:56:57.877 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:57.878 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-10-16T18:56:57.878 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-10-16T18:56:57.878 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-10-16T18:56:57.879 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-10-16T18:56:57.879 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:57.879 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.879 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.880 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.880 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.880 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.880 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.881 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-10-16T18:56:57.881 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.881 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.881 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.882 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.882 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.882 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 1550504 10190 /usr/lib64/libnm.so.0.1.0 2023-10-16T18:56:57.882 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.883 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.883 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root 1u unix 0xffff8ed4902ba200 0t0 21805 type=STREAM (CONNECTED) 2023-10-16T18:56:57.883 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root 2u unix 0xffff8ed4902ba200 0t0 21805 type=STREAM (CONNECTED) 2023-10-16T18:56:57.884 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root 3u a_inode 0,14 0 1053 [eventfd:6] 2023-10-16T18:56:57.884 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root 4u a_inode 0,14 0 1053 [eventfd:10] 2023-10-16T18:56:57.884 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root 5u unix 0xffff8ed490141dc0 0t0 367 type=STREAM (CONNECTED) 2023-10-16T18:56:57.884 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 784 pool-nm-d root 6u a_inode 0,14 0 1053 [eventfd:11] 2023-10-16T18:56:57.885 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.885 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.885 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root txt REG 8,1 61696 20956 /usr/libexec/nm-dispatcher 2023-10-16T18:56:57.885 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.886 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.886 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-10-16T18:56:57.886 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-10-16T18:56:57.887 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-10-16T18:56:57.887 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-10-16T18:56:57.887 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-10-16T18:56:57.887 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-10-16T18:56:57.888 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:57.888 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.888 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.888 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.889 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.889 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.889 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.889 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-10-16T18:56:57.890 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.890 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.890 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.891 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.891 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.891 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 1550504 10190 /usr/lib64/libnm.so.0.1.0 2023-10-16T18:56:57.891 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.892 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.892 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root 1u unix 0xffff8ed4902ba200 0t0 21805 type=STREAM (CONNECTED) 2023-10-16T18:56:57.892 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root 2u unix 0xffff8ed4902ba200 0t0 21805 type=STREAM (CONNECTED) 2023-10-16T18:56:57.892 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root 3u a_inode 0,14 0 1053 [eventfd:6] 2023-10-16T18:56:57.893 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root 4u a_inode 0,14 0 1053 [eventfd:10] 2023-10-16T18:56:57.893 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root 5u unix 0xffff8ed490141dc0 0t0 367 type=STREAM (CONNECTED) 2023-10-16T18:56:57.893 INFO:teuthology.orchestra.run.smithi059.stdout:nm-dispat 782 785 gdbus root 6u a_inode 0,14 0 1053 [eventfd:11] 2023-10-16T18:56:57.893 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.894 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.894 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-10-16T18:56:57.894 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.894 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:57.895 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.895 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.895 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.896 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.896 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.896 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:57.896 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:57.897 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.897 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.897 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.897 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.898 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-16T18:56:57.898 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:57.898 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:57.898 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:57.899 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:57.899 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.899 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:57.900 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.900 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-16T18:56:57.900 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.900 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.901 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-16T18:56:57.901 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:57.901 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.901 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.902 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root 1u unix 0xffff8ed486c12a80 0t0 19001 type=STREAM (CONNECTED) 2023-10-16T18:56:57.902 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root 2u unix 0xffff8ed486c12a80 0t0 19001 type=STREAM (CONNECTED) 2023-10-16T18:56:57.902 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root 3u IPv4 18096 0t0 TCP *:ssh (LISTEN) 2023-10-16T18:56:57.903 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 806 root 4u IPv6 18098 0t0 TCP *:ssh (LISTEN) 2023-10-16T18:56:57.903 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.903 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.903 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-10-16T18:56:57.904 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-10-16T18:56:57.904 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.904 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.905 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-10-16T18:56:57.905 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.905 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.905 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.906 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.906 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.906 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.906 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.907 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.907 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-10-16T18:56:57.907 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.908 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.908 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.908 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2023-10-16T18:56:57.908 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-16T18:56:57.909 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.909 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.909 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.909 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.910 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.910 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.910 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.911 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-10-16T18:56:57.911 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.911 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.911 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2023-10-16T18:56:57.912 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.912 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.912 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.912 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-10-16T18:56:57.913 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.913 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.913 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.913 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.914 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.914 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.914 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.915 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.915 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.915 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.915 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.916 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.916 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.916 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.917 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.917 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.917 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:57.917 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.918 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-10-16T18:56:57.918 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.918 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.918 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.919 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.919 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.919 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.919 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root 1u unix 0xffff8ed490143fc0 0t0 380 type=STREAM (CONNECTED) 2023-10-16T18:56:57.920 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root 2u unix 0xffff8ed490143fc0 0t0 380 type=STREAM (CONNECTED) 2023-10-16T18:56:57.920 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root 3w REG 8,1 9346 1216 /var/log/tuned/tuned.log 2023-10-16T18:56:57.920 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root 4u sock 0,8 0t0 14999 protocol: NETLINK 2023-10-16T18:56:57.920 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root 5u unix 0xffff8ed4901461c0 0t0 408 type=STREAM (CONNECTED) 2023-10-16T18:56:57.921 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root 6u a_inode 0,14 0 1053 [eventfd:17] 2023-10-16T18:56:57.921 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root 7u unix 0xffff8ed486c150c0 0t0 19035 type=STREAM (CONNECTED) 2023-10-16T18:56:57.921 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 root 8u unix 0xffff8ed486c15d80 0t0 19036 type=STREAM (CONNECTED) 2023-10-16T18:56:57.921 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.922 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.922 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-10-16T18:56:57.922 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-10-16T18:56:57.923 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.923 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.923 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-10-16T18:56:57.923 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.924 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:57.924 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.924 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:57.924 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-16T18:56:57.925 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-16T18:56:57.925 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:57.925 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-16T18:56:57.925 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-10-16T18:56:57.926 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.926 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-16T18:56:57.926 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-16T18:56:57.926 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2023-10-16T18:56:57.927 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-16T18:56:57.927 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.927 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:57.928 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:57.928 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:57.928 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:57.928 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:57.929 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:57.929 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-10-16T18:56:57.929 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.929 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:57.930 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2023-10-16T18:56:57.930 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.930 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:57.930 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.931 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-10-16T18:56:57.931 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.931 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.931 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.932 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.932 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.932 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.933 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.933 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.933 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.933 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.934 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.934 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.934 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.934 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.935 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.935 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.935 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:57.936 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.936 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-10-16T18:56:57.936 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.936 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.937 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.937 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-10-16T18:56:57.937 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.937 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.938 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root 1u unix 0xffff8ed490143fc0 0t0 380 type=STREAM (CONNECTED) 2023-10-16T18:56:57.938 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root 2u unix 0xffff8ed490143fc0 0t0 380 type=STREAM (CONNECTED) 2023-10-16T18:56:57.938 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root 3w REG 8,1 9346 1216 /var/log/tuned/tuned.log 2023-10-16T18:56:57.939 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root 4u sock 0,8 0t0 14999 protocol: NETLINK 2023-10-16T18:56:57.939 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root 5u unix 0xffff8ed4901461c0 0t0 408 type=STREAM (CONNECTED) 2023-10-16T18:56:57.939 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root 6u a_inode 0,14 0 1053 [eventfd:17] 2023-10-16T18:56:57.939 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root 7u unix 0xffff8ed486c150c0 0t0 19035 type=STREAM (CONNECTED) 2023-10-16T18:56:57.940 INFO:teuthology.orchestra.run.smithi059.stdout:tuned 807 901 tuned root 8u unix 0xffff8ed486c15d80 0t0 19036 type=STREAM (CONNECTED) 2023-10-16T18:56:57.940 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.940 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.940 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-10-16T18:56:57.941 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:57.941 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.941 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.941 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-10-16T18:56:57.942 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-10-16T18:56:57.942 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:57.942 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:57.943 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:57.943 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:57.943 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.943 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.944 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.944 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T18:56:57.944 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T18:56:57.944 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.945 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-10-16T18:56:57.945 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:57.945 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:57.945 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:57.946 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:57.946 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:57.946 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-10-16T18:56:57.947 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.947 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-10-16T18:56:57.947 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-10-16T18:56:57.947 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-10-16T18:56:57.948 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:57.948 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:57.948 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-10-16T18:56:57.948 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:57.949 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:57.949 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:57.949 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:57.949 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:57.950 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:57.950 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.950 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:57.951 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.951 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root 1u unix 0xffff8ed490144840 0t0 376 type=STREAM (CONNECTED) 2023-10-16T18:56:57.951 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root 2u unix 0xffff8ed490144840 0t0 376 type=STREAM (CONNECTED) 2023-10-16T18:56:57.951 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root 3u unix 0xffff8ed4935f9dc0 0t0 22592 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.952 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root 4r FIFO 0,13 0t0 22597 pipe 2023-10-16T18:56:57.952 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root 5u a_inode 0,14 0 1053 [eventpoll:4,6,7,8] 2023-10-16T18:56:57.952 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root 6u a_inode 0,14 0 1053 [eventfd:16] 2023-10-16T18:56:57.952 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root 7u unix 0xffff8ed492f40cc0 0t0 22593 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-10-16T18:56:57.953 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root 8u unix 0xffff8ed492f40880 0t0 22594 /run/gssproxy.sock type=STREAM (LISTEN) 2023-10-16T18:56:57.953 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 root 9w FIFO 0,13 0t0 22597 pipe 2023-10-16T18:56:57.953 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.954 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.954 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-10-16T18:56:57.954 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:57.954 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.955 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.955 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-10-16T18:56:57.955 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-10-16T18:56:57.955 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:57.956 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:57.956 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:57.956 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:57.957 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.957 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.957 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.957 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T18:56:57.958 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T18:56:57.958 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.958 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-10-16T18:56:57.958 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:57.959 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:57.959 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:57.959 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:57.960 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:57.960 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-10-16T18:56:57.960 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.960 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-10-16T18:56:57.961 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-10-16T18:56:57.961 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-10-16T18:56:57.961 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:57.961 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:57.962 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-10-16T18:56:57.962 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:57.962 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:57.962 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:57.963 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:57.963 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:57.963 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:57.964 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.964 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:57.964 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.964 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root 1u unix 0xffff8ed490144840 0t0 376 type=STREAM (CONNECTED) 2023-10-16T18:56:57.965 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root 2u unix 0xffff8ed490144840 0t0 376 type=STREAM (CONNECTED) 2023-10-16T18:56:57.965 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root 3u unix 0xffff8ed4935f9dc0 0t0 22592 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.965 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root 4r FIFO 0,13 0t0 22597 pipe 2023-10-16T18:56:57.965 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root 5u a_inode 0,14 0 1053 [eventpoll:4,6,7,8] 2023-10-16T18:56:57.966 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root 6u a_inode 0,14 0 1053 [eventfd:16] 2023-10-16T18:56:57.966 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root 7u unix 0xffff8ed492f40cc0 0t0 22593 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-10-16T18:56:57.966 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root 8u unix 0xffff8ed492f40880 0t0 22594 /run/gssproxy.sock type=STREAM (LISTEN) 2023-10-16T18:56:57.966 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 821 gssproxy root 9w FIFO 0,13 0t0 22597 pipe 2023-10-16T18:56:57.967 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.967 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.967 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-10-16T18:56:57.967 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:57.968 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.968 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.968 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-10-16T18:56:57.969 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-10-16T18:56:57.969 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:57.969 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:57.969 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:57.970 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:57.970 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.970 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.970 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.971 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T18:56:57.971 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T18:56:57.971 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.971 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-10-16T18:56:57.972 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:57.972 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:57.972 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:57.972 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:57.973 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:57.973 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-10-16T18:56:57.973 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.973 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-10-16T18:56:57.974 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-10-16T18:56:57.974 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-10-16T18:56:57.974 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:57.975 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:57.975 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-10-16T18:56:57.975 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:57.975 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:57.976 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:57.976 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:57.976 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:57.976 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:57.977 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.977 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:57.977 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.977 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root 1u unix 0xffff8ed490144840 0t0 376 type=STREAM (CONNECTED) 2023-10-16T18:56:57.978 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root 2u unix 0xffff8ed490144840 0t0 376 type=STREAM (CONNECTED) 2023-10-16T18:56:57.978 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root 3u unix 0xffff8ed4935f9dc0 0t0 22592 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.978 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root 4r FIFO 0,13 0t0 22597 pipe 2023-10-16T18:56:57.979 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root 5u a_inode 0,14 0 1053 [eventpoll:4,6,7,8] 2023-10-16T18:56:57.979 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root 6u a_inode 0,14 0 1053 [eventfd:16] 2023-10-16T18:56:57.979 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root 7u unix 0xffff8ed492f40cc0 0t0 22593 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-10-16T18:56:57.979 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root 8u unix 0xffff8ed492f40880 0t0 22594 /run/gssproxy.sock type=STREAM (LISTEN) 2023-10-16T18:56:57.980 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 822 gssproxy root 9w FIFO 0,13 0t0 22597 pipe 2023-10-16T18:56:57.980 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.980 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.980 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-10-16T18:56:57.981 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:57.981 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.981 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.981 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-10-16T18:56:57.982 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-10-16T18:56:57.982 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:57.982 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:57.982 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:57.983 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:57.983 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.983 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.983 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.984 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T18:56:57.984 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T18:56:57.984 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.984 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-10-16T18:56:57.985 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:57.985 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:57.985 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:57.986 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:57.986 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:57.986 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-10-16T18:56:57.986 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:57.987 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-10-16T18:56:57.987 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-10-16T18:56:57.987 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-10-16T18:56:57.988 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:57.988 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:57.988 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-10-16T18:56:57.988 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:57.989 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:57.989 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:57.989 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:57.989 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:57.990 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:57.990 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:57.990 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:57.991 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:57.991 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root 1u unix 0xffff8ed490144840 0t0 376 type=STREAM (CONNECTED) 2023-10-16T18:56:57.991 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root 2u unix 0xffff8ed490144840 0t0 376 type=STREAM (CONNECTED) 2023-10-16T18:56:57.991 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root 3u unix 0xffff8ed4935f9dc0 0t0 22592 type=DGRAM (CONNECTED) 2023-10-16T18:56:57.992 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root 4r FIFO 0,13 0t0 22597 pipe 2023-10-16T18:56:57.992 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root 5u a_inode 0,14 0 1053 [eventpoll:4,6,7,8] 2023-10-16T18:56:57.992 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root 6u a_inode 0,14 0 1053 [eventfd:16] 2023-10-16T18:56:57.992 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root 7u unix 0xffff8ed492f40cc0 0t0 22593 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-10-16T18:56:57.993 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root 8u unix 0xffff8ed492f40880 0t0 22594 /run/gssproxy.sock type=STREAM (LISTEN) 2023-10-16T18:56:57.993 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 823 gssproxy root 9w FIFO 0,13 0t0 22597 pipe 2023-10-16T18:56:57.993 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:57.994 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:57.994 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-10-16T18:56:57.994 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:57.994 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:57.995 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:57.995 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-10-16T18:56:57.995 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-10-16T18:56:57.996 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:57.996 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:57.996 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:57.996 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:57.997 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:57.997 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:57.997 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:57.997 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T18:56:57.998 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T18:56:57.998 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:57.998 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-10-16T18:56:57.999 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:57.999 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:57.999 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:57.999 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:58.000 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:58.000 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-10-16T18:56:58.000 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:58.000 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-10-16T18:56:58.001 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-10-16T18:56:58.001 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-10-16T18:56:58.001 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:58.001 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:58.002 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-10-16T18:56:58.002 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:58.002 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:58.003 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:58.003 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:58.003 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:58.003 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:58.004 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.004 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:58.004 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.004 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root 1u unix 0xffff8ed490144840 0t0 376 type=STREAM (CONNECTED) 2023-10-16T18:56:58.005 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root 2u unix 0xffff8ed490144840 0t0 376 type=STREAM (CONNECTED) 2023-10-16T18:56:58.005 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root 3u unix 0xffff8ed4935f9dc0 0t0 22592 type=DGRAM (CONNECTED) 2023-10-16T18:56:58.005 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root 4r FIFO 0,13 0t0 22597 pipe 2023-10-16T18:56:58.006 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root 5u a_inode 0,14 0 1053 [eventpoll:4,6,7,8] 2023-10-16T18:56:58.006 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root 6u a_inode 0,14 0 1053 [eventfd:16] 2023-10-16T18:56:58.006 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root 7u unix 0xffff8ed492f40cc0 0t0 22593 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-10-16T18:56:58.006 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root 8u unix 0xffff8ed492f40880 0t0 22594 /run/gssproxy.sock type=STREAM (LISTEN) 2023-10-16T18:56:58.007 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 824 gssproxy root 9w FIFO 0,13 0t0 22597 pipe 2023-10-16T18:56:58.007 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.007 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.007 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-10-16T18:56:58.008 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:58.008 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:58.008 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:58.008 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-10-16T18:56:58.009 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-10-16T18:56:58.009 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:58.009 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:58.010 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:58.010 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:58.010 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:58.010 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:58.011 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:58.011 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-16T18:56:58.011 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-10-16T18:56:58.011 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.012 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-10-16T18:56:58.012 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:58.012 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:58.013 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:58.013 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:58.013 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:58.013 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-10-16T18:56:58.014 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:58.014 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-10-16T18:56:58.014 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-10-16T18:56:58.014 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-10-16T18:56:58.015 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:58.015 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:58.015 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-10-16T18:56:58.016 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:58.016 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:58.016 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:58.016 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:58.017 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:58.017 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:58.017 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.017 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:58.018 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.018 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root 1u unix 0xffff8ed490144840 0t0 376 type=STREAM (CONNECTED) 2023-10-16T18:56:58.018 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root 2u unix 0xffff8ed490144840 0t0 376 type=STREAM (CONNECTED) 2023-10-16T18:56:58.019 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root 3u unix 0xffff8ed4935f9dc0 0t0 22592 type=DGRAM (CONNECTED) 2023-10-16T18:56:58.019 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root 4r FIFO 0,13 0t0 22597 pipe 2023-10-16T18:56:58.019 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root 5u a_inode 0,14 0 1053 [eventpoll:4,6,7,8] 2023-10-16T18:56:58.019 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root 6u a_inode 0,14 0 1053 [eventfd:16] 2023-10-16T18:56:58.020 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root 7u unix 0xffff8ed492f40cc0 0t0 22593 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-10-16T18:56:58.020 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root 8u unix 0xffff8ed492f40880 0t0 22594 /run/gssproxy.sock type=STREAM (LISTEN) 2023-10-16T18:56:58.020 INFO:teuthology.orchestra.run.smithi059.stdout:gssproxy 820 825 gssproxy root 9w FIFO 0,13 0t0 22597 pipe 2023-10-16T18:56:58.021 INFO:teuthology.orchestra.run.smithi059.stdout:atd 827 root cwd DIR 8,1 4096 1657 /var/spool/at 2023-10-16T18:56:58.021 INFO:teuthology.orchestra.run.smithi059.stdout:atd 827 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.021 INFO:teuthology.orchestra.run.smithi059.stdout:atd 827 root txt REG 8,1 32680 12473 /usr/sbin/atd 2023-10-16T18:56:58.021 INFO:teuthology.orchestra.run.smithi059.stdout:atd 827 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:58.022 INFO:teuthology.orchestra.run.smithi059.stdout:atd 827 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.022 INFO:teuthology.orchestra.run.smithi059.stdout:atd 827 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:58.022 INFO:teuthology.orchestra.run.smithi059.stdout:atd 827 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:58.022 INFO:teuthology.orchestra.run.smithi059.stdout:atd 827 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-16T18:56:58.023 INFO:teuthology.orchestra.run.smithi059.stdout:atd 827 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:58.023 INFO:teuthology.orchestra.run.smithi059.stdout:atd 827 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:58.023 INFO:teuthology.orchestra.run.smithi059.stdout:atd 827 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-16T18:56:58.023 INFO:teuthology.orchestra.run.smithi059.stdout:atd 827 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.024 INFO:teuthology.orchestra.run.smithi059.stdout:atd 827 root 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.024 INFO:teuthology.orchestra.run.smithi059.stdout:atd 827 root 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.024 INFO:teuthology.orchestra.run.smithi059.stdout:atd 827 root 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.025 INFO:teuthology.orchestra.run.smithi059.stdout:atd 827 root 3uW REG 0,24 4 1335 /run/atd.pid 2023-10-16T18:56:58.025 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.025 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.025 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root txt REG 8,1 74552 11234 /usr/sbin/crond 2023-10-16T18:56:58.026 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:58.026 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:58.026 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:58.026 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:58.027 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.027 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:58.027 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:58.027 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:58.028 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:58.028 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-16T18:56:58.028 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:58.029 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:58.029 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-16T18:56:58.029 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:58.029 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:58.030 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:58.030 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:58.030 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:58.030 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:58.031 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:58.031 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.031 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:58.031 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.032 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root 1u unix 0xffff8ed490146a40 0t0 388 type=STREAM (CONNECTED) 2023-10-16T18:56:58.032 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root 2u unix 0xffff8ed490146a40 0t0 388 type=STREAM (CONNECTED) 2023-10-16T18:56:58.032 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root 3uW REG 0,24 4 1334 /run/crond.pid 2023-10-16T18:56:58.033 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root 4u unix 0xffff8ed49014d0c0 0t0 391 type=DGRAM (CONNECTED) 2023-10-16T18:56:58.033 INFO:teuthology.orchestra.run.smithi059.stdout:crond 828 root 5r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:58.033 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.033 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.034 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-10-16T18:56:58.034 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:58.034 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-10-16T18:56:58.034 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-10-16T18:56:58.035 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:58.035 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:58.035 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T18:56:58.035 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-10-16T18:56:58.036 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-10-16T18:56:58.036 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-10-16T18:56:58.036 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-10-16T18:56:58.036 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-10-16T18:56:58.037 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-10-16T18:56:58.037 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-10-16T18:56:58.037 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-10-16T18:56:58.038 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-10-16T18:56:58.038 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-10-16T18:56:58.038 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-10-16T18:56:58.038 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-10-16T18:56:58.039 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-10-16T18:56:58.039 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-10-16T18:56:58.039 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-10-16T18:56:58.039 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:58.040 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:58.040 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:58.040 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.040 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-10-16T18:56:58.041 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:58.041 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:58.041 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:58.041 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:58.042 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:58.042 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:58.042 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:58.043 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:58.043 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:58.043 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:58.043 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:58.044 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-16T18:56:58.044 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:58.044 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:58.044 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:58.045 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:58.045 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:58.045 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-16T18:56:58.045 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:58.046 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:58.046 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-16T18:56:58.046 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:58.047 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-10-16T18:56:58.047 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.047 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-16T18:56:58.047 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.048 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.048 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.048 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root 3u unix 0xffff8ed48b9d1540 0t0 18142 type=DGRAM (CONNECTED) 2023-10-16T18:56:58.048 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root 4u IPv4 18115 0t0 TCP smithi059.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:35204 (ESTABLISHED) 2023-10-16T18:56:58.049 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root 6u unix 0xffff8ed490142a80 0t0 434 type=STREAM (CONNECTED) 2023-10-16T18:56:58.049 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root 7w FIFO 0,24 0t0 1361 /run/systemd/sessions/1.ref 2023-10-16T18:56:58.049 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 923 root 8u unix 0xffff8ed489ad2640 0t0 18146 type=STREAM (CONNECTED) 2023-10-16T18:56:58.049 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.050 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.050 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-10-16T18:56:58.050 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:58.051 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:58.051 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:58.051 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 595024 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-16T18:56:58.051 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:58.052 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.052 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:58.052 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:58.052 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-10-16T18:56:58.053 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:58.053 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:58.053 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-10-16T18:56:58.054 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:58.054 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:58.054 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-10-16T18:56:58.054 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:58.055 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-16T18:56:58.055 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:58.055 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-16T18:56:58.055 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:58.056 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:58.056 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-10-16T18:56:58.056 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:58.057 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:58.057 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-10-16T18:56:58.057 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:58.057 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-16T18:56:58.058 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T18:56:58.058 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:58.058 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 21219 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-16T18:56:58.058 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.059 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-16T18:56:58.059 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.059 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 1u unix 0xffff8ed4902baec0 0t0 21927 type=STREAM (CONNECTED) 2023-10-16T18:56:58.060 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 2u unix 0xffff8ed4902baec0 0t0 21927 type=STREAM (CONNECTED) 2023-10-16T18:56:58.060 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 3u unix 0xffff8ed490238880 0t0 21955 type=DGRAM (CONNECTED) 2023-10-16T18:56:58.060 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 4u a_inode 0,14 0 1053 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2023-10-16T18:56:58.060 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 5u a_inode 0,14 0 1053 [signalfd] 2023-10-16T18:56:58.061 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 6r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:58.061 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 7r DIR 0,25 0 3228 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2023-10-16T18:56:58.061 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 8u a_inode 0,14 0 1053 [timerfd] 2023-10-16T18:56:58.061 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 9u a_inode 0,14 0 1053 [eventpoll:10,13] 2023-10-16T18:56:58.062 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 10r REG 0,20 0 21944 /proc/927/mountinfo 2023-10-16T18:56:58.062 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 11r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:58.062 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 12u unix 0xffff8ed486c10880 0t0 19057 /run/user/1000/bus type=STREAM (LISTEN) 2023-10-16T18:56:58.063 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 13r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:58.063 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 14r REG 0,20 0 4026532076 /proc/swaps 2023-10-16T18:56:58.063 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 15u netlink 0t0 21961 KOBJECT_UEVENT 2023-10-16T18:56:58.063 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 16u unix 0xffff8ed488c3ea40 0t0 19044 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2023-10-16T18:56:58.064 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 17u unix 0xffff8ed488c3e600 0t0 19045 type=DGRAM (CONNECTED) 2023-10-16T18:56:58.064 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 18u unix 0xffff8ed488c3a640 0t0 19046 type=DGRAM (CONNECTED) 2023-10-16T18:56:58.064 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 19u unix 0xffff8ed486c12ec0 0t0 19047 /run/user/1000/systemd/private type=STREAM (LISTEN) 2023-10-16T18:56:58.064 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 20u unix 0xffff8ed486c13300 0t0 19049 type=STREAM (CONNECTED) 2023-10-16T18:56:58.065 INFO:teuthology.orchestra.run.smithi059.stdout:systemd 927 ubuntu 21u a_inode 0,14 0 1053 [timerfd] 2023-10-16T18:56:58.065 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.065 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.065 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-10-16T18:56:58.066 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:58.066 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-10-16T18:56:58.066 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T18:56:58.066 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-10-16T18:56:58.067 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-10-16T18:56:58.067 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-10-16T18:56:58.067 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-10-16T18:56:58.067 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-10-16T18:56:58.068 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-10-16T18:56:58.068 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-10-16T18:56:58.068 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-10-16T18:56:58.069 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-10-16T18:56:58.069 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 595024 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-16T18:56:58.069 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:58.069 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:58.070 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:58.070 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:58.070 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:58.070 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:58.071 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-10-16T18:56:58.071 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:58.071 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:58.072 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:58.072 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:58.072 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.072 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:58.073 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-16T18:56:58.073 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-16T18:56:58.073 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-16T18:56:58.073 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-10-16T18:56:58.074 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:58.074 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-16T18:56:58.074 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:58.074 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:58.075 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-10-16T18:56:58.075 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:58.075 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-10-16T18:56:58.075 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-10-16T18:56:58.076 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-16T18:56:58.076 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-10-16T18:56:58.076 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:58.077 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 21219 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-16T18:56:58.077 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.077 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-16T18:56:58.077 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.078 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu 1u unix 0xffff8ed4902baec0 0t0 21927 type=STREAM (CONNECTED) 2023-10-16T18:56:58.078 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu 2u unix 0xffff8ed4902baec0 0t0 21927 type=STREAM (CONNECTED) 2023-10-16T18:56:58.078 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu 3u a_inode 0,14 0 1053 [eventfd:18] 2023-10-16T18:56:58.078 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu 4u a_inode 0,14 0 1053 [eventfd:19] 2023-10-16T18:56:58.079 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu 6w FIFO 0,13 0t0 21931 pipe 2023-10-16T18:56:58.079 INFO:teuthology.orchestra.run.smithi059.stdout:(sd-pam) 929 ubuntu 7u unix 0xffff8ed49023fb40 0t0 21947 type=DGRAM (CONNECTED) 2023-10-16T18:56:58.079 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.080 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.080 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-10-16T18:56:58.080 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:58.080 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-10-16T18:56:58.081 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-10-16T18:56:58.081 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:58.081 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:58.081 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T18:56:58.082 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-10-16T18:56:58.082 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-10-16T18:56:58.082 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-10-16T18:56:58.082 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-10-16T18:56:58.083 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-10-16T18:56:58.083 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-10-16T18:56:58.083 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-10-16T18:56:58.084 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-10-16T18:56:58.084 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-10-16T18:56:58.084 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-10-16T18:56:58.084 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-10-16T18:56:58.085 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-10-16T18:56:58.085 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-10-16T18:56:58.085 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-10-16T18:56:58.085 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-10-16T18:56:58.086 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:58.086 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:58.086 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:58.086 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.087 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-10-16T18:56:58.087 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:58.087 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:58.088 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:58.088 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:58.088 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:58.088 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:58.089 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:58.089 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:58.089 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:58.089 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:58.090 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:58.090 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-16T18:56:58.090 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:58.091 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:58.091 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:58.091 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:58.091 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:58.092 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-16T18:56:58.092 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:58.092 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:58.092 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-16T18:56:58.093 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:58.093 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-10-16T18:56:58.093 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.094 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-16T18:56:58.094 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.094 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.094 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.095 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu 3u unix 0xffff8ed48b9d1540 0t0 18142 type=DGRAM (CONNECTED) 2023-10-16T18:56:58.095 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu 4u IPv4 18115 0t0 TCP smithi059.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:35204 (ESTABLISHED) 2023-10-16T18:56:58.095 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu 5u unix 0xffff8ed489ad61c0 0t0 18145 type=STREAM (CONNECTED) 2023-10-16T18:56:58.095 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu 6u unix 0xffff8ed490142a80 0t0 434 type=STREAM (CONNECTED) 2023-10-16T18:56:58.096 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 942 ubuntu 7w FIFO 0,24 0t0 1361 /run/systemd/sessions/1.ref 2023-10-16T18:56:58.096 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.096 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.096 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root txt REG 8,1 1388920 9667 /usr/bin/bash 2023-10-16T18:56:58.097 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:58.097 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:58.097 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:58.098 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.098 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:58.098 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:58.098 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:58.099 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-10-16T18:56:58.099 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:58.099 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:58.099 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:58.100 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:58.100 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:58.100 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:58.101 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.101 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:58.101 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.101 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root 1u unix 0xffff8ed489ad7b40 0t0 18159 type=STREAM (CONNECTED) 2023-10-16T18:56:58.102 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root 2u unix 0xffff8ed489ad7b40 0t0 18159 type=STREAM (CONNECTED) 2023-10-16T18:56:58.102 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root 9w REG 0,24 0 1378 /run/lock/kdump 2023-10-16T18:56:58.102 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 977 root 255r REG 8,1 49465 11732 /usr/bin/kdumpctl 2023-10-16T18:56:58.102 INFO:teuthology.orchestra.run.smithi059.stdout:nrpe 978 nrpe cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.103 INFO:teuthology.orchestra.run.smithi059.stdout:nrpe 978 nrpe rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.103 INFO:teuthology.orchestra.run.smithi059.stdout:nrpe 978 nrpe txt REG 8,1 80984 12959 /usr/sbin/nrpe 2023-10-16T18:56:58.103 INFO:teuthology.orchestra.run.smithi059.stdout:nrpe 978 nrpe mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.103 INFO:teuthology.orchestra.run.smithi059.stdout:nrpe 978 nrpe mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:58.104 INFO:teuthology.orchestra.run.smithi059.stdout:nrpe 978 nrpe mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:58.104 INFO:teuthology.orchestra.run.smithi059.stdout:nrpe 978 nrpe mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-10-16T18:56:58.104 INFO:teuthology.orchestra.run.smithi059.stdout:nrpe 978 nrpe mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.104 INFO:teuthology.orchestra.run.smithi059.stdout:nrpe 978 nrpe 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.105 INFO:teuthology.orchestra.run.smithi059.stdout:nrpe 978 nrpe 1w CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.105 INFO:teuthology.orchestra.run.smithi059.stdout:nrpe 978 nrpe 2w CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.105 INFO:teuthology.orchestra.run.smithi059.stdout:nrpe 978 nrpe 3u IPv4 15951 0t0 TCP *:nrpe (LISTEN) 2023-10-16T18:56:58.106 INFO:teuthology.orchestra.run.smithi059.stdout:nrpe 978 nrpe 4u unix 0xffff8ed4884bf2c0 0t0 15943 type=DGRAM (CONNECTED) 2023-10-16T18:56:58.106 INFO:teuthology.orchestra.run.smithi059.stdout:nrpe 978 nrpe 5u IPv6 15952 0t0 TCP *:nrpe (LISTEN) 2023-10-16T18:56:58.106 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.106 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.107 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root txt REG 8,1 1388920 9667 /usr/bin/bash 2023-10-16T18:56:58.107 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:58.107 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.108 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:58.108 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:58.108 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:58.108 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:58.109 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:58.109 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-10-16T18:56:58.109 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:58.109 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:58.110 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:58.110 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:58.110 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:58.111 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:58.111 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.111 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:58.111 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.112 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root 1w CHR 4,65 0t0 114 /dev/ttyS1 2023-10-16T18:56:58.112 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root 2w CHR 4,65 0t0 114 /dev/ttyS1 2023-10-16T18:56:58.112 INFO:teuthology.orchestra.run.smithi059.stdout:rc.local 979 root 255r REG 8,1 4545 63567 /etc/rc.d/rc.local 2023-10-16T18:56:58.112 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.113 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.113 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-10-16T18:56:58.113 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-10-16T18:56:58.113 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:58.114 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:58.114 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.114 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-10-16T18:56:58.115 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-10-16T18:56:58.115 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-10-16T18:56:58.115 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:58.115 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:58.116 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:58.116 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:58.116 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:58.116 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:58.117 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:58.117 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:58.117 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-10-16T18:56:58.117 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-10-16T18:56:58.118 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:58.118 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.118 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.119 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root 1w CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.119 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root 2w CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.119 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root 3r CHR 1,9 0t0 9 /dev/urandom 2023-10-16T18:56:58.119 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root 4w REG 8,1 752693 1641 /var/log/messages 2023-10-16T18:56:58.120 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root 5u unix 0xffff8ed4884bb740 0t0 15955 type=DGRAM (CONNECTED) 2023-10-16T18:56:58.120 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root 6w REG 8,1 680 1220 /var/log/cron 2023-10-16T18:56:58.120 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root 7w REG 8,1 324979 1642 /var/log/secure 2023-10-16T18:56:58.120 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root 8r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:58.121 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 root 10r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-10-16T18:56:58.121 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.121 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.121 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-10-16T18:56:58.122 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-10-16T18:56:58.122 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:58.122 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:58.122 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.123 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-10-16T18:56:58.123 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-10-16T18:56:58.123 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-10-16T18:56:58.123 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:58.125 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:58.126 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:58.126 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:58.126 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:58.127 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:58.127 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:58.127 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:58.127 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-10-16T18:56:58.128 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-10-16T18:56:58.128 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:58.128 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.128 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.129 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root 1w CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.129 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root 2w CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.129 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root 3r CHR 1,9 0t0 9 /dev/urandom 2023-10-16T18:56:58.130 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root 4w REG 8,1 752693 1641 /var/log/messages 2023-10-16T18:56:58.130 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root 5u unix 0xffff8ed4884bb740 0t0 15955 type=DGRAM (CONNECTED) 2023-10-16T18:56:58.130 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root 6w REG 8,1 680 1220 /var/log/cron 2023-10-16T18:56:58.130 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root 7w REG 8,1 324979 1642 /var/log/secure 2023-10-16T18:56:58.131 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root 8r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:58.131 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 988 in:imjour root 10r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-10-16T18:56:58.131 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.131 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.132 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-10-16T18:56:58.132 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-10-16T18:56:58.132 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:58.132 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:58.133 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.133 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-10-16T18:56:58.133 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-10-16T18:56:58.134 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-10-16T18:56:58.134 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:58.134 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:58.134 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:58.135 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:58.135 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:58.135 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:58.135 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-10-16T18:56:58.136 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:58.136 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-10-16T18:56:58.136 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-10-16T18:56:58.137 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:58.137 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.137 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.137 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root 1w CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.138 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root 2w CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.138 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root 3r CHR 1,9 0t0 9 /dev/urandom 2023-10-16T18:56:58.138 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root 4w REG 8,1 752693 1641 /var/log/messages 2023-10-16T18:56:58.138 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root 5u unix 0xffff8ed4884bb740 0t0 15955 type=DGRAM (CONNECTED) 2023-10-16T18:56:58.139 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root 6w REG 8,1 680 1220 /var/log/cron 2023-10-16T18:56:58.139 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root 7w REG 8,1 324979 1642 /var/log/secure 2023-10-16T18:56:58.139 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root 8r a_inode 0,14 0 1053 inotify 2023-10-16T18:56:58.140 INFO:teuthology.orchestra.run.smithi059.stdout:rsyslogd 981 992 rs:main root 10r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-10-16T18:56:58.140 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.140 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.140 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root txt REG 8,1 1388920 9667 /usr/bin/bash 2023-10-16T18:56:58.141 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:58.141 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:58.141 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:58.141 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.142 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:58.142 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:58.142 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:58.142 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-10-16T18:56:58.143 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:58.143 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:58.143 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:58.144 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:58.144 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:58.144 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:58.144 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.145 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:58.145 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.145 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root 1u unix 0xffff8ed489ad7b40 0t0 18159 type=STREAM (CONNECTED) 2023-10-16T18:56:58.145 INFO:teuthology.orchestra.run.smithi059.stdout:kdumpctl 989 root 2u unix 0xffff8ed489ad7b40 0t0 18159 type=STREAM (CONNECTED) 2023-10-16T18:56:58.146 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.146 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.146 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root txt REG 8,1 1388920 9667 /usr/bin/bash 2023-10-16T18:56:58.147 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:58.147 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:58.147 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.147 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:58.147 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:58.148 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:58.148 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:58.148 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-10-16T18:56:58.148 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:58.149 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:58.149 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:58.149 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:58.149 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:58.150 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:58.150 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.150 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:58.151 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.151 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root 1u unix 0xffff8ed489ad7b40 0t0 18159 type=STREAM (CONNECTED) 2023-10-16T18:56:58.151 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root 2u unix 0xffff8ed489ad7b40 0t0 18159 type=STREAM (CONNECTED) 2023-10-16T18:56:58.151 INFO:teuthology.orchestra.run.smithi059.stdout:mkdumprd 1105 root 255r REG 8,1 12457 11743 /usr/sbin/mkdumprd 2023-10-16T18:56:58.152 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.152 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.152 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-10-16T18:56:58.152 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:58.153 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-10-16T18:56:58.153 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-10-16T18:56:58.153 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:58.153 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:58.154 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T18:56:58.154 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-10-16T18:56:58.154 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-10-16T18:56:58.154 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-10-16T18:56:58.155 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-10-16T18:56:58.155 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-10-16T18:56:58.155 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-10-16T18:56:58.155 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-10-16T18:56:58.156 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-10-16T18:56:58.156 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-10-16T18:56:58.156 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-10-16T18:56:58.157 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-10-16T18:56:58.157 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-10-16T18:56:58.157 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-10-16T18:56:58.157 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-10-16T18:56:58.158 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-10-16T18:56:58.158 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-10-16T18:56:58.158 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:58.158 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:58.159 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:58.159 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:58.159 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:58.159 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:58.160 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.160 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:58.160 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:58.161 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:58.161 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:58.164 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:58.165 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:58.165 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:58.165 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:58.165 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-16T18:56:58.166 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:58.166 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:58.166 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:58.167 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:58.167 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:58.167 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-16T18:56:58.167 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:58.168 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:58.168 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-16T18:56:58.168 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:58.169 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-10-16T18:56:58.169 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.169 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-16T18:56:58.169 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.170 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.170 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.170 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root 3u unix 0xffff8ed4886bc840 0t0 15101 type=DGRAM (CONNECTED) 2023-10-16T18:56:58.170 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root 4u IPv4 15074 0t0 TCP smithi059.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:59254 (ESTABLISHED) 2023-10-16T18:56:58.171 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root 6u unix 0xffff8ed4902ba640 0t0 22042 type=STREAM (CONNECTED) 2023-10-16T18:56:58.171 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root 7w FIFO 0,24 0t0 1389 /run/systemd/sessions/3.ref 2023-10-16T18:56:58.171 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1234 root 8u unix 0xffff8ed4884e2640 0t0 15105 type=STREAM (CONNECTED) 2023-10-16T18:56:58.172 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.172 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.172 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-10-16T18:56:58.172 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:58.173 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-10-16T18:56:58.173 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-10-16T18:56:58.173 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:58.173 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:58.174 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T18:56:58.174 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-10-16T18:56:58.174 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-10-16T18:56:58.175 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-10-16T18:56:58.175 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-10-16T18:56:58.175 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-10-16T18:56:58.175 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-10-16T18:56:58.176 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-10-16T18:56:58.176 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-10-16T18:56:58.176 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-10-16T18:56:58.176 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-10-16T18:56:58.177 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-10-16T18:56:58.177 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-10-16T18:56:58.177 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-10-16T18:56:58.177 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-10-16T18:56:58.178 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-10-16T18:56:58.178 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-10-16T18:56:58.178 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:58.179 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:58.179 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:58.179 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:58.179 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:58.180 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:58.180 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.180 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:58.180 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:58.181 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:58.181 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:58.181 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:58.181 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:58.182 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:58.182 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:58.182 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-16T18:56:58.182 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:58.183 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:58.183 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:58.183 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:58.183 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:58.184 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-16T18:56:58.184 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:58.184 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:58.185 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-16T18:56:58.185 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:58.185 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-10-16T18:56:58.185 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.186 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-16T18:56:58.186 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.186 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.187 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.187 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu 3u unix 0xffff8ed4886bc840 0t0 15101 type=DGRAM (CONNECTED) 2023-10-16T18:56:58.187 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu 4u IPv4 15074 0t0 TCP smithi059.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:59254 (ESTABLISHED) 2023-10-16T18:56:58.187 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu 5u unix 0xffff8ed4884e7b40 0t0 15104 type=STREAM (CONNECTED) 2023-10-16T18:56:58.188 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu 6u unix 0xffff8ed4902ba640 0t0 22042 type=STREAM (CONNECTED) 2023-10-16T18:56:58.188 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 1305 ubuntu 7w FIFO 0,24 0t0 1389 /run/systemd/sessions/3.ref 2023-10-16T18:56:58.188 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.188 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.189 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root txt REG 8,1 1388920 9667 /usr/bin/bash 2023-10-16T18:56:58.189 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:58.189 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:58.189 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.190 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:58.190 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:58.190 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:58.191 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:58.191 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-10-16T18:56:58.191 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:58.191 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:58.192 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:58.192 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:58.192 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:58.192 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:58.193 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.193 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:58.193 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.193 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root 1u unix 0xffff8ed489ad7b40 0t0 18159 type=STREAM (CONNECTED) 2023-10-16T18:56:58.194 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root 2u unix 0xffff8ed489ad7b40 0t0 18159 type=STREAM (CONNECTED) 2023-10-16T18:56:58.194 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root 15w FIFO 8,1 0t0 262180 /var/tmp/dracut.ZQsCqk/systemd-cat 2023-10-16T18:56:58.194 INFO:teuthology.orchestra.run.smithi059.stdout:dracut 1309 root 255r REG 8,1 98435 11623 /usr/bin/dracut 2023-10-16T18:56:58.194 INFO:teuthology.orchestra.run.smithi059.stdout:cat 1354 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.195 INFO:teuthology.orchestra.run.smithi059.stdout:cat 1354 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.195 INFO:teuthology.orchestra.run.smithi059.stdout:cat 1354 root txt REG 8,1 36320 10018 /usr/bin/cat 2023-10-16T18:56:58.195 INFO:teuthology.orchestra.run.smithi059.stdout:cat 1354 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.196 INFO:teuthology.orchestra.run.smithi059.stdout:cat 1354 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.196 INFO:teuthology.orchestra.run.smithi059.stdout:cat 1354 root 0r FIFO 8,1 0t0 262180 /var/tmp/dracut.ZQsCqk/systemd-cat 2023-10-16T18:56:58.196 INFO:teuthology.orchestra.run.smithi059.stdout:cat 1354 root 1u unix 0xffff8ed486c10cc0 0t0 19107 type=STREAM (CONNECTED) 2023-10-16T18:56:58.196 INFO:teuthology.orchestra.run.smithi059.stdout:cat 1354 root 2u unix 0xffff8ed486c10cc0 0t0 19107 type=STREAM (CONNECTED) 2023-10-16T18:56:58.197 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.197 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.197 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-10-16T18:56:58.197 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:58.198 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-10-16T18:56:58.198 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-10-16T18:56:58.198 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:58.199 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:58.199 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T18:56:58.199 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-10-16T18:56:58.199 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-10-16T18:56:58.200 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-10-16T18:56:58.200 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-10-16T18:56:58.200 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-10-16T18:56:58.200 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-10-16T18:56:58.201 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-10-16T18:56:58.201 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-10-16T18:56:58.201 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-10-16T18:56:58.201 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-10-16T18:56:58.202 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-10-16T18:56:58.202 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-10-16T18:56:58.202 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-10-16T18:56:58.203 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-10-16T18:56:58.203 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-10-16T18:56:58.203 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-10-16T18:56:58.203 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:58.204 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:58.204 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:58.204 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:58.204 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:58.205 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:58.205 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:58.205 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.205 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:58.206 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:58.206 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:58.206 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:58.206 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-16T18:56:58.207 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:58.207 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:58.207 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:58.207 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:58.208 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:58.208 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:58.208 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:58.209 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:58.209 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-16T18:56:58.209 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:58.209 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:58.210 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-16T18:56:58.210 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:58.210 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-10-16T18:56:58.210 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.211 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-16T18:56:58.211 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.211 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.211 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.212 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root 3u unix 0xffff8ed490149dc0 0t0 790 type=DGRAM (CONNECTED) 2023-10-16T18:56:58.212 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root 4u IPv4 24679 0t0 TCP smithi059.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:35948 (ESTABLISHED) 2023-10-16T18:56:58.212 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root 6u unix 0xffff8ed490145d80 0t0 773 type=STREAM (CONNECTED) 2023-10-16T18:56:58.213 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root 7w FIFO 0,24 0t0 1402 /run/systemd/sessions/4.ref 2023-10-16T18:56:58.213 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 3957 root 8u unix 0xffff8ed490141980 0t0 794 type=STREAM (CONNECTED) 2023-10-16T18:56:58.213 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.213 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.214 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root txt REG 8,1 36312 10086 /usr/bin/sleep 2023-10-16T18:56:58.214 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:58.214 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.215 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:58.215 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:58.215 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:58.215 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:58.216 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:58.216 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:58.216 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:58.216 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:58.217 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:58.217 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:58.217 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:58.217 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.218 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:58.218 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.218 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root 1w CHR 4,65 0t0 114 /dev/ttyS1 2023-10-16T18:56:58.219 INFO:teuthology.orchestra.run.smithi059.stdout:sleep 3961 root 2w CHR 4,65 0t0 114 /dev/ttyS1 2023-10-16T18:56:58.219 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.219 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.219 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-10-16T18:56:58.220 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:58.220 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-10-16T18:56:58.220 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-10-16T18:56:58.220 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:58.221 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:58.221 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T18:56:58.221 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-10-16T18:56:58.221 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-10-16T18:56:58.222 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-10-16T18:56:58.222 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-10-16T18:56:58.222 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-10-16T18:56:58.223 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-10-16T18:56:58.223 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-10-16T18:56:58.223 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-10-16T18:56:58.223 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-10-16T18:56:58.224 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-10-16T18:56:58.224 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-10-16T18:56:58.224 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-10-16T18:56:58.224 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-10-16T18:56:58.225 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-10-16T18:56:58.225 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-10-16T18:56:58.225 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-10-16T18:56:58.226 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-16T18:56:58.226 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:58.226 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:58.226 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:58.227 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:58.227 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-16T18:56:58.227 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-16T18:56:58.228 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.228 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-16T18:56:58.228 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-16T18:56:58.228 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:58.229 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:58.229 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-16T18:56:58.229 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:58.229 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:58.230 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:58.230 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:58.230 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:58.231 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:58.231 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:58.231 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:58.231 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-16T18:56:58.232 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:58.232 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-16T18:56:58.232 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-16T18:56:58.232 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:58.233 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-10-16T18:56:58.233 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.233 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-16T18:56:58.233 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu 0u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.234 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu 1u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.234 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu 2u CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.234 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu 3u unix 0xffff8ed490149dc0 0t0 790 type=DGRAM (CONNECTED) 2023-10-16T18:56:58.235 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu 4u IPv4 24679 0t0 TCP smithi059.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:35948 (ESTABLISHED) 2023-10-16T18:56:58.235 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu 5u unix 0xffff8ed490142ec0 0t0 793 type=STREAM (CONNECTED) 2023-10-16T18:56:58.235 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu 6u unix 0xffff8ed490145d80 0t0 773 type=STREAM (CONNECTED) 2023-10-16T18:56:58.235 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu 7w FIFO 0,24 0t0 1402 /run/systemd/sessions/4.ref 2023-10-16T18:56:58.236 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu 12r FIFO 0,13 0t0 25872 pipe 2023-10-16T18:56:58.236 INFO:teuthology.orchestra.run.smithi059.stdout:sshd 4038 ubuntu 14r FIFO 0,13 0t0 25873 pipe 2023-10-16T18:56:58.236 INFO:teuthology.orchestra.run.smithi059.stdout:xargs 5109 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.236 INFO:teuthology.orchestra.run.smithi059.stdout:xargs 5109 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.237 INFO:teuthology.orchestra.run.smithi059.stdout:xargs 5109 root txt REG 8,1 65424 9828 /usr/bin/xargs 2023-10-16T18:56:58.237 INFO:teuthology.orchestra.run.smithi059.stdout:xargs 5109 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.237 INFO:teuthology.orchestra.run.smithi059.stdout:xargs 5109 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.238 INFO:teuthology.orchestra.run.smithi059.stdout:xargs 5109 root 0r FIFO 0,13 0t0 26745 pipe 2023-10-16T18:56:58.238 INFO:teuthology.orchestra.run.smithi059.stdout:xargs 5109 root 1u unix 0xffff8ed489ad7b40 0t0 18159 type=STREAM (CONNECTED) 2023-10-16T18:56:58.238 INFO:teuthology.orchestra.run.smithi059.stdout:xargs 5109 root 2w CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.238 INFO:teuthology.orchestra.run.smithi059.stdout:xargs 5109 root 15w FIFO 8,1 0t0 262180 /var/tmp/dracut.ZQsCqk/systemd-cat 2023-10-16T18:56:58.239 INFO:teuthology.orchestra.run.smithi059.stdout:strip 5110 root cwd DIR 8,1 4096 2 / 2023-10-16T18:56:58.239 INFO:teuthology.orchestra.run.smithi059.stdout:strip 5110 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.239 INFO:teuthology.orchestra.run.smithi059.stdout:strip 5110 root txt REG 8,1 189800 11550 /usr/bin/strip 2023-10-16T18:56:58.239 INFO:teuthology.orchestra.run.smithi059.stdout:strip 5110 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.240 INFO:teuthology.orchestra.run.smithi059.stdout:strip 5110 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:58.240 INFO:teuthology.orchestra.run.smithi059.stdout:strip 5110 root mem REG 8,1 1339416 13713 /usr/lib64/libbfd-2.35.2-42.el9.so 2023-10-16T18:56:58.240 INFO:teuthology.orchestra.run.smithi059.stdout:strip 5110 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.240 INFO:teuthology.orchestra.run.smithi059.stdout:strip 5110 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.241 INFO:teuthology.orchestra.run.smithi059.stdout:strip 5110 root 1u unix 0xffff8ed489ad7b40 0t0 18159 type=STREAM (CONNECTED) 2023-10-16T18:56:58.241 INFO:teuthology.orchestra.run.smithi059.stdout:strip 5110 root 2w CHR 1,3 0t0 4 /dev/null 2023-10-16T18:56:58.241 INFO:teuthology.orchestra.run.smithi059.stdout:strip 5110 root 3u REG 8,1 0 262911 /var/tmp/dracut.ZQsCqk/initramfs/stuCYw97 (deleted) 2023-10-16T18:56:58.242 INFO:teuthology.orchestra.run.smithi059.stdout:strip 5110 root 4u REG 8,1 0 262912 /var/tmp/dracut.ZQsCqk/initramfs/squash/root/stMPZaRM (deleted) 2023-10-16T18:56:58.242 INFO:teuthology.orchestra.run.smithi059.stdout:strip 5110 root 5r REG 8,1 1154 262907 /var/tmp/dracut.ZQsCqk/initramfs/init 2023-10-16T18:56:58.242 INFO:teuthology.orchestra.run.smithi059.stdout:strip 5110 root 6u REG 8,1 0 262913 /var/tmp/dracut.ZQsCqk/initramfs/squash/root/kdumpscripts/sti8rcNR (deleted) 2023-10-16T18:56:58.242 INFO:teuthology.orchestra.run.smithi059.stdout:strip 5110 root 7r REG 8,1 4631 262689 /var/tmp/dracut.ZQsCqk/initramfs/squash/root/shutdown 2023-10-16T18:56:58.243 INFO:teuthology.orchestra.run.smithi059.stdout:strip 5110 root 9r REG 8,1 482 262355 /var/tmp/dracut.ZQsCqk/initramfs/squash/root/kdumpscripts/monitor_dd_progress 2023-10-16T18:56:58.243 INFO:teuthology.orchestra.run.smithi059.stdout:strip 5110 root 15w FIFO 8,1 0t0 262180 /var/tmp/dracut.ZQsCqk/systemd-cat 2023-10-16T18:56:58.243 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2023-10-16T18:56:58.243 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.244 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu txt REG 8,1 1388920 9667 /usr/bin/bash 2023-10-16T18:56:58.244 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:58.244 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.245 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:58.245 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:58.245 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:58.245 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:58.246 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:58.246 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-10-16T18:56:58.246 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:58.246 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:58.247 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:58.247 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:58.247 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:58.248 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:58.248 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.248 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:58.248 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu 0r FIFO 0,13 0t0 25871 pipe 2023-10-16T18:56:58.249 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu 1w FIFO 0,13 0t0 25872 pipe 2023-10-16T18:56:58.249 INFO:teuthology.orchestra.run.smithi059.stdout:bash 5113 ubuntu 2w FIFO 0,13 0t0 25873 pipe 2023-10-16T18:56:58.249 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-10-16T18:56:58.249 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.250 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-10-16T18:56:58.250 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-10-16T18:56:58.250 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-16T18:56:58.250 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-16T18:56:58.251 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-16T18:56:58.251 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-16T18:56:58.251 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-10-16T18:56:58.251 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-10-16T18:56:58.252 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-10-16T18:56:58.252 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-10-16T18:56:58.252 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-10-16T18:56:58.252 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-10-16T18:56:58.253 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-10-16T18:56:58.253 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-10-16T18:56:58.253 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-10-16T18:56:58.253 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-10-16T18:56:58.254 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-10-16T18:56:58.254 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:58.254 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:58.255 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:58.255 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:58.255 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:58.255 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:58.256 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-16T18:56:58.256 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-10-16T18:56:58.256 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-10-16T18:56:58.256 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-10-16T18:56:58.257 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-16T18:56:58.257 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-10-16T18:56:58.257 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-16T18:56:58.257 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:58.258 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:58.258 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-10-16T18:56:58.258 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:58.259 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:58.259 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.259 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:58.259 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-16T18:56:58.260 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-10-16T18:56:58.260 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-16T18:56:58.260 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-10-16T18:56:58.260 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-16T18:56:58.261 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-16T18:56:58.261 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-16T18:56:58.261 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:58.261 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-16T18:56:58.262 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-10-16T18:56:58.262 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:58.262 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-16T18:56:58.263 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-16T18:56:58.263 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-16T18:56:58.263 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-16T18:56:58.263 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-16T18:56:58.264 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-16T18:56:58.264 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-16T18:56:58.264 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.264 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-16T18:56:58.265 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root 0r FIFO 0,13 0t0 25871 pipe 2023-10-16T18:56:58.265 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root 1w FIFO 0,13 0t0 25872 pipe 2023-10-16T18:56:58.265 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root 2w FIFO 0,13 0t0 25873 pipe 2023-10-16T18:56:58.265 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root 3r FIFO 0,13 0t0 24835 pipe 2023-10-16T18:56:58.266 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root 4w FIFO 0,13 0t0 24835 pipe 2023-10-16T18:56:58.266 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root 5u netlink 0t0 24841 AUDIT 2023-10-16T18:56:58.266 INFO:teuthology.orchestra.run.smithi059.stdout:sudo 5129 root 6u unix 0xffff8ed48b9d2640 0t0 24842 type=DGRAM (CONNECTED) 2023-10-16T18:56:58.267 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-10-16T18:56:58.267 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.267 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root txt REG 8,1 179232 12343 /usr/bin/lsof 2023-10-16T18:56:58.267 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:58.268 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:58.268 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:58.268 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:58.268 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:58.269 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:58.269 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:58.269 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.270 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:58.270 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:58.270 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:58.270 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:58.271 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:58.271 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T18:56:58.271 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:58.271 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.272 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root 0r FIFO 0,13 0t0 25871 pipe 2023-10-16T18:56:58.272 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root 1w FIFO 0,13 0t0 25872 pipe 2023-10-16T18:56:58.272 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root 2w FIFO 0,13 0t0 25873 pipe 2023-10-16T18:56:58.273 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root 3r DIR 0,20 0 1 /proc 2023-10-16T18:56:58.273 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root 4r DIR 0,20 0 24216 /proc/5131/fd 2023-10-16T18:56:58.273 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root 5w FIFO 0,13 0t0 24221 pipe 2023-10-16T18:56:58.273 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5131 root 6r FIFO 0,13 0t0 24222 pipe 2023-10-16T18:56:58.274 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-10-16T18:56:58.274 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root rtd DIR 8,1 4096 2 / 2023-10-16T18:56:58.274 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root txt REG 8,1 179232 12343 /usr/bin/lsof 2023-10-16T18:56:58.274 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-16T18:56:58.275 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-16T18:56:58.275 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-16T18:56:58.275 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-16T18:56:58.275 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-16T18:56:58.276 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-16T18:56:58.276 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-16T18:56:58.276 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-16T18:56:58.277 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-16T18:56:58.277 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-16T18:56:58.277 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-16T18:56:58.277 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-16T18:56:58.278 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-16T18:56:58.278 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-10-16T18:56:58.278 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-16T18:56:58.279 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-16T18:56:58.279 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root 4r FIFO 0,13 0t0 24221 pipe 2023-10-16T18:56:58.279 INFO:teuthology.orchestra.run.smithi059.stdout:lsof 5132 root 7w FIFO 0,13 0t0 24222 pipe 2023-10-16T18:56:58.279 INFO:teuthology.orchestra.run.smithi059.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2023-10-16T18:56:58.280 INFO:teuthology.orchestra.run.smithi059.stdout:root 2 0.0 0.0 0 0 ? S 18:56 0:00 [kthreadd] 2023-10-16T18:56:58.280 INFO:teuthology.orchestra.run.smithi059.stdout:root 3 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [rcu_gp] 2023-10-16T18:56:58.280 INFO:teuthology.orchestra.run.smithi059.stdout:root 4 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [rcu_par_gp] 2023-10-16T18:56:58.280 INFO:teuthology.orchestra.run.smithi059.stdout:root 5 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [slub_flushwq] 2023-10-16T18:56:58.281 INFO:teuthology.orchestra.run.smithi059.stdout:root 6 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [netns] 2023-10-16T18:56:58.281 INFO:teuthology.orchestra.run.smithi059.stdout:root 7 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/0:0-rcu_gp] 2023-10-16T18:56:58.281 INFO:teuthology.orchestra.run.smithi059.stdout:root 8 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kworker/0:0H-events_highpri] 2023-10-16T18:56:58.281 INFO:teuthology.orchestra.run.smithi059.stdout:root 9 0.1 0.0 0 0 ? I 18:56 0:00 \_ [kworker/u16:0-flush-8:0] 2023-10-16T18:56:58.282 INFO:teuthology.orchestra.run.smithi059.stdout:root 10 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [mm_percpu_wq] 2023-10-16T18:56:58.282 INFO:teuthology.orchestra.run.smithi059.stdout:root 11 0.1 0.0 0 0 ? I 18:56 0:00 \_ [kworker/u16:1-ext4-rsv-conversion] 2023-10-16T18:56:58.282 INFO:teuthology.orchestra.run.smithi059.stdout:root 12 0.0 0.0 0 0 ? I 18:56 0:00 \_ [rcu_tasks_kthre] 2023-10-16T18:56:58.282 INFO:teuthology.orchestra.run.smithi059.stdout:root 13 0.0 0.0 0 0 ? I 18:56 0:00 \_ [rcu_tasks_rude_] 2023-10-16T18:56:58.283 INFO:teuthology.orchestra.run.smithi059.stdout:root 14 0.0 0.0 0 0 ? I 18:56 0:00 \_ [rcu_tasks_trace] 2023-10-16T18:56:58.283 INFO:teuthology.orchestra.run.smithi059.stdout:root 15 0.0 0.0 0 0 ? S 18:56 0:00 \_ [ksoftirqd/0] 2023-10-16T18:56:58.283 INFO:teuthology.orchestra.run.smithi059.stdout:root 16 16.2 0.0 0 0 ? S 18:56 0:04 \_ [pr/ttyS1] 2023-10-16T18:56:58.283 INFO:teuthology.orchestra.run.smithi059.stdout:root 17 0.0 0.0 0 0 ? I 18:56 0:00 \_ [rcu_preempt] 2023-10-16T18:56:58.284 INFO:teuthology.orchestra.run.smithi059.stdout:root 18 0.0 0.0 0 0 ? S 18:56 0:00 \_ [migration/0] 2023-10-16T18:56:58.284 INFO:teuthology.orchestra.run.smithi059.stdout:root 19 0.0 0.0 0 0 ? S 18:56 0:00 \_ [idle_inject/0] 2023-10-16T18:56:58.284 INFO:teuthology.orchestra.run.smithi059.stdout:root 20 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/0:1-events] 2023-10-16T18:56:58.285 INFO:teuthology.orchestra.run.smithi059.stdout:root 21 0.0 0.0 0 0 ? S 18:56 0:00 \_ [cpuhp/0] 2023-10-16T18:56:58.285 INFO:teuthology.orchestra.run.smithi059.stdout:root 22 0.0 0.0 0 0 ? S 18:56 0:00 \_ [cpuhp/1] 2023-10-16T18:56:58.285 INFO:teuthology.orchestra.run.smithi059.stdout:root 23 0.0 0.0 0 0 ? S 18:56 0:00 \_ [idle_inject/1] 2023-10-16T18:56:58.285 INFO:teuthology.orchestra.run.smithi059.stdout:root 24 0.5 0.0 0 0 ? S 18:56 0:00 \_ [migration/1] 2023-10-16T18:56:58.286 INFO:teuthology.orchestra.run.smithi059.stdout:root 25 0.0 0.0 0 0 ? S 18:56 0:00 \_ [ksoftirqd/1] 2023-10-16T18:56:58.286 INFO:teuthology.orchestra.run.smithi059.stdout:root 26 0.2 0.0 0 0 ? I 18:56 0:00 \_ [kworker/1:0-events_freezable] 2023-10-16T18:56:58.286 INFO:teuthology.orchestra.run.smithi059.stdout:root 27 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kworker/1:0H-events_highpri] 2023-10-16T18:56:58.286 INFO:teuthology.orchestra.run.smithi059.stdout:root 28 0.0 0.0 0 0 ? S 18:56 0:00 \_ [cpuhp/2] 2023-10-16T18:56:58.287 INFO:teuthology.orchestra.run.smithi059.stdout:root 29 0.0 0.0 0 0 ? S 18:56 0:00 \_ [idle_inject/2] 2023-10-16T18:56:58.287 INFO:teuthology.orchestra.run.smithi059.stdout:root 30 0.5 0.0 0 0 ? S 18:56 0:00 \_ [migration/2] 2023-10-16T18:56:58.287 INFO:teuthology.orchestra.run.smithi059.stdout:root 31 0.0 0.0 0 0 ? S 18:56 0:00 \_ [ksoftirqd/2] 2023-10-16T18:56:58.288 INFO:teuthology.orchestra.run.smithi059.stdout:root 32 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/2:0-cgroup_destroy] 2023-10-16T18:56:58.288 INFO:teuthology.orchestra.run.smithi059.stdout:root 33 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kworker/2:0H-events_highpri] 2023-10-16T18:56:58.288 INFO:teuthology.orchestra.run.smithi059.stdout:root 34 0.0 0.0 0 0 ? S 18:56 0:00 \_ [cpuhp/3] 2023-10-16T18:56:58.288 INFO:teuthology.orchestra.run.smithi059.stdout:root 35 0.0 0.0 0 0 ? S 18:56 0:00 \_ [idle_inject/3] 2023-10-16T18:56:58.289 INFO:teuthology.orchestra.run.smithi059.stdout:root 36 0.5 0.0 0 0 ? S 18:56 0:00 \_ [migration/3] 2023-10-16T18:56:58.289 INFO:teuthology.orchestra.run.smithi059.stdout:root 37 0.0 0.0 0 0 ? S 18:56 0:00 \_ [ksoftirqd/3] 2023-10-16T18:56:58.289 INFO:teuthology.orchestra.run.smithi059.stdout:root 38 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/3:0-cgroup_destroy] 2023-10-16T18:56:58.289 INFO:teuthology.orchestra.run.smithi059.stdout:root 39 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kworker/3:0H-events_highpri] 2023-10-16T18:56:58.290 INFO:teuthology.orchestra.run.smithi059.stdout:root 40 0.0 0.0 0 0 ? S 18:56 0:00 \_ [cpuhp/4] 2023-10-16T18:56:58.290 INFO:teuthology.orchestra.run.smithi059.stdout:root 41 0.0 0.0 0 0 ? S 18:56 0:00 \_ [idle_inject/4] 2023-10-16T18:56:58.290 INFO:teuthology.orchestra.run.smithi059.stdout:root 42 0.5 0.0 0 0 ? S 18:56 0:00 \_ [migration/4] 2023-10-16T18:56:58.290 INFO:teuthology.orchestra.run.smithi059.stdout:root 43 0.0 0.0 0 0 ? S 18:56 0:00 \_ [ksoftirqd/4] 2023-10-16T18:56:58.291 INFO:teuthology.orchestra.run.smithi059.stdout:root 44 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/4:0-events] 2023-10-16T18:56:58.291 INFO:teuthology.orchestra.run.smithi059.stdout:root 45 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kworker/4:0H-events_highpri] 2023-10-16T18:56:58.291 INFO:teuthology.orchestra.run.smithi059.stdout:root 46 0.0 0.0 0 0 ? S 18:56 0:00 \_ [cpuhp/5] 2023-10-16T18:56:58.291 INFO:teuthology.orchestra.run.smithi059.stdout:root 47 0.0 0.0 0 0 ? S 18:56 0:00 \_ [idle_inject/5] 2023-10-16T18:56:58.292 INFO:teuthology.orchestra.run.smithi059.stdout:root 48 0.5 0.0 0 0 ? S 18:56 0:00 \_ [migration/5] 2023-10-16T18:56:58.292 INFO:teuthology.orchestra.run.smithi059.stdout:root 49 0.0 0.0 0 0 ? S 18:56 0:00 \_ [ksoftirqd/5] 2023-10-16T18:56:58.292 INFO:teuthology.orchestra.run.smithi059.stdout:root 50 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/5:0-mm_percpu_wq] 2023-10-16T18:56:58.293 INFO:teuthology.orchestra.run.smithi059.stdout:root 51 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kworker/5:0H-events_highpri] 2023-10-16T18:56:58.293 INFO:teuthology.orchestra.run.smithi059.stdout:root 52 0.0 0.0 0 0 ? S 18:56 0:00 \_ [cpuhp/6] 2023-10-16T18:56:58.293 INFO:teuthology.orchestra.run.smithi059.stdout:root 53 0.0 0.0 0 0 ? S 18:56 0:00 \_ [idle_inject/6] 2023-10-16T18:56:58.293 INFO:teuthology.orchestra.run.smithi059.stdout:root 54 0.5 0.0 0 0 ? S 18:56 0:00 \_ [migration/6] 2023-10-16T18:56:58.294 INFO:teuthology.orchestra.run.smithi059.stdout:root 55 0.0 0.0 0 0 ? S 18:56 0:00 \_ [ksoftirqd/6] 2023-10-16T18:56:58.294 INFO:teuthology.orchestra.run.smithi059.stdout:root 56 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/6:0-cgroup_destroy] 2023-10-16T18:56:58.294 INFO:teuthology.orchestra.run.smithi059.stdout:root 57 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kworker/6:0H-events_highpri] 2023-10-16T18:56:58.294 INFO:teuthology.orchestra.run.smithi059.stdout:root 58 0.0 0.0 0 0 ? S 18:56 0:00 \_ [cpuhp/7] 2023-10-16T18:56:58.295 INFO:teuthology.orchestra.run.smithi059.stdout:root 59 0.0 0.0 0 0 ? S 18:56 0:00 \_ [idle_inject/7] 2023-10-16T18:56:58.295 INFO:teuthology.orchestra.run.smithi059.stdout:root 60 0.5 0.0 0 0 ? S 18:56 0:00 \_ [migration/7] 2023-10-16T18:56:58.295 INFO:teuthology.orchestra.run.smithi059.stdout:root 61 0.0 0.0 0 0 ? S 18:56 0:00 \_ [ksoftirqd/7] 2023-10-16T18:56:58.295 INFO:teuthology.orchestra.run.smithi059.stdout:root 62 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/7:0-pm] 2023-10-16T18:56:58.296 INFO:teuthology.orchestra.run.smithi059.stdout:root 63 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kworker/7:0H-events_highpri] 2023-10-16T18:56:58.296 INFO:teuthology.orchestra.run.smithi059.stdout:root 65 0.1 0.0 0 0 ? I 18:56 0:00 \_ [kworker/u16:2-flush-8:0] 2023-10-16T18:56:58.296 INFO:teuthology.orchestra.run.smithi059.stdout:root 66 0.1 0.0 0 0 ? I 18:56 0:00 \_ [kworker/u16:3-flush-8:0] 2023-10-16T18:56:58.297 INFO:teuthology.orchestra.run.smithi059.stdout:root 67 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/u16:4-flush-8:0] 2023-10-16T18:56:58.297 INFO:teuthology.orchestra.run.smithi059.stdout:root 68 0.1 0.0 0 0 ? I 18:56 0:00 \_ [kworker/u16:5-flush-8:0] 2023-10-16T18:56:58.297 INFO:teuthology.orchestra.run.smithi059.stdout:root 69 1.3 0.0 0 0 ? I 18:56 0:00 \_ [kworker/u16:6-flush-8:0] 2023-10-16T18:56:58.297 INFO:teuthology.orchestra.run.smithi059.stdout:root 70 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/u16:7-events_unbound] 2023-10-16T18:56:58.298 INFO:teuthology.orchestra.run.smithi059.stdout:root 71 0.0 0.0 0 0 ? S 18:56 0:00 \_ [kdevtmpfs] 2023-10-16T18:56:58.298 INFO:teuthology.orchestra.run.smithi059.stdout:root 72 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [inet_frag_wq] 2023-10-16T18:56:58.298 INFO:teuthology.orchestra.run.smithi059.stdout:root 73 0.0 0.0 0 0 ? S 18:56 0:00 \_ [kauditd] 2023-10-16T18:56:58.298 INFO:teuthology.orchestra.run.smithi059.stdout:root 74 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/5:1-events] 2023-10-16T18:56:58.299 INFO:teuthology.orchestra.run.smithi059.stdout:root 75 0.0 0.0 0 0 ? S 18:56 0:00 \_ [khungtaskd] 2023-10-16T18:56:58.299 INFO:teuthology.orchestra.run.smithi059.stdout:root 76 0.0 0.0 0 0 ? S 18:56 0:00 \_ [oom_reaper] 2023-10-16T18:56:58.299 INFO:teuthology.orchestra.run.smithi059.stdout:root 77 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [writeback] 2023-10-16T18:56:58.299 INFO:teuthology.orchestra.run.smithi059.stdout:root 78 0.0 0.0 0 0 ? S 18:56 0:00 \_ [kcompactd0] 2023-10-16T18:56:58.300 INFO:teuthology.orchestra.run.smithi059.stdout:root 79 0.0 0.0 0 0 ? SN 18:56 0:00 \_ [ksmd] 2023-10-16T18:56:58.300 INFO:teuthology.orchestra.run.smithi059.stdout:root 80 0.0 0.0 0 0 ? SN 18:56 0:00 \_ [khugepaged] 2023-10-16T18:56:58.300 INFO:teuthology.orchestra.run.smithi059.stdout:root 81 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [cryptd] 2023-10-16T18:56:58.301 INFO:teuthology.orchestra.run.smithi059.stdout:root 82 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kintegrityd] 2023-10-16T18:56:58.301 INFO:teuthology.orchestra.run.smithi059.stdout:root 83 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kblockd] 2023-10-16T18:56:58.301 INFO:teuthology.orchestra.run.smithi059.stdout:root 84 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [blkcg_punt_bio] 2023-10-16T18:56:58.301 INFO:teuthology.orchestra.run.smithi059.stdout:root 85 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [tpm_dev_wq] 2023-10-16T18:56:58.302 INFO:teuthology.orchestra.run.smithi059.stdout:root 86 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [md] 2023-10-16T18:56:58.302 INFO:teuthology.orchestra.run.smithi059.stdout:root 87 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [edac-poller] 2023-10-16T18:56:58.302 INFO:teuthology.orchestra.run.smithi059.stdout:root 88 0.0 0.0 0 0 ? S 18:56 0:00 \_ [watchdogd] 2023-10-16T18:56:58.302 INFO:teuthology.orchestra.run.smithi059.stdout:root 89 0.3 0.0 0 0 ? I 18:56 0:00 \_ [kworker/3:1-events] 2023-10-16T18:56:58.303 INFO:teuthology.orchestra.run.smithi059.stdout:root 90 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kworker/5:1H-kblockd] 2023-10-16T18:56:58.303 INFO:teuthology.orchestra.run.smithi059.stdout:root 91 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/6:1-mm_percpu_wq] 2023-10-16T18:56:58.303 INFO:teuthology.orchestra.run.smithi059.stdout:root 92 0.0 0.0 0 0 ? S 18:56 0:00 \_ [kswapd0] 2023-10-16T18:56:58.303 INFO:teuthology.orchestra.run.smithi059.stdout:root 94 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/1:1-rcu_gp] 2023-10-16T18:56:58.304 INFO:teuthology.orchestra.run.smithi059.stdout:root 98 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kthrotld] 2023-10-16T18:56:58.304 INFO:teuthology.orchestra.run.smithi059.stdout:root 99 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/3:2] 2023-10-16T18:56:58.304 INFO:teuthology.orchestra.run.smithi059.stdout:root 102 0.1 0.0 0 0 ? I 18:56 0:00 \_ [kworker/0:2-events] 2023-10-16T18:56:58.304 INFO:teuthology.orchestra.run.smithi059.stdout:root 103 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/0:3] 2023-10-16T18:56:58.305 INFO:teuthology.orchestra.run.smithi059.stdout:root 105 0.1 0.0 0 0 ? I 18:56 0:00 \_ [kworker/2:1-events] 2023-10-16T18:56:58.305 INFO:teuthology.orchestra.run.smithi059.stdout:root 106 0.1 0.0 0 0 ? I 18:56 0:00 \_ [kworker/4:1-mm_percpu_wq] 2023-10-16T18:56:58.305 INFO:teuthology.orchestra.run.smithi059.stdout:root 107 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/7:1-cgroup_destroy] 2023-10-16T18:56:58.306 INFO:teuthology.orchestra.run.smithi059.stdout:root 108 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [acpi_thermal_pm] 2023-10-16T18:56:58.306 INFO:teuthology.orchestra.run.smithi059.stdout:root 109 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kmpath_rdacd] 2023-10-16T18:56:58.306 INFO:teuthology.orchestra.run.smithi059.stdout:root 110 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kaluad] 2023-10-16T18:56:58.306 INFO:teuthology.orchestra.run.smithi059.stdout:root 111 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/1:2] 2023-10-16T18:56:58.307 INFO:teuthology.orchestra.run.smithi059.stdout:root 112 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [mld] 2023-10-16T18:56:58.307 INFO:teuthology.orchestra.run.smithi059.stdout:root 113 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kworker/4:1H-kblockd] 2023-10-16T18:56:58.307 INFO:teuthology.orchestra.run.smithi059.stdout:root 114 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [ipv6_addrconf] 2023-10-16T18:56:58.307 INFO:teuthology.orchestra.run.smithi059.stdout:root 123 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kstrp] 2023-10-16T18:56:58.308 INFO:teuthology.orchestra.run.smithi059.stdout:root 124 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/7:2-events] 2023-10-16T18:56:58.308 INFO:teuthology.orchestra.run.smithi059.stdout:root 132 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/4:2-cgroup_destroy] 2023-10-16T18:56:58.308 INFO:teuthology.orchestra.run.smithi059.stdout:root 133 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/5:2-cgroup_destroy] 2023-10-16T18:56:58.309 INFO:teuthology.orchestra.run.smithi059.stdout:root 138 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [zswap-shrink] 2023-10-16T18:56:58.309 INFO:teuthology.orchestra.run.smithi059.stdout:root 252 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/7:3] 2023-10-16T18:56:58.309 INFO:teuthology.orchestra.run.smithi059.stdout:root 253 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kworker/u17:0] 2023-10-16T18:56:58.309 INFO:teuthology.orchestra.run.smithi059.stdout:root 292 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kworker/0:1H-kblockd] 2023-10-16T18:56:58.310 INFO:teuthology.orchestra.run.smithi059.stdout:root 295 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kworker/2:1H-kblockd] 2023-10-16T18:56:58.310 INFO:teuthology.orchestra.run.smithi059.stdout:root 305 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kworker/1:1H-kblockd] 2023-10-16T18:56:58.310 INFO:teuthology.orchestra.run.smithi059.stdout:root 306 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kworker/3:1H-kblockd] 2023-10-16T18:56:58.310 INFO:teuthology.orchestra.run.smithi059.stdout:root 309 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/2:2-cgroup_destroy] 2023-10-16T18:56:58.311 INFO:teuthology.orchestra.run.smithi059.stdout:root 437 0.1 0.0 0 0 ? I< 18:56 0:00 \_ [kworker/7:1H-kblockd] 2023-10-16T18:56:58.311 INFO:teuthology.orchestra.run.smithi059.stdout:root 441 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [nvme-wq] 2023-10-16T18:56:58.311 INFO:teuthology.orchestra.run.smithi059.stdout:root 442 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [nvme-reset-wq] 2023-10-16T18:56:58.311 INFO:teuthology.orchestra.run.smithi059.stdout:root 443 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [nvme-delete-wq] 2023-10-16T18:56:58.312 INFO:teuthology.orchestra.run.smithi059.stdout:root 444 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [nvme-auth-wq] 2023-10-16T18:56:58.312 INFO:teuthology.orchestra.run.smithi059.stdout:root 451 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [ata_sff] 2023-10-16T18:56:58.312 INFO:teuthology.orchestra.run.smithi059.stdout:root 453 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [ixgbe] 2023-10-16T18:56:58.313 INFO:teuthology.orchestra.run.smithi059.stdout:root 461 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/4:3] 2023-10-16T18:56:58.313 INFO:teuthology.orchestra.run.smithi059.stdout:root 462 0.0 0.0 0 0 ? S 18:56 0:00 \_ [scsi_eh_0] 2023-10-16T18:56:58.313 INFO:teuthology.orchestra.run.smithi059.stdout:root 463 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [scsi_tmf_0] 2023-10-16T18:56:58.313 INFO:teuthology.orchestra.run.smithi059.stdout:root 464 0.0 0.0 0 0 ? S 18:56 0:00 \_ [scsi_eh_1] 2023-10-16T18:56:58.314 INFO:teuthology.orchestra.run.smithi059.stdout:root 465 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [scsi_tmf_1] 2023-10-16T18:56:58.314 INFO:teuthology.orchestra.run.smithi059.stdout:root 466 0.0 0.0 0 0 ? S 18:56 0:00 \_ [scsi_eh_2] 2023-10-16T18:56:58.314 INFO:teuthology.orchestra.run.smithi059.stdout:root 467 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [scsi_tmf_2] 2023-10-16T18:56:58.314 INFO:teuthology.orchestra.run.smithi059.stdout:root 468 0.0 0.0 0 0 ? S 18:56 0:00 \_ [scsi_eh_3] 2023-10-16T18:56:58.315 INFO:teuthology.orchestra.run.smithi059.stdout:root 469 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [scsi_tmf_3] 2023-10-16T18:56:58.315 INFO:teuthology.orchestra.run.smithi059.stdout:root 470 0.0 0.0 0 0 ? S 18:56 0:00 \_ [scsi_eh_4] 2023-10-16T18:56:58.315 INFO:teuthology.orchestra.run.smithi059.stdout:root 471 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [scsi_tmf_4] 2023-10-16T18:56:58.315 INFO:teuthology.orchestra.run.smithi059.stdout:root 472 0.0 0.0 0 0 ? S 18:56 0:00 \_ [scsi_eh_5] 2023-10-16T18:56:58.316 INFO:teuthology.orchestra.run.smithi059.stdout:root 473 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [scsi_tmf_5] 2023-10-16T18:56:58.316 INFO:teuthology.orchestra.run.smithi059.stdout:root 474 0.0 0.0 0 0 ? S 18:56 0:00 \_ [scsi_eh_6] 2023-10-16T18:56:58.316 INFO:teuthology.orchestra.run.smithi059.stdout:root 475 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [scsi_tmf_6] 2023-10-16T18:56:58.317 INFO:teuthology.orchestra.run.smithi059.stdout:root 476 0.0 0.0 0 0 ? S 18:56 0:00 \_ [scsi_eh_7] 2023-10-16T18:56:58.317 INFO:teuthology.orchestra.run.smithi059.stdout:root 477 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [scsi_tmf_7] 2023-10-16T18:56:58.317 INFO:teuthology.orchestra.run.smithi059.stdout:root 478 0.0 0.0 0 0 ? S 18:56 0:00 \_ [scsi_eh_8] 2023-10-16T18:56:58.317 INFO:teuthology.orchestra.run.smithi059.stdout:root 479 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [scsi_tmf_8] 2023-10-16T18:56:58.318 INFO:teuthology.orchestra.run.smithi059.stdout:root 480 0.0 0.0 0 0 ? S 18:56 0:00 \_ [scsi_eh_9] 2023-10-16T18:56:58.318 INFO:teuthology.orchestra.run.smithi059.stdout:root 481 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [scsi_tmf_9] 2023-10-16T18:56:58.318 INFO:teuthology.orchestra.run.smithi059.stdout:root 482 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/u16:8-flush-8:0] 2023-10-16T18:56:58.318 INFO:teuthology.orchestra.run.smithi059.stdout:root 483 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/u16:9-ext4-rsv-conversion] 2023-10-16T18:56:58.319 INFO:teuthology.orchestra.run.smithi059.stdout:root 484 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/u16:10-events_unbound] 2023-10-16T18:56:58.319 INFO:teuthology.orchestra.run.smithi059.stdout:root 485 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/u16:11-events_unbound] 2023-10-16T18:56:58.319 INFO:teuthology.orchestra.run.smithi059.stdout:root 490 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [kworker/6:1H-kblockd] 2023-10-16T18:56:58.319 INFO:teuthology.orchestra.run.smithi059.stdout:root 505 0.0 0.0 0 0 ? S 18:56 0:00 \_ [jbd2/sda1-8] 2023-10-16T18:56:58.320 INFO:teuthology.orchestra.run.smithi059.stdout:root 506 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [ext4-rsv-conver] 2023-10-16T18:56:58.320 INFO:teuthology.orchestra.run.smithi059.stdout:root 587 0.0 0.0 0 0 ? S 18:56 0:00 \_ [ext4lazyinit] 2023-10-16T18:56:58.320 INFO:teuthology.orchestra.run.smithi059.stdout:root 652 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [ipmi-msghandler] 2023-10-16T18:56:58.320 INFO:teuthology.orchestra.run.smithi059.stdout:root 663 0.0 0.0 0 0 ? SN 18:56 0:00 \_ [kipmi0] 2023-10-16T18:56:58.321 INFO:teuthology.orchestra.run.smithi059.stdout:root 673 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [rpciod] 2023-10-16T18:56:58.321 INFO:teuthology.orchestra.run.smithi059.stdout:root 674 0.0 0.0 0 0 ? I< 18:56 0:00 \_ [xprtiod] 2023-10-16T18:56:58.321 INFO:teuthology.orchestra.run.smithi059.stdout:root 720 0.0 0.0 0 0 ? I 18:56 0:00 \_ [kworker/6:2-cgroup_destroy] 2023-10-16T18:56:58.321 INFO:teuthology.orchestra.run.smithi059.stdout:root 1 5.7 0.0 172620 16968 ? Ss 18:56 0:01 /usr/lib/systemd/systemd --switched-root --system --deserialize 31 2023-10-16T18:56:58.322 INFO:teuthology.orchestra.run.smithi059.stdout:root 429 0.5 0.0 7296 2388 ? S 18:56 0:00 @usr/sbin/plymouthd --mode=boot --pid-file=/run/plymouth/pid --attach-to-session 2023-10-16T18:56:58.322 INFO:teuthology.orchestra.run.smithi059.stdout:root 581 0.2 0.0 26268 11660 ? Ss 18:56 0:00 /usr/lib/systemd/systemd-journald 2023-10-16T18:56:58.322 INFO:teuthology.orchestra.run.smithi059.stdout:root 599 0.7 0.0 35728 13668 ? Ss 18:56 0:00 /usr/lib/systemd/systemd-udevd 2023-10-16T18:56:58.323 INFO:teuthology.orchestra.run.smithi059.stdout:rpc 668 0.1 0.0 13244 5592 ? Ss 18:56 0:00 /usr/bin/rpcbind -w -f 2023-10-16T18:56:58.323 INFO:teuthology.orchestra.run.smithi059.stdout:root 681 0.0 0.0 91824 4456 ? S sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T18:56:58.340 DEBUG:teuthology.orchestra.run.smithi151:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-16T18:56:58.380 INFO:teuthology.orchestra.run.smithi151.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-16T18:56:58.406 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-16T18:56:58.418 INFO:tasks.ceph:Archiving crash dumps... 2023-10-16T18:56:58.422 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429048/remote/smithi059/crash 2023-10-16T18:56:58.423 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T18:56:58.467 INFO:teuthology.orchestra.run.smithi059.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2023-10-16T18:56:58.468 INFO:teuthology.orchestra.run.smithi059.stderr:tar: Error is not recoverable: exiting now 2023-10-16T18:56:58.470 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429048/remote/smithi151/crash 2023-10-16T18:56:58.472 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-16T18:56:58.508 INFO:teuthology.orchestra.run.smithi151.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2023-10-16T18:56:58.508 INFO:teuthology.orchestra.run.smithi151.stderr:tar: Error is not recoverable: exiting now 2023-10-16T18:56:58.509 INFO:tasks.ceph:Shutting down logrotate 2023-10-16T18:56:58.511 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-10-16T18:56:58.528 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-16T18:56:58.540 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-10-16T18:56:58.550 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-16T18:56:58.551 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T18:56:58.559 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-16T18:56:58.637 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-16T18:56:58.648 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-16T18:56:58.649 DEBUG:teuthology.orchestra.run.smithi059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T18:56:58.653 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-16T18:56:58.666 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: ntpq: command not found 2023-10-16T18:56:58.669 INFO:teuthology.orchestra.run.smithi151.stderr:bash: ntpq: command not found 2023-10-16T18:56:58.671 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T18:56:58.671 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2023-10-16T18:56:58.671 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv01.front.sepia.ceph.com 2 6 17 4 +22us[ +24us] +/- 84ms 2023-10-16T18:56:58.672 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv02.front.sepia.ceph.com 3 6 17 3 -3374us[-3373us] +/- 73ms 2023-10-16T18:56:58.672 INFO:teuthology.orchestra.run.smithi059.stdout:^* hv03.front.sepia.ceph.com 3 6 17 3 +2767us[+2769us] +/- 60ms 2023-10-16T18:56:58.672 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 7 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T18:56:58.674 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-16T18:56:58.674 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2023-10-16T18:56:58.675 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv01.front.sepia.ceph.com 2 6 17 2 +9823ns[-4867ns] +/- 85ms 2023-10-16T18:56:58.675 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv02.front.sepia.ceph.com 3 6 17 2 -3363us[-3378us] +/- 74ms 2023-10-16T18:56:58.675 INFO:teuthology.orchestra.run.smithi151.stdout:^* hv03.front.sepia.ceph.com 3 6 17 2 +2762us[+2747us] +/- 61ms 2023-10-16T18:56:58.676 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-16T18:56:58.676 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-16T18:56:58.686 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-16T18:56:58.686 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-16T18:56:58.696 DEBUG:teuthology.orchestra.run.smithi059:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-16T18:56:58.726 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:56:58.726 INFO:teuthology.orchestra.run.smithi059.stderr:mkdir: cannot create directory ‘/home/ubuntu/cephtest/archive/audit’: No such file or directory 2023-10-16T18:56:58.727 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/selinux.py", line 165, in teardown self.archive_log() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/selinux.py", line 195, in archive_log self.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log' 2023-10-16T18:56:58.734 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-16T18:56:58.744 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-16T18:56:58.754 INFO:teuthology.task.internal:Duration was 17080.420836 seconds 2023-10-16T18:56:58.755 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-16T18:56:58.764 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-16T18:56:58.764 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T18:56:58.770 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-16T18:56:58.842 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T18:56:58.901 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-16T18:56:59.121 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-16T18:56:59.122 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi059.front.sepia.ceph.com 2023-10-16T18:56:59.122 DEBUG:teuthology.orchestra.run.smithi059:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T18:56:59.140 INFO:teuthology.orchestra.run.smithi059.stderr:grep: /home/ubuntu/cephtest/archive/syslog/kern.log: No such file or directory 2023-10-16T18:56:59.145 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2023-10-16T18:56:59.146 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-16T18:56:59.165 INFO:teuthology.orchestra.run.smithi151.stderr:grep: /home/ubuntu/cephtest/archive/syslog/kern.log: No such file or directory 2023-10-16T18:56:59.177 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-16T18:56:59.177 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T18:56:59.189 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-16T18:56:59.201 INFO:teuthology.orchestra.run.smithi059.stderr:find: ‘/home/ubuntu/cephtest/archive/syslog’: No such file or directory 2023-10-16T18:56:59.232 INFO:teuthology.orchestra.run.smithi151.stderr:find: ‘/home/ubuntu/cephtest/archive/syslog’: No such file or directory 2023-10-16T18:56:59.243 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-16T18:56:59.244 DEBUG:teuthology.orchestra.run.smithi059:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T18:56:59.262 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-16T18:56:59.274 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz: No such file or directory 2023-10-16T18:56:59.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:56:59.294 ERROR:teuthology.run_tasks:Manager failed: internal.syslog Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/syslog.py", line 76, in syslog yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/syslog.py", line 185, in syslog run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz' 2023-10-16T18:56:59.315 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-16T18:56:59.329 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-16T18:56:59.330 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-16T18:56:59.338 INFO:teuthology.orchestra.run.smithi151.stderr:bash: /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz: No such file or directory 2023-10-16T18:56:59.365 INFO:teuthology.orchestra.run.smithi059.stderr:mv: cannot stat '/etc/sudoers.orig.teuthology': No such file or directory 2023-10-16T18:56:59.366 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:56:59.367 ERROR:teuthology.run_tasks:Manager failed: internal.sudo Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 452, in sudo yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 455, in sudo ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers' 2023-10-16T18:56:59.389 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-16T18:56:59.399 DEBUG:teuthology.orchestra.run.smithi059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T18:56:59.411 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-16T18:56:59.459 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2023-10-16T18:56:59.466 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = core 2023-10-16T18:56:59.471 INFO:teuthology.orchestra.run.smithi151.stderr:find: ‘/home/ubuntu/cephtest/archive/coredump’: No such file or directory 2023-10-16T18:56:59.477 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/archive/coredump': No such file or directory 2023-10-16T18:56:59.484 INFO:teuthology.orchestra.run.smithi059.stderr:find: ‘/home/ubuntu/cephtest/archive/coredump’: No such file or directory 2023-10-16T18:56:59.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:56:59.507 INFO:teuthology.orchestra.run.smithi059.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/archive/coredump': No such file or directory 2023-10-16T18:56:59.507 ERROR:teuthology.run_tasks:Manager failed: internal.coredump Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 488, in coredump yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 491, in coredump run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: "sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump" 2023-10-16T18:56:59.527 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-16T18:56:59.538 INFO:teuthology.task.internal:Transferring archived files... 2023-10-16T18:56:59.540 DEBUG:teuthology.misc:Transferring archived files from smithi059:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi/7429048/remote/smithi059 2023-10-16T18:56:59.540 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-16T18:56:59.575 INFO:teuthology.orchestra.run.smithi059.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2023-10-16T18:56:59.576 INFO:teuthology.orchestra.run.smithi059.stderr:tar: Error is not recoverable: exiting now 2023-10-16T18:56:59.577 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.8/tarfile.py", line 2318, in next tarinfo = self.tarinfo.fromtarfile(self) File "/usr/lib/python3.8/tarfile.py", line 1105, in fromtarfile obj = cls.frombuf(buf, tarfile.encoding, tarfile.errors) File "/usr/lib/python3.8/tarfile.py", line 1041, in frombuf raise EmptyHeaderError("empty header") tarfile.EmptyHeaderError: empty header During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 418, in archive misc.pull_directory(rem, archive_dir, path, maybe_compress) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 749, in pull_directory tar = tarfile.open(mode='r|', fileobj=r.stdout) File "/usr/lib/python3.8/tarfile.py", line 1633, in open t = cls(name, filemode, stream, **kwargs) File "/usr/lib/python3.8/tarfile.py", line 1514, in __init__ self.firstmember = self.next() File "/usr/lib/python3.8/tarfile.py", line 2333, in next raise ReadError("empty file") tarfile.ReadError: empty file 2023-10-16T18:56:59.673 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-16T18:56:59.684 INFO:teuthology.task.internal:Not uploading archives. 2023-10-16T18:56:59.684 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-16T18:56:59.694 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-16T18:56:59.695 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T18:56:59.704 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-16T18:56:59.716 INFO:teuthology.orchestra.run.smithi059.stderr:find: ‘/home/ubuntu/cephtest’: No such file or directory 2023-10-16T18:56:59.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-16T18:56:59.718 INFO:teuthology.orchestra.run.smithi059.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': No such file or directory 2023-10-16T18:56:59.719 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_33be745ec4531df08cd1bb70b4c9c1f89be58078/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi059 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-16T18:56:59.739 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-16T18:56:59.750 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-16T18:56:59.762 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi059 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-10-16T18:56:59.763 INFO:teuthology.nuke:Checking targets against current locks 2023-10-16T18:56:59.773 INFO:teuthology.orchestra.run.smithi151.stderr:find: ‘/home/ubuntu/cephtest’: No such file or directory 2023-10-16T18:56:59.773 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': No such file or directory 2023-10-16T18:56:59.796 INFO:teuthology.nuke:Not nuking smithi059.front.sepia.ceph.com because description doesn't match: rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi != /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430051 2023-10-16T18:56:59.821 INFO:teuthology.nuke:Not nuking smithi151.front.sepia.ceph.com because description doesn't match: rishabh-2023-10-16_12:17:50-fs-rishabh-2023oct13-testing-default-smithi != /home/teuthworker/archive/yuriw-2023-10-16_14:43:00-fs-wip-yuri4-testing-2023-10-11-0735-reef-distro-default-smithi/7429617 2023-10-16T18:56:59.822 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLFbm9GBm0PuOVOy7gqpNI4KVYVxUv4j23Db55DLRWpftPvEn6sIuxTsSyj7oDjY/SWP93oKV2mme1EVRwNtdrM= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMHTziqB5teh/lBoPv1jHxEa7Ze7bDZZsPZSvuFJeywXK46LMBc8xATc6PAW4Srivx2tZtkFYf9CfflFypvKsME= 2023-10-16T18:56:59.831 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} duration: 17080.420835971832 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev), test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default mon.a-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 mon.b-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=e9aaee682b5543988c636aaee41b7e8d status: fail success: false 2023-10-16T18:56:59.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T18:56:59.920 INFO:teuthology.run:FAIL